ZeroMat Solving Cold start Problem of Recommender System with No Input Data. Recommender system is an applicable technique in most E commerce commercial product technical designs. However, nearly all recommender system faces a challenge called the cold start problem. The problem is so notorious that almost every industrial practitioner needs to resolve this issue when building recommender systems. Most cold start problem solvers need some kind of data input as the starter of the system. On the other hand, many real world applications place popular items or random items as recommendation results. In this paper, we propose a new technique called ZeroMat that requries no input data at all and predicts the user item rating data that is competitive in Mean Absolute Error and fairness metric compared with the classic matrix factorization with affluent data, and much better performance than random placement.


MegLoc A Robust and Accurate Visual Localization Pipeline. In this paper, we present a visual localization pipeline, namely MegLoc, for robust and accurate 6 DoF pose estimation under varying scenarios, including indoor and outdoor scenes, different time across a day, different seasons across a year, and even across years. MegLoc achieves state of the art results on a range of challenging datasets, including winning the Outdoor and Indoor Visual Localization Challenge of ICCV 2021 Workshop on Long term Visual Localization under Changing Conditions, as well as the Re localization Challenge for Autonomous Driving of ICCV 2021 Workshop on Map based Localization for Autonomous Driving.


A new type of mirror symmetry in the set of protein amino acids. In several previous works, I presented the mirror symmetry in the set of protein amino acids, expressed through the number of atoms. Here, however, the same thing is shown but over the number of nucleons and molecules mass. Compared to the previous version of the paper, minimal changes have been made, and Display 2 as well as Figures 3 and 4 have been added.


Real Time Violence Detection Using CNN LSTM. Violence rates however have been brought down about 57 during the span of the past 4 decades yet it doesn't change the way that the demonstration of violence actually happens, unseen by the law. Violence can be mass controlled sometimes by higher authorities, however, to hold everything in line one must "Microgovern" over each movement occurring in every road of each square. To address the butterfly effects impact in our setting, I made a unique model and a theorized system to handle the issue utilizing deep learning. The model takes the input of the CCTV video feeds and after drawing inference, recognizes if a violent movement is going on. And hypothesized architecture aims towards probability driven computation of video feeds and reduces overhead from naively computing for every CCTV video feeds.


A sampling guided unsupervised learning method to capture percolation in complex networks. The use of machine learning techniques in classical and quantum systems has led to novel techniques to classify ordered and disordered phases, as well as uncover transition points in critical phenomena. Efforts to extend these methods to dynamical processes in complex networks is a field of active research. Network percolation, a measure of resilience and robustness to structural failures, as well as a proxy for spreading processes, has numerous applications in social, technological, and infrastructural systems. A particular challenge is to identify the existence of a percolation cluster in a network in the face of noisy data. Here, we consider bond percolation, and introduce a sampling approach that leverages the core periphery structure of such networks at a microscopic scale, using onion decomposition, a refined version of the k core. By selecting subsets of nodes in a particular layer of the onion spectrum that follow similar trajectories in the percolation process, percolating phases can be distinguished from non percolating ones through an unsupervised clustering method. Accuracy in the initial step is essential for extracting samples with information rich content, that are subsequently used to predict the critical transition point through the confusion scheme, a recently introduced learning method. The method circumvents the difficulty of missing data or noisy measurements, as it allows for sampling nodes from both the core and periphery, as well as intermediate layers. We validate the effectiveness of our sampling strategy on a spectrum of synthetic network topologies, as well as on two real word case studies the integration time of the US domestic airport network, and the identification of the epidemic cluster of COVID 19 outbreaks in three major US states. The method proposed here allows for identifying phase transitions in empirical time varying networks.


Random walk approximation for irreversible drift diffusion process on manifold ergodicity, unconditional stability and convergence. Irreversible drift diffusion processes are very common in biochemical reactions. They have a non equilibrium stationary state (invariant measure) which does not satisfy detailed balance. For the corresponding Fokker Planck equation on a closed manifold, via Voronoi tessellation, we propose two upwind finite volume schemes with or without the information of the invariant measure. Both two schemes enjoy stochastic Q matrix structures and can be decomposed as a gradient flow part and a Hamiltonian flow part, which enable us to prove unconditional stability, ergodicity and error estimates. Based on two upwind schemes, several numerical examples including sampling accelerated by a mixture flow, image transformations and simulations for stochastic model of chaotic system are conducted. These two structure preserving schemes also give a natural random walk approximation for a generic irreversible drift diffusion process on a manifold. Thus they can be adapted to manifold related computations induced from high dimensional molecular dynamics.


Metaknowledge Extraction Based on Multi Modal Documents. The triple based knowledge in large scale knowledge bases is most likely lacking in structural logic and problematic of conducting knowledge hierarchy. In this paper, we introduce the concept of metaknowledge to knowledge engineering research for the purpose of structural knowledge construction. Therefore, the Metaknowledge Extraction Framework and Document Structure Tree model are presented to extract and organize metaknowledge elements (titles, authors, abstracts, sections, paragraphs, etc.), so that it is feasible to extract the structural knowledge from multi modal documents. Experiment results have proved the effectiveness of metaknowledge elements extraction by our framework. Meanwhile, detailed examples are given to demonstrate what exactly metaknowledge is and how to generate it. At the end of this paper, we propose and analyze the task flow of metaknowledge applications and the associations between knowledge and metaknowledge.


Wronskians, total positivity, and real Schubert calculus. A complete flag in mathbb R n is a sequence of nested subspaces V 1 subset cdots subset V n 1 such that each V k has dimension k . It is called totally nonnegative if all its Pl "ucker coordinates are nonnegative. We may view each V k as a subspace of polynomials in mathbb R x of degree at most n 1 , by associating a vector (a 1, dots, a n) in mathbb R n to the polynomial a 1 a 2x cdots a nx n 1 . We show that a complete flag is totally nonnegative if and only if each of its Wronskian polynomials Wr(V k) is nonzero on the interval (0, infty) . In the language of Chebyshev systems, this means that the flag forms a Markov system or ECT system on (0, infty) . This gives a new characterization and membership test for the totally nonnegative flag variety. Similarly, we show that a complete flag is totally positive if and only if each Wr(V k) is nonzero on 0, infty . We use these results to show that a conjecture of Eremenko (2015) in real Schubert calculus is equivalent to the following conjecture if V is a finite dimensional subspace of polynomials such that all complex zeros of Wr(V) lie in the interval ( infty, 0) , then all Pl "ucker coordinates of V are real and positive. This conjecture is a totally positive strengthening of a result of Mukhin, Tarasov, and Varchenko (2009), and can be reformulated as saying that all complex solutions to a certain family of Schubert problems in the Grassmannian are real and totally positive. We also show that our conjecture is equivalent to a totally positive strengthening of the secant conjecture (2012).


Strong modeling limits of graphs with bounded tree width. The notion of first order convergence of graphs unifies the notions of convergence for sparse and dense graphs. Ne v s et v r il and Ossona de Mendez J. Symbolic Logic 84 (2019), 452 472 proved that every first order convergent sequence of graphs from a nowhere dense class of graphs has a modeling limit and conjectured the existence of such modeling limits with an additional property, the strong finitary mass transport principle. The existence of modeling limits satisfying the strong finitary mass transport principle was proved for first order convergent sequences of trees by Ne v s et v r il and Ossona de Mendez Electron. J. Combin. 23 (2016), P2.52 and for first order sequences of graphs with bounded path width by Gajarsk 'y et al. Random Structures Algorithms 50 (2017), 612 635 . We establish the existence of modeling limits satisfying the strong finitary mass transport principle for first order convergent sequences of graphs with bounded tree width.


An analytical study of content and contexts of keywords on physics. This paper analysed author assigned and title keywords into constituent words collected from 769 articles published in the journal Low Temperature Physics since the year 2006 to 2010. The total number of distinct keywords over the said time span has been found as 1155, which have been analyzed into 869 numbers of single words having total frequency of occurrence of 2287. The single words obtained from keywords have been categorized in four broad classes, viz. eponymous word, form word, acronym and semantic word. A semantic word bears several contexts and thus may be considered as relevant in several other subject areas. These probable relevant subject areas have been found with the aid of two popular online reference tools. The semantic words are further categorized in twelve classes according to their contexts. Some parameters have been defined on the basis of associations among the words and formation of keywords in consequence, i.e. Word Association Density, Word Association Coefficient and Keyword Formation Density. The values of these parameters have been observed for different word categories. The statistics of word association tending keyword formation would be known from this study. The allied subject domains also become predictable from this study.


imath Hall algebra of Jordan quiver and imath Hall Littlewood functions. We show that the imath Hall algebra of the Jordan quiver is a polynomial ring in infinitely many generators and obtain transition relations among several generating sets. We establish a ring isomorphism from this imath Hall algebra to the ring of symmetric functions in two parameters t, theta , which maps the imath Hall basis to a class of (modified) inhomogeneous Hall Littlewood ( imath HL) functions. The (modified) imath HL functions admit a formulation via raising and lowering operators. We formulate and prove Pieri rules for (modified) imath HL functions. The modified imath HL functions specialize at theta 0 to the modified HL functions they specialize at theta 1 to the deformed universal characters of type C, which further specialize at (t 0, theta 1) to the universal characters of type C.


Toward Realistic Single View 3D Object Reconstruction with Unsupervised Learning from Multiple Images. Recovering the 3D structure of an object from a single image is a challenging task due to its ill posed nature. One approach is to utilize the plentiful photos of the same object category to learn a strong 3D shape prior for the object. This approach has successfully been demonstrated by a recent work of Wu et al. (2020), which obtained impressive 3D reconstruction networks with unsupervised learning. However, their algorithm is only applicable to symmetric objects. In this paper, we eliminate the symmetry requirement with a novel unsupervised algorithm that can learn a 3D reconstruction network from a multi image dataset. Our algorithm is more general and covers the symmetry required scenario as a special case. Besides, we employ a novel albedo loss that improves the reconstructed details and realisticity. Our method surpasses the previous work in both quality and robustness, as shown in experiments on datasets of various structures, including single view, multi view, image collection, and video sets.


Meeting in the notebook a notebook based environment for micro submissions in data science collaborations. Developers in data science and other domains frequently use computational notebooks to create exploratory analyses and prototype models. However, they often struggle to incorporate existing software engineering tooling into these notebook based workflows, leading to fragile development processes. We introduce Assembl ' e , a new development environment for collaborative data science projects, in which promising code fragments of data science pipelines can be contributed as pull requests to an upstream repository entirely from within JupyterLab, abstracting away low level version control tool usage. We describe the design and implementation of Assembl ' e and report on a user study of 23 data scientists.


Observation of slow light in glide symmetric photonic crystal waveguides. We report optical transmission measurements on suspended silicon photonic crystal waveguides, where one side of the photonic lattice is shifted by half a period along the waveguide axis. The combination of this glide symmetry and slow light leads to a strongly enhanced chiral light matter interaction but the interplay between slow light and backscattering has not been investigated experimentally in such waveguides. We build photonic crystal resonators consisting of glide symmetric waveguides terminated by reflectors and use transmission measurements as well as evanescent coupling to map out the dispersion relation. We find excellent agreement with theory and measure group indices exceeding 90, implying significant potential for applications in slow light devices and chiral quantum optics. By measuring resonators of different length, we assess the role of backscattering induced by fabrication imperfections and its intimate connection to the group index.


Optimal Pose and Shape Estimation for Category level 3D Object Perception. We consider a category level perception problem, where one is given 3D sensor data picturing an object of a given category (e.g. a car), and has to reconstruct the pose and shape of the object despite intra class variability (i.e. different car models have different shapes). We consider an active shape model, where for an object category we are given a library of potential CAD models describing objects in that category, and we adopt a standard formulation where pose and shape estimation are formulated as a non convex optimization. Our first contribution is to provide the first certifiably optimal solver for pose and shape estimation. In particular, we show that rotation estimation can be decoupled from the estimation of the object translation and shape, and we demonstrate that (i) the optimal object rotation can be computed via a tight (small size) semidefinite relaxation, and (ii) the translation and shape parameters can be computed in closed form given the rotation. Our second contribution is to add an outlier rejection layer to our solver, hence making it robust to a large number of misdetections. Towards this goal, we wrap our optimal solver in a robust estimation scheme based on graduated non convexity. To further enhance robustness to outliers, we also develop the first graph theoretic formulation to prune outliers in category level perception, which removes outliers via convex hull and maximum clique computations the resulting approach is robust to 70 90 outliers. Our third contribution is an extensive experimental evaluation. Besides providing an ablation study on a simulated dataset and on the PASCAL3D dataset, we combine our solver with a deep learned keypoint detector, and show that the resulting approach improves over the state of the art in vehicle pose estimation in the ApolloScape datasets.


On the validity of kernel approximations for orthogonally initialized neural networks. In this note we extend kernel function approximation results for neural networks with Gaussian distributed weights to single layer networks initialized using Haar distributed random orthogonal matrices (with possible rescaling). This is accomplished using recent results from random matrix theory.


Capability based access control for multi tenant systems using OAuth 2.0 and Verifiable Credentials. We propose a capability based access control technique for sharing Web resources, based on Verifiable Credentials (VCs) and OAuth 2.0. VCs are a secure means for expressing claims about a subject. Although VCs are ideal for encoding capabilities, the lack of standards for exchanging and using VCs impedes their adoption and limits their interoperability. We mitigate this problem by integrating VCs into the OAuth 2.0 authorization flow. To this end, we propose a new form of OAuth 2.0 access token based on VCs. Our approach leverages JSON Web Tokens (JWT) to encode VCs and takes advantage of JWT based mechanisms for proving VC possession. Our solution not only requires minimum changes to existing OAuth 2.0 code bases, but it also removes some of the complexity of verifying VC claims by relying on JSON Web Signatures a simple, standardized, and well supported signature format. Additionally, we fill the gap of VC generation processes by defining a new protocol that leverages the OAuth 2.0 "client credentials" grant.


Measuring Lay Reactions to Personal Data Markets. The recording, aggregation, and exchange of personal data is necessary to the development of socially relevant machine learning applications. However, anecdotal and survey evidence show that ordinary people feel discontent and even anger regarding data collection practices that are currently typical and legal. This suggests that personal data markets in their current form do not adhere to the norms applied by ordinary people. The present study experimentally probes whether market transactions in a typical online scenario are accepted when evaluated by lay people. The results show that a high percentage of study participants refused to participate in a data pricing exercise, even in a commercial context where market rules would typically be expected to apply. For those participants who did price the data, the median price was an order of magnitude higher than the market price. These results call into question the notice and consent market paradigm that is used by technology firms and government regulators when evaluating data flows. The results also point to a conceptual mismatch between cultural and legal expectations regarding the use of personal data.


Batch Active Learning at Scale. The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched queries to a labeling oracle, is a common approach for addressing this problem. The practical benefits of batch sampling come with the downside of less adaptivity and the risk of sampling redundant examples within a batch a risk that grows with the batch size. In this work, we analyze an efficient active learning algorithm, which focuses on the large batch setting. In particular, we show that our sampling method, which combines notions of uncertainty and diversity, easily scales to batch sizes (100K 1M) several orders of magnitude larger than used in previous studies and provides significant improvements in model training efficiency compared to recent baselines. Finally, we provide an initial theoretical analysis, proving label complexity guarantees for a related sampling method, which we show is approximately equivalent to our sampling method in specific settings.


Different Environmental Conditions in Genetic Algorithm. We propose an extended genetic algorithm (GA) with different local environmental conditions. Genetic entities, or configurations, are put on nodes in a ring structure, and location dependent environmental conditions are applied for each entity. Our GA is motivated by the geographic aspect of natural evolution Geographic isolation reduces the diversity in a local group, but at the same time, can enhance intergroup diversity. Mating of genetic entities across different environments can make it possible to search for broad area of the fitness landscape. We validate our extended GA for finding the ground state of three dimensional spin glass system and find that the use of different environmental conditions makes it possible to find the lower energy spin configurations at relatively shorter computation time. Our extension of GA belongs to a meta optimization method and thus can be applied for a broad research area in which finding of the optimal state in a shorter computation time is the key problem.


Objective video quality metrics application to video codecs comparisons choosing the best for subjective quality estimation. Quality assessment plays a key role in creating and comparing video compression algorithms. Despite the development of a large number of new methods for assessing quality, generally accepted and well known codecs comparisons mainly use the classical methods like PSNR, SSIM and new method VMAF. These methods can be calculated following different rules they can use different frame by frame averaging techniques or different summation of color components. In this paper, a fundamental comparison of various versions of generally accepted metrics is carried out to find the most relevant and recommended versions of video quality metrics to be used in codecs comparisons. For comparison, we used a set of videos encoded with video codecs of different standards, and visual quality scores collected for the resulting set of streams since 2018 until 2021


Uniqueness of Meromorphic functions concerning k th derivatives and difference operators. In this paper, we continue to study the sharing value problems for higher order derivatives of meromorphic functions with its linear difference and q difference operators. Some of our results generalize and improve the results of Meng Liu (J. Appl. Math. and Informatics, 37(2019), 133 148) to a large extent.


Graph Routing between Capsules. Routing methods in capsule networks often learn a hierarchical relationship for capsules in successive layers, but the intra relation between capsules in the same layer is less studied, while this intra relation is a key factor for the semantic understanding in text data. Therefore, in this paper, we introduce a new capsule network with graph routing to learn both relationships, where capsules in each layer are treated as the nodes of a graph. We investigate strategies to yield adjacency and degree matrix with three different distances from a layer of capsules, and propose the graph routing mechanism between those capsules. We validate our approach on five text classification datasets, and our findings suggest that the approach combining bottom up routing and top down attention performs the best. Such an approach demonstrates generalization capability across datasets. Compared to the state of the art routing methods, the improvements in accuracy in the five datasets we used were 0.82, 0.39, 0.07, 1.01, and 0.02, respectively.


Using edge cuts to find Euler tours and Euler families in hypergraphs. An Euler tour in a hypergraph is a closed walk that traverses each edge of the hypergraph exactly once, while an Euler family is a family of closed walks that jointly traverse each edge exactly once and cannot be concatenated. In this paper, we show how the problem of existence of an Euler tour (family) in a hypergraph H can be reduced to the analogous problem in some smaller hypergraphs that are derived from H using an edge cut of H . In the process, new techniques of edge cut assignments and collapsed hypergraphs are introduced. Moreover, we describe algorithms based on these characterizations that determine whether or not a hypergraph admits an Euler tour (family), and can also construct an Euler tour (family) if it exists.


Capacity Self Planning in Small Cell Multi Tenant 5G Networks. Multi tenancy allows diverse agents sharing the infrastructure in the 5 th generation of mobile networks. Such a feature calls for more automated and faster planning procedures in order to adapt the network capacity to the varying traffic demand. To achieve these goals, Small Cells offer network providers more flexible, scalable, and cost effective solutions compared to macrocell deployments. This paper proposes a novel framework for cell planning in multi tenant Small Cell networks. In this framework, the tenant's contracted capacity is translated to a set of detailed planning specifications over time and space domains in order to efficiently update the network infrastructure and configuration. Based on this, an algorithm is proposed that considers different actions such as adding removing channels and adding or relocating small cells. The proposed approach is evaluated considering the deployment of a new tenant, where different sets of planning specifications are tested.


Peptipedia a comprehensive database for peptide research supported by Assembled predictive models and Data Mining approaches. Motivation Peptides have attracted the attention in this century due to their remarkable therapeutic properties. Computational tools are being developed to take advantage of existing information, encapsulating knowledge and making it available in a simple way for general public use. However, these are property specific redundant data systems, and usually do not display the data in a clear way. In some cases, information download is not even possible. This data needs to be available in a simple form for drug design and other biotechnological applications. Results We developed Peptipedia, a user friendly database and web application to search, characterise and analyse peptide sequences. Our tool integrates the information from thirty previously reported databases, making it the largest repository of peptides with recorded activities so far. Besides, we implemented a variety of services to increase our tool's usability. The significant differences of our tools with other existing alternatives becomes a substantial contribution to develop biotechnological and bioengineering applications for peptides. Availability Peptipedia is available for non commercial use as an open access software, licensed under the GNU General Public License, version GPL 3.0. The web platform is publicly available at pesb2.cl peptipedia. Both the source code and sample datasets are available in the GitHub repository https github.com CristoferQ PeptideDatabase. Contact david.medina cebib.cl, ana.sanchez ing.uchile.cl


Optimal portfolio choice with path dependent labor income Finite retirement time. This paper extends the project initiated in arXiv 2002.00201 and studies a lifecycle portfolio choice problem with borrowing constraints and finite retirement time in which an agent receives labor income that adjusts to financial market shocks in a path dependent way. The novelty here, with respect to arXiv 2002.00201, is the fact that we have a finite retirement time, which makes the model more realistic, but harder to solve. The presence of both path dependency, as in arXiv 2002.00201, and finite retirement, leads to a two stages infinite dimensional stochastic optimal control problem, a family of problems which, to our knowledge, has not yet been treated in the literature. We solve the problem completely, and find explicitly the optimal controls in feedback form. This is possible because we are able to find an explicit solution to the associated infinite dimensional Hamilton Jacobi Bellman (HJB) equation, even if state constraints are present. Note that, differently from arXiv 2002.00201 , here the HJB equation is of parabolic type, hence the work to identify the solutions and optimal feedbacks is more delicate, as it involves, in particular, time dependent state constraints, which, as far as we know, have not yet been treated in the infinite dimensional literature. The explicit solution allows us to study the properties of optimal strategies and discuss their financial implications.


XCiT Cross Covariance Image Transformers. Following their success in natural language processing, transformers have recently shown much promise for computer vision. The self attention operation underlying transformers yields global interactions between all tokens ,i.e. words or image patches, and enables flexible modelling of image data beyond the local interactions of convolutions. This flexibility, however, comes with a quadratic complexity in time and memory, hindering application to long sequences and high resolution images. We propose a "transposed" version of self attention that operates across feature channels rather than tokens, where the interactions are based on the cross covariance matrix between keys and queries. The resulting cross covariance attention (XCA) has linear complexity in the number of tokens, and allows efficient processing of high resolution images. Our cross covariance image transformer (XCiT) is built upon XCA. It combines the accuracy of conventional transformers with the scalability of convolutional architectures. We validate the effectiveness and generality of XCiT by reporting excellent results on multiple vision benchmarks, including image classification and self supervised feature learning on ImageNet 1k, object detection and instance segmentation on COCO, and semantic segmentation on ADE20k.


On the subgroup of B 4 that contains the kernel of Burau representation. It is known that there are braids alpha and beta in the braid group B 4 , such that the group langle alpha, beta rangle is a fee subgroup cite 7 , which contains the kernel K of the Burau map rho 4 B 4 to G L left(3, mathbb Z t,t 1 right) cite 6 , cite 4 . In this paper we will prove that K is subgroup of G langle tau, Delta rangle , where tau and Delta are fourth and square roots of the generator theta of the center Z of the group B 4 . Consequently, we will write elements of K in terms of tau i, i 1,2,3 and Delta . Moreover, we will show that the quotient group G Z is isomorphic to the free product Z 4 Z 2 .


On almost self centered graphs and almost peripheral graphs. An almost self centered graph is a connected graph of order n with exactly n 2 central vertices, and an almost peripheral graph is a connected graph of order n with exactly n 1 peripheral vertices. We determine (1) the maximum girth of an almost self centered graph of order n (2) the maximum independence number of an almost self centered graph of order n and radius r (3) the minimum order of a k regular almost self centered graph and (4) the maximum size of an almost peripheral graph of order n (5) which numbers are possible for the maximum degree of an almost peripheral graph of order n (6) the maximum number of vertices of maximum degree in an almost peripheral graph of order n whose maximum degree is the second largest possible. Whenever the extremal graphs have a neat form, we also describe them.


A topological degree theory for rotating solutions of planar systems. We present a generalized notion of degree for rotating solutions of planar systems. We prove a formula for the relation of such degree with the classical use of Brouwer's degree and obtain a twist theorem for the existence of periodic solutions, which is complementary to the Poincar 'e Birkhoff Theorem. Some applications to asymptotically linear and superlinear differential equations are discussed.


Invariant Gragh and Random Bony Attractors. In this paper, we deal with random attractors for dynamical systems forced by a deterministic noise. These kind of systems are modeled as skew products where the dynamics of the forcing process are described by the base transformation. Here, we consider skew products over the Bernoulli shift with the unit interval fiber. We study the geometric structure of maximal attractors, the orbit stability and stability of mixing of these skew products under random perturbations of the fiber maps. We show that there exists an open set mathcal U in the space of such skew products so that any skew product belonging to this set admits an attractor which is either a continuous invariant graph or a bony graph attractor. These skew products have negative fiber Lyapunov exponents and their fiber maps are non uniformly contracting, hence the non uniform contraction rates are measured by Lyapnnov exponents. Furthermore, each skew product of mathcal U admits an invariant ergodic measure whose support is contained in that attractor. Additionally, we show that the invariant measure for the perturbed system is continuous in the Hutchinson metric.


SAGCI System Towards Sample Efficient, Generalizable, Compositional, and Incremental Robot Learning. Building general purpose robots to perform a diverse range of tasks in a large variety of environments in the physical world at the human level is extremely challenging. It requires the robot learning to be sample efficient, generalizable, compositional, and incremental. In this work, we introduce a systematic learning framework called SAGCI system towards achieving these above four requirements. Our system first takes the raw point clouds gathered by the camera mounted on the robot's wrist as the inputs and produces initial modeling of the surrounding environment represented as a file of Unified Robot Description Format (URDF). Our system adopts a learning augmented differentiable simulation that loads the URDF. The robot then utilizes the interactive perception to interact with the environment to online verify and modify the URDF. Leveraging the differentiable simulation, we propose a model based learning algorithm combining object centric and robot centric stages to efficiently produce policies to accomplish manipulation tasks. We apply our system to perform articulated object manipulation tasks, both in the simulation and the real world. Extensive experiments demonstrate the effectiveness of our proposed learning framework. Supplemental materials and videos are available on https sites.google.com view egci.


Rationale production to support clinical decision making. The development of neural networks for clinical artificial intelligence (AI) is reliant on interpretability, transparency, and performance. The need to delve into the black box neural network and derive interpretable explanations of model output is paramount. A task of high clinical importance is predicting the likelihood of a patient being readmitted to hospital in the near future to enable efficient triage. With the increasing adoption of electronic health records (EHRs), there is great interest in applications of natural language processing (NLP) to clinical free text contained within EHRs. In this work, we apply InfoCal, the current state of the art model that produces extractive rationales for its predictions, to the task of predicting hospital readmission using hospital discharge notes. We compare extractive rationales produced by InfoCal to competitive transformer based models pretrained on clinical text data and for which the attention mechanism can be used for interpretation. We find each presented model with selected interpretability or feature importance methods yield varying results, with clinical language domain expertise and pretraining critical to performance and subsequent interpretability.


Results on the normality of square free monomial ideals and cover ideals under some graph operations. In this paper, we introduce techniques for producing normal square free monomial ideals from old such ideals. These techniques are then used to investigate the normality of cover ideals under some graph operations. Square free monomial ideals that come out as linear combinations of two normal ideals are shown to be not necessarily normal under such a case we investigate the integral closedness of all powers of these ideals.


Scalable Molecular GW Calculations Valence and Core Spectra. We present a scalable implementation of the GW approximation using Gaussian atomic orbitals to study the valence and core ionization spectroscopies of molecules. The implementation of the standard spectral decomposition approach to the screened Coulomb interaction, as well as a contour deformation method are described. We have implemented both of these approaches using the robust variational fitting approximation to the four center electron repulsion integrals. We have utilized the MINRES solver with the contour deformation approach to reduce the computational scaling by one order of magnitude. A complex heuristic in the quasiparticle equation solver further allows a speed up of the computation of core and semi core ionization energies. Benchmark tests using the GW100 and CORE65 datasets and the carbon 1 it s binding energy of the well studied ethyl trifluoroacetate, or ESCA molecule, were performed to validate the accuracy of our implementation. We also demonstrate and discuss the parallel performance and computational scaling of our implementation using a range of water clusters of increasing size.


X volution On the unification of convolution and self attention. Convolution and self attention are acting as two fundamental building blocks in deep neural networks, where the former extracts local image features in a linear way while the latter non locally encodes high order contextual relationships. Though essentially complementary to each other, i.e., first high order, stat of the art architectures, i.e., CNNs or transformers lack a principled way to simultaneously apply both operations in a single computational module, due to their heterogeneous computing pattern and excessive burden of global dot product for visual tasks. In this work, we theoretically derive a global self attention approximation scheme, which approximates a self attention via the convolution operation on transformed features. Based on the approximated scheme, we establish a multi branch elementary module composed of both convolution and self attention operation, capable of unifying both local and non local feature interaction. Importantly, once trained, this multi branch module could be conditionally converted into a single standard convolution operation via structural re parameterization, rendering a pure convolution styled operator named X volution, ready to be plugged into any modern networks as an atomic operation. Extensive experiments demonstrate that the proposed X volution, achieves highly competitive visual understanding improvements ( 1.2 top 1 accuracy on ImageNet classification, 1.7 box AP and 1.5 mask AP on COCO detection and segmentation).


Generating Cutting Inequalities Successively for Quadratic Optimization Problems in Binary Variables. We propose a successive generation of cutting inequalities for binary quadratic optimization problems. Multiple cutting inequalities are successively generated for the convex hull of the set of the optimal solutions subset 0, 1 n , while the standard cutting inequalities are used for the convex hull of the feasible region. An arbitrary linear inequality with integer coefficients and the right hand side value in integer is considered as a candidate for a valid inequality. The validity of the linear inequality is determined by solving a conic relaxation of a subproblem such as the doubly nonnegative relaxation, under the assumption that an upper bound for the unknown optimal value of the problem is available. Moreover, the candidates generated for the multiple cutting inequalities are tested simultaneously for their validity in parallel. Preliminary numerical results on 60 quadratic unconstrained binary optimization problems with a simple implementation of the successive cutting inequalities using an 8 or 32 core machine show that the exact optimal values are obtained for 70 of the tested problems, demonstrating the strong potential of the proposed technique.


Behavioral QLTL. In this paper we introduce Behavioral QLTL, which is a behavioral'' variant of linear time temporal logic on infinite traces with second order quantifiers. Behavioral QLTL is characterized by the fact that the functions that assign the truth value of the quantified propositions along the trace can only depend on the past. In other words such functions must be processes''. This gives to the logic a strategic flavor that we usually associate to planning. Indeed we show that temporally extended planning in nondeterministic domains, as well as LTL synthesis, are expressed in Behavioral QLTL through formulas with a simple quantification alternation. While, as this alternation increases, we get to forms of planning synthesis in which conditional and conformant planning aspects get mixed. We study this logic from the computational point of view and compare it to the original QLTL (with non behavioral semantics) and with simpler forms of behavioral semantics.


Discovering Technology Gaps using the IntSight Knowledge Navigator. Knowledge analysis is an important application of knowledge graphs. In this paper, we present a complex knowledge analysis problem that discovers the gaps in the technology areas of interest to an organization. Our knowledge graph is developed on a heterogeneous data management platform. The analysis combines semantic search, graph analytics, and polystore query optimization.


Terwilliger algebras and some related algebras defined by finite connected simple graphs. For a finite connected simple graph, the Terwilliger algebra is a matrix algebra generated by the adjacency matrix and idempotents corresponding to the distance partition with respect to a fixed vertex. We will consider algebras defined by two other partitions and the centralizer algebra of the stabilizer of the fixed vertex in the automorphism group of the graph. We will give some methods to compute such algebras and examples for various graphs.


LOHO Latent Optimization of Hairstyles via Orthogonalization. Hairstyle transfer is challenging due to hair structure differences in the source and target hair. Therefore, we propose Latent Optimization of Hairstyles via Orthogonalization (LOHO), an optimization based approach using GAN inversion to infill missing hair structure details in latent space during hairstyle transfer. Our approach decomposes hair into three attributes perceptual structure, appearance, and style, and includes tailored losses to model each of these attributes independently. Furthermore, we propose two stage optimization and gradient orthogonalization to enable disentangled latent space optimization of our hair attributes. Using LOHO for latent space manipulation, users can synthesize novel photorealistic images by manipulating hair attributes either individually or jointly, transferring the desired attributes from reference hairstyles. LOHO achieves a superior FID compared with the current state of the art (SOTA) for hairstyle transfer. Additionally, LOHO preserves the subject's identity comparably well according to PSNR and SSIM when compared to SOTA image embedding pipelines. Code is available at https github.com dukebw LOHO.


Backprop Free Reinforcement Learning with Active Neural Generative Coding. In humans, perceptual awareness facilitates the fast recognition and extraction of information from sensory input. This awareness largely depends on how the human agent interacts with the environment. In this work, we propose active neural generative coding, a computational framework for learning action driven generative models without backpropagation of errors (backprop) in dynamic environments. Specifically, we develop an intelligent agent that operates even with sparse rewards, drawing inspiration from the cognitive theory of planning as inference. We demonstrate on several simple control problems that our framework performs competitively with deep Q learning. The robust performance of our agent offers promising evidence that a backprop free approach for neural inference and learning can drive goal directed behavior.


Robust Sensing of Low Rank Matrices with Non Orthogonal Sparse Decomposition. We consider the problem of recovering an unknown low rank matrix X with (possibly) non orthogonal, effectively sparse rank 1 decomposition from incomplete and inaccurate measurements y gathered in a linear measurement process A. We propose a variational formulation that lends itself to alternating minimization and whose global minimizers provably approximate X from y up to noise level. Working with a variant of robust injectivity, we derive reconstruction guarantees for various choices of A including sub gaussian, Gaussian rank 1, and heavy tailed measurements. Numerical experiments support the validity of our theoretical considerations.


Efficient and Differentiable Shadow Computation for Inverse Problems. Differentiable rendering has received increasing interest for image based inverse problems. It can benefit traditional optimization based solutions to inverse problems, but also allows for self supervision of learning based approaches for which training data with ground truth annotation is hard to obtain. However, existing differentiable renderers either do not model visibility of the light sources from the different points in the scene, responsible for shadows in the images, or are too slow for being used to train deep architectures over thousands of iterations. To this end, we propose an accurate yet efficient approach for differentiable visibility and soft shadow computation. Our approach is based on the spherical harmonics approximations of the scene illumination and visibility, where the occluding surface is approximated with spheres. This allows for a significantly more efficient shadow computation compared to methods based on ray tracing. As our formulation is differentiable, it can be used to solve inverse problems such as texture, illumination, rigid pose, and geometric deformation recovery from images using analysis by synthesis optimization.


The Coven Meyerowitz tiling conditions for 3 odd prime factors. It is well known that if a finite set A subset mathbb Z tiles the integers by translations, then the translation set must be periodic, so that the tiling is equivalent to a factorization A oplus B mathbb Z M of a finite cyclic group. We are interested in characterizing all finite sets A subset mathbb Z that have this property. Coven and Meyerowitz (1998) proposed conditions (T1), (T2) that are sufficient for A to tile, and necessary when the cardinality of A has at most two distinct prime factors. They also proved that (T1) holds for all finite tiles, regardless of size. It is not known whether (T2) must hold for all tilings with no restrictions on the number of prime factors of A . We prove that the Coven Meyerowitz tiling condition (T2) holds for all integer tilings of period M (p ip jp k) 2 , where p i,p j,p k are distinct odd primes. The proof also provides a classification of all such tilings.


Convex strategies for trajectory optimisation application to the Polytope Traversal Problem. Non linear Trajectory Optimisation (TO) methods require good initial guesses to converge to a locally optimal solution. A feasible guess can often be obtained by allocating a large amount of time for the trajectory to complete. However for unstable dynamical systems such as humanoid robots, this quasi static assumption does not always hold. We propose a conservative formulation of the TO problem that simultaneously computes a feasible path and its time allocation. The problem is solved as an efficient convex optimisation problem guaranteed to converge to a locally optimal solution. The interest of the approach is illustrated with the computation of feasible trajectories that traverse sequentially a sequence of polytopes. We demonstrate that on instances of the problem where the quasi static solutions are not admissible, our approach is able to find a feasible solution with a success rate above 80 in all the scenarios considered, in less than 10ms for problems involving traversing less than 5 polytopes and less than 1s for problems involving 20 polytopes, thus demonstrating its ability to reliably provide initial guesses to advanced non linear solvers.


Medical Instrument Segmentation in 3D US by Hybrid Constrained Semi Supervised Learning. Medical instrument segmentation in 3D ultrasound is essential for image guided intervention. However, to train a successful deep neural network for instrument segmentation, a large number of labeled images are required, which is expensive and time consuming to obtain. In this article, we propose a semi supervised learning (SSL) framework for instrument segmentation in 3D US, which requires much less annotation effort than the existing methods. To achieve the SSL learning, a Dual UNet is proposed to segment the instrument. The Dual UNet leverages unlabeled data using a novel hybrid loss function, consisting of uncertainty and contextual constraints. Specifically, the uncertainty constraints leverage the uncertainty estimation of the predictions of the UNet, and therefore improve the unlabeled information for SSL training. In addition, contextual constraints exploit the contextual information of the training images, which are used as the complementary information for voxel wise uncertainty estimation. Extensive experiments on multiple ex vivo and in vivo datasets show that our proposed method achieves Dice score of about 68.6 69.1 and the inference time of about 1 sec. per volume. These results are better than the state of the art SSL methods and the inference time is comparable to the supervised approaches.


Hate Speech Classifiers Learn Human Like Social Stereotypes. Social stereotypes negatively impact individuals' judgements about different groups and may have a critical role in how people understand language directed toward minority social groups. Here, we assess the role of social stereotypes in the automated detection of hateful language by examining the relation between individual annotator biases and erroneous classification of texts by hate speech classifiers. Specifically, in Study 1 we investigate the impact of novice annotators' stereotypes on their hate speech annotation behavior. In Study 2 we examine the effect of language embedded stereotypes on expert annotators' aggregated judgements in a large annotated corpus. Finally, in Study 3 we demonstrate how language embedded stereotypes are associated with systematic prediction errors in a neural network hate speech classifier. Our results demonstrate that hate speech classifiers learn human like biases which can further perpetuate social inequalities when propagated at scale. This framework, combining social psychological and computational linguistic methods, provides insights into additional sources of bias in hate speech moderation, informing ongoing debates regarding fairness in machine learning.


Cycles of arbitrary length in distance graphs on mathbb F q d . For E subset Bbb F q d , d ge 2 , where Bbb F q is the finite field with q elements, we consider the distance graph mathcal G dist t(E) , t not 0 , where the vertices are the elements of E , and two vertices x , y are connected by an edge if x y equiv (x 1 y 1) 2 dots (x d y d) 2 t . We prove that if E ge C k q frac d 2 2 , then mathcal G dist t(E) contains a statistically correct number of cycles of length k . We are also going to consider the dot product graph mathcal G prod t(E) , t not 0 , where the vertices are the elements of E , and two vertices x , y are connected by an edge if x cdot y equiv x 1y 1 dots x dy d t . We obtain similar results in this case using more sophisticated methods necessitated by the fact that the function x cdot y is not translation invariant. The exponent frac d 2 2 is improved for sufficiently long cycles.


p2pGNN A Decentralized Graph Neural Network for Node Classification in Peer to Peer Networks. In this work, we aim to classify nodes of unstructured peer to peer networks with communication uncertainty, such as users of decentralized social networks. Graph Neural Networks (GNNs) are known to improve the accuracy of simple classifiers in centralized settings by leveraging naturally occurring network links, but graph convolutional layers are challenging to implement in decentralized settings when node neighbors are not constantly available. We address this problem by employing decoupled GNNs, where base classifier predictions and errors are diffused through graphs after training. For these, we deploy pre trained and gossip trained base classifiers and implement peer to peer graph diffusion under communication uncertainty. In particular, we develop an asynchronous decentralized formulation of diffusion that converges to centralized predictions in distribution and linearly with respect to communication rates. We experiment on three real world graphs with node features and labels and simulate peer to peer networks with uniformly random communication frequencies given a portion of known labels, our decentralized graph diffusion achieves comparable accuracy to centralized GNNs with minimal communication overhead (less than 3 of what gossip training already adds).


Structured Prediction as Translation between Augmented Natural Languages. We propose a new framework, Translation between Augmented Natural Languages (TANL), to solve many structured prediction language tasks including joint entity and relation extraction, nested named entity recognition, relation classification, semantic role labeling, event extraction, coreference resolution, and dialogue state tracking. Instead of tackling the problem by training task specific discriminative classifiers, we frame it as a translation task between augmented natural languages, from which the task relevant information can be easily extracted. Our approach can match or outperform task specific models on all tasks, and in particular, achieves new state of the art results on joint entity and relation extraction (CoNLL04, ADE, NYT, and ACE2005 datasets), relation classification (FewRel and TACRED), and semantic role labeling (CoNLL 2005 and CoNLL 2012). We accomplish this while using the same architecture and hyperparameters for all tasks and even when training a single model to solve all tasks at the same time (multi task learning). Finally, we show that our framework can also significantly improve the performance in a low resource regime, thanks to better use of label semantics.


Object Allocation Over a Network of Objects Mobile Agents with Strict Preferences. In recent work, Gourv es, Lesca, and Wilczynski propose a variant of the classic housing markets model where the matching between agents and objects evolves through Pareto improving swaps between pairs of adjacent agents in a social network. To explore the swap dynamics of their model, they pose several basic questions concerning the set of reachable matchings. In their work and other follow up works, these questions have been studied for various classes of graphs stars, paths, generalized stars (i.e., trees where at most one vertex has degree greater than two), trees, and cliques. For generalized stars and trees, it remains open whether a Pareto efficient reachable matching can be found in polynomial time. In this paper, we pursue the same set of questions under a natural variant of their model. In our model, the social network is replaced by a network of objects, and a swap is allowed to take place between two agents if it is Pareto improving and the associated objects are adjacent in the network. In those cases where the question of polynomial time solvability versus NP hardness has been resolved for the social network model, we are able to show that the same result holds for the network of objects model. In addition, for our model, we present a polynomial time algorithm for computing a Pareto efficient reachable matching in generalized star networks. Moreover, the object reachability algorithm that we present for path networks is significantly faster than the known polynomial time algorithms for the same question in the social network model.


Trends in Publishing Blockchain Surveys A Bibliometric Perspective. A large number of survey papers are being published in blockchain since the first survey appeared in 2017. A person entering into the field of blockchain is faced with the issue of which blockchain surveys to read and why? Who is publishing these surveys and what is the nature of these surveys? Which of the publishers are publishing more such surveys and what are the lengths of the published surveys? Which kind of survey is getting more citations? Which of the authors is collaborating on such surveys? etc. All these questions motivated us to analyze the trends in publishing blockchain surveys. In this paper, we have performed a bibliometric analysis on 801 surveys or review papers published in the field of blockchain in the last approximately five years. We have analyzed the papers with respect to the publication type, publishers and venue, references, citations, paper length, different categories, year, countries, authors, and their collaborations and found interesting insights. To the best of our knowledge, this study is the first of its kind and hope to provide better understanding of the field.


On the Queue Number of Partial Orders. The queue number of a poset is the queue number of its cover graph viewed as a directed acyclic graph, i.e., when the vertex order must be a linear extension of the poset. Heath and Pemmaraju conjectured that every poset of width w has queue number at most w . Recently, Alam et al. constructed posets of width w with queue number w 1 . Our contribution is a construction of posets with width w with queue number Omega(w 2) . This asymptotically matches the known upper bound.


Opening Deep Neural Networks with Generative Models. Image classification methods are usually trained to perform predictions taking into account a predefined group of known classes. Real world problems, however, may not allow for a full knowledge of the input and label spaces, making failures in recognition a hazard to deep visual learning. Open set recognition methods are characterized by the ability to correctly identify inputs of known and unknown classes. In this context, we propose GeMOS simple and plug and play open set recognition modules that can be attached to pretrained Deep Neural Networks for visual recognition. The GeMOS framework pairs pre trained Convolutional Neural Networks with generative models for open set recognition to extract open set scores for each sample, allowing for failure recognition in object recognition tasks. We conduct a thorough evaluation of the proposed method in comparison with state of the art open set algorithms, finding that GeMOS either outperforms or is statistically indistinguishable from more complex and costly models.


A Novel Edge Detection Operator for Identifying Buildings in Augmented Reality Applications. Augmented Reality is an environment enhancing technology, widely applied in many domains, such as tourism and culture. One of the major challenges in this field is precise detection and extraction of building information through Computer Vision techniques. Edge detection is one of the building blocks operations for many feature extraction solutions in Computer Vision. AR systems use edge detection for building extraction or for extraction of facade details from buildings. In this paper, we propose a novel filter operator for edge detection that aims to extract building contours or facade features better. The proposed filter gives more weight for finding vertical and horizontal edges that is an important feature for our aim.


The growth of abelian sections. Given an abstract group G , we study the function ab n(G) sup G H leq n H H,H . If G has no abelian composition factors, then ab n(G) is bounded by a polynomial as a consequence, we find a sharp upper bound for the representation growth of these groups.


Gamma convergence of Cheeger energies with respect to increasing distances. We prove a Gamma convergence result for Cheeger energies along sequences of metric measure spaces, where the measure space is kept fixed, while distances are monotonically converging from below to the limit one. As a consequence, we show that the infinitesimal Hilbertianity condition is stable under this kind of convergence of metric measure spaces.


Handling Neumann and Robin boundary conditions in a fictitious domain volume penalization framework. Sakurai et al. (J Comput Phys, 2019) presented a flux based volume penalization (VP) approach for imposing inhomogeneous Neumann boundary conditions on embedded interfaces. The flux based VP method modifies the diffusion coefficient of the original elliptic (Poisson) equation and uses a flux forcing function as a source term in the equation to impose the Neumann boundary conditions. As such, the flux based VP method can be easily incorporated into existing fictitious domain codes. Sakurai et al. relied on an analytical construction of flux forcing functions, which limits the practicality of the approach. Because of the analytical approach taken in the prior work, only (spatially) constant flux values on simple interfaces were considered. In this paper, we present a numerical technique for constructing flux forcing functions for arbitrarily complex boundaries. The imposed flux values are also allowed to vary spatially in our approach. Furthermore, the flux based VP method is extended to include (spatially varying) Robin boundary conditions, which makes the flux based VP method even more general. We consider several two and three dimensional test examples to access the spatial accuracy of the numerical solutions. The method is also used to simulate flux driven thermal convection in a concentric annular domain. We formally derive the flux based volume penalized Poisson equation satisfying Neumann Robin boundary condition in strong form such a derivation was not presented in Sakurai et al., where the equation first appeared for the Neumann problem. The derivation reveals that the flux based VP approach relies on a surface delta function to impose inhomogeneous Neumann Robin boundary conditions. However, explicit construction of the delta function is not necessary for the flux based VP method, which makes it different from other diffuse domain equations presented in the literature.


Characterization and Prediction of Deep Learning Workloads in Large Scale GPU Datacenters. Modern GPU datacenters are critical for delivering Deep Learning (DL) models and services in both the research community and industry. When operating a datacenter, optimization of resource scheduling and management can bring significant financial benefits. Achieving this goal requires a deep understanding of the job features and user behaviors. We present a comprehensive study about the characteristics of DL jobs and resource management. First, we perform a large scale analysis of real world job traces from SenseTime. We uncover some interesting conclusions from the perspectives of clusters, jobs and users, which can facilitate the cluster system designs. Second, we introduce a general purpose framework, which manages resources based on historical data. As case studies, we design a Quasi Shortest Service First scheduling service, which can minimize the cluster wide average job completion time by up to 6.5x and a Cluster Energy Saving service, which improves overall cluster utilization by up to 13 .


Direct Search for a Class of Stochastic Min Max Problems. Recent applications in machine learning have renewed the interest of the community in min max optimization problems. While gradient based optimization methods are widely used to solve such problems, there are however many scenarios where these techniques are not well suited, or even not applicable when the gradient is not accessible. We investigate the use of direct search methods that belong to a class of derivative free techniques that only access the objective function through an oracle. In this work, we design a novel algorithm in the context of min max saddle point games where one sequentially updates the min and the max player. We prove convergence of this algorithm under mild assumptions, where the objective of the max player satisfies the Polyak L ojasiewicz (PL) condition, while the min player is characterized by a nonconvex objective. Our method only assumes dynamically adjusted accurate estimates of the oracle with a fixed probability. To the best of our knowledge, our analysis is the first one to address the convergence of a direct search method for min max objectives in a stochastic setting.


Automatically identifying a mobile phone user's position within a vehicle. Traffic related injuries and fatalities are major health risks in the United States. Mobile phone use while driving quadruples the risk for a motor vehicle crash. This work demonstrates the feasibility of using the mobile phone camera to passively detect the location of the phone's user within a vehicle. In a large, varied dataset we were able correctly identify if the user was in the driver's seat or one of the passenger seats with 94.9 accuracy. This model could be used by application developers to selectively change or lock functionality while a user is driving, but not if the user is a passenger in a moving vehicle.


Angular spectrum dependent interference. Optical interference is not only a fundamental phenomenon that has enabled new theories of light to be derived but it has also been used in interferometry for the measurement of small displacements, refractive index changes and surface irregularities. In a two beam interferometer, variations in the interference fringes are used as a diagnostic for anything that causes the optical path difference (OPD) to change therefore, for a specified OPD, greater variation in the fringes indicates better measurement sensitivity. Here, we introduce and experimentally validate an interesting optical interference phenomenon that uses photons with a structured frequency angular spectrum, which are generated from a spontaneous parametric down conversion process in a nonlinear crystal. This interference phenomenon is manifested as interference fringes that vary much more rapidly with increasing OPD than the corresponding fringes for equal inclination interference the phenomenon is parameterised using an equivalent wavelength, which under our experimental conditions is 29.38 nm or about 1 27 of the real wavelength. This phenomenon not only enriches the knowledge with regard to optical interference but also offers promise for applications in interferometry.


Quality Guidelines for Research Artifacts in Model Driven Engineering. Sharing research artifacts is known to help people to build upon existing knowledge, adopt novel contributions in practice, and increase the chances of papers receiving attention. In Model Driven Engineering (MDE), openly providing research artifacts plays a key role, even more so as the community targets a broader use of AI techniques, which can only become feasible if large open datasets and confidence measures for their quality are available. However, the current lack of common discipline specific guidelines for research data sharing opens the opportunity for misunderstandings about the true potential of research artifacts and subjective expectations regarding artifact quality. To address this issue, we introduce a set of guidelines for artifact sharing specifically tailored to MDE research. To design this guidelines set, we systematically analyzed general purpose artifact sharing practices of major computer science venues and tailored them to the MDE domain. Subsequently, we conducted an online survey with 90 researchers and practitioners with expertise in MDE. We investigated our participants' experiences in developing and sharing artifacts in MDE research and the challenges encountered while doing so. We then asked them to prioritize each of our guidelines as essential, desirable, or unnecessary. Finally, we asked them to evaluate our guidelines with respect to clarity, completeness, and relevance. In each of these dimensions, our guidelines were assessed positively by more than 92 of the participants. To foster the reproducibility and reusability of our results, we make the full set of generated artifacts available in an open repository at texttt url https mdeartifacts.github.io .


Dual Polarization Bandwidth Bridged On Chip Bandpass Sampling Fourier Transform Spectrometer from Visible to Near Infrared. The on chip broadband optical spectrometers which cover the entire tissue transparency window ( lambda 650 1050 nm) with high resolution are highly demanded for the miniaturized bio sensing and bio imaging applications. Here, we propose a novel type of spatial heterodyne Fourier transform spectrometer (SHFTS) integrated with a sub wavelength grating coupler (SWGC) for the dual polarization bandpass sampling on the Si3N4 platform. Through tuning the coupling angles with different polarization, we experimentally demonstrated the unprecedented broadband spectrum retrieval results with the overall bandwidth coverage of 400 nm, bridging the wavelengths from 650 nm to 1050 nm, with the resolution of 2 5 nm. By applying the bandpass sampling theorem, we circumvented the intrinsic trade off limitation between the bandwidth and resolution of SHFTS without having an outrageous number of Mach Zehnder interferometer (MZI) arrays or adding additional active components. The bandpass sampling SHFTS is designed to have linearly unbalanced 32 MZIs with the maximum optical path length difference of 93 mu m within an overall footprint size of 4.7 mm x 0.65 mm, and the coupling angles of SWGC are varied from 0 deg to 32 deg to cover the entire tissue transparency window.


A cut and fold self sustained compliant oscillator for autonomous actuation of origami inspired robots. Origami inspired robots are of particular interest given their potential for rapid and accessible design and fabrication of elegant designs and complex functionalities through cutting and folding of flexible 2D sheets or even strings, i.e.printable manufacturing. Yet, origami robots still require bulky, rigid components or electronics for actuation and control to accomplish tasks with reliability, programmability, ability to output substantial force, and durability, restricting their full potential. Here, we present a printable self sustained compliant oscillator that generates periodic actuation using only constant electrical power, without discrete components or electronic control hardware. This oscillator is robust (9 out of 10 prototypes worked successfully on the first try), configurable (with tunable periods from 3 s to 12 s), powerful (can overcome hydrodynamic resistance to consistently propel a swimmer at 1.6 body lengths min), and long lasting ( 10 3 cycles) it enables driving macroscale devices with prescribed autonomous behaviors, e.g. locomotion and sequencing. This oscillator is also fully functional underwater and in high magnetic fields. Our analytical model characterizes essential parameters of the oscillation period, enabling programmable design of the oscillator. The printable oscillator can be integrated into origami inspired systems seamlessly and monolithically, allowing rapid design and prototyping the resulting integrated devices are lightweight, low cost, compliant, electronic free, and nonmagnetic, enabling practical applications in extreme areas. We demonstrate the functionalities of the oscillator with (i) autonomous gliding of a printable swimmer, (ii) LED flashing, and (iii) fluid stirring. This work paves the way for realizing fully printable autonomous robots with a high integration of actuation and control.


The Hadwiger theorem on convex functions. III. A complete family of functional Steiner formulas is established. As applications, an explicit representation of functional intrinsic volumes using special mixed Monge Amp ere measures and a new version of the Hadwiger theorem on convex functions are obtained.


GaussiGAN Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes. We present an algorithm that learns a coarse 3D representation of objects from unposed multi view 2D mask supervision, then uses it to generate detailed mask and image texture. In contrast to existing voxel based methods for unposed object reconstruction, our approach learns to represent the generated shape and pose with a set of self supervised canonical 3D anisotropic Gaussians via a perspective camera, and a set of per image transforms. We show that this approach can robustly estimate a 3D space for the camera and object, while recent baselines sometimes struggle to reconstruct coherent 3D spaces in this setting. We show results on synthetic datasets with realistic lighting, and demonstrate object insertion with interactive posing. With our work, we help move towards structured representations that handle more real world variation in learning based object reconstruction.


Hypergraph Laplacians in Diffusion Framework. Networks are important structures used to model complex systems where interactions take place. In a basic network model, entities are represented as nodes, and interaction and relations among them are represented as edges. However, in a complex system, we cannot describe all relations as pairwise interactions, rather should describe as higher order interactions. Hypergraphs are successfully used to model higher order interactions in complex systems. In this paper, we present two new hypergraph Laplacians based on diffusion framework. Our Laplacians take the relations between higher order interactions into consideration, hence can be used to model diffusion on hypergraphs not only between vertices but also higher order structures. These Laplacians can be employed in different network mining problems on hypergraphs, such as social contagion models on hypergraphs, influence study on hypergraphs, and hypergraph classification, to list a few.


Plasma steering to avoid disruptions in ITER and tokamak power plants. Steering tokamak plasmas is commonly viewed as a way to avoid disruptions and runaway electrons. Plasma steering sounds as safe as driving to work but will be shown to more closely resemble driving at high speed through a dense fog on an icy road. The long time required to terminate an ITER discharge compared to time over which dangers can be foreseen is analogous to driving in a dense fog. The difficulty of regaining plasma control if it is lost resembles driving on an icy road. Disruptions and runaways are associated with three issues a solution to one tends to complicate the solution to the other two loss of plasma position control, excessive heat deposition, and wall melting due to runaway electrons. All three risks must be addressed for ITER to achieve its mission and essentially eliminated before tokamak power plants can be deployed.


DP UTIL Comprehensive Utility Analysis of Differential Privacy in Machine Learning. Differential Privacy (DP) has emerged as a rigorous formalism to reason about quantifiable privacy leakage. In machine learning (ML), DP has been employed to limit inference disclosure of training examples. Prior work leveraged DP across the ML pipeline, albeit in isolation, often focusing on mechanisms such as gradient perturbation. In this paper, we present, DP UTIL, a holistic utility analysis framework of DP across the ML pipeline with focus on input perturbation, objective perturbation, gradient perturbation, output perturbation, and prediction perturbation. Given an ML task on privacy sensitive data, DP UTIL enables a ML privacy practitioner perform holistic comparative analysis on the impact of DP in these five perturbation spots, measured in terms of model utility loss, privacy leakage, and the number of truly revealed training samples. We evaluate DP UTIL over classification tasks on vision, medical, and financial datasets, using two representative learning algorithms (logistic regression and deep neural network) against membership inference attack as a case study attack. One of the highlights of our results is that prediction perturbation consistently achieves the lowest utility loss on all models across all datasets. In logistic regression models, objective perturbation results in lowest privacy leakage compared to other perturbation techniques. For deep neural networks, gradient perturbation results in lowest privacy leakage. Moreover, our results on true revealed records suggest that as privacy leakage increases a differentially private model reveals more number of member samples. Overall, our findings suggest that to make informed decisions as to which perturbation mechanism to use, a ML privacy practitioner needs to examine the dynamics between optimization techniques (convex vs. non convex), perturbation mechanisms, number of classes, and privacy budget.


Tree Edit Distance with Variables. Measuring the Similarity between Mathematical Formulas. In this article, we propose tree edit distance with variables, which is an extension of the tree edit distance to handle trees with variables and has a potential application to measuring the similarity between mathematical formulas, especially, those appearing in mathematical models of biological systems. We analyze the computational complexities of several variants of this new model. In particular, we show that the problem is NP complete for ordered trees. We also show for unordered trees that the problem of deciding whether or not the distance is 0 is graph isomorphism complete but can be solved in polynomial time if the maximum outdegree of input trees is bounded by a constant. This distance model is then extended for measuring the difference similarity between two systems of differential equations, for which results of preliminary computational experiments using biological models are provided.


Leveraging Slot Descriptions for Zero Shot Cross Domain Dialogue State Tracking. Zero shot cross domain dialogue state tracking (DST) enables us to handle task oriented dialogue in unseen domains without the expense of collecting in domain data. In this paper, we propose a slot description enhanced generative approach for zero shot cross domain DST. Specifically, our model first encodes dialogue context and slots with a pre trained self attentive encoder, and generates slot values in an auto regressive manner. In addition, we incorporate Slot Type Informed Descriptions that capture the shared information across slots to facilitate cross domain knowledge transfer. Experimental results on the MultiWOZ dataset show that our proposed method significantly improves existing state of the art results in the zero shot cross domain setting.


Radioactivity control strategy for the JUNO detector. JUNO is a massive liquid scintillator detector with a primary scientific goal of determining the neutrino mass ordering by studying the oscillated anti neutrino flux coming from two nuclear power plants at 53 km distance. The expected signal anti neutrino interaction rate is only 60 counts per day, therefore a careful control of the background sources due to radioactivity is critical. In particular, natural radioactivity present in all materials and in the environment represents a serious issue that could impair the sensitivity of the experiment if appropriate countermeasures were not foreseen. In this paper we discuss the background reduction strategies undertaken by the JUNO collaboration to reduce at minimum the impact of natural radioactivity. We describe our efforts for an optimized experimental design, a careful material screening and accurate detector production handling, and a constant control of the expected results through a meticulous Monte Carlo simulation program. We show that all these actions should allow us to keep the background count rate safely below the target value of 10 Hz in the default fiducial volume, above an energy threshold of 0.7 MeV.


Local topological features of robust supply networks. The design of robust supply and distribution systems is one of the fundamental challenges at the interface of network science and logistics. Given the multitude of performance criteria, real world constraints, and external influences acting upon such a system, even formulating an appropriate research question to address this topic is non trivial. Here we present an abstraction of a supply and distribution system leading to a minimal model, which only retains stylized facts of the systemic function and, in this way, allows us to investigate the generic properties of robust supply networks. On this level of abstraction, a supply and distribution system is the strategic use of transportation to eliminate mismatches between production patterns (i.e., the amounts of goods produced at each production site of a company) and demand patterns (i.e., the amount of goods consumed at each location). When creating networks based on this paradigm and furthermore requiring the robustness of the system with respect to the loss of transportation routes (edge of the network) we see that robust networks are built from specific sets of subgraphs, while vulnerable networks display a markedly different subgraph composition. Our findings confirm a long standing hypothesis in the field of network science, namely, that network motifs statistically over represented small subgraphs are informative about the robust functioning of a network. Also, our findings offer a blueprint for enhancing the robustness of real world supply and distribution systems.


PeCoQ A Dataset for Persian Complex Question Answering over Knowledge Graph. Question answering systems may find the answers to users' questions from either unstructured texts or structured data such as knowledge graphs. Answering questions using supervised learning approaches including deep learning models need large training datasets. In recent years, some datasets have been presented for the task of Question answering over knowledge graphs, which is the focus of this paper. Although many datasets in English were proposed, there have been a few question answering datasets in Persian. This paper introduces textit PeCoQ , a dataset for Persian question answering. This dataset contains 10,000 complex questions and answers extracted from the Persian knowledge graph, FarsBase. For each question, the SPARQL query and two paraphrases that were written by linguists are provided as well. There are different types of complexities in the dataset, such as multi relation, multi entity, ordinal, and temporal constraints. In this paper, we discuss the dataset's characteristics and describe our methodology for building it.


Measuring Ethics in AI with AI A Methodology and Dataset Construction. Recently, the use of sound measures and metrics in Artificial Intelligence has become the subject of interest of academia, government, and industry. Efforts towards measuring different phenomena have gained traction in the AI community, as illustrated by the publication of several influential field reports and policy documents. These metrics are designed to help decision takers to inform themselves about the fast moving and impacting influences of key advances in Artificial Intelligence in general and Machine Learning in particular. In this paper we propose to use such newfound capabilities of AI technologies to augment our AI measuring capabilities. We do so by training a model to classify publications related to ethical issues and concerns. In our methodology we use an expert, manually curated dataset as the training set and then evaluate a large set of research papers. Finally, we highlight the implications of AI metrics, in particular their contribution towards developing trustful and fair AI based tools and technologies. Keywords AI Ethics AI Fairness AI Measurement. Ethics in Computer Science.


ATRIA A Bit Parallel Stochastic Arithmetic Based Accelerator for In DRAM CNN Processing. With the rapidly growing use of Convolutional Neural Networks (CNNs) in real world applications related to machine learning and Artificial Intelligence (AI), several hardware accelerator designs for CNN inference and training have been proposed recently. In this paper, we present ATRIA, a novel bit pArallel sTochastic aRithmetic based In DRAM Accelerator for energy efficient and high speed inference of CNNs. ATRIA employs light weight modifications in DRAM cell arrays to implement bit parallel stochastic arithmetic based acceleration of multiply accumulate (MAC) operations inside DRAM. ATRIA significantly improves the latency, throughput, and efficiency of processing CNN inferences by performing 16 MAC operations in only five consecutive memory operation cycles. We mapped the inference tasks of four benchmark CNNs on ATRIA to compare its performance with five state of the art in DRAM CNN accelerators from prior work. The results of our analysis show that ATRIA exhibits only 3.5 drop in CNN inference accuracy and still achieves improvements of up to 3.2x in frames per second (FPS) and up to 10x in efficiency (FPS W mm2), compared to the best performing in DRAM accelerator from prior work.


Can a Humorous Conversational Agent Enhance Learning Experience and Outcomes?. Previous studies have highlighted the benefits of pedagogical conversational agents using socially oriented conversation with students. In this work, we examine the effects of a conversational agent's use of affiliative and self defeating humour considered conducive to social well being and enhancing interpersonal relationships on learners' perception of the agent and attitudes towards the task. Using a between subjects protocol, 58 participants taught a conversational agent about rock classification using a learning by teaching platform, the Curiosity Notebook. While all agents were curious and enthusiastic, the style of humour was manipulated such that the agent either expressed an affiliative style, a self defeating style, or no humour. Results demonstrate that affiliative humour can significantly increase motivation and effort, while self defeating humour, although enhancing effort, negatively impacts enjoyment. Findings further highlight the importance of understanding learner characteristics when using humour.


Text AutoAugment Learning Compositional Augmentation Policy for Text Classification. Data augmentation aims to enrich training samples for alleviating the overfitting issue in low resource or class imbalanced situations. Traditional methods first devise task specific operations such as Synonym Substitute, then preset the corresponding parameters such as the substitution rate artificially, which require a lot of prior knowledge and are prone to fall into the sub optimum. Besides, the number of editing operations is limited in the previous methods, which decreases the diversity of the augmented data and thus restricts the performance gain. To overcome the above limitations, we propose a framework named Text AutoAugment (TAA) to establish a compositional and learnable paradigm for data augmentation. We regard a combination of various operations as an augmentation policy and utilize an efficient Bayesian Optimization algorithm to automatically search for the best policy, which substantially improves the generalization capability of models. Experiments on six benchmark datasets show that TAA boosts classification accuracy in low resource and class imbalanced regimes by an average of 8.8 and 9.7 , respectively, outperforming strong baselines.


Coupled Fixed Points for Hardy Rogers Type of Maps and Their Applications in the Investigations of Market Equilibrium in Duopoly Markets for Non Differentiable, Nonlinear Response Functions. In this paper we generalize Hardy Rogers maps in the context of coupled fixed points. We generalizes with the help of the obtained main theorem some known results about existence and uniqueness of market equilibrium in duopoly markets. We investigate some recent results about market equilibrium in duopoly markets with the help of the main theorem and we enrich them. We define a generalized response function including production and surpluses. Finally we illustrate a possible application of the main result in the investigation of market equilibrium, when the pay off functions are non differentiable.


SanMove Next Location Recommendation via Self Attention Network. Currently, next location recommendation plays a vital role in location based social network applications and services. Although many methods have been proposed to solve this problem, three important challenges have not been well addressed so far (1) most existing methods are based on recurrent network, which is time consuming to train long sequences due to not allowing for full parallelism (2) personalized preferences generally are not considered reasonably (3) existing methods rarely systematically studied how to efficiently utilize various auxiliary information (e.g., user ID and timestamp) in trajectory data and the spatio temporal relations among non consecutive locations. To address the above challenges, we propose a novel method named SanMove, a self attention network based model, to predict the next location via capturing the long and short term mobility patterns of users. Specifically, SanMove introduces a long term preference learning module, and it uses a self attention module to capture the users long term mobility pattern which can represent personalized location preferences of users. Meanwhile, SanMove uses a spatial temporal guided non invasive self attention (STNOVA) to exploit auxiliary information to learn short term preferences. We evaluate SanMove with two real world datasets, and demonstrate SanMove is not only faster than the state of the art RNN based predict model but also outperforms the baselines for next location prediction.


Anthropogenic Mixing of Seasonally Stratified Shelf Seas by Offshore Wind Farm Infrastructure. The offshore wind energy sector has rapidly expanded over the past two decades, providing a renewable energy solution for coastal nations. Sector development has been led in Europe, but is growing globally. Most developments to date have been in well mixed, i.e. unstratified, shallow waters near to shore. Sector growth is, for the first time, pushing developments to deep water, into a brand new environment seasonally stratified shelf seas. Seasonally stratified shelf seas, where water density varies with depth, have a disproportionately key role in primary production, marine ecosystem and biochemically cycles. Infrastructure will directly mix stratified shelf seas. The magnitude of this mixing, additional to natural background processes, has yet to be fully quantified. If large enough it may erode shelf sea stratification. Therefore, offshore wind growth may destabilize and fundamentally change shelf sea systems. However, enhanced mixing may also positively impact some marine ecosystems. This paper sets the scene for sector development into this new environment, reviews the potential physical and environmental benefits and impacts of large scale industrialization of seasonally stratified shelf seas and identifies areas where research is required to best utilise, manage and mitigate environmental change.


ACE BERT Adversarial Cross modal Enhanced BERT for E commerce Retrieval. Nowadays on E commerce platforms, products are presented to the customers with multiple modalities. These multiple modalities are significant for a retrieval system while providing attracted products for customers. Therefore, how to take into account those multiple modalities simultaneously to boost the retrieval performance is crucial. This problem is a huge challenge to us due to the following reasons (1) the way of extracting patch features with the pre trained image model (e.g., CNN based model) has much inductive bias. It is difficult to capture the efficient information from the product image in E commerce. (2) The heterogeneity of multimodal data makes it challenging to construct the representations of query text and product including title and image in a common subspace. We propose a novel Adversarial Cross modal Enhanced BERT (ACE BERT) for efficient E commerce retrieval. In detail, ACE BERT leverages the patch features and pixel features as image representation. Thus the Transformer architecture can be applied directly to the raw image sequences. With the pre trained enhanced BERT as the backbone network, ACE BERT further adopts adversarial learning by adding a domain classifier to ensure the distribution consistency of different modality representations for the purpose of narrowing down the representation gap between query and product. Experimental results demonstrate that ACE BERT outperforms the state of the art approaches on the retrieval task. It is remarkable that ACE BERT has already been deployed in our E commerce's search engine, leading to 1.46 increase in revenue.


Uncertainty quantification of a thrombosis model considering the clotting assay PFA 100. Mathematical models of thrombosis are currently used to study clinical scenarios of pathological thrombus formation. Most of these models involve inherent uncertainties that must be assessed to increase the confidence in model predictions and identify avenues of improvement for both thrombosis modeling and anti platelet therapies. In this work, an uncertainty quantification analysis of a multi constituent thrombosis model is performed considering a common assay for platelet function (PFA 100). The analysis is performed using a polynomial chaos expansion as a parametric surrogate for the thrombosis model. The polynomial approximation is validated and used to perform a global sensitivity analysis via computation of Sobol' coefficients. Six out of fifteen parameters were found to be influential in the simulation variability considering only individual effects. Nonetheless, parameter interactions are highlighted when considering the total Sobol' indices. In addition to the sensitivity analysis, the surrogate model was used to compute the PFA 100 closure times of 300,000 virtual cases that align well with clinical data. The current methodology could be used including common anti platelet therapies to identify scenarios that preserve the hematological balance.


Interaction between optical pulse and tumor using finite element analysis. Photoacoustic imaging is an emerging technology based on the photoacoustic effect that has developed rapidly in recent years. It combines the high contrast of optical imaging and the high penetration and high resolution of acoustic imaging. As a non destructive biological tissue imaging technology, photoacoustic imaging has important application value in the field of biomedicine. With its high efficiency bi oimaging capabilities and excellent biosafety performance, it has been favored by researchers. The visualization of photoacoustic imaging has great research signifi cance in the early diagnosis of some diseases, especially tumors. In photoacoustic imaging, light transmission and thermal effects are important processes. This article is based on COMSOL software and uses finite element analysis to construct a physi cal model for simulation. Through laser pulses into the stomach tissue containing tumor, the physical process of light transmission and biological heat transfer was studied, and a photothermal model composed of two physical fields was built, and finally a series of visualization graphics were obtained. This work has certain theo retical guiding significance for further promoting the application of photoacoustic imaging in the field of biomedicine.


Theoretical and numerical comparison of first order algorithms for cocoercive equations and smooth convex optimization. This paper provides a theoretical and numerical comparison of classical first order splitting methods for solving smooth convex optimization problems and cocoercive equations. In a theoretical point of view, we compare convergence rates of gradient descent, forward backward, Peaceman Rachford, and Douglas Rachford algorithms for minimizing the sum of two smooth convex functions when one of them is strongly convex. A similar comparison is given in the more general cocoercive setting under the presence of strong monotonicity and we observe that the convergence rates in optimization are strictly better than the corresponding rates for cocoercive equations for some algorithms. We obtain improved rates with respect to the literature in several instances exploiting the structure of our problems. Moreover, we indicate which algorithm is the most efficient depending on strong convexity and cocoercive parameters. In a numerical point of view, we verify our theoretical results by implementing and comparing previous algorithms in well established signal and image inverse problems involving sparsity. We replace the widely used ell 1 norm by the Huber loss and we observe that fully proximal based strategies have numerical and theoretical advantages with respect to methods using gradient steps.