DexYCB A Benchmark for Capturing Hand Grasping of Objects. We introduce DexYCB, a new dataset for capturing hand grasping of objects. We first compare DexYCB with a related one through cross dataset evaluation. We then present a thorough benchmark of state of the art approaches on three relevant tasks 2D object and keypoint detection, 6D object pose estimation, and 3D hand pose estimation. Finally, we evaluate a new robotics relevant task generating safe robot grasps in human to robot object handover. Dataset and code are available at https dex ycb.github.io.


Coverability, Termination, and Finiteness in Recursive Petri Nets. In the early two thousands, Recursive Petri nets have been introduced in order to model distributed planning of multi agent systems for which counters and recursivity were necessary. Although Recursive Petri nets strictly extend Petri nets and context free grammars, most of the usual problems (reachability, coverability, finiteness, boundedness and termination) were known to be solvable by using non primitive recursive algorithms. For almost all other extended Petri nets models containing a stack, the complexity of coverability and termination are unknown or strictly larger than EXPSPACE. In contrast, we establish here that for Recursive Petri nets, the coverability, termination, boundedness and finiteness problems are EXPSPACE complete as for Petri nets. From an expressiveness point of view, we show that coverability languages of Recursive Petri nets strictly include the union of coverability languages of Petri nets and context free languages. Thus we get a more powerful model than Petri net for free.


Graph Pattern Matching in GQL and SQL PGQ. As graph databases become widespread, JTC1 the committee in joint charge of information technology standards for the International Organization for Standardization (ISO), and International Electrotechnical Commission (IEC) has approved a project to create GQL, a standard property graph query language. This complements a project to extend SQL with a new part, SQL PGQ, which specifies how to define graph views over an SQL tabular schema, and to run read only queries against them. Both projects have been assigned to the ISO IEC JTC1 SC32 working group for Database Languages, WG3, which continues to maintain and enhance SQL as a whole. This common responsibility helps enforce a policy that the identical core of both PGQ and GQL is a graph pattern matching sub language, here termed GPML. The WG3 design process is also analyzed by an academic working group, part of the Linked Data Benchmark Council (LDBC), whose task is to produce a formal semantics of these graph data languages, which complements their standard specifications. This paper, written by members of WG3 and LDBC, presents the key elements of the GPML of SQL PGQ and GQL in advance of the publication of these new standards.


Continual Active Learning for Efficient Adaptation of Machine Learning Models to Changing Image Acquisition. Imaging in clinical routine is subject to changing scanner protocols, hardware, or policies in a typically heterogeneous set of acquisition hardware. Accuracy and reliability of deep learning models suffer from those changes as data and targets become inconsistent with their initial static training set. Continual learning can adapt to a continuous data stream of a changing imaging environment. Here, we propose a method for continual active learning on a data stream of medical images. It recognizes shifts or additions of new imaging sources domains , adapts training accordingly, and selects optimal examples for labelling. Model training has to cope with a limited labelling budget, resembling typical real world scenarios. We demonstrate our method on T1 weighted magnetic resonance images from three different scanners with the task of brain age estimation. Results demonstrate that the proposed method outperforms naive active learning while requiring less manual labelling.


Using Adversarial Debiasing to Remove Bias from Word Embeddings. Word Embeddings have been shown to contain the societal biases present in the original corpora. Existing methods to deal with this problem have been shown to only remove superficial biases. The method of Adversarial Debiasing was presumed to be similarly superficial, but this is was not verified in previous works. Using the experiments that demonstrated the shallow removal in other methods, I show results that suggest Adversarial Debiasing is more effective at removing bias and thus motivate further investigation on the utility of Adversarial Debiasing.


Hierarchical Representations and Explicit Memory Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks. Representations are crucial for a robot to learn effective navigation policies. Recent work has shown that mid level perceptual abstractions, such as depth estimates or 2D semantic segmentation, lead to more effective policies when provided as observations in place of raw sensor data (e.g., RGB images). However, such policies must still learn latent three dimensional scene properties from mid level abstractions. In contrast, high level, hierarchical representations such as 3D scene graphs explicitly provide a scene's geometry, topology, and semantics, making them compelling representations for navigation. In this work, we present a reinforcement learning framework that leverages high level hierarchical representations to learn navigation policies. Towards this goal, we propose a graph neural network architecture and show how to embed a 3D scene graph into an agent centric feature space, which enables the robot to learn policies for low level action in an end to end manner. For each node in the scene graph, our method uses features that capture occupancy and semantic content, while explicitly retaining memory of the robot trajectory. We demonstrate the effectiveness of our method against commonly used visuomotor policies in a challenging object search task. These experiments and supporting ablation studies show that our method leads to more effective object search behaviors, exhibits improved long term memory, and successfully leverages hierarchical information to guide its navigation objectives.


Riesz representation theorems for positive algebra homomorphisms. Let X be a locally compact Hausdorff space, let mathrm A be a partially ordered algebra, and let T mathrm C mathrm c (X) to mathrm A be a positive algebra homomorphism. Under conditions on mathrm A that are satisfied in a good number of cases of practical interest, we show that T is represented by a (unique regular) measure mu on the Borel sigma algebra of X that takes it values in the positive cone of mathrm A , and with the property that mu(A 1 cap A 2) mu(A 1) mu(A 2) for Borel subsets A 1,A 2 of X . The positive algebra homomorphism T can be extended from mathrm C mathrm c (X) to the accompanying mathcal L 1 space of mu . We show that, quite often, this mathcal L 1 space is closed under multiplication, so that it is a Riesz algebra, and that the extended map T mathcal L 1 to mathrm A is not only an algebra homomorphism, but, even when mathrm A is not a Riesz space, also a vector lattice homomorphism in a sense that is explained in the paper. The latter property enables one to describe images of the extended map in terms of sequential up downs and down ups of the image of (the positive cone of ) mathrm C mathrm c (X) when mathrm A has the countable sup property. We apply the main results, which are obtained by purely order theoretical methods, to positive algebra homomorphisms from mathrm C 0(X) into the order continuous operators on a Banach lattice, and to representations of mathrm C 0(X, mathbb C) on Hilbert spaces. It is thus seen that, for representations on Banach lattices and on Hilbert spaces, although situated in rather different contexts, spectral theorems can be established that are both rooted in the same order theoretical Riesz representation theorem for positive algebra homomorphisms from mathrm C mathrm c (X) into partially ordered algebras.


Tracelet Hopf algebras and decomposition spaces. Tracelets are the intrinsic carriers of causal information in categorical rewriting systems. In this work, we assemble tracelets into a symmetric monoidal decomposition space, inducing a cocommutative Hopf algebra of tracelets. This Hopf algebra captures important combinatorial and algebraic aspects of rewriting theory, and is motivated by applications of its representation theory to stochastic rewriting systems such as chemical reaction networks.


The Robin problem on rectangles. We study the statistics and the arithmetic properties of the Robin spectrum of a rectangle. A number of results are obtained for the multiplicities in the spectrum, depending on the Diophantine nature of the aspect ratio. In particular, it is shown that for the square, unlike the case of Neumann eigenvalues where there are unbounded multiplicities of arithmetic origin, there are no multiplicities in the Robin spectrum for sufficiently small (but nonzero) Robin parameter except a systematic symmetry. In addition, uniform lower and upper bounds are established for the Robin Neumann gaps in terms of their limiting mean spacing. Finally, that the pair correlation function of the Robin spectrum on a Diophantine rectangle is shown to be Poissonian.


Single Image Automatic Radial Distortion Compensation Using Deep Convolutional Network. In many computer vision domains, the input images must conform with the pinhole camera model, where straight lines in the real world are projected as straight lines in the image. Performing computer vision tasks on live sports broadcast footage imposes challenging requirements where the algorithms cannot rely on a specific calibration pattern must be able to cope with unknown and uncalibrated cameras, radial distortion originating from complex television lenses, few visual clues to compensate distortion by, and the necessity for real time performance. We present a novel method for single image automatic lens distortion compensation based on deep convolutional neural networks, capable of real time performance and accuracy using two highest order coefficients of the polynomial distortion model operating in the application domain of sports broadcast. Keywords Deep Convolutional Neural Network, Radial Distortion, Single Image Rectification


Integrative Data Semantics through a Model enabled Data Stewardship. Motivation The importance of clinical data in understanding the pathophysiology of complex disorders has prompted the launch of multiple initiatives designed to generate patient level data from various modalities. While these studies can reveal important findings relevant to the disease, each study captures different yet complementary aspects and modalities which, when combined, generate a more comprehensive picture of disease aetiology. However, achieving this requires a global integration of data across studies, which proves to be challenging given the lack of interoperability of cohort datasets. Results Here, we present the Data Steward Tool (DST), an application that allows for semi automatic semantic integration of clinical data into ontologies and global data models and data standards. We demonstrate the applicability of the tool in the field of dementia research by establishing a Clinical Data Model (CDM) in this domain. The CDM currently consists of 277 common variables covering demographics (e.g. age and gender), diagnostics, neuropsychological tests, and biomarker measurements. The DST combined with this disease specific data model shows how interoperability between multiple, heterogeneous dementia datasets can be achieved.


Quadratic differentials with prescribed singularities. The local invariants of a meromorphic quadratic differential on a compact Riemann surface are the orders of zeros and poles, and the residues at the poles of even orders. The main result of this paper is that with few exceptions, every pattern of local invariants can be obtained by a quadratic differential on some Riemann surface. The exceptions are completely classified and only occur in genera zero and one. Moreover, in the case of a nonconnected stratum, we show that, with three exceptions in genus one, every invariants can be realized in each connected component of the stratum. These results are obtained using the flat metric induced by the differentials. We give an application by bounding the number of disjoint cylinders on a primitive quadratic differential.


On n partite digraphical representations of finite groups. A group G admits an textbf em n partite digraphical representation if there exists a regular n partite digraph Gamma such that the automorphism group mathrm Aut ( Gamma) of Gamma satisfies the following properties mathrm Aut ( Gamma) is isomorphic to G , mathrm Aut ( Gamma) acts semiregularly on the vertices of Gamma and the orbits of mathrm Aut ( Gamma) on the vertex set of Gamma form a partition into n parts giving a structure of n partite digraph to Gamma . In this paper, for every positive integer n , we classify the finite groups admitting an n partite digraphical representation.


SCAPE Learning Stiffness Control from Augmented Position Control Experiences. We introduce a sample efficient method for learning state dependent stiffness control policies for dexterous manipulation. The ability to control stiffness facilitates safe and reliable manipulation by providing compliance and robustness to uncertainties. Most current reinforcement learning approaches to achieve robotic manipulation have exclusively focused on position control, often due to the difficulty of learning high dimensional stiffness control policies. This difficulty can be partially mitigated via policy guidance such as imitation learning. However, expert stiffness control demonstrations are often expensive or infeasible to record. Therefore, we present an approach to learn Stiffness Control from Augmented Position control Experiences (SCAPE) that bypasses this difficulty by transforming position control demonstrations into approximate, suboptimal stiffness control demonstrations. Then, the suboptimality of the augmented demonstrations is addressed by using complementary techniques that help the agent safely learn from both the demonstrations and reinforcement learning. By using simulation tools and experiments on a robotic testbed, we show that the proposed approach efficiently learns safe manipulation policies and outperforms learned position control policies and several other baseline learning algorithms.


From Alignment to Assignment Frustratingly Simple Unsupervised Entity Alignment. Cross lingual entity alignment (EA) aims to find the equivalent entities between crosslingual KGs, which is a crucial step for integrating KGs. Recently, many GNN based EA methods are proposed and show decent performance improvements on several public datasets. Meanwhile, existing GNN based EA methods inevitably inherit poor interpretability and low efficiency from neural networks. Motivated by the isomorphic assumption of GNNbased methods, we successfully transform the cross lingual EA problem into the assignment problem. Based on this finding, we propose a frustratingly Simple but Effective Unsupervised entity alignment method (SEU) without neural networks. Extensive experiments show that our proposed unsupervised method even beats advanced supervised methods across all public datasets and has high efficiency, interpretability, and stability.


Compensation Learning. Weighting strategy prevails in machine learning. For example, a common approach in robust machine learning is to exert lower weights on samples which are likely to be noisy or quite hard. This study reveals another undiscovered strategy, namely, compensating. Various incarnations of compensating have been utilized but it has not been explicitly revealed. Learning with compensating is called compensation learning and a systematic taxonomy is constructed for it in this study. In our taxonomy, compensation learning is divided on the basis of the compensation targets, directions, inference manners, and granularity levels. Many existing learning algorithms including some classical ones can be viewed or understood at least partially as compensation techniques. Furthermore, a family of new learning algorithms can be obtained by plugging the compensation learning into existing learning algorithms. Specifically, two concrete new learning algorithms are proposed for robust machine learning. Extensive experiments on image classification and text sentiment analysis verify the effectiveness of the two new algorithms. Compensation learning can also be used in other various learning scenarios, such as imbalance learning, clustering, regression, and so on.


An Inverse Theorem for Certain Directional Gowers Uniformity Norms. Let G be a finite dimensional vector space over a prime field mathbb F p with some subspaces H 1, dots, H k . Let f colon G to mathbb C be a function. Generalizing the notion of Gowers uniformity norms, Austin introduced directional Gowers uniformity norms of f over (H 1, dots, H k) as f mathsf U (H 1, dots, H k) 2 k mathbb E x in G,h 1 in H 1, dots, h k in H k partial h 1 dots partial h k f(x) where partial u f(x) colon f(x u) overline f(x) is the discrete multiplicative derivative. Suppose that G is a direct sum of subspaces G U 1 oplus U 2 oplus dots oplus U k . In this paper we prove the inverse theorem for the norm cdot mathsf U (U 1, dots, U k, smash b underbrace scriptstyle G, dots, G scriptscriptstyle ell ) , which is the simplest interesting unknown case of the inverse problem for the directional Gowers uniformity norms. Namely, writing cdot mathsf U for the norm above, we show that if f colon G to mathbb C is a function bounded by 1 in magnitude and obeying f mathsf U geq c , provided ell p , one can find a polynomial alpha colon G to mathbb F p of degree at most k ell 1 and functions g i colon oplus j in k setminus i G j to z in mathbb C colon z leq 1 for i in k such that Big mathbb E x in G f(x) omega alpha(x) prod i in k g i(x 1, dots, x i 1 , x i 1 , dots, x k) Big geq Big( exp (O p,k, ell (1)) (O p,k, ell (c 1 )) Big) 1 . The proof relies on an approximation theorem for the cuboid counting function that is proved using the inverse theorem for Freiman multi homomorphisms.


How I Learned to Stop Worrying and Love Retraining. Many Neural Network Pruning approaches consist of several iterative training and pruning steps, seemingly losing a significant amount of their performance after pruning and then recovering it in the subsequent retraining phase. Recent works of Renda et al. (2020) and Le Hua (2021) demonstrate the significance of the learning rate schedule during the retraining phase and propose specific heuristics for choosing such a schedule for IMP (Han et al., 2015). We place these findings in the context of the results of Li et al. (2020) regarding the training of models within a fixed training budget and demonstrate that, consequently, the retraining phase can be massively shortened using a simple linear learning rate schedule. Going a step further, we propose similarly imposing a budget on the initial dense training phase and show that the resulting simple and efficient method is capable of outperforming significantly more complex or heavily parameterized state of the art approaches that attempt to sparsify the network during training. These findings not only advance our understanding of the retraining phase, but more broadly question the belief that one should aim to avoid the need for retraining and reduce the negative effects of 'hard' pruning by incorporating the sparsification process into the standard training.


Towards Electronic Structure Based Ab Initio Molecular Dynamics Simulations with Hundreds of Millions of Atoms. We push the boundaries of electronic structure based textit ab initio molecular dynamics (AIMD) beyond 100 million atoms. This scale is otherwise barely reachable with classical force field methods or novel neural network and machine learning potentials. We achieve this breakthrough by combining innovations in linear scaling AIMD, efficient and approximate sparse linear algebra, low and mixed precision floating point computation on GPUs, and a compensation scheme for the errors introduced by numerical approximations. The core of our work is the non orthogonalized local submatrix method (NOLSM), which scales very favorably to massively parallel computing systems and translates large sparse matrix operations into highly parallel, dense matrix operations that are ideally suited to hardware accelerators. We demonstrate that the NOLSM method, which is at the center point of each AIMD step, is able to achieve a sustained performance of 324 PFLOP s in mixed FP16 FP32 precision corresponding to an efficiency of 67.7 when running on 1536 NVIDIA A100 GPUs.


The Three F's for Bicategories I Localization by Fractions is Exact. We study the interaction between the notions of filteredness, fractions and fibrations in the theory of bicategories, generalizing classical results for categories. We give an explicit formula for filtered pseudo colimits of categories indexed by a bicategory, and we use it to compute the hom categories of a bicategory of fractions. As a consequence, we show that the canonical pseudo functor into a bicategory of fractions is exact.


Two dynamical systems in the space of triangles. Let M be the space of triangles, defined up to shifts, rotations and dilations. We define two maps f M to M and g M to M . The map f corresponds to a triangle of perimeter pi the triangle with angles numerically equal to edges of the initial triangle. The map g corresponds to a triangle of perimeter 2 pi the triangle with emph exterior angles numerically equal to edges of the initial triangle. For p in M the sequence p,f(p),f(f(p)), ldots converges to the equilateral triangle and the sequence p,g(p),g(g(p)), ldots converges to the "degenerate triangle" with angles (0,0, pi) . In Supplement an analogous problem about inscribed circumscribed quadrangles is discussed.


MagicPai at SemEval 2021 Task 7 Method for Detecting and Rating Humor Based on Multi Task Adversarial Training. This paper describes MagicPai's system for SemEval 2021 Task 7, HaHackathon Detecting and Rating Humor and Offense. This task aims to detect whether the text is humorous and how humorous it is. There are four subtasks in the competition. In this paper, we mainly present our solution, a multi task learning model based on adversarial examples, for task 1a and 1b. More specifically, we first vectorize the cleaned dataset and add the perturbation to obtain more robust embedding representations. We then correct the loss via the confidence level. Finally, we perform interactive joint learning on multiple tasks to capture the relationship between whether the text is humorous and how humorous it is. The final result shows the effectiveness of our system.


Retrieving Black box Optimal Images from External Databases. Suppose we have a black box function (e.g., deep neural network) that takes an image as input and outputs a value that indicates preference. How can we retrieve optimal images with respect to this function from an external database on the Internet? Standard retrieval problems in the literature (e.g., item recommendations) assume that an algorithm has full access to the set of items. In other words, such algorithms are designed for service providers. In this paper, we consider the retrieval problem under different assumptions. Specifically, we consider how users with limited access to an image database can retrieve images using their own black box functions. This formulation enables a flexible and finer grained image search defined by each user. We assume the user can access the database through a search query with tight API limits. Therefore, a user needs to efficiently retrieve optimal images in terms of the number of queries. We propose an efficient retrieval algorithm Tiara for this problem. In the experiments, we confirm that our proposed method performs better than several baselines under various settings.


Tools for Scientific Computing. A large multitude of scientific computing tools is available today. This article gives an overview of available tools and explains the main application fields. In addition basic principles of number representations in computing and the resulting truncation errors are treated. The selection of tools is for those students, who work in the field of accelerator beam dynamics.


Efficient Feature Transformations for Discriminative and Generative Continual Learning. As neural networks are increasingly being applied to real world applications, mechanisms to address distributional shift and sequential task learning without forgetting are critical. Methods incorporating network expansion have shown promise by naturally adding model capacity for learning new tasks while simultaneously avoiding catastrophic forgetting. However, the growth in the number of additional parameters of many of these types of methods can be computationally expensive at larger scales, at times prohibitively so. Instead, we propose a simple task specific feature map transformation strategy for continual learning, which we call Efficient Feature Transformations (EFTs). These EFTs provide powerful flexibility for learning new tasks, achieved with minimal parameters added to the base architecture. We further propose a feature distance maximization strategy, which significantly improves task prediction in class incremental settings, without needing expensive generative models. We demonstrate the efficacy and efficiency of our method with an extensive set of experiments in discriminative (CIFAR 100 and ImageNet 1K) and generative (LSUN, CUB 200, Cats) sequences of tasks. Even with low single digit parameter growth rates, EFTs can outperform many other continual learning methods in a wide range of settings.


Invariant differential operators and the generalized symmetric group. In this paper we study the decomposition of the direct image of pi ( Oc X ) the polynomial ring Oc X as a D module, under the map pi spec Oc X to spec Oc X G(r,n) , where Oc X G(r,n) is the ring of invariant polynomial under the action of the wreath product G(r,p) ZZ r ZZ wr Sc n . We first describe the generators of the simple components of pi ( Oc X) and give their multiplicities. Using an equivalence of categories and the higher Specht polynomials, we describe a D module decomposition of the polynomial ring localized at the discriminant of pi . Furthermore, we study the action invariants, differential operators, on the higher Specht polynomials.


Improving Multilingual Translation by Representation and Gradient Regularization. Multilingual Neural Machine Translation (NMT) enables one model to serve all translation directions, including ones that are unseen during training, i.e. zero shot translation. Despite being theoretically attractive, current models often produce low quality translations commonly failing to even produce outputs in the right target language. In this work, we observe that off target translation is dominant even in strong multilingual systems, trained on massive multilingual corpora. To address this issue, we propose a joint approach to regularize NMT models at both representation level and gradient level. At the representation level, we leverage an auxiliary target language prediction task to regularize decoder outputs to retain information about the target language. At the gradient level, we leverage a small amount of direct data (in thousands of sentence pairs) to regularize model gradients. Our results demonstrate that our approach is highly effective in both reducing off target translation occurrences and improving zero shot translation performance by 5.59 and 10.38 BLEU on WMT and OPUS datasets respectively. Moreover, experiments show that our method also works well when the small amount of direct data is not available.


A Method for Uniformly Proving a Family of Identities. This paper presents both a proof method and a result. The proof method presented is particularly suitable for uniformly proving families of identities satisfied by a family of recursive sequences. To illustrate the method, we study the family of recursive sequences F (k) n sum i 1 k F (k) n i , n ge 0, k ge 2, with n a parameter varying over integers, and k a parameter indexing members of the family. The main theorem states F (k) n sum j 1 k P k,j F (k) n jk , with P a recursive triangle satisfying the triangle recursion P i,j 2P i 1,j P i 1,j 1 , with appropriate initial conditions. The proof of the theorem exploits the fact that characteristic polynomials of identities are divisible by the characteristic polynomial of the recursion generating the underlying sequence.


A new method for binary classification of proteins with Machine Learning. In this work we set out to find a method to classify protein structures using a Deep Learning methodology. Our Artificial Intelligence has been trained to recognize complex biomolecule structures extrapolated from the Protein Data Bank (PDB) database and reprocessed as images for this purpose various tests have been conducted with pre trained Convolutional Neural Networks, such as InceptionResNetV2 or InceptionV3, in order to extract significant features from these images and correctly classify the molecule. A comparative analysis of the performances of the various networks will therefore be produced.


Equidistribution of zeros of some polynomials related to cyclic functions. In the study of the cyclicity of a function f in reproducing kernel Hilbert spaces an important role is played by sequences of polynomials p n n in mathbb N called emph optimal polynomial approximants (o.p.a.). For many such spaces and when the functions f generating those o.p.a. are polynomials without zeros inside the disk but with some zeros on its boundary, we find that the weakly asympotic distribution of the zeros of 1 p nf is the uniform measure on the unit circle.


Profitability Analysis in Stock Investment Using an LSTM Based Deep Learning Model. Designing robust systems for precise prediction of future prices of stocks has always been considered a very challenging research problem. Even more challenging is to build a system for constructing an optimum portfolio of stocks based on the forecasted future stock prices. We present a deep learning based regression model built on a long and short term memory network (LSTM) network that automatically scraps the web and extracts historical stock prices based on a stock's ticker name for a specified pair of start and end dates, and forecasts the future stock prices. We deploy the model on 75 significant stocks chosen from 15 critical sectors of the Indian stock market. For each of the stocks, the model is evaluated for its forecast accuracy. Moreover, the predicted values of the stock prices are used as the basis for investment decisions, and the returns on the investments are computed. Extensive results are presented on the performance of the model. The analysis of the results demonstrates the efficacy and effectiveness of the system and enables us to compare the profitability of the sectors from the point of view of the investors in the stock market.


Investigations into the opening of fractures during hydraulic testing using a hybrid dimensional flow formulation. We applied a hybrid dimensional flow model to pressure transients recorded during pumping experiments conducted at the Reiche Zeche underground research laboratory to study the normal opening behavior of fractures due to fluid injection. Two distinct types of pressure responses to flow rate steps were identified and numerically modelled using a radial symmetric flow formulation for a fracture that comprises a non linear constitutive relation for the contact mechanics governing reversible fracture surface interaction. These two groups represent radial symmetric and plane axisymmetric flow regimes from a conventional pressure diffusion perspective. A comprehensive parameter study into the sensitivity of the applied hydro mechanical model to changes in characteristic fracture parameters revealed an interrelation between fracture length and normal fracture stiffness that yield a match between field observations and numerical results. Fracture stiffness values increase with corresponding fracture length. Decomposition of the acting normal stresses into a stresses associated with the deformation state of the global fracture geometry and the contact stresses indicates that geometrically induced stresses contribute the more the lower the total effective normal stress and the shorter the fracture. Separating the contributions of the local contact mechanics and the overall fracture geometry to fracture normal stiffness indicates that the latter, the geometrical stiffness, constitutes a lower bound for total stiffness its relevance increases with decreasing fracture length, too. Our study demonstrates that non linear hydro mechanical coupling can lead to vastly different hydraulic responses and thus provides an alternative to conventional pressure diffusion analysis that requires changes in flow regime to cover the full range of observations.


BLEND A Fast, Memory Efficient, and Accurate Mechanism to Find Fuzzy Seed Matches. Comparing genomic sequences is a fundamental yet costly step in most genomic analyses. It requires identifying similar genomic sequence pairs sharing a sufficient number of short subsequences, called seeds. The length and number of seed matches between sequences directly impact the sensitivity, performance, and memory footprint of today's read mappers. Existing attempts optimizing seed matches suffer from either 1) increasing the use of the costly sequence alignment step due to finding a large number of sequence pairs for alignment or 2) limited sensitivity when finding seed matches. Our goal is to efficiently and effectively identify potentially similar sequences using a small number of seed matches, while tolerating variations within each seed. To this end, we introduce BLEND, a fast, memory efficient, and accurate mechanism to find approximate (i.e., fuzzy) seed matches. BLEND 1) finds the minimizer k mers and extends them to increase the length of seeds and 2) utilizes the SimHash technique to enable generating the same hash values for highly similar seeds, which allows matching fuzzy seeds with a single look up. We show the benefits of BLEND when used in two important genomics applications read overlapping and read mapping. For read overlapping, BLEND enables a 2.6x 63.5x (on average 19.5x) faster and 0.9x 9.7x (on average 3.6x) more memory efficient implementation than the state of the art tool, Minimap2. We observe that BLEND finds better quality overlaps that lead to more accurate de novo assemblies compared to Minimap2. For read mapping, BLEND provides 0.7x 3.7x (on average 1.7x) speedup compared to Minimap2. Source code is available at https github.com CMU SAFARI BLEND.


Universal Approximation Under Constraints is Possible with Transformers. Many practical problems need the output of a machine learning model to satisfy a set of constraints, K . Nevertheless, there is no known guarantee that classical neural network architectures can exactly encode constraints while simultaneously achieving universality. We provide a quantitative constrained universal approximation theorem which guarantees that for any non convex compact set K and any continuous function f mathbb R n rightarrow K , there is a probabilistic transformer hat F whose randomized outputs all lie in K and whose expected output uniformly approximates f . Our second main result is a "deep neural version" of Berge's Maximum Theorem (1963). The result guarantees that given an objective function L , a constraint set K , and a family of soft constraint sets, there is a probabilistic transformer hat F that approximately minimizes L and whose outputs belong to K moreover, hat F approximately satisfies the soft constraints. Our results imply the first universal approximation theorem for classical transformers with exact convex constraint satisfaction. They also yield that a chart free universal approximation theorem for Riemannian manifold valued functions subject to suitable geodesically convex constraints.


Robust Model based Reinforcement Learning for Autonomous Greenhouse Control. Due to the high efficiency and less weather dependency, autonomous greenhouses provide an ideal solution to meet the increasing demand for fresh food. However, managers are faced with some challenges in finding appropriate control strategies for crop growth, since the decision space of the greenhouse control problem is an astronomical number. Therefore, an intelligent closed loop control framework is highly desired to generate an automatic control policy. As a powerful tool for optimal control, reinforcement learning (RL) algorithms can surpass human beings' decision making and can also be seamlessly integrated into the closed loop control framework. However, in complex real world scenarios such as agricultural automation control, where the interaction with the environment is time consuming and expensive, the application of RL algorithms encounters two main challenges, i.e., sample efficiency and safety. Although model based RL methods can greatly mitigate the efficiency problem of greenhouse control, the safety problem has not got too much attention. In this paper, we present a model based robust RL framework for autonomous greenhouse control to meet the sample efficiency and safety challenges. Specifically, our framework introduces an ensemble of environment models to work as a simulator and assist in policy optimization, thereby addressing the low sample efficiency problem. As for the safety concern, we propose a sample dropout module to focus more on worst case samples, which can help improve the adaptability of the greenhouse planting policy in extreme cases. Experimental results demonstrate that our approach can learn a more effective greenhouse planting policy with better robustness than existing methods.


International Comparative Studies on the Software Testing Profession. This work attempts to fill a gap by exploring the human dimension in particular, by trying to understand the motivation of software professionals for taking up and sustaining their careers as software testers. Towards that goal, four surveys were conducted in four countries India, Canada, Cuba, and China to try to understand how professional software engineers perceive and value work related factors that could influence their motivation to start or move into software testing careers. From our sample of 220 software professionals, we observed that very few were keen to take up testing careers. Some aspects of software testing, such as the potential for learning opportunities and the importance of the job, appear to be common motivators across the four countries, whereas the treatment of testers as second class citizens and the complexity of the job appeared to be the most prominent de motivators.


Probing neural networks with t SNE, class specific projections and a guided tour. We use graphical methods to probe neural nets that classify images. Plots of t SNE outputs at successive layers in a network reveal increasingly organized arrangement of the data points. They can also reveal how a network can diminish or even forget about within class structure as the data proceeds through layers. We use class specific analogues of principal components to visualize how succeeding layers separate the classes. These allow us to sort images from a given class from most typical to least typical (in the data) and they also serve as very useful projection coordinates for data visualization. We find them especially useful when defining versions guided tours for animated data visualization.


Normal forms of hyperbolic logarithmic transseries. We find the normal forms of hyperbolic logarithmic transseries with respect to parabolic logarithmic normalizing changes of variables. We provide a necessary and sufficient condition on such transseries for the normal form to be linear. The normalizing transformations are obtained via fixed point theorems, and are given algorithmically, as limits of Picard sequences in appropriate topologies.


On Gromov's dihedral extremality and rigidity conjectures. In this paper, we prove Gromov's dihedral extremality conjecture and dihedral rigidity conjecture regarding comparisons of scalar curvatures, mean curvatures and dihedral angles between two compact manifolds with corners possibly of different dimensions. As a consequence, we answer positively Gromov's dihedral extremality conjecture for convex polyhedra in all dimensions, and Gromov's dihedral rigidity conjecture for convex polyhedra in dimension three. A key ingredient of our proofs is a new index theory for manifolds with corners.


Revisiting dissipative motion of a spinning heavy symmetric top and the rise of the top by friction. The dissipative motion and the rise of a heavy symmetrical top with a hemispherical peg are studied. A model taking the fixed point of the top as the center of the peg is considered when the top completely slips and the rolling motion is ignored. This is different from existing models like Jellet's one. Jellett's model and pure slipping are compared for different tops for the rise of the top.


Fine Tuning the Odds in Bayesian Networks. This paper proposes various new analysis techniques for Bayes networks in which conditional probability tables (CPTs) may contain symbolic variables. The key idea is to exploit scalable and powerful techniques for synthesis problems in parametric Markov chains. Our techniques are applicable to arbitrarily many, possibly dependent parameters that may occur in various CPTs. This lifts the severe restrictions on parameters, e.g., by restricting the number of parametrized CPTs to one or two, or by avoiding parameter dependencies between several CPTs, in existing works for parametric Bayes networks (pBNs). We describe how our techniques can be used for various pBN synthesis problems studied in the literature such as computing sensitivity functions (and values), simple and difference parameter tuning, ratio parameter tuning, and minimal change tuning. Experiments on several benchmarks show that our prototypical tool built on top of the probabilistic model checker Storm can handle several hundreds of parameters.


EDLaaS Fully Homomorphic Encryption Over Neural Network Graphs. We present automatically parameterised Fully Homomorphic Encryption (FHE), for encrypted neural network inference. We present and exemplify our inference over FHE compatible neural networks with our own open source framework and reproducible step by step examples. We use the 4th generation Cheon, Kim, Kim and Song (CKKS) FHE scheme over fixed points provided by the Microsoft Simple Encrypted Arithmetic Library (MS SEAL). We significantly enhance the usability and applicability of FHE in deep learning contexts, with a focus on the constituent graphs, traversal, and optimisation. We find that FHE is not a panacea for all privacy preserving machine learning (PPML) problems, and that certain limitations still remain, such as model training. However we also find that in certain contexts FHE is well suited for computing completely private predictions with neural networks. We focus on convolutional neural networks (CNNs), fashion MNIST, and levelled FHE operations. The ability to privately compute sensitive problems more easily, while lowering the barriers to entry, can allow otherwise too sensitive fields to begin advantaging themselves of performant third party neural networks. Lastly we show encrypted deep learning, applied to a sensitive real world problem in agri food, and how this can have a large positive impact on food waste and encourage much needed data sharing.


VR3Dense Voxel Representation Learning for 3D Object Detection and Monocular Dense Depth Reconstruction. 3D object detection and dense depth estimation are one of the most vital tasks in autonomous driving. Multiple sensor modalities can jointly attribute towards better robot perception, and to that end, we introduce a method for jointly training 3D object detection and monocular dense depth reconstruction neural networks. It takes as inputs, a LiDAR point cloud, and a single RGB image during inference and produces object pose predictions as well as a densely reconstructed depth map. LiDAR point cloud is converted into a set of voxels, and its features are extracted using 3D convolution layers, from which we regress object pose parameters. Corresponding RGB image features are extracted using another 2D convolutional neural network. We further use these combined features to predict a dense depth map. While our object detection is trained in a supervised manner, the depth prediction network is trained with both self supervised and supervised loss functions. We also introduce a loss function, edge preserving smooth loss, and show that this results in better depth estimation compared to the edge aware smooth loss function, frequently used in depth prediction works.


Existence and decay of traveling waves for the nonlocal Gross Pitaevskii equation. We consider the nonlocal Gross Pitaevskii equation that models a Bose gas with general nonlocal interactions between particles in one spatial dimension, with constant density far away. We address the problem of the existence of traveling waves with nonvanishing conditions at infinity, i.e. dark solitons. Under general conditions on the interactions, we prove existence of dark solitons for almost every subsonic speed. Moreover, we show existence in the whole subsonic regime for a family of potentials. The proofs rely on a Mountain Pass argument combined with the so called "monotonicity trick", as well as on a priori estimates for the Palais Smale sequences. Finally, we establish properties of the solitons such us exponential decay at infinity and analyticity.


MRIReco.jl An MRI Reconstruction Framework written in Julia. Purpose The aim of this work is to develop a high performance, flexible and easy to use MRI reconstruction framework using the scientific programming language Julia. Methods Julia is a modern, general purpose programming language with strong features in the area of signal image processing and numerical computing. It has a high level syntax but still generates efficient machine code that is usually as fast as comparable C C applications. In addition to the language features itself, Julia has a sophisticated package management system that makes proper modularization of functionality across different packages feasible. Our developed MRI reconstruction framework MRIReco.jl can therefore reuse existing functionality from other Julia packages and concentrate on the MRI related parts. This includes common imaging operators and support for MRI raw data formats. Results MRIReco.jl is a simple to use framework with a high degree of accessibility. While providing a simple to use interface, many of its components can easily be extended and customized. The performance of MRIReco.jl is compared to the Berkeley Advanced Reconstruction Toolbox (BART) and we show that the Julia framework achieves comparable reconstruction speed as the popular C C library. Conclusion Modern programming languages can bridge the gap between high performance and accessible implementations. MRIReco.jl leverages this fact and contributes a promising environment for future algorithmic development in MRI reconstruction.


Capacity Region Bounds for the K user Dispersive Nonlinear Optical WDM Channel with Peak Power Constraints. It is known that fiber nonlinearities induce crosstalk in a wavelength division multiplexed (WDM) system, which limits the capacity of such systems as the transmitted signal power is increased. A network user in a WDM system is an entity that operates around a given optical wavelength. Traditionally, the channel capacity of a WDM system has been analyzed under different assumptions for the transmitted signals of the other users, while treating the interference arising from these users as noise. In this paper, we instead take a multi user information theoretic view and treat the optical WDM system impaired by cross phase modulation and dispersion as an interference channel. We characterize, for the first time, an outer bound on the capacity region of simultaneously achievable rate pairs, assuming a general K user perturbative channel model using genie aided techniques. Furthermore, an achievable rate region is obtained by time sharing between certain single user strategies. It is shown that such time sharing can achieve better rate tuples compared to treating nonlinear interference as noise. For the single polarization single span system under consideration and a power 4 4 dB above the optimum launch power, treating nonlinear interference as noise results in a rate of 0 22 bit sym, while time sharing gives a rate of 1 82 bit sym.


Revealing Fundamentals of Charge Extraction in Photovoltaic Devices Through Potentiostatic Photoluminescence Imaging. The photocurrent density voltage (J(V)) curve is the fundamental characteristic to assess opto electronic devices, in particular solar cells. However, it only yields information on the performance integrated over the entire active device area. Here, a method to determine a spatially resolved photocurrent image by voltage dependent photoluminescence microscopy is derived from basic principles. The opportunities and limitations of the approach are studied by the investigation of III V and perovskite solar cells. This approach allows the real time assessment of the microscopically resolved local J(V) curve, the steady state Jsc, as well as transient effects. In addition, the measurement contains information on local charge extraction and interfacial recombination. This facilitates the identification of regions of non ideal charge extraction in the solar cells and enables to link these to the processing conditions. The proposed technique highlights that, combined with potentiostatic measurements, luminescence microscopy turns out to be a powerful tool for the assessment of performance losses and the improvement of solar cells.


Robust models of SARS CoV 2 heterogeneity and control. In light of the continuing emergence of new SARS CoV 2 variants and vaccines, we create a simulation framework for exploring possible infection trajectories under various scenarios. The situations of primary interest involve the interaction between three components vaccination campaigns, non pharmaceutical interventions (NPIs), and the emergence of new SARS CoV 2 variants. Additionally, immunity waning and vaccine boosters are modeled to account for their growing importance. New infections are generated according to a hierarchical model in which people have a random, individual infectiousness. The model thus includes super spreading observed in the COVID 19 pandemic. Our simulation functions as a dynamic compartment model in which an individual's history of infection, vaccination, and possible reinfection all play a role in their resistance to further infections. We present a risk measure for each SARS CoV 2 variant, rho V , that accounts for the amount of resistance within a population and show how this risk changes as the vaccination rate increases. Furthermore, by considering different population compositions in terms of previous infection and type of vaccination, we can learn about variants which pose differential risk to different countries. Different control strategies are implemented which aim to both suppress COVID 19 outbreaks when they occur as well as relax restrictions when possible. We demonstrate that a controller that responds to the effective reproduction number in addition to case numbers is more efficient and effective in controlling new waves than monitoring case numbers alone. This is of interest as the majority of the public discussion and well known statistics deal primarily with case numbers.


Digger Finger GelSight Tactile Sensor for Object Identification Inside Granular Media. In this paper we present an early prototype of the Digger Finger that is designed to easily penetrate granular media and is equipped with the GelSight sensor. Identifying objects buried in granular media using tactile sensors is a challenging task. First, particle jamming in granular media prevents downward movement. Second, the granular media particles tend to get stuck between the sensing surface and the object of interest, distorting the actual shape of the object. To tackle these challenges we present a Digger Finger prototype. It is capable of fluidizing granular media during penetration using mechanical vibrations. It is equipped with high resolution vision based tactile sensing to identify objects buried inside granular media. We describe the experimental procedures we use to evaluate these fluidizing and buried shape recognition capabilities. A robot with such fingers can perform explosive ordnance disposal and Improvised Explosive Device (IED) detection tasks at a much a finer resolution compared to techniques like Ground Penetration Radars (GPRs). Sensors like the Digger Finger will allow robotic manipulation research to move beyond only manipulating rigid objects.


CLIPScore A Reference free Evaluation Metric for Image Captioning. Image captioning has conventionally relied on reference based automatic evaluations, where machine captions are compared against captions written by humans. This is in contrast to the reference free manner in which humans assess caption quality. In this paper, we report the surprising empirical finding that CLIP (Radford et al., 2021), a cross modal model pretrained on 400M image caption pairs from the web, can be used for robust automatic evaluation of image captioning without the need for references. Experiments spanning several corpora demonstrate that our new reference free metric, CLIPScore, achieves the highest correlation with human judgements, outperforming existing reference based metrics like CIDEr and SPICE. Information gain experiments demonstrate that CLIPScore, with its tight focus on image text compatibility, is complementary to existing reference based metrics that emphasize text text similarities. Thus, we also present a reference augmented version, RefCLIPScore, which achieves even higher correlation. Beyond literal description tasks, several case studies reveal domains where CLIPScore performs well (clip art images, alt text rating), but also where it is relatively weaker in comparison to reference based metrics, e.g., news captions that require richer contextual knowledge.


Equilibrium Properties of E. coli Lactose Permease Symport A Random walk Model Approach. The symport of lactose and H is an important physiological process in E. coli, for it is closely related to cellular energy supply. In this paper, the symport of H and lactose by E. coli LacY protein is computationally simulated using a newly proposed cotransport model that takes the "leakage" phenomenon (uncoupled sugar translocation) into account and also satisfies the static head equilibrium condition. Then, we study the equilibrium properties of this cotransport process including equilibrium solution and the time required to reach equilibrium state, when varying the parameters of the initial state of cotransport system. It can be found that in the presence of leakage, H and lactose will reach their equilibrium state separately, but the intensity of "leakage" has almost no effect on the equilibrium solution, while the stronger leakage is, the shorter the time required for H and lactose to reach equilibrium. For E. coli cells with different periplasm and cytoplasm volumes, when cotransport is performed at constant initial particle concentration, the time for cytoplasm pH to be stabilized increases monotonically with the periplasm to cytoplasm volume ratio. For a certain E. coli cell, as it continues to lose water and contract, the time for cytoplasm pH to be stabilized by cotransport also increases monotonically when the cell survives. The above phenomena and other findings in this paper may help us to not only further validate or improve the model, but also deepen our understanding of the cotransport process of E. coli LacY protein.


Concept of miniature optical pressure sensor based on coupled WGMs in a dielectric microsphere. We present the physical concept and sample engineering design of a new miniature pressure sensor based on the whispering gallery modes (WGMs) optically excited in a dielectric microsphere placed near a flexible reflective membrane which acts as an ambient pressure sensing element. WGMs excitation is carried out by free space coupling of optical radiation to a microsphere. The distinctive feature of proposed sensor design is double excitation of optical eigenmodes by forward and backward propagating radiation reflected from a membrane that causes WGMs interference in particle volume. The optical intensity of resulting resonant field established in the microsphere carries information about the exact position of the pressure loaded reflecting membrane. The sensitivity of the proposed sensor strongly depends on the quality factor of the excited resonant mode, as well as geometrical and mechanical parameters of the flexible membrane. Important advantages of the proposed sensor are miniature design (linear sensor dimensions depends only on the membrane diameter) and the absence of a mechanical contact of pressure sensitive element with WGM resonator.


Semiconductor Laser Linewidth Theory Revisited. More and more applications require semiconductor lasers distinguished not only by large modulation bandwidths or high output powers, but also by small spectral linewidths. The theoretical understanding of the root causes limiting the linewidth is therefore of great practical relevance. In this paper, we derive a general expression for the calculation of the spectral linewidth step by step in a self contained manner. We build on the linewidth theory developed in the 1980s and 1990s but look from a modern perspective, in the sense that we choose as our starting points the time dependent coupled wave equations for the forward and backward propagating fields and an expansion of the fields in terms of the stationary longitudinal modes of the open cavity. As a result, we obtain rather general expressions for the longitudinal excess factor of spontaneous emission ( K factor) and the effective alpha factor including the effects of nonlinear gain (gain compression) and refractive index (Kerr effect), gain dispersion and longitudinal spatial hole burning in multi section cavity structures. The effect of linewidth narrowing due to feedback from an external cavity often described by the so called chirp reduction factor is also automatically included. We propose a new analytical formula for the dependence of the spontaneous emission on the carrier density avoiding the use of the population inversion factor. The presented theoretical framework is applied to a numerical study of a two section distributed Bragg reflector laser.


Fast User Adaptation for Human Motion Prediction in Physical Human Robot Interaction. Accurate prediction of human movements is required to enhance the efficiency of physical human robot interaction. Behavioral differences across various users are crucial factors that limit the prediction of human motion. Although recent neural network based modeling methods have improved their prediction accuracy, most did not consider an effective adaptations to different users, thereby employing the same model parameters for all users. To deal with this insufficiently addressed challenge, we introduce a meta learning framework to facilitate the rapid adaptation of the model to unseen users. In this study, we propose a model structure and a meta learning algorithm specialized to enable fast user adaptation in predicting human movements in cooperative situations with robots. The proposed prediction model comprises shared and adaptive parameters, each addressing the user's general and individual movements. Using only a small amount of data from an individual user, the adaptive parameters are adjusted to enable user specific prediction through a two step process initialization via a separate network and adaptation via a few gradient steps. Regarding the motion dataset that has 20 users collaborating with a robotic device, the proposed method outperforms existing meta learning and non meta learning baselines in predicting the movements of unseen users.


CBIR using Pre Trained Neural Networks. Much of the recent research work in image retrieval, has been focused around using Neural Networks as the core component. Many of the papers in other domain have shown that training multiple models, and then combining their outcomes, provide good results. This is since, a single Neural Network model, may not extract sufficient information from the input. In this paper, we aim to follow a different approach. Instead of the using a single model, we use a pretrained Inception V3 model, and extract activation of its last fully connected layer, which forms a low dimensional representation of the image. This feature matrix, is then divided into branches and separate feature extraction is done for each branch, to obtain multiple features flattened into a vector. Such individual vectors are then combined, to get a single combined feature. We make use of CUB200 2011 Dataset, which comprises of 200 birds classes to train the model on. We achieved a training accuracy of 99.46 and validation accuracy of 84.56 for the same. On further use of 3 branched global descriptors, we improve the validation accuracy to 88.89 . For this, we made use of MS RMAC feature extraction method.


Understanding and Measuring Robustness of Multimodal Learning. The modern digital world is increasingly becoming multimodal. Although multimodal learning has recently revolutionized the state of the art performance in multimodal tasks, relatively little is known about the robustness of multimodal learning in an adversarial setting. In this paper, we introduce a comprehensive measurement of the adversarial robustness of multimodal learning by focusing on the fusion of input modalities in multimodal models, via a framework called MUROAN (MUltimodal RObustness ANalyzer). We first present a unified view of multimodal models in MUROAN and identify the fusion mechanism of multimodal models as a key vulnerability. We then introduce a new type of multimodal adversarial attacks called decoupling attack in MUROAN that aims to compromise multimodal models by decoupling their fused modalities. We leverage the decoupling attack of MUROAN to measure several state of the art multimodal models and find that the multimodal fusion mechanism in all these models is vulnerable to decoupling attacks. We especially demonstrate that, in the worst case, the decoupling attack of MUROAN achieves an attack success rate of 100 by decoupling just 1.16 of the input space. Finally, we show that traditional adversarial training is insufficient to improve the robustness of multimodal models with respect to decoupling attacks. We hope our findings encourage researchers to pursue improving the robustness of multimodal learning.


On the space time discretization of variational retarded potential boundary integral equations. This paper discusses the practical development of space time boundary element methods for the wave equation in three spatial dimensions. The employed trial spaces stem from simplex meshes of the lateral boundary of the space time cylinder. This approach conforms genuinely to the distinguished structure of the solution operators of the wave equation, so called retarded potentials. Since the numerical evaluation of the arising integrals is intricate, the bulk of this work is constituted by ideas about quadrature techniques for retarded layer potentials and associated energetic bilinear forms. Finally, we glimpse at algorithmic aspects regarding the efficient implementation of retarded potentials in the space time setting. The proposed methods are verified by means of numerical experiments, which illustrate their capacity.


Leveraging Conditional Generative Models in a General Explanation Framework of Classifier Decisions. Providing a human understandable explanation of classifiers' decisions has become imperative to generate trust in their use for day to day tasks. Although many works have addressed this problem by generating visual explanation maps, they often provide noisy and inaccurate results forcing the use of heuristic regularization unrelated to the classifier in question. In this paper, we propose a new general perspective of the visual explanation problem overcoming these limitations. We show that visual explanation can be produced as the difference between two generated images obtained via two specific conditional generative models. Both generative models are trained using the classifier to explain and a database to enforce the following properties (i) All images generated by the first generator are classified similarly to the input image, whereas the second generator's outputs are classified oppositely. (ii) Generated images belong to the distribution of real images. (iii) The distances between the input image and the corresponding generated images are minimal so that the difference between the generated elements only reveals relevant information for the studied classifier. Using symmetrical and cyclic constraints, we present two different approximations and implementations of the general formulation. Experimentally, we demonstrate significant improvements w.r.t the state of the art on three different public data sets. In particular, the localization of regions influencing the classifier is consistent with human annotations.


From sleep medicine to medicine during sleep A clinical perspective. Sleep has a profound influence on the physiology of body systems and biological processes. Molecular studies have shown circadian regulated shifts in protein expression patterns across human tissues, further emphasizing the unique functional, behavioral and pharmacokinetic landscape of sleep. Thus, many pathological processes are also expected to exhibit sleep specific manifestations. Nevertheless, sleep is seldom utilized for the study, detection and treatment of non sleep specific pathologies. Modern advances in biosensor technologies have enabled remote, non invasive recording of a growing number of physiologic parameters and biomarkers. Sleep is an ideal time frame for the collection of long and clean physiological time series data which can then be analyzed using data driven algorithms such as deep learning. In this perspective paper, we aim to highlight the potential of sleep as an auspicious time for diagnosis, management and therapy of nonsleep specific pathologies. We introduce key clinical studies in selected medical fields, which leveraged novel technologies and the advantageous period of sleep to diagnose, monitor and treat pathologies. We then discuss possible opportunities to further harness this new paradigm and modern technologies to explore human health and disease during sleep and to advance the development of novel clinical applications From sleep medicine to medicine during sleep.


Sensor Fusion based GNSS Spoofing Attack Detection Framework for Autonomous Vehicles. In this study, a sensor fusion based GNSS spoofing attack detection framework is presented that consists of three concurrent strategies for an autonomous vehicle (AV) (i) prediction of location shift, (ii) detection of turns (left or right), and (iii) recognition of motion state (including standstill state). Data from multiple low cost in vehicle sensors (i.e., accelerometer, steering angle sensor, speed sensor, and GNSS) are fused and fed into a recurrent neural network model, which is a long short term memory (LSTM) network for predicting the location shift, i.e., the distance that an AV travels between two consecutive timestamps. We have then combined k Nearest Neighbors (k NN) and Dynamic Time Warping (DTW) algorithms to detect turns using data from the steering angle sensor. In addition, data from an AV's speed sensor is used to recognize the AV's motion state including the standstill state. To prove the efficacy of the sensor fusion based attack detection framework, attack datasets are created for three unique and sophisticated spoofing attacks turn by turn, overshoot, and stop using the publicly available real world Honda Research Institute Driving Dataset (HDD). Our analysis reveals that the sensor fusion based detection framework successfully detects all three types of spoofing attacks within the required computational latency threshold.


Interactive Multi level Stroke Control for Neural Style Transfer. We present StyleTune, a mobile app for interactive multi level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes and texture patches, on a global as well as local level. To this end, we propose a novel stroke adaptive feed forward style transfer network, that enables control over stroke size and intensity and allows a larger range of edits than current approaches. For additional level of control, we propose a network agnostic method for stroke orientation adjustment by utilizing the rotation variance of CNNs. To achieve high output fidelity, we further add a patch based style transfer method that enables users to obtain output resolutions of more than 20 Megapixel. Our approach empowers users to create many novel results that are not possible with current mobile neural style transfer apps.


Post Quantum Era in V2X Security Convergence of Orchestration and Parallel Computation. Along with the potential emergence of quantum computing, safety and security of new and complex communication services such as automated driving need to be redefined in the post quantum era. To ensure reliable, continuous and secure operation of these scenarios, quantum resistant security algorithms (QRSAs) that enable secure connectivity must be integrated into the network management and orchestration systems of mobile networks. This paper explores a roadmap study of post quantum era convergence with cellular connectivity using the Service Computation Orchestrator (SCO) framework for enhanced data security in radio access and backhaul transmission with a particular focus on Vehicle to Everything (V2X) services. Using NTRU as a QSRA, we have shown that the parallelization performance of Toom Cook and Karatsuba computation methods can vary based on different CPU load conditions through extensive simulations and that the SCO framework can facilitate the selection of the most efficient computation for a given QRSA. Finally, we discuss the evaluation results, identify the current standardization efforts, and possible directions for the coexistence of post quantum and mobile network connectivity through a SCO framework that leverages parallel computing.


Personalized News Recommendation Methods and Challenges. Personalized news recommendation is an important technique to help users find their interested news information and alleviate their information overload. It has been extensively studied over decades and has achieved notable success in improving users' news reading experience. However, there are still many unsolved problems and challenges that need to be further studied. To help researchers master the advances in personalized news recommendation over the past years, in this paper we present a comprehensive overview of personalized news recommendation. Instead of following the conventional taxonomy of news recommendation methods, in this paper we propose a novel perspective to understand personalized news recommendation based on its core problems and the associated techniques and challenges. We first review the techniques for tackling each core problem in a personalized news recommender system and the challenges they face. Next, we introduce the public datasets and evaluation methods for personalized news recommendation. We then discuss the key points on improving the responsibility of personalized news recommender systems. Finally, we raise several research directions that are worth investigating in the future. This paper can provide up to date and comprehensive views to help readers understand the personalized news recommendation field. We hope this paper can facilitate research on personalized news recommendation as well as related fields in natural language processing and data mining.


Fluctuation estimates for the multi cell formula in stochastic homogenization of partitions. In this paper we derive quantitative estimates in the context of stochastic homogenization for integral functionals defined on finite partitions, where the random surface integrand is assumed to be stationary. Requiring the integrand to satisfy in addition a multiscale functional inequality, we control quantitatively the fluctuations of the asymptotic cell formulas defining the homogenized surface integrand. As a byproduct we obtain a simplified cell formula where we replace cubes by almost flat hyperrectangles.


Long term regulation of prolonged epidemic outbreaks in large populations via adaptive control a singular perturbation approach. Initial hopes of quickly eradicating the COVID 19 pandemic proved futile, and the goal shifted to controlling the peak of the infection, so as to minimize the load on healthcare systems. To that end, public health authorities intervened aggressively to institute social distancing, lock down policies, and other Non Pharmaceutical Interventions (NPIs). Given the high social, educational, psychological, and economic costs of NPIs, authorities tune them, alternatively tightening up or relaxing rules, with the result that, in effect, a relatively flat infection rate results. For example, during the summer in parts of the United States, daily infection numbers dropped to a plateau. This paper approaches NPI tuning as a control theoretic problem, starting from a simple dynamic model for social distancing based on the classical SIR epidemics model. Using a singular perturbation approach, the plateau becomes a Quasi Steady State (QSS) of a reduced two dimensional SIR model regulated by adaptive dynamic feedback. It is shown that the QSS can be assigned and it is globally asymptotically stable. Interestingly, the dynamic model for social distancing can be interpreted as a nonlinear integral controller. Problems of data fitting and parameter identifiability are also studied for this model. The paper also discusses how this simple model allows for meaningful study of the effect of population size, vaccinations, and the emergence of second waves.


On infinitely many foliations by caustics in strictly convex open billiards. Reflection in strictly convex bounded planar billiard acts on the space of oriented lines and preserves a standard area form. A caustic is a curve C whose tangent lines are reflected by the billiard to lines tangent to C . The famous Birkhoff Conjecture states that the only strictly convex billiards with a foliation by closed caustics near the boundary are ellipses. By Lazutkin's theorem, there always exists a Cantor family of closed caustics approaching the boundary. In the present paper we deal with a billiard whose boundary contains a strictly convex embedded (non closed) curve gamma . We prove that there exists a domain U adjacent to gamma from the convex side and a C infty smooth foliation of U sqcup gamma whose leaves are gamma and non closed caustics of the billiard. This generalizes a previous result by R.Melrose, which yields existence of a germ of foliation as above at a boundary point. We show that there exists a continuum of above foliations by caustics whose germs at each point in gamma are pairwise different. We prove a more general version of this statement in the case, when both gamma and the caustics are immersed curves. It also applies to a billiard bounded by a closed strictly convex curve gamma and yields infinitely many "immersed" foliations by immersed caustics. For the proof of the above results, we state and prove their analogue for a special class of area preserving maps generalizing billiard reflections the so called C infty lifted strongly billiard like maps.


SQAPlanner Generating Data Informed Software Quality Improvement Plans. Software Quality Assurance (SQA) planning aims to define proactive plans, such as defining maximum file size, to prevent the occurrence of software defects in future releases. To aid this, defect prediction models have been proposed to generate insights as the most important factors that are associated with software quality. Such insights that are derived from traditional defect models are far from actionable i.e., practitioners still do not know what they should do or avoid to decrease the risk of having defects, and what is the risk threshold for each metric. A lack of actionable guidance and risk threshold can lead to inefficient and ineffective SQA planning processes. In this paper, we investigate the practitioners' perceptions of current SQA planning activities, current challenges of such SQA planning activities, and propose four types of guidance to support SQA planning. We then propose and evaluate our AI Driven SQAPlanner approach, a novel approach for generating four types of guidance and their associated risk thresholds in the form of rule based explanations for the predictions of defect prediction models. Finally, we develop and evaluate an information visualization for our SQAPlanner approach. Through the use of qualitative survey and empirical evaluation, our results lead us to conclude that SQAPlanner is needed, effective, stable, and practically applicable. We also find that 80 of our survey respondents perceived that our visualization is more actionable. Thus, our SQAPlanner paves a way for novel research in actionable software analytics i.e., generating actionable guidance on what should practitioners do and not do to decrease the risk of having defects to support SQA planning.


Multi feature 360 Video Quality Estimation. We propose a new method for the visual quality assessment of 360 degree (omnidirectional) videos. The proposed method is based on computing multiple spatio temporal objective quality features on viewports extracted from 360 degree videos. A new model is learnt to properly combine these features into a metric that closely matches subjective quality scores. The main motivations for the proposed approach are that 1) quality metrics computed on viewports better captures the user experience than metrics computed on the projection domain 2) the use of viewports easily supports different projection methods being used in current 360 degree video systems and 3) no individual objective image quality metric always performs the best for all types of visual distortions, while a learned combination of them is able to adapt to different conditions. Experimental results, based on both the largest available 360 degree videos quality dataset and a cross dataset validation, demonstrate that the proposed metric outperforms state of the art 360 degree and 2D video quality metrics.


SYNFIX Automatically Fixing Syntax Errors using Compiler Diagnostics. Beginning programmers struggle with the complex grammar of modern programming languages like Java, and make lot of syntax errors. The diagnostic syntax error messages from compilers and IDEs are sometimes useful, but often the messages are cryptic and puzzling. Students could be helped, and instructors' time saved, by automated repair suggestions when dealing with syntax errors. Large samples of student errors and fixes are now available, offering the possibility of data driven machine learning approaches to help students fix syntax errors. Current machine learning approaches do a reasonable job fixing syntax errors in shorter programs, but don't work as well even for moderately longer programs. We introduce SYNFIX, a machine learning based tool that substantially improves on the state of the art, by learning to use compiler diagnostics, employing a very large neural model that leverages unsupervised pre training, and relying on multi label classification rather than autoregressive synthesis to generate the (repaired) output. We describe SYNFIX's architecture in detail, and provide a detailed evaluation. We have built SYNFIX into a free, open source version of Visual Studio Code we make all our source code and models freely available.


Geometry of gyrogroups via Klein's approach. Using Klein's approach, geometry can be studied in terms of a space of points and a group of transformations of that space. This allows us to apply algebraic tools in studying geometry of mathematical structures. In this article, we follow Klein's approach to study the geometry (G, mathcal T ) , where G is an abstract gyrogroup and mathcal T is an appropriate group of transformations containing all gyroautomorphisms of G . We focus on n transitivity of gyrogroups and also give a few characterizations of coset spaces to be minimally invariant sets. We then prove that the collection of open balls of equal radius is a minimally invariant set of the geometry (G, Gamma m) for any normed gyrogroup G , where Gamma m is a suitable group of isometries of G .


Innovation adoption Broadcasting vs. Virality. Diffusion channels are critical to determining the adoption scale which leads to the ultimate impact of an innovation. The aim of this study is to develop an integrative understanding of the impact of two diffusion channels (i.e., broadcasting vs virality) on innovation adoption. Using citations of a series of classic algorithms and the time series of co authorship as the footprints of their diffusion trajectories, we propose a novel method to analyze the intertwining relationships between broadcasting and virality in the innovation diffusion process. Our findings show that broadcasting and virality have similar diffusion power, but play different roles across diffusion stages. Broadcasting is more powerful in the early stages but may be gradually caught up or even surpassed by virality in the later period. Meanwhile, diffusion speed in virality is significantly faster than broadcasting and members from virality channels tend to adopt the same innovation repetitively.


Auditing E Commerce Platforms for Algorithmically Curated Vaccine Misinformation. There is a growing concern that e commerce platforms are amplifying vaccine misinformation. To investigate, we conduct two sets of algorithmic audits for vaccine misinformation on the search and recommendation algorithms of Amazon world's leading e retailer. First, we systematically audit search results belonging to vaccine related search queries without logging into the platform unpersonalized audits. We find 10.47 of search results promote misinformative health products. We also observe ranking bias, with Amazon ranking misinformative search results higher than debunking search results. Next, we analyze the effects of personalization due to account history, where history is built progressively by performing various real world user actions, such as clicking a product. We find evidence of filter bubble effect in Amazon's recommendations accounts performing actions on misinformative products are presented with more misinformation compared to accounts performing actions on neutral and debunking products. Interestingly, once user clicks on a misinformative product, homepage recommendations become more contaminated compared to when user shows an intention to buy that product.


Rethinking Domain Generalization Baselines. Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and data augmentation strategies have shown to be helpful tools to increase data variability, supporting model robustness across domains. In our work we focus on style transfer data augmentation and we present how it can be implemented with a simple and inexpensive strategy to improve generalization. Moreover, we analyze the behavior of current state of the art domain generalization methods when integrated with this augmentation solution our thorough experimental evaluation shows that their original effect almost always disappears with respect to the augmented baseline. This issue open new scenarios for domain generalization research, highlighting the need of novel methods properly able to take advantage of the introduced data variability.


Data Deduplication with Random Substitutions. Data deduplication saves storage space by identifying and removing repeats in the data stream. Compared with traditional compression methods, data deduplication schemes are more time efficient and are thus widely used in large scale storage systems. In this paper, we provide an information theoretic analysis on the performance of deduplication algorithms on data streams in which repeats are not exact. We introduce a source model in which probabilistic substitutions are considered. More precisely, each symbol in a repeated string is substituted with a given edit probability. Deduplication algorithms in both the fixed length scheme and the variable length scheme are studied. The fixed length deduplication algorithm is shown to be unsuitable for the proposed source model as it does not take into account the edit probability. Two modifications are proposed and shown to have performances within a constant factor of optimal with the knowledge of source model parameters. We also study the conventional variable length deduplication algorithm and show that as source entropy becomes smaller, the size of the compressed string vanishes relative to the length of the uncompressed string, leading to high compression ratios.


Entropic Optimal Transport Geometry and Large Deviations. We study the convergence of entropically regularized optimal transport to optimal transport. The main result is concerned with the convergence of the associated optimizers and takes the form of a large deviations principle quantifying the local exponential convergence rate as the regularization parameter vanishes. The exact rate function is determined in a general setting and linked to the Kantorovich potential of optimal transport. Our arguments are based on the geometry of the optimizers and inspired by the use of c cyclical monotonicity in classical transport theory. The results can also be phrased in terms of Schr "odinger bridges.


FFB6D A Full Flow Bidirectional Fusion Network for 6D Pose Estimation. In this work, we present FFB6D, a Full Flow Bidirectional fusion network designed for 6D pose estimation from a single RGBD image. Our key insight is that appearance information in the RGB image and geometry information from the depth image are two complementary data sources, and it still remains unknown how to fully leverage them. Towards this end, we propose FFB6D, which learns to combine appearance and geometry information for representation learning as well as output representation selection. Specifically, at the representation learning stage, we build bidirectional fusion modules in the full flow of the two networks, where fusion is applied to each encoding and decoding layer. In this way, the two networks can leverage local and global complementary information from the other one to obtain better representations. Moreover, at the output representation stage, we designed a simple but effective 3D keypoints selection algorithm considering the texture and geometry information of objects, which simplifies keypoint localization for precise pose estimation. Experimental results show that our method outperforms the state of the art by large margins on several benchmarks. Code and video are available at url https github.com ethnhe FFB6D.git .


Shape aware Multi Person Pose Estimation from Multi View Images. In this paper we contribute a simple yet effective approach for estimating 3D poses of multiple people from multi view images. Our proposed coarse to fine pipeline first aggregates noisy 2D observations from multiple camera views into 3D space and then associates them into individual instances based on a confidence aware majority voting technique. The final pose estimates are attained from a novel optimization scheme which links high confidence multi view 2D observations and 3D joint candidates. Moreover, a statistical parametric body model such as SMPL is leveraged as a regularizing prior for these 3D joint candidates. Specifically, both 3D poses and SMPL parameters are optimized jointly in an alternating fashion. Here the parametric models help in correcting implausible 3D pose estimates and filling in missing joint detections while updated 3D poses in turn guide obtaining better SMPL estimations. By linking 2D and 3D observations, our method is both accurate and generalizes to different data sources because it better decouples the final 3D pose from the inter person constellation and is more robust to noisy 2D detections. We systematically evaluate our method on public datasets and achieve state of the art performance. The code and video will be available on the project page https ait.ethz.ch projects 2021 multi human pose .


Creolizing the Web. The evolution of language has been a hotly debated subject with contradicting hypotheses and unreliable claims. Drawing from signalling games, dynamic population mechanics, machine learning and algebraic topology, we present a method for detecting evolutionary patterns in a sociological model of language evolution. We develop a minimalistic model that provides a rigorous base for any generalized evolutionary model for language based on communication between individuals. We also discuss theoretical guarantees of this model, ranging from stability of language representations to fast convergence of language by temporal communication and language drift in an interactive setting. Further we present empirical results and their interpretations on a real world dataset from rdt to identify communities and echo chambers for opinions, thus placing obstructions to reliable communication among communities.


On lattice isomorphisms of orthodox semigroups. Two semigroups are lattice isomorphic if the lattices of their subsemigroups are isomorphic, and a class of semigroups is lattice closed if it contains every semigroup which is lattice isomorphic to some semigroup from that class. An orthodox semigroup is a regular semigroup whose idempotents form a subsemigroup. We prove that the class of all orthodox semigroups in which every nonidempotent element has infinite order is lattice closed.


Are NLP Models really able to Solve Simple Math Word Problems?. The problem of designing NLP solvers for math word problems (MWP) has seen sustained research activity and steady gains in the test accuracy. Since existing solvers achieve high performance on the benchmark datasets for elementary level MWPs containing one unknown arithmetic word problems, such problems are often considered "solved" with the bulk of research attention moving to more complex MWPs. In this paper, we restrict our attention to English MWPs taught in grades four and lower. We provide strong evidence that the existing MWP solvers rely on shallow heuristics to achieve high performance on the benchmark datasets. To this end, we show that MWP solvers that do not have access to the question asked in the MWP can still solve a large fraction of MWPs. Similarly, models that treat MWPs as bag of words can also achieve surprisingly high accuracy. Further, we introduce a challenge dataset, SVAMP, created by applying carefully chosen variations over examples sampled from existing datasets. The best accuracy achieved by state of the art models is substantially lower on SVAMP, thus showing that much remains to be done even for the simplest of the MWPs.


On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations. The adaptation of pretrained language models to solve supervised tasks has become a baseline in NLP, and many recent works have focused on studying how linguistic information is encoded in the pretrained sentence representations. Among other information, it has been shown that entire syntax trees are implicitly embedded in the geometry of such models. As these models are often fine tuned, it becomes increasingly important to understand how the encoded knowledge evolves along the fine tuning. In this paper, we analyze the evolution of the embedded syntax trees along the fine tuning process of BERT for six different tasks, covering all levels of the linguistic structure. Experimental results show that the encoded syntactic information is forgotten (PoS tagging), reinforced (dependency and constituency parsing) or preserved (semantics related tasks) in different ways along the fine tuning process depending on the task.


Dynamic Prioritization for Conflict Free Path Planning of Multi Robot Systems. Planning collision free paths for multi robot systems (MRS) is a challenging problem because of the safety and efficiency constraints required for real world solutions. Even though coupled path planning approaches provide optimal collision free paths for each agent of the MRS, they search the composite space of all the agents and therefore, suffer from exponential increase in computation with the number of robots. On the other hand, prioritized approaches provide a practical solution to applications with large number of robots, especially when path computation time and collision avoidance take precedence over guaranteed globally optimal solution. While most centrally planned algorithms use static prioritization, a dynamic prioritization algorithm, PD , is proposed that employs a novel metric, called freedom index, to decide the priority order of the robots at each time step. This allows the PD algorithm to simultaneously plan the next step for all robots while ensuring collision free operation in obstacle ridden environments. Extensive simulations were performed to test and compare the performance of the proposed PD scheme with other state of the art algorithms. It was found that PD improves upon the computational time by 25 while providing solutions of similar path lengths. Increase in efficiency was particularly prominent in scenarios with large number of robots and or higher obstacle densities, where the probability of collisions is higher, suggesting the suitability of PD in solving such problems.


One Point Gradient Free Methods for Composite Optimization with Applications to Distributed Optimization. This work is devoted to solving the composite optimization problem with the mixture oracle for the smooth part of the problem, we have access to the gradient, and for the non smooth part, only to the one point zero order oracle. For such a setup, we present a new method based on the sliding algorithm. Our method allows to separate the oracle complexities and compute the gradient for one of the function as rarely as possible. The paper also present the applicability of our new method to the problems of distributed optimization and federated learning. Experimental results confirm the theory.


Biquaternion Z Transform. In this work, the biquaternion Z transformation method is proposed to solve a class of biquaternion recurrence relations. Biqueternion Z transform is an natural extension of the complex Z transform. In the design process, special norm presentation is employed to analyze the region of convergence of the biquaternion geometry sequence. In addition, some useful properties have been given. It is shown that the proposed properties is helpful to understand the biquaternion Z transform. Finally, several examples have been given to illustrate the effectiveness of the proposed design method.


Hybrid Bayesian network discovery with latent variables by scoring multiple interventions. In Bayesian Networks (BNs), the direction of edges is crucial for causal reasoning and inference. However, Markov equivalence class considerations mean it is not always possible to establish edge orientations, which is why many BN structure learning algorithms cannot orientate all edges from purely observational data. Moreover, latent confounders can lead to false positive edges. Relatively few methods have been proposed to address these issues. In this work, we present the hybrid mFGS BS (majority rule and Fast Greedy equivalence Search with Bayesian Scoring) algorithm for structure learning from discrete data that involves an observational data set and one or more interventional data sets. The algorithm assumes causal insufficiency in the presence of latent variables and produces a Partial Ancestral Graph (PAG). Structure learning relies on a hybrid approach and a novel Bayesian scoring paradigm that calculates the posterior probability of each directed edge being added to the learnt graph. Experimental results based on well known networks of up to 109 variables and 10k sample size show that mFGS BS improves structure learning accuracy relative to the state of the art and it is computationally efficient.


Dual Encoding U Net for Spatio Temporal Domain Shift Frame Prediction. The landscape of city wide mobility behaviour has altered significantly over the past 18 months. The ability to make accurate and reliable predictions on such behaviour has likewise changed drastically with COVID 19 measures impacting how populations across the world interact with the different facets of mobility. This raises the question "How does one use an abundance of pre covid mobility data to make predictions on future behaviour in a present post covid environment?" This paper seeks to address this question by introducing an approach for traffic frame prediction using a lightweight Dual Encoding U Net built using only 12 Convolutional layers that incorporates a novel approach to skip connections between Convolutional LSTM layers. This approach combined with an intuitive handling of training data can model both a temporal and spatio temporal domain shift (gitlab.com alchera alchera traffic4cast 2021).