Scale dependent inclination angle of turbulent structures in stratified atmospheric surface layers. A large scale spanwise and wall normal array of sonic anemometers in the atmospheric surface layer is used to acquire all three components of instantaneous fluctuating velocity as well as temperature in a range of stability conditions. These data permit investigation of the three dimensional statistical structure of turbulence structures. The present work extends the view of a self similar range of wall attached turbulence structures to the atmospheric surface layer under unstable and near neutral stability conditions, and includes the statistical structure in both the wall normal and spanwise directions in relation to the streamwise wavelength. Results suggest that the self similar wall attached structures have similar aspect ratios between streamwise wall normal scales and streamwise spanwise scales such that lambda x Delta z lambda x Delta y approx 1 for both near neutral and unstable conditions. By analysing the phase shift between synchronized measurements, in the spectral domain, it is quantified how the structure inclination angle varies with stability. Under the most unstable conditions, coherent structures of lambda x delta 1 are inclined at angles as high as 65 circ relative to the solid boundary, while larger scales of lambda x delta 6 exhibit inclination angles of approximately 35 circ . For near neutral stability conditions, the angle tends towards 12 circ for all scales. It is noted that in the near neutral condition, the structure inclination angle and the aspect ratio and thus the statistical modeling of coherent structures in the ASL are highly sensitive to the value of the stability parameter.


Quotients, inductive types, and quotient inductive types. This paper introduces an expressive class of indexed quotient inductive types, called QWI types, within the framework of constructive type theory. They are initial algebras for indexed families of equational theories with possibly infinitary operators and equations. We prove that QWI types can be derived from quotient types and inductive types in the type theory of toposes with natural number object and universes, provided those universes satisfy the Weakly Initial Set of Covers (WISC) axiom. We do so by constructing QWI types as colimits of a family of approximations to them defined by well founded recursion over a suitable notion of size, whose definition involves the WISC axiom. We developed the proof and checked it using the Agda theorem prover.


Metric Spaces Are Universal for Bi interpretation with Metric Structures. In the context of metric structures introduced by Ben Yaacov, Berenstein, Henson, and Usvyatsov, we exhibit an explicit encoding of metric structures in countable signatures as pure metric spaces in the empty signature, showing that such structures are universal for bi interpretation among metric structures with positive diameter. This is analogous to the classical encoding of arbitrary discrete structures in finite signatures as graphs, but is stronger in certain ways and weaker in others. There are also certain fine grained topological concerns with no analog in the discrete setting.


Partial sums of Horadam sequences sum free representations via generating functions. Horadam sequences and their partial sums are computed via generating functions. The results are as simple as possible.


On the (In)Feasibility of Attribute Inference Attacks on Machine Learning Models. With an increase in low cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak information about records in the training dataset via membership inference attacks. In this paper, we take a closer look at another inference attack reported in literature, called attribute inference, whereby an attacker tries to infer missing attributes of a partially known record used in the training dataset by accessing the machine learning model as an API. We show that even if a classification model succumbs to membership inference attacks, it is unlikely to be susceptible to attribute inference attacks. We demonstrate that this is because membership inference attacks fail to distinguish a member from a nearby non member. We call the ability of an attacker to distinguish the two (similar) vectors as strong membership inference. We show that membership inference attacks cannot infer membership in this strong setting, and hence inferring attributes is infeasible. However, under a relaxed notion of attribute inference, called approximate attribute inference, we show that it is possible to infer attributes close to the true attributes. We verify our results on three publicly available datasets, five membership, and three attribute inference attacks reported in literature.


Niching Diversity Estimation for Multi modal Multi objective Optimization. Niching is an important and widely used technique in evolutionary multi objective optimization. Its applications mainly focus on maintaining diversity and avoiding early convergence to local optimum. Recently, a special class of multi objective optimization problems, namely, multi modal multi objective optimization problems (MMOPs), started to receive increasing attention. In MMOPs, a solution in the objective space may have multiple inverse images in the decision space, which are termed as equivalent solutions. Since equivalent solutions are overlapping (i.e., occupying the same position) in the objective space, standard diversity estimators such as crowding distance are likely to select one of them and discard the others, which may cause diversity loss in the decision space. In this study, a general niching mechanism is proposed to make standard diversity estimators more efficient when handling MMOPs. In our experiments, we integrate our proposed niching diversity estimation method into SPEA2 and NSGA II and evaluate their performance on several MMOPs. Experimental results show that the proposed niching mechanism notably enhances the performance of SPEA2 and NSGA II on various MMOPs.


Machine Learning for Genomic Data. This report explores the application of machine learning techniques on short timeseries gene expression data. Although standard machine learning algorithms work well on longer time series', they often fail to find meaningful insights from fewer timepoints. In this report, we explore model based clustering techniques. We combine popular unsupervised learning techniques like K Means, Gaussian Mixture Models, Bayesian Networks, Hidden Markov Models with the well known Expectation Maximization algorithm. K Means and Gaussian Mixture Models are fairly standard, while Hidden Markov Model and Bayesian Networks clustering are more novel ideas that suit time series gene expression data.


On singular log Calabi Yau compactifications of Landau Ginzburg models. We consider the procedure that constructs log Calabi Yau compactifications of weak Landau Ginzburg models of Fano varieties. We apply it for del Pezzo surfaces and coverings of projective spaces of index one. For the coverings of degree greater then 2 the log Calabi Yau compactification is singular moreover, no smooth projective log Calabi Yau compactification exists. We also prove in the cases under consideration the conjecture saying that the number of components of the fiber over infinity and of finite fibers is equal to the dimension of an anticanonical system of the Fano variety.


Directed Network Laplacians and Random Graph Models. We consider spectral methods that uncover hidden structures in directed networks. We establish and exploit connections between node reordering via (a) minimizing an objective function and (b) maximizing the likelihood of a random graph model. We focus on two existing spectral approaches that build and analyse Laplacian style matrices via the minimization of frustration and trophic incoherence. These algorithms aim to reveal directed periodic and linear hierarchies, respectively. We show that reordering nodes using the two algorithms, or mapping them onto a specified lattice, is associated with new classes of directed random graph models. Using this random graph setting, we are able to compare the two algorithms on a given network and quantify which structure is more likely to be present. We illustrate the approach on synthetic and real networks, and discuss practical implementation issues.


Disentanglement by Cyclic Reconstruction. Deep neural networks have demonstrated their ability to automatically extract meaningful features from data. However, in supervised learning, information specific to the dataset used for training, but irrelevant to the task at hand, may remain encoded in the extracted representations. This remaining information introduces a domain specific bias, weakening the generalization performance. In this work, we propose splitting the information into a task related representation and its complementary context representation. We propose an original method, combining adversarial feature predictors and cyclic reconstruction, to disentangle these two representations in the single domain supervised case. We then adapt this method to the unsupervised domain adaptation problem, consisting of training a model capable of performing on both a source and a target domain. In particular, our method promotes disentanglement in the target domain, despite the absence of training labels. This enables the isolation of task specific information from both domains and a projection into a common representation. The task specific representation allows efficient transfer of knowledge acquired from the source domain to the target domain. In the single domain case, we demonstrate the quality of our representations on information retrieval tasks and the generalization benefits induced by sharpened task specific representations. We then validate the proposed method on several classical domain adaptation benchmarks and illustrate the benefits of disentanglement for domain adaptation.


Amplified steady state bifurcations in feedforward networks. We investigate bifurcations in feedforward coupled cell networks. Feedforward structure (the absence of feedback) can be defined by a partial order on the cells. We use this property to study generic one parameter steady state bifurcations for such networks. Branching solutions and their asymptotics are described in terms of Taylor coefficients of the internal dynamics. They can be determined via an algorithm that only exploits the network structure. Similar to previous results on feedforward chains, we observe amplifications of the growth rates of steady state branches induced by the feedforward structure. However, contrary to these earlier results, as the interaction scenarios can be more complicated in general feedforward networks, different branching patterns and different amplifications can occur for different regions in the space of Taylor coefficients.


Learning to Ask Conversational Questions by Optimizing Levenshtein Distance. Conversational Question Simplification (CQS) aims to simplify self contained questions into conversational ones by incorporating some conversational characteristics, e.g., anaphora and ellipsis. Existing maximum likelihood estimation (MLE) based methods often get trapped in easily learned tokens as all tokens are treated equally during training. In this work, we introduce a Reinforcement Iterative Sequence Editing (RISE) framework that optimizes the minimum Levenshtein distance (MLD) through explicit editing actions. RISE is able to pay attention to tokens that are related to conversational characteristics. To train RISE, we devise an Iterative Reinforce Training (IRT) algorithm with a Dynamic Programming based Sampling (DPS) process to improve exploration. Experimental results on two benchmark datasets show that RISE significantly outperforms state of the art methods and generalizes well on unseen data.


A Survey on Personality Aware Recommendation Systems. With the emergence of personality computing as a new research field related to artificial intelligence and personality psychology, we have witnessed an unprecedented proliferation of personality aware recommendation systems. Unlike conventional recommendation systems, these new systems solve traditional problems such as the cold start and data sparsity problems. This survey aims to study and systematically classify personality aware recommendation systems. To the best of our knowledge, this survey is the first that focuses on personality aware recommendation systems. We explore the different design choices of personality aware recommendation systems, by comparing their personality modeling methods, as well as their recommendation techniques. Furthermore, we present the commonly used datasets and point out some of the challenges of personality aware recommendation systems.


Lifting methods in mass partition problems. Many results in mass partitions are proved by lifting mathbb R d to a higher dimensional space and dividing the higher dimensional space into pieces. We extend such methods to use lifting arguments to polyhedral surfaces. Among other results, we prove the existence of equipartitions of d 1 measures in mathbb R d by parallel hyperplanes and of d 2 measures in mathbb R d by concentric spheres. For measures whose supports are sufficiently well separated, we prove results where one can cut a fixed (possibly different) fraction of each measure either by parallel hyperplanes, concentric spheres, convex polyhedral surfaces of few facets, or convex polytopes with few vertices.


Meta Back translation. Back translation is an effective strategy to improve the performance of Neural Machine Translation (NMT) by generating pseudo parallel data. However, several recent works have found that better translation quality of the pseudo parallel data does not necessarily lead to better final translation models, while lower quality but more diverse data often yields stronger results. In this paper, we propose a novel method to generate pseudo parallel data from a pre trained back translation model. Our method is a meta learning algorithm which adapts a pre trained back translation model so that the pseudo parallel data it generates would train a forward translation model to do well on a validation set. In our evaluations in both the standard datasets WMT En De'14 and WMT En Fr'14, as well as a multilingual translation setting, our method leads to significant improvements over strong baselines. Our code will be made available.


Continual Learning of Knowledge Graph Embeddings. In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown concepts, these representations typically assume that all concepts are known a priori, and incorporating new information requires all concepts to be learned afresh. Our work relaxes this limiting assumption of existing representations and tackles the incremental knowledge graph embedding problem by leveraging the principles of a range of continual learning methods. Through an experimental evaluation with several knowledge graphs and embedding representations, we provide insights about trade offs for practitioners to match a semantics driven robotics applications to a suitable continual knowledge graph embedding method.


What's in your Head? Emergent Behaviour in Multi Task Transformer Models. The primary paradigm for multi task training in natural language processing is to represent the input with a shared pre trained language model, and add a small, thin network (head) per task. Given an input, a target head is the head that is selected for outputting the final prediction. In this work, we examine the behaviour of non target heads, that is, the output of heads when given input that belongs to a different task than the one they were trained for. We find that non target heads exhibit emergent behaviour, which may either explain the target task, or generalize beyond their original task. For example, in a numerical reasoning task, a span extraction head extracts from the input the arguments to a computation that results in a number generated by a target generative head. In addition, a summarization head that is trained with a target question answering head, outputs query based summaries when given a question and a context from which the answer is to be extracted. This emergent behaviour suggests that multi task training leads to non trivial extrapolation of skills, which can be harnessed for interpretability and generalization.


Model Based Reliability and Safety Reducing the Complexity of Safety Analyses Using Component Fault Trees. The importance of mission or safety critical software systems in many application domains of embedded systems is continuously growing, and so is the effort and complexity for reliability and safety analysis. Model driven development is currently one of the key approaches to cope with increasing development complexity, in general. Applying similar concepts to reliability, availability, maintainability and safety (RAMS) analysis activities is a promising approach to extend the advantages of model driven development to safety engineering activities aiming at a reduction of development costs, a higher product quality and a shorter time to market. Nevertheless, many model based safety or reliability engineering approaches aim at reducing the analysis complexity but applications or case studies are rare. Therefore we present here a large scale industrial case study which shows the benefits of the application of component fault trees when it comes to complex safety mechanisms. We compare the methodology of component fault trees against classic fault trees and summarize benefits and drawbacks of both modeling methodologies.


About the value of the two dimensional Levy's constant. We give a numerical approximation of the L 'evy constant on the growth of the denominators of the best Diophantine approximations in dimension 2 with respect to the euclidean norm. This constant is expressed as an integral on a surface of dimension 7. We reduce the computation of this integral to a triple integral, whose numerical evaluation was carried out in cite Xieu .


On Baker Gill Solovay Oracle Turing Machines and Relativization Barrier. This work analysis the so called "Relativization Barrier" with respect to Baker Gill Solovay oracle Turing machine. We show that the it diagonalization technique is a valid mathematical proof technique, but it has some prerequisites when referring to "Relativization barrier".


Emoji aware Co attention Network with EmoGraph2vec Model for Sentiment Anaylsis. In social media platforms, emojis have an extremely high occurrence in computer mediated communications. Many emojis are used to strengthen the emotional expressions and the emojis that co occurs in a sentence also have a strong sentiment connection. However, when it comes to emoji representation learning, most studies have only utilized the fixed descriptions provided by the Unicode Consortium, without consideration of actual usage scenario. As for the sentiment analysis task, many researchers ignore the emotional impact of the interaction between text and emojis. It results that the emotional semantics of emojis cannot be fully explored. In this work, we propose a method to learn emoji representations called EmoGraph2vec and design an emoji aware co attention network that learns the mutual emotional semantics between text and emojis on short texts of social media. In EmoGraph2vec, we form an emoji co occurrence network on real social data and enrich the semantic information based on an external knowledge base EmojiNet to obtain emoji node embeddings. Our model designs a co attention mechanism to incorporate the text and emojis, and integrates a squeeze and excitation (SE) block into a convolutional neural network as a classifier. Finally, we use the transfer learning method to increase converge speed and achieve higher accuracy. Experimental results show that the proposed model can outperform several baselines for sentiment analysis on benchmark datasets. Additionally, we conduct a series of ablation and comparison experiments to investigate the effectiveness of our model.


QAFactEval Improved QA Based Factual Consistency Evaluation for Summarization. Factual consistency is an essential quality of text summarization models in practical settings. Existing work in evaluating this dimension can be broadly categorized into two lines of research, entailment based and question answering (QA) based metrics, and different experimental setups often lead to contrasting conclusions as to which paradigm performs the best. In this work, we conduct an extensive comparison of entailment and QA based metrics, demonstrating that carefully choosing the components of a QA based metric, especially question generation and answerability classification, is critical to performance. Building on those insights, we propose an optimized metric, which we call QAFactEval, that leads to a 14 average improvement over previous QA based metrics on the SummaC factual consistency benchmark, and also outperforms the best performing entailment based metric. Moreover, we find that QA based and entailment based metrics can offer complementary signals and be combined into a single metric for a further performance boost.


Arbitrarily Precise Quantum Alchemy. Doping compounds can be considered a perturbation to the nuclear charges in a molecular Hamiltonian. Expansions of this perturbation in a Taylor series, i.e. quantum alchemy, has been used in literature to assess millions of derivative compounds at once rather than enumerating them in costly quantum chemistry calculations. So far, it was unclear whether this series even converges for small molecules, whether it can be used for geometry relaxation and how strong this perturbation may be to still obtain convergent numbers. This work provides numerical evidence that this expansion converges and recovers the self consistent energy of Hartree Fock calculations. The convergence radius of this expansion is quantified for dimer examples and systematically evaluated for different basis sets, allowing for estimates of the chemical space that can be covered by perturbing one reference calculation alone. Besides electronic energy, convergence is shown for density matrix elements, molecular orbital energies, and density profiles, even for large changes in electronic structure, e.g. transforming He 3 into H 6 . Subsequently, mixed alchemical and spatial derivatives are used to relax H 2 from the electronic structure of He alone, highlighting a path to spatially relaxed quantum alchemy. Finally, the underlying code (APHF) which allows for arbitrary precision evaluation of restricted Hartree Fock energies and arbitrary order derivatives is made available to support future method development.


Adversarial Training for Face Recognition Systems using Contrastive Adversarial Learning and Triplet Loss Fine tuning. Though much work has been done in the domain of improving the adversarial robustness of facial recognition systems, a surprisingly small percentage of it has focused on self supervised approaches. In this work, we present an approach that combines Ad versarial Pre Training with Triplet Loss AdversarialFine Tuning. We compare our methods with the pre trained ResNet50 model that forms the backbone of FaceNet, finetuned on our CelebA dataset. Through comparing adversarial robustness achieved without adversarial training, with triplet loss adversarial training, and our contrastive pre training combined with triplet loss adversarial fine tuning, we find that our method achieves comparable results with far fewer epochs re quired during fine tuning. This seems promising, increasing the training time for fine tuning should yield even better results. In addition to this, a modified semi supervised experiment was conducted, which demonstrated the improvement of contrastive adversarial training with the introduction of small amounts of labels.


Parallel Peeling of Bipartite Networks for Hierarchical Dense Subgraph Discovery. Wing and Tip decomposition construct a hierarchy of butterfly dense edge and vertex induced bipartite subgraphs, respectively. They have applications in several domains including e commerce, recommendation systems and document analysis. Existing decomposition algorithms use a bottom up approach that constructs the hierarchy in an increasing order of subgraph density. They iteratively peel the entities with minimum butterfly count i.e. remove them from the graph and update the butterfly count of other entities. However, the amount of butterflies in large bipartite graphs makes bottom up peeling computationally demanding. Furthermore, the strict order of peeling entities results in a numerous sequentially dependent iterations, which makes parallelization challenging. In this paper, we propose a novel Parallel Bipartite Network peelinG (PBNG) framework which adopts a two phased peeling approach to relax the order of peeling, and in turn, reduce synchronization. The first phase divides the decomposition hierarchy into several partitions using very few peeling iterations. The second phase concurrently processes these partitions to generate the final hierarchy, and requires no global synchronization. The two phased peeling further enables batching optimizations that dramatically improve the computational efficiency. We empirically evaluate PBNG using several real world bipartite graphs. Compared to the state of the art frameworks and decomposition algorithms, PBNG achieves up to four orders of magnitude reduction in synchronization and two orders of magnitude speedup, respectively. We also present the first decomposition results of some of the largest public real world datasets, which PBNG can peel in few minutes but existing algorithms fail to process even in several days.


Determining when an algebra is an evolution algebra. Evolution algebras are non associative algebras that describe non Mendelian hereditary processes and have connections with many other areas. In this paper we obtain necessary and sufficient conditions for a given algebra A to be an evolution algebra. We prove that the problem is equivalent to the so called SDC problem , that is, the simultaneous diagonalisation via congruence of a given set of matrices. More precisely we show that an n dimensional algebra A is an evolution algebra if, and only if, a certain set of n symmetric n times n matrices M 1 , ldots, M n describing the product of A are SDC . We apply this characterisation to show that while certain classical genetic algebras (representing Mendelian and auto tetraploid inheritance) are not themselves evolution algebras, arbitrarily small perturbations of these are evolution algebras. This is intriguing as evolution algebras model asexual reproduction unlike the classical ones.


EditVAE Unsupervised Part Aware Controllable 3D Point Cloud Shape Generation. This paper tackles the problem of parts aware point cloud generation. Unlike existing works which require the point cloud to be segmented into parts a priori, our parts aware editing and generation are performed in an unsupervised manner. We achieve this with a simple modification of the Variational Auto Encoder which yields a joint model of the point cloud itself along with a schematic representation of it as a combination of shape primitives. In particular, we introduce a latent representation of the point cloud which can be decomposed into a disentangled representation for each part of the shape. These parts are in turn disentangled into both a shape primitive and a point cloud representation, along with a standardising transformation to a canonical coordinate system. The dependencies between our standardising transformations preserve the spatial dependencies between the parts in a manner that allows meaningful parts aware point cloud generation and shape editing. In addition to the flexibility afforded by our disentangled representation, the inductive bias introduced by our joint modeling approach yields state of the art experimental results on the ShapeNet dataset.


Stereo Matching by Self supervision of Multiscopic Vision. Self supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground truth depth, online fine tuning, and better generalization with unlimited data attract researchers to seek self supervised solutions. In this work, we propose a new self supervised framework for stereo matching utilizing multiple images captured at aligned camera positions. A cross photometric loss, an uncertainty aware mutual supervision loss, and a new smoothness loss are introduced to optimize the network in learning disparity maps end to end without ground truth depth information. To train this framework, we build a new multiscopic dataset consisting of synthetic images rendered by 3D engines and real images captured by real cameras. After being trained with only the synthetic images, our network can perform well in unseen outdoor scenes. Our experiment shows that our model obtains better disparity maps than previous unsupervised methods on the KITTI dataset and is comparable to supervised methods when generalized to unseen data. Our source code and dataset are available at https sites.google.com view multiscopic.


On Off Center Surround Receptive Fields for Accurate and Robust Image Classification. Robustness to variations in lighting conditions is a key objective for any deep vision system. To this end, our paper extends the receptive field of convolutional neural networks with two residual components, ubiquitous in the visual processing system of vertebrates On center and off center pathways, with excitatory center and inhibitory surround OOCS for short. The on center pathway is excited by the presence of a light stimulus in its center but not in its surround, whereas the off center one is excited by the absence of a light stimulus in its center but not in its surround. We design OOCS pathways via a difference of Gaussians, with their variance computed analytically from the size of the receptive fields. OOCS pathways complement each other in their response to light stimuli, ensuring this way a strong edge detection capability, and as a result, an accurate and robust inference under challenging lighting conditions. We provide extensive empirical evidence showing that networks supplied with the OOCS edge representation gain accuracy and illumination robustness compared to standard deep models.


My Boss the Computer A Bayesian analysis of socio demographic and cross cultural determinants of attitude toward the Non Human Resource Management. Human resource management technologies have moved from biometric surveillance to emotional artificial intelligence (AI) that monitor employees' engagement and productivity, analyze video interviews and CVs of job applicants. The rise of the US 20 billion emotional AI industry will transform the future workplace. Yet, besides no international consensus on the principles or standards for such technologies, there is a lack of cross cultural research on future job seekers' attitude toward such use of AI technologies. This study collects a cross sectional dataset of 1,015 survey responses of international students from 48 countries and 8 regions worldwide. A majority of the respondents (52 ) are concerned about being managed by AI. Following the hypothetico deductivist philosophy of science, we use the MCMC Hamiltonian approach and conduct a detailed comparison of 10 Bayesian network models with the PSIS LOO method. We consistently find having a higher income, being male, majoring in business, and or self rated familiarity with AI correlate with a more positive view of emotional AI in the workplace. There is also a stark cross cultural and cross regional difference. Our analysis shows people from economically less developed regions (Africa, Oceania, Central Asia) tend to exhibit less concern for AI managers. And for East Asian countries, 64 of the Japanese, 56 of the South Korean, and 42 of the Chinese professed the trusting attitude. In contrast, an overwhelming majority of 75 of the European and Northern American possesses the worrying neutral attitude toward being managed by AI. Regarding religion, Muslim students correlate with the most concern toward emotional AI in the workplace. When religiosity is higher, the correlation becomes stronger for Muslim and Buddhist students.


gradSim Differentiable simulation for system identification and visuomotor control. We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill posed due to the loss of information during image formation. Current solutions require precise 3D labels which are labor intensive to gather, and infeasible to create for many systems such as deformable solids or cloth. We present gradSim, a framework that overcomes the dependence on 3D supervision by leveraging differentiable multiphysics simulation and differentiable rendering to jointly model the evolution of scene dynamics and image formation. This novel combination enables backpropagation from pixels in a video sequence through to the underlying physical attributes that generated them. Moreover, our unified computation graph spanning from the dynamics and through the rendering process enables learning in challenging visuomotor control tasks, without relying on state based (3D) supervision, while obtaining performance competitive to or better than techniques that rely on precise 3D labels.


Learning of Visual Relations The Devil is in the Tails. Significant effort has been recently devoted to modeling visual relations. This has mostly addressed the design of architectures, typically by adding parameters and increasing model complexity. However, visual relation learning is a long tailed problem, due to the combinatorial nature of joint reasoning about groups of objects. Increasing model complexity is, in general, ill suited for long tailed problems due to their tendency to overfit. In this paper, we explore an alternative hypothesis, denoted the Devil is in the Tails. Under this hypothesis, better performance is achieved by keeping the model simple but improving its ability to cope with long tailed distributions. To test this hypothesis, we devise a new approach for training visual relationships models, which is inspired by state of the art long tailed recognition literature. This is based on an iterative decoupled training scheme, denoted Decoupled Training for Devil in the Tails (DT2). DT2 employs a novel sampling approach, Alternating Class Balanced Sampling (ACBS), to capture the interplay between the long tailed entity and predicate distributions of visual relations. Results show that, with an extremely simple architecture, DT2 ACBS significantly outperforms much more complex state of the art methods on scene graph generation tasks. This suggests that the development of sophisticated models must be considered in tandem with the long tailed nature of the problem.


Enhanced laser driven proton acceleration via improved fast electron heating in a controlled pre plasma. The interaction of ultraintense laser pulses with solids is largely affected by the plasma gradient at the vacuum solid interface, which modifies the absorption and ultimately, controls the energy distribution function of heated electrons. A micrometer scale length plasma has been predicted to yield a significant enhancement of the energy and weight of the fast electron population and to play a major role in laser driven proton acceleration with thin foils. We report on recent experimental results on proton acceleration from laser interaction with foil targets at ultra relativistic intensities. We show a three fold increase of the proton cut off energy when a micrometer scale length pre plasma is introduced by irradiation with a low energy femtosecond pre pulse. Our realistic numerical simulations agree with the observed gain of the proton cut off energy and confirm the role of stochastic heating of fast electrons in the enhancement of the accelerating sheath field.


Randomness is inherently imprecise. We use the martingale theoretic approach of game theoretic probability to incorporate imprecision into the study of randomness. In particular, we define several notions of randomness associated with interval, rather than precise, forecasting systems, and study their properties. The richer mathematical structure that thus arises lets us, amongst other things, better understand and place existing results for the precise limit. When we focus on constant interval forecasts, we find that every sequence of binary outcomes has an associated filter of intervals it is random for. It may happen that none of these intervals is precise a single real number which justifies the title of this paper. We illustrate this by showing that randomness associated with non stationary precise forecasting systems can be captured by a constant interval forecast, which must then be less precise a gain in model simplicity is thus paid for by a loss in precision. But imprecise randomness can't always be explained away as a result of oversimplification we show that there are sequences that are random for a constant interval forecast, but never random for any comp (more) precise forecasting system. We also show that the set of sequences that are random for a non vacuous interval forecasting system is meagre, as it is for precise forecasting systems.


Metro stations as crowd shipping catalysts an empirical and computational study. Crowd shipping is a promising shared mobility service that involves the delivery of goods using non professional shippers. This service is mainly intended to reduce congestion and pollution in city centers but, as some authors observe, in most crowd shipping initiatives the crowd rely on private motorized vehicles and hence the environmental benefits could be small, if not negative. Conversely, a crowd shipping service relying on public transport should maximize the environmental benefits. Motivated by this observation, in this study we assess the potentials of crowd shipping based on metro commuters in the city of Brescia, Italy. Our contribution is twofold. First, we analyze the results of a survey conducted among metro users to assess their willingness to act as crowd shippers. The main result is that most young commuters and retirees are willing to be crowd shippers even for a null reward. Second, we assess the potential economic impact of using metro based crowd shipping coupled with a traditional home delivery service. To this end, we formulate a variant of the VRP model where the customers closest to the metro stations may be served either by a conventional vehicle or by a crowd shipper. The model is implemented using Python with Gurobi solver. A computational study based on the Brescia case is performed to get insights on the economic advantages that a metro based crowd delivery option may have for a retailing company.


Towards Robust Visual Information Extraction in Real World New Dataset and Novel Solution. Visual information extraction (VIE) has attracted considerable attention recently owing to its various advanced applications such as document understanding, automatic marking and intelligent education. Most existing works decoupled this problem into several independent sub tasks of text spotting (text detection and recognition) and information extraction, which completely ignored the high correlation among them during optimization. In this paper, we propose a robust visual information extraction system (VIES) towards real world scenarios, which is a unified end to end trainable framework for simultaneous text detection, recognition and information extraction by taking a single document image as input and outputting the structured information. Specifically, the information extraction branch collects abundant visual and semantic representations from text spotting for multimodal feature fusion and conversely, provides higher level semantic clues to contribute to the optimization of text spotting. Moreover, regarding the shortage of public benchmarks, we construct a fully annotated dataset called EPHOIE (https github.com HCIILAB EPHOIE), which is the first Chinese benchmark for both text spotting and visual information extraction. EPHOIE consists of 1,494 images of examination paper head with complex layouts and background, including a total of 15,771 Chinese handwritten or printed text instances. Compared with the state of the art methods, our VIES shows significant superior performance on the EPHOIE dataset and achieves a 9.01 F score gain on the widely used SROIE dataset under the end to end scenario.


On some restricted inequalities for the iterated Hardy type operator involving suprema and their applications. In this paper we characterize the inequality begin equation bigg( int 0 infty bigg( int 0 x big T u,b f (t) big r ,dt bigg) frac q r w(x) ,dx bigg) frac 1 q le C , bigg( int 0 infty bigg( int 0 x f ( tau) p ,d tau bigg) frac m p v(x) ,dx bigg) frac 1 m end equation for 1 m p le r q infty or 1 m le r min p,q infty , where w and v are weight functions on (0, infty) . The inequality is required to hold with some positive constant C for all measurable functions defined on measure space ( mathbb R n,dx) . Here f is the non increasing rearrangement of a measurable function f defined on mathbb R n and T u,b is the iterated Hardy type operator involving suprema, whish is defined for a measurable non negative function f on (0, infty) by (T u,b g)(t) sup t le tau infty frac u( tau) B( tau) int 0 tau g(s)b(s) ,ds, qquad t in (0, infty), where u and b are two weight functions on (0, infty) such that u is continuous on (0, infty) and the function B(t) int 0 t b(s) ,ds satisfies 0 B(t) infty for every t in (0, infty) . At the end of the paper, as an application of obtained results, we calculate the norm of the generalized maximal operator M phi, Lambda alpha (b) , defined with 0 alpha infty and functions b, , phi (0, infty) rightarrow (0, infty) for all measurable functions f on mathbb R n by begin equation M phi, Lambda alpha (b) f(x) sup Q ni x frac f chi Q Lambda alpha (b) phi ( Q ) , qquad x in mathbb R n, end equation from operatorname G Gamma (p 1,m 1,v) into operatorname G Gamma (p 2,m 2,w) . Here Lambda alpha (b) and operatorname G Gamma (p,m,w) are the classical and generalized Lorentz spaces, respectively.


On the Besicovitch Stability of Noisy Random Tilings. In this paper, we introduce a noisy framework for SFTs, allowing some amount of forbidden patterns to appear. Using the Besicovitch distance, which permits a global comparison of configurations, we then study the closeness of noisy measures to non noisy ones as the amount of noise goes to 0. Our first main result is the full classification of the (in)stability in the one dimensional case. Our second main result is a stability property under Bernoulli noise for higher dimensional periodic SFTs, which we finally extend to an aperiodic example through a variant of the Robinson tiling.


Diophantine analysis of the expansions of a fixed point under continuum many bases. In this paper, we study the Diophantine properties of the orbits of a fixed point in its expansions under continuum many bases. More precisely, let T beta be the beta transformation with base beta 1 , x n n geq 1 be a sequence of real numbers in 0,1 and varphi colon mathbb N rightarrow (0,1 be a positive function. With a detailed analysis on the distribution of em full cylinders in the base space beta 1 , it is shown that for any given x in(0,1 , for almost all or almost no bases beta 1 , the orbit of x under T beta can varphi well approximate the sequence x n n geq 1 according to the divergence or convergence of the series sum varphi(n) . This strengthens Schmeling's result significantly and complete all known results in this aspect. Moreover, the idea presented here can also be used to determine the Lebesgue measure of the set begin equation x in 0,1 colon T n beta x L(x) varphi(n) text for infinitely many n in mathbb N , end equation for a fixed base beta 1 , where L colon 0,1 rightarrow 0,1 is a Lipschitz function.


Shape Control of Deformable Linear Objects with Offline and Online Learning of Local Linear Deformation Models. The shape control of deformable linear objects (DLOs) is challenging, since it is difficult to obtain the deformation models. Previous studies often approximate the models in purely offline or online ways. In this paper, we propose a scheme for the shape control of DLOs, where the unknown model is estimated with both offline and online learning. The model is formulated in a local linear format, and approximated by a neural network (NN). First, the NN is trained offline to provide a good initial estimation of the model, which can directly migrate to the online phase. Then, an adaptive controller is proposed to achieve the shape control tasks, in which the NN is further updated online to compensate for any errors in the offline model caused by insufficient training or changes of DLO properties. The simulation and real world experiments show that the proposed method can precisely and efficiently accomplish the DLO shape control tasks, and adapt well to new and untrained DLOs.


Paving the Way for Distributed Artificial Intelligence over the Air. Distributed Artificial Intelligence (DAI) is regarded as one of the most promising techniques to provide intelligent services under strict privacy protection regulations for multiple clients. By applying DAI, training on raw data is carried out locally, while the trained outputs, e.g., model parameters, from multiple local clients, are sent back to a central server for aggregation. Recently, for achieving better practicality, DAI is studied in conjunction with wireless communication networks, incorporating various random effects brought by wireless channels. However, because of the complex and case dependent nature of wireless channels, a generic simulator for applying DAI in wireless communication networks is still lacking. To accelerate the development of DAI applied in wireless communication networks, we propose a generic system design in this paper as well as an associated simulator that can be set according to wireless channels and system level configurations. Details of the system design and analysis of the impacts of wireless environments are provided to facilitate further implementations and updates. We employ a series of experiments to verify the effectiveness and efficiency of the proposed system design and reveal its superior scalability.


Constructing C diagonals in AH algebras. We construct Cartan subalgebras and hence groupoid models for classes of AH algebras. Our results cover all AH algebras whose building blocks have base spaces of dimension at most one as well as Villadsen algebras, and thus go beyond classifiable simple C algebras.


A novel crossed molecular beam experiment for investigating reactions of state and conformationally selected strong field seeking molecules. The structure and quantum state of the reactants have a profound impact on the kinetics and dynamics of chemical reactions. Over the past years, significant advances have been made in the control and manipulation of molecules with external electric and magnetic fields in molecular beam experiments for investigations of their state , structure and energy specific chemical reactivity. Whereas studies for neutrals have so far mainly focused on weak field seeking species, we report here progress towards investigating reactions of strong field seeking molecules by introducing a novel crossed molecular beam experiment featuring an electrostatic deflector. The new setup enables the characterisation of state and geometry specific effects in reactions under single collision conditions. As a proof of principle, we present results on the chemi ionisation reaction of metastable neon atoms with rotationally state selected carbonyl sulfide (OCS) molecules and show that the branching ratio between the Penning and dissociative ionisation pathways strongly depends on the initial rotational state of OCS.


Matrix power means and new characterizations of operator monotone functions. For positive definite matrices A and B , the Kubo Ando matrix power mean is defined as P mu(p, A, B) A 1 2 left( frac 1 (A 1 2 BA 1 2 ) p 2 right ) 1 p A 1 2 quad (p ge 0). In this paper, for 0 le p le 1 le q , we show that if one of the following inequalities begin align f(P mu(p, A, B)) le f(P mu(1, A, B)) le f(P mu(q, A, B)) nonumber end align holds for any positive definite matrices A and B , then the function f is operator monotone on (0, infty). We also study the inverse problem for non Kubo Ando matrix power means with the powers 1 2 and 2 . As a consequence, we establish new charaterizations of operator monotone functions with the non Kubo Ando matrix power means.


Parallel two scale finite element implementation of a system with varying microstructures. We propose a two scale finite element method designed for heterogeneous microstructures. Our approach exploits domain diffeomorphisms between the microscopic structures to gain computational efficiency. By using a conveniently constructed pullback operator, we are able to model the different microscopic domains as macroscopically dependent deformations of a reference domain. This allows for a relatively simple finite element framework to approximate the underlying PDE system with a parallel computational structure. We apply this technique to a model problem where we focus on transport in plant tissues. We illustrate the accuracy of the implementation with convergence benchmarks and show satisfactory parallelization speed ups. We further highlight the effect of the heterogeneous microscopic structure on the output of the two scale systems. Our implementation (publicly available on GitHub) builds on the deal.II FEM library. Application of this technique allows for an increased capacity of microscopic detail in multiscale modeling, while keeping running costs manageable.


Learning Hyperbolic Representations of Topological Features. Learning task specific representations of persistence diagrams is an important problem in topological data analysis and machine learning. However, current state of the art methods are restricted in terms of their expressivity as they are focused on Euclidean representations. Persistence diagrams often contain features of infinite persistence (i.e., essential features) and Euclidean spaces shrink their importance relative to non essential features because they cannot assign infinite distance to finite points. To deal with this issue, we propose a method to learn representations of persistence diagrams on hyperbolic spaces, more specifically on the Poincare ball. By representing features of infinite persistence infinitesimally close to the boundary of the ball, their distance to non essential features approaches infinity, thereby their relative importance is preserved. This is achieved without utilizing extremely high values for the learnable parameters, thus the representation can be fed into downstream optimization methods and trained efficiently in an end to end fashion. We present experimental results on graph and image classification tasks and show that the performance of our method is on par with or exceeds the performance of other state of the art methods.


The intrinsic core and minimal faces of convex sets in general vector spaces. Intrinsic core generalises the finite dimensional notion of the relative interior to arbitrary (real) vector spaces. Our main goal is to provide a self contained overview of the key results pertaining to the intrinsic core and to elucidate the relations between intrinsic core and facial structure of convex sets in this general context. We gather several equivalent definitions of the intrinsic core, cover much of the folklore, review relevant recent results and present examples illustrating some of the phenomena specific to the facial structure of infinite dimensional sets.


Improving Energy Efficiency of Massive MIMO Relay Systems using Power Bisection Allocation for Cell Edge Users. This paper studies downlink energy efficiency (EE) of a cellular massive Multiple Input Multiple Output (MIMO) system with massive number of antennas at both base station (BS) and relay considering cell edge users which is less investigated in the literature. Some improving methods for base station (BS) and relay power allocation under quality of service constraints are proposed. The EE optimization problem is provided over BS and relay power variables (power dimensions). Considering the quasi concavity property of the EE function relative to each power variable, we propose to use a power bisection algorithm (PBA) in one dimension, followed by the exhaustive search in the other dimension (ODS algorithm) which is called PBODS algorithm and also a method to limit the range of power variables. The results show that the performance of the PBODS algorithm approaches the performance of optimal solution which is exhaustive search in both dimensions while it has a lower complexity. In addition to that we suggest to use the PBA in two dimensions alternatively as the sub optimal alternative optimization (AOP) algorithm. The complexity can highly be reduced using the AOP algorithm with a slight but acceptable degradation in performance which makes the algorithm much suitable for practical use.


Partial Is Better Than All Revisiting Fine tuning Strategy for Few shot Learning. The goal of few shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes through fine tuning (Here fine tuning procedure is defined as transferring knowledge from base to novel data, i.e. learning to transfer in few shot scenario.) or meta learning. However, as the base classes have no overlap to the novel set, simply transferring whole knowledge from base data is not an optimal solution since some knowledge in the base model may be biased or even harmful to the novel class. In this paper, we propose to transfer partial knowledge by freezing or fine tuning particular layer(s) in the base model. Specifically, layers will be imposed different learning rates if they are chosen to be fine tuned, to control the extent of preserved transferability. To determine which layers to be recast and what values of learning rates for them, we introduce an evolutionary search based method that is efficient to simultaneously locate the target layers and determine their individual learning rates. We conduct extensive experiments on CUB and mini ImageNet to demonstrate the effectiveness of our proposed method. It achieves the state of the art performance on both meta learning and non meta based frameworks. Furthermore, we extend our method to the conventional pre training fine tuning paradigm and obtain consistent improvement.


Learning a Large Neighborhood Search Algorithm for Mixed Integer Programs. Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current assignment. In this paper we consider a learning based LNS approach for mixed integer programs (MIPs). We train a Neural Diving model to represent a probability distribution over assignments, which, together with an off the shelf MIP solver, generates an initial assignment. Formulating the subsequent search steps as a Markov Decision Process, we train a Neural Neighborhood Selection policy to select a search neighborhood at each step, which is searched using a MIP solver to find the next assignment. The policy network is trained using imitation learning. We propose a target policy for imitation that, given enough compute resources, is guaranteed to select the neighborhood containing the optimal next assignment amongst all possible choices for the neighborhood of a specified size. Our approach matches or outperforms all the baselines on five real world MIP datasets with large scale instances from diverse applications, including two production applications at Google. It achieves 2 times to 37.8 times better average primal gap than the best baseline on three of the datasets at large running times.


Zeros of Gaussian power series, Hardy spaces and determinantal point processes. Given a sequence ( xi n) of standard i.i.d complex Gaussian random variables, Peres and Vir 'ag (in the paper Zeros of the i.i.d. Gaussian power series a conformally invariant determinantal process'' it Acta Math. (2005) 194, 1 35) discovered the striking fact that the zeros of the random power series f(z) sum n 1 infty xi n z n 1 in the complex unit disc mathbb D constitute a determinantal point process. The study of the zeros of the general random series f(z) where the restriction of independence is relaxed upon the random variables ( xi n) is an important open problem. This paper proves that if ( xi n) is an infinite sequence of complex Gaussian random variables such that their covariance matrix is invertible and its inverse is a Toeplitz matrix, then the zero set of f(z) constitutes a determinantal point process with the same distribution as the case of i.i.d variables studied by Peres and Vir 'ag. The arguments are based on some interplays between Hardy spaces and reproducing kernels. Illustrative examples are constructed from classical Toeplitz matrices and the classical fractional Gaussian noise.


High dimensional nonlinear approximation by parametric manifolds in H "older Nikol'skii spaces of mixed smoothness. We study high dimensional nonlinear approximation of functions in H "older Nikol'skii spaces H alpha infty( mathbb I d) on the unit cube mathbb I d 0,1 d having mixed smoothness, by parametric manifolds. The approximation error is measured in the L infty norm. In this context, we explicitly constructed methods of nonlinear approximation, and give dimension dependent estimates of the approximation error explicitly in dimension d and number N measuring computation complexity of the parametric manifold of approximants. For d 2 , we derived a novel right asymptotic order of noncontinuous manifold N widths of the unit ball of H alpha infty( mathbb I 2) in the space L infty( mathbb I 2) . In constructing approximation methods, the function decomposition by the tensor product Faber series and special representations of its truncations on sparse grids play a central role.


Vanishing dissipation limit to the planar rarefaction wave for the three dimensional compressible Navier Stokes Fourier equations. We study the vanishing dissipation limit of the three dimensional (3D) compressible Navier Stokes Fourier equations to the corresponding 3D full Euler equations. Our results are twofold. First, we prove that the 3D compressible Navier Stokes Fourier equations admit a family of smooth solutions that converge to the planar rarefaction wave solution of the 3D compressible Euler equations with arbitrary strength. Second, we obtain a uniform convergence rate in terms of the viscosity and heat conductivity coefficients. For this multi dimensional problem, we first need to introduce the hyperbolic wave to recover the physical dissipations of the inviscid rarefaction wave profile as in our previous work 29 on the two dimensional (2D) case. However, due to the 3D setting that makes the analysis significantly more challenging than the 2D problem, the hyperbolic scaled variables for the space and time could not be used to normalize the dissipation coefficients as in the 2D case. Instead, the analysis of the 3D case is carried out in the original non scaled variables, and consequently the dissipation terms are more singular compared with the 2D scaled case. Novel ideas and techniques are developed to establish the uniform estimates. In particular, more accurate it a priori assumptions with respect to the dissipation coefficients are crucially needed for the stability analysis, and some new observations on the cancellations of the physical structures for the flux terms are essentially used to justify the 3D limit. Moreover, we find that the decay rate with respect to the dissipation coefficients is determined by the nonlinear flux terms in the original variables for the 3D limit in this paper, but fully determined by the error terms in the scaled variables for the 2D case in 29 .


Occluded Video Instance Segmentation Dataset and ICCV 2021 Challenge. Although deep learning methods have achieved advanced video object recognition performance in recent years, perceiving heavily occluded objects in a video is still a very challenging task. To promote the development of occlusion understanding, we collect a large scale dataset called OVIS for video instance segmentation in the occluded scenario. OVIS consists of 296k high quality instance masks and 901 occluded scenes. While our human vision systems can perceive those occluded objects by contextual reasoning and association, our experiments suggest that current video understanding systems cannot. On the OVIS dataset, all baseline methods encounter a significant performance degradation of about 80 in the heavily occluded object group, which demonstrates that there is still a long way to go in understanding obscured objects and videos in a complex real world scenario. To facilitate the research on new paradigms for video understanding systems, we launched a challenge based on the OVIS dataset. The submitted top performing algorithms have achieved much higher performance than our baselines. In this paper, we will introduce the OVIS dataset and further dissect it by analyzing the results of baselines and submitted methods. The OVIS dataset and challenge information can be found at http songbai.site ovis .


Rainbow cycles for families of matchings. Given a graph G and a coloring of its edges, a subgraph of G is called rainbow if its edges have distinct colors. The rainbow girth of an edge coloring of G is the minimum length of a rainbow cycle in G. A generalization of the famous Caccetta Haggkvist conjecture (CHC), proposed by the first author, is that if G has n vertices, G is n edge colored and the size of every color class is k, then the rainbow girth is at most lceil frac n k rceil. In the only known example showing sharpness of this conjecture, that stems from an example for the sharpness of CHC, the color classes are stars. This suggests that in the antipodal case to stars, namely matchings, the result can be improved. Indeed, we show that the rainbow girth of n matchings of size at least 2 is O( log n), as compared with the general bound of lceil frac n 2 rceil.


Model Extraction and Defenses on Generative Adversarial Networks. Model extraction attacks aim to duplicate a machine learning model through query access to a target model. Early studies mainly focus on discriminative models. Despite the success, model extraction attacks against generative models are less well explored. In this paper, we systematically study the feasibility of model extraction attacks against generative adversarial networks (GANs). Specifically, we first define accuracy and fidelity on model extraction attacks against GANs. Then we study model extraction attacks against GANs from the perspective of accuracy extraction and fidelity extraction, according to the adversary's goals and background knowledge. We further conduct a case study where an adversary can transfer knowledge of the extracted model which steals a state of the art GAN trained with more than 3 million images to new domains to broaden the scope of applications of model extraction attacks. Finally, we propose effective defense techniques to safeguard GANs, considering a trade off between the utility and security of GAN models.


Space Partitioning RANSAC. A new algorithm is proposed to accelerate RANSAC model quality calculations. The method is based on partitioning the joint correspondence space, e.g., 2D 2D point correspondences, into a pair of regular grids. The grid cells are mapped by minimal sample models, estimated within RANSAC, to reject correspondences that are inconsistent with the model parameters early. The proposed technique is general. It works with arbitrary transformations even if a point is mapped to a point set, e.g., as a fundamental matrix maps to epipolar lines. The method is tested on thousands of image pairs from publicly available datasets on fundamental and essential matrix, homography and radially distorted homography estimation. On average, it reduces the RANSAC run time by 41 with provably no deterioration in the accuracy. It can be straightforwardly plugged into state of the art RANSAC frameworks, e.g. VSAC.


Yamabe systems, optimal partitions, and nodal solutions to the Yamabe equation. We give conditions for the existence of regular optimal partitions, with an arbitrary number ell geq 2 of components, for the Yamabe equation on a closed Riemannian manifold (M,g) . To this aim, we study a weakly coupled competitive elliptic system of ell equations, related to the Yamabe equation. We show that this system has a least energy solution with nontrivial components if dim M geq 10 , (M,g) is not locally conformally flat and satisfies an additional geometric assumption whenever dim M 10 . Moreover, we show that the limit profiles of the components of the solution separate spatially as the competition parameter goes to infty , giving rise to an optimal partition. We show that this partition exhausts the whole manifold, and we prove the regularity of both the interfaces and the limit profiles, together with a free boundary condition. For ell 2 the optimal partition obtained yields a least energy sign changing solution to the Yamabe equation with precisely two nodal domains.


Your Face Mirrors Your Deepest Beliefs Predicting Personality and Morals through Facial Emotion Recognition. Can we really "read the mind in the eyes"? Moreover, can AI assist us in this task? This paper answers these two questions by introducing a machine learning system that predicts personality characteristics of individuals on the basis of their face. It does so by tracking the emotional response of the individual's face through facial emotion recognition (FER) while watching a series of 15 short videos of different genres. To calibrate the system, we invited 85 people to watch the videos, while their emotional responses were analyzed through their facial expression. At the same time, these individuals also took four well validated surveys of personality characteristics and moral values the revised NEO FFI personality inventory, the Haidt moral foundations test, the Schwartz personal value system, and the domain specific risk taking scale (DOSPERT). We found that personality characteristics and moral values of an individual can be predicted through their emotional response to the videos as shown in their face, with an accuracy of up to 86 using gradient boosted trees. We also found that different personality characteristics are better predicted by different videos, in other words, there is no single video that will provide accurate predictions for all personality characteristics, but it is the response to the mix of different videos that allows for accurate prediction.


DPEx II A New Dusty Plasma Device Capable of Producing Large Sized DC Coulomb Crystals. The creation of a spatially extended stable DC complex plasma crystal is a big experimental challenge and a topical area of research in the field of dusty plasmas. In this paper we describe a newly built and commissioned dusty plasma experimental device, DPEx II, at the Institute for Plasma Research. The device can support the formation of large sized Coulomb crystals in a DC glow discharge plasma. The plasma in this L shaped table top glass chamber is produced between a circular anode and a long tray shaped cathode. It is characterized with the help of various electrostatic probes over a range of discharge conditions. The dust particles are introduced by a dust dispenser to form a strongly coupled Coulomb crystal in the cathode sheath region. The unique asymmetric electrode configuration minimizes the heating of dust particles and facilitates the formation of crystalline structures with a maximum achievable dimension of 40 cm X 15 cm using this device. A larger crystal has numerous advantages over smaller ones, such as higher structural homogeneity, fewer defects, lower statistical errors due to finite size effects etc.. A host of diagnostics tools are provided to characterize the Coulomb crystal. Results of a few initial experiments aimed at demonstrating the technical capabilities of the device and its potential for future dusty plasma research, are reported.


Porcupine A Synthesizing Compiler for Vectorized Homomorphic Encryption. Homomorphic encryption (HE) is a privacy preserving technique that enables computation directly on encrypted data. Despite its promise, HE has seen limited use due to performance overheads and compilation challenges. Recent work has made significant advances to address the performance overheads but automatic compilation of efficient HE kernels remains relatively unexplored. This paper presents Porcupine, an optimizing compiler, and HE DSL named Quill to automatically generate HE code using program synthesis. HE poses three major compilation challenges it only supports a limited set of SIMD like operators, it uses long vector operands, and decryption can fail if ciphertext noise growth is not managed properly. Quill captures the underlying HE operator behavior that enables Porcupine to reason about the complex trade offs imposed by the challenges and generate optimized, verified HE kernels. To improve synthesis time, we propose a series of optimizations including a sketch design tailored to HE and instruction restriction to narrow the program search space. We evaluate Procupine using a set of kernels and show speedups of up to 51 (11 geometric mean) compared to heuristic driven hand optimized kernels. Analysis of Porcupine's synthesized code reveals that optimal solutions are not always intuitive, underscoring the utility of automated reasoning in this domain.


All at once formulation meets the Bayesian approach A study of two prototypical linear inverse problems. In this work, the Bayesian approach to inverse problems is formulated in an all at once setting. The advantages of the all at once formulation are known to include the avoidance of a parameter to state map as well as numerical improvements, especially when considering nonlinear problems. In the Bayesian approach, prior knowledge is taken into account with the help of a prior distribution. In addition, the error in the observation equation is formulated by means of a distribution. This method naturally results in a whole posterior distribution for the unknown target, not just point estimates. This allows for further statistical analysis including the computation of credible intervals. We combine the Bayesian setting with the all at once formulation, resulting in a novel approach for investigating inverse problems. With this combination we are able to chose a prior not only for the parameter, but also for the state variable, which directly influences the parameter. Furthermore, errors not only in the observation equation, but additionally, in the model can be taken into account. The aim of this approach is not only to accomplish reasonable reconstructions of the unknown parameter but also to maximize the information gained from measurements through combining it with prior knowledge, obtained either from certain expertise or former investigation in the model. We analyze this approach with the help of two linear standard examples, namely the inverse source problem for the Poisson equation and the backwards heat equation, i.e. a stationary and a time dependent problem. Appropriate function spaces and derivation of adjoint operators are investigated. To assess the degree of ill posedness, we analyze the singular values of the corresponding all at once forward operators. as well as the convergence of the method. Finally, joint priors are designed and numerically tested.


Multimodal Face Synthesis from Visual Attributes. Synthesis of face images from visual attributes is an important problem in computer vision and biometrics due to its applications in law enforcement and entertainment. Recent advances in deep generative networks have made it possible to synthesize high quality face images from visual attributes. However, existing methods are specifically designed for generating unimodal images (i.e visible faces) from attributes. In this paper, we propose a novel generative adversarial network that simultaneously synthesizes identity preserving multimodal face images (i.e. visible, sketch, thermal, etc.) from visual attributes without requiring paired data in different domains for training the network. We introduce a novel generator with multimodal stretch out modules to simultaneously synthesize multimodal face images. Additionally, multimodal stretch in modules are introduced in the discriminator which discriminates between real and fake images. Extensive experiments and comparisons with several state of the art methods are performed to verify the effectiveness of the proposed attribute based multimodal synthesis method.


Distortion Oblivious Algorithms for Minimizing Flow Time. We consider the classic online problem of scheduling on a single machine to minimize total flow time. In STOC 2021, the concept of robustness to distortion in processing times was introduced for every distortion factor mu , an O( mu 2) competitive algorithm operatorname ALG mu which handles distortions up to mu was presented. However, using that result requires one to know the distortion of the input in advance, which is impractical. We present the first emph distortion oblivious algorithms algorithms which are competitive for emph every input of emph every distortion, and thus do not require knowledge of the distortion in advance. Moreover, the competitive ratios of our algorithms are tilde O ( mu) , which is a quadratic improvement over the algorithm from STOC 2021, and is nearly optimal (we show a randomized lower bound of Omega( mu) on competitiveness).


Teichmuller space theory and classical problems of geometric function theory. Recently the author presented a new approach to solving the coefficient problems for holomorphic functions based on the deep features of Teichmuller spaces. It involves the Bers isomorphism theorem for Teichmuller spaces of punctured Riemann surfaces. The aim of the present paper is to provide new applications of this approach and extend the indicated results to more general classes of functions


Designing Two Dimensional Complete Complementary Codes for Omnidirectional Transmission in Massive MIMO Systems. This paper presents an efficient construction of two dimensional (2D) complete complementary codes (CCCs) for their modern application as omnidirectional precoding matrices in massive MIMO systems to attain enhanced cell coverage. Unlike the traditional 1D CCCs, little progress has been made on efficient and systematic constructions of the 2D counterpart. In contrast to the existing recursive constructions with the aid of various sequence operations, certain 1D seed sequences or 2D arrays, we propose to use 2D generalized Boolean functions for direct synthesis of 2D CCCs. Simulation results show that the proposed 2D CCCs appear to be good candidates for precoding matrices to achieve omnidirectional transmission in massive MIMO systems.


StackMix and Blot Augmentations for Handwritten Text Recognition. This paper proposes a handwritten text recognition(HTR) system that outperforms current state of the artmethods. The comparison was carried out on three of themost frequently used in HTR task datasets, namely Ben tham, IAM, and Saint Gall. In addition, the results on tworecently presented datasets, Peter the Greats manuscriptsand HKR Dataset, are provided.The paper describes the architecture of the neural net work and two ways of increasing the volume of train ing data augmentation that simulates strikethrough text(HandWritten Blots) and a new text generation method(StackMix), which proved to be very effective in HTR tasks.StackMix can also be applied to the standalone task of gen erating handwritten text based on printed text.


Gotthold Eisenstein and Philosopher John. Before the recent publication of the correspondence between Gauss and Encke, nothing was known about the role that John Taylor, a cotton merchant from Liverpool, had played in the life of Gotthold Eisenstein. In this article, we will bring together what we have discovered about John Taylor's life.


PatchCleanser Certifiably Robust Defense against Adversarial Patches for Any Image Classifier. The adversarial patch attack against image classification models aims to inject adversarially crafted pixels within a restricted image region (i.e., a patch) for inducing model misclassification. This attack can be realized in the physical world by printing and attaching the patch to the victim object thus, it imposes a real world threat to computer vision systems. To counter this threat, we design PatchCleanser as a certifiably robust defense against adversarial patches. In PatchCleanser, we perform two rounds of pixel masking on the input image to neutralize the effect of the adversarial patch. This image space operation makes PatchCleanser compatible with any state of the art image classifier for achieving high accuracy. Furthermore, we can prove that PatchCleanser will always predict the correct class labels on certain images against any adaptive white box attacker within our threat model, achieving certified robustness. We extensively evaluate PatchCleanser on the ImageNet, ImageNette, CIFAR 10, CIFAR 100, SVHN, and Flowers 102 datasets and demonstrate that our defense achieves similar clean accuracy as state of the art classification models and also significantly improves certified robustness from prior works. Remarkably, PatchCleanser achieves 83.9 top 1 clean accuracy and 62.1 top 1 certified robust accuracy against a 2 pixel square patch anywhere on the image for the 1000 class ImageNet dataset.


COSTA Communication Optimal Shuffle and Transpose Algorithm with Process Relabeling. Communication avoiding algorithms for Linear Algebra have become increasingly popular, in particular for distributed memory architectures. In practice, these algorithms assume that the data is already distributed in a specific way, thus making data reshuffling a key to use them. For performance reasons, a straightforward all to all exchange must be avoided. Here, we show that process relabeling (i.e. permuting processes in the final layout) can be used to obtain communication optimality for data reshuffling, and that it can be efficiently found by solving a Linear Assignment Problem (Maximum Weight Bipartite Perfect Matching). Based on this, we have developed a Communication Optimal Shuffle and Transpose Algorithm (COSTA) this highly optimised algorithm implements A alpha cdot operatorname op (B) beta cdot A, operatorname op in operatorname transpose , operatorname conjugate transpose , operatorname identity on distributed systems, where A, B are matrices with potentially different (distributed) layouts and alpha, beta are scalars. COSTA can take advantage of the communication optimal process relabeling even for heterogeneous network topologies, where latency and bandwidth differ among nodes. The implementation not only outperforms the best available ScaLAPACK redistribute and transpose routines multiple times, but is also able to deal with more general matrix layouts, in particular it is not limited to block cyclic layouts. Finally, we use COSTA to integrate a communication optimal matrix multiplication algorithm into the CP2K quantum chemistry simulation package. This way, we show that COSTA can be used to unlock the full potential of recent Linear Algebra algorithms in applications by facilitating interoperability between algorithms with a wide range of data layouts, in addition to bringing significant redistribution speedups.


Go Small and Similar A Simple Output Decay Brings Better Performance. Regularization and data augmentation methods have been widely used and become increasingly indispensable in deep learning training. Researchers who devote themselves to this have considered various possibilities. But so far, there has been little discussion about regularizing outputs of the model. This paper begins with empirical observations that better performances are significantly associated with output distributions, that have smaller average values and variances. By audaciously assuming there is causality involved, we propose a novel regularization term, called Output Decay, that enforces the model to assign smaller and similar output values on each class. Though being counter intuitive, such a small modification result in a remarkable improvement on performance. Extensive experiments demonstrate the wide applicability, versatility, and compatibility of Output Decay.


Error Estimates for the Deep Ritz Method with Boundary Penalty. We establish estimates on the error made by the Deep Ritz Method for elliptic problems on the space H 1( Omega) with different boundary conditions. For Dirichlet boundary conditions, we estimate the error when the boundary values are approximately enforced through the boundary penalty method. Our results apply to arbitrary and in general non linear classes V subseteq H 1( Omega) of ansatz functions and estimate the error in dependence of the optimization accuracy, the approximation capabilities of the ansatz class and in the case of Dirichlet boundary values the penalisation strength lambda . For non essential boundary conditions the error of the Ritz method decays with the same rate as the approximation rate of the ansatz classes. For essential boundary conditions, given an approximation rate of r in H 1( Omega) and an approximation rate of s in L 2( partial Omega) of the ansatz classes, the optimal decay rate of the estimated error is min(s 2, r) and achieved by choosing lambda n sim n s . We discuss the implications for ansatz classes which are given through ReLU networks and the relation to existing estimates for finite element functions.


DeCOM Decomposed Policy for Constrained Cooperative Multi Agent Reinforcement Learning. In recent years, multi agent reinforcement learning (MARL) has presented impressive performance in various applications. However, physical limitations, budget restrictions, and many other factors usually impose textit constraints on a multi agent system (MAS), which cannot be handled by traditional MARL frameworks. Specifically, this paper focuses on constrained MASes where agents work textit cooperatively to maximize the expected team average return under various constraints on expected team average costs, and develops a textit constrained cooperative MARL framework, named DeCOM, for such MASes. In particular, DeCOM decomposes the policy of each agent into two modules, which empowers information sharing among agents to achieve better cooperation. In addition, with such modularization, the training algorithm of DeCOM separates the original constrained optimization into an unconstrained optimization on reward and a constraints satisfaction problem on costs. DeCOM then iteratively solves these problems in a computationally efficient manner, which makes DeCOM highly scalable. We also provide theoretical guarantees on the convergence of DeCOM's policy update algorithm. Finally, we validate the effectiveness of DeCOM with various types of costs in both toy and large scale (with 500 agents) environments.


Simple is better Making Decision Trees faster using random sampling. In recent years, gradient boosted decision trees have become popular in building robust machine learning models on big data. The primary technique that has enabled these algorithms success has been distributing the computation while building the decision trees. A distributed decision tree building, in turn, has been enabled by building quantiles of the big datasets and choosing the candidate split points from these quantile sets. In XGBoost, for instance, a sophisticated quantile building algorithm is employed to identify the candidate split points for the decision trees. This method is often projected to yield better results when the computation is distributed. In this paper, we dispel the notion that these methods provide more accurate and scalable methods for building decision trees in a distributed manner. In a significant contribution, we show theoretically and empirically that choosing the split points uniformly at random provides the same or even better performance in terms of accuracy and computational efficiency. Hence, a simple random selection of points suffices for decision tree building compared to more sophisticated methods.


AttDLNet Attention based DL Network for 3D LiDAR Place Recognition. LiDAR based place recognition is one of the key components of SLAM and global localization in autonomous vehicles and robotics applications. With the success of DL approaches in learning useful information from 3D LiDARs, place recognition has also benefited from this modality, which has led to higher re localization and loop closure detection performance, particularly, in environments with significant changing conditions. Despite the progress in this field, the extraction of proper and efficient descriptors from 3D LiDAR data that are invariant to changing conditions and orientation is still an unsolved challenge. To address this problem, this work proposes a novel 3D LiDAR based deep learning network (named AttDLNet) that uses a range based proxy representation for point clouds and an attention network with stacked attention layers to selectively focus on long range context and inter feature relationships. The proposed network is trained and validated on the KITTI dataset and an ablation study is presented to assess the novel attention network. Results show that adding attention to the network improves performance, leading to efficient loop closures, and outperforming an established 3D LiDAR based place recognition approach. From the ablation study, results indicate that the middle encoder layers have the highest mean performance, while deeper layers are more robust to orientation change. The code is publicly available at https github.com Cybonic AttDLNet


An Overview of the HFL Model Checking Project. In this article, we give an overview of our project on higher order program verification based on HFL (higher order fixpoint logic) model checking. After a brief introduction to HFL, we explain how it can be applied to program verification, and summarize the current status of the project.


Linear configurations containing 4 term arithmetic progressions are uncommon. A linear configuration is said to be common in G if every 2 coloring of G yields at least the number of monochromatic instances of a randomly chosen coloring. Saad and Wolf asked whether, analogously to a result by Thomason in graph theory, every configuration containing a 4 term arithmetic progression is uncommon. We prove this in mathbb F p n for p geq 5 and large n and in mathbb Z p for large primes p .


Optimal Reinsurance and Investment under Common Shock Dependence Between Financial and Actuarial Markets. We study optimal proportional reinsurance and investment strategies for an insurance company which experiences both ordinary and catastrophic claims and wishes to maximize the expected exponential utility of its terminal wealth. We propose a model where the insurance framework is affected by environmental factors, and aggregate claims and stock prices are subject to common shocks, i.e. drastic events such as earthquakes, extreme weather conditions, or even pandemics, that have an immediate impact on the financial market and simultaneously induce insurance claims. Using the classical stochastic control approach based on the Hamilton Jacobi Bellman equation, we provide a verification result for the value function via classical solutions to two backward partial differential equations and characterize the optimal reinsurance and investment strategies. Finally, we make a comparison analysis to discuss the effect of common shock dependence.


Stealthy Attack on Algorithmic Protected DNNs via Smart Bit Flipping. Recently, deep neural networks (DNNs) have been deployed in safety critical systems such as autonomous vehicles and medical devices. Shortly after that, the vulnerability of DNNs were revealed by stealthy adversarial examples where crafted inputs by adding tiny perturbations to original inputs can lead a DNN to generate misclassification outputs. To improve the robustness of DNNs, some algorithmic based countermeasures against adversarial examples have been introduced thereafter. In this paper, we propose a new type of stealthy attack on protected DNNs to circumvent the algorithmic defenses via smart bit flipping in DNN weights, we can reserve the classification accuracy for clean inputs but misclassify crafted inputs even with algorithmic countermeasures. To fool protected DNNs in a stealthy way, we introduce a novel method to efficiently find their most vulnerable weights and flip those bits in hardware. Experimental results show that we can successfully apply our stealthy attack against state of the art algorithmic protected DNNs.


A Little Robustness Goes a Long Way Leveraging Robust Features for Targeted Transfer Attacks. Adversarial examples for neural network image classifiers are known to be transferable examples optimized to be misclassified by a source classifier are often misclassified as well by classifiers with different architectures. However, targeted adversarial examples optimized to be classified as a chosen target class tend to be less transferable between architectures. While prior research on constructing transferable targeted attacks has focused on improving the optimization procedure, in this work we examine the role of the source classifier. Here, we show that training the source classifier to be "slightly robust" that is, robust to small magnitude adversarial examples substantially improves the transferability of class targeted and representation targeted adversarial attacks, even between architectures as different as convolutional neural networks and transformers. The results we present provide insight into the nature of adversarial examples as well as the mechanisms underlying so called "robust" classifiers.


Transfer Learning and Augmentation for Word Sense Disambiguation. Many downstream NLP tasks have shown significant improvement through continual pre training, transfer learning and multi task learning. State of the art approaches in Word Sense Disambiguation today benefit from some of these approaches in conjunction with information sources such as semantic relationships and gloss definitions contained within WordNet. Our work builds upon these systems and uses data augmentation along with extensive pre training on various different NLP tasks and datasets. Our transfer learning and augmentation pipeline achieves state of the art single model performance in WSD and is at par with the best ensemble results.


To Improve Cyber Resilience, Measure It. We are not very good at measuring rigorously and quantitatively the cyber security of systems. Our ability to measure cyber resilience is even worse. And without measuring cyber resilience, we can neither improve it nor trust its efficacy. It is difficult to know if we are improving or degrading cyber resilience when we add another control, or a mix of controls, to harden the system. The only way to know is to specifically measure cyber resilience with and without a particular set of controls. What needs to be measured are temporal patterns of recovery and adaptation, and not time independent failure probabilities. In this paper, we offer a set of criteria that would ensure decision maker confidence in the reliability of the methodology used in obtaining a meaningful measurement.


The Scaled Relative Graph of a Linear Operator. The scaled relative graph (SRG) of an operator is a subset of the complex plane. It captures several salient features of an operator, such as contractiveness, and can be used to reveal the geometric nature of many of the inequality based arguments used in the convergence analyses of fixed point iterations. In this paper we show that the SRG of a linear operator can be determined from the numerical range of a closely related linear operator. Furthermore we demonstrate that the SRG of a linear operator has a range of spectral and convexity properties, and satisfies an analogue of Hildebrant's theorem.


Collective Intelligence for Deep Learning A Survey of Recent Developments. In the past decade, we have witnessed the rise of deep learning to dominate the field of artificial intelligence. Advances in artificial neural networks alongside corresponding advances in hardware accelerators with large memory capacity, together with the availability of large datasets enabled practitioners to train and deploy sophisticated neural network models that achieve state of the art performance on tasks across several fields spanning computer vision, natural language processing, and reinforcement learning. However, as these neural networks become bigger, more complex, and more widely used, fundamental problems with current deep learning models become more apparent. State of the art deep learning models are known to suffer from issues that range from poor robustness, inability to adapt to novel task settings, to requiring rigid and inflexible configuration assumptions. Collective behavior, commonly observed in nature, tends to produce systems that are robust, adaptable, and have less rigid assumptions about the environment configuration. Collective intelligence, as a field, studies the group intelligence that emerges from the interactions of many individuals. Within this field, ideas such as self organization, emergent behavior, swarm optimization, and cellular automata were developed to model and explain complex systems. It is therefore natural to see these ideas incorporated into newer deep learning methods. In this review, we will provide a historical context of neural network research's involvement with complex systems, and highlight several active areas in modern deep learning research that incorporate the principles of collective intelligence to advance its current capabilities. We hope this review can serve as a bridge between the complex systems and deep learning communities.


Unitary representations of totally disconnected locally compact groups satisfying Ol'shanskii's factorization. Inspired by Ol'shanskii's work, we provide an axiomatic framework to describe certain irreducible unitary representations of non discrete unimodular totally disconnected locally compact groups. We then look at the applications to certain groups of automorphisms of locally finite trees and semi regular right angled buildings.


A short proof of cuplength estimates on Lagrangian intersections. In this note we give a short proof of Arnold's conjecture for the zero section of a cotangent bundle. The proof is based on some basic properties of Lagrangian spectral invariants.


On the approximation error for approximating convex bodies using multiobjective optimization. A polyhedral approximation of a convex body can be calculated by solving approximately an associated multiobjective convex program (MOCP). An MOCP can be solved approximately by Benson type algorithms, which compute outer and inner polyhedral approximations of the problem's upper image. Polyhedral approximations of a convex body can be obtained from polyhedral approximations of the upper image of the associated MOCP. We provide error bounds in terms of the Hausdorff distance for the polyhedral approximations of a convex body in dependence of the stopping criterion of the primal and dual Benson type algorithms which are applied to the associated MOCP.


Semantic Frame Induction using Masked Word Embeddings and Two Step Clustering. Recent studies on semantic frame induction show that relatively high performance has been achieved by using clustering based methods with contextualized word embeddings. However, there are two potential drawbacks to these methods one is that they focus too much on the superficial information of the frame evoking verb and the other is that they tend to divide the instances of the same verb into too many different frame clusters. To overcome these drawbacks, we propose a semantic frame induction method using masked word embeddings and two step clustering. Through experiments on the English FrameNet data, we demonstrate that using the masked word embeddings is effective for avoiding too much reliance on the surface information of frame evoking verbs and that two step clustering can improve the number of resulting frame clusters for the instances of the same verb.


The Ramsey number for 4 uniform tight cycles. A k uniform tight cycle is a k graph with a cyclic ordering of its vertices such that its edges are precisely the sets of k consecutive vertices in that ordering. A k uniform tight path is a k graph obtained by deleting a vertex from a k uniform tight cycle. We prove that the Ramsey number for the 4 uniform tight cycle on 4n vertices is (5 o(1))n . This is asymptotically tight. This result also implies that the Ramsey number for the 4 uniform tight path on n vertices is (5 4 o(1))n .


Dissipative solutions to the compressible isentropic Navier Stokes equations. The existence of dissipative solutions to the compressible isentropic Navier Stokes equations was established in this paper. This notion was inspired by the concept of dissipative solutions to the incompressible Euler equations of Lions ( cite Lions 1996 , Section 4.4). Our method is to recover such solutions by passing to the limits from approximated solutions, thanks to compactness argument.