Self supervised Audiovisual Representation Learning for Remote Sensing Data. Many current deep learning approaches make extensive use of backbone networks pre trained on large datasets like ImageNet, which are then fine tuned to perform a certain task. In remote sensing, the lack of comparable large annotated datasets and the wide diversity of sensing platforms impedes similar developments. In order to contribute towards the availability of pre trained backbone networks in remote sensing, we devise a self supervised approach for pre training deep neural networks. By exploiting the correspondence between geo tagged audio recordings and remote sensing imagery, this is done in a completely label free manner, eliminating the need for laborious manual annotation. For this purpose, we introduce the SoundingEarth dataset, which consists of co located aerial imagery and audio samples all around the world. Using this dataset, we then pre train ResNet models to map samples from both modalities into a common embedding space, which encourages the models to understand key properties of a scene that influence both visual and auditory appearance. To validate the usefulness of the proposed approach, we evaluate the transfer learning performance of pre trained weights obtained against weights obtained through other means. By fine tuning the models on a number of commonly used remote sensing datasets, we show that our approach outperforms existing pre training strategies for remote sensing imagery. The dataset, code and pre trained model weights will be available at https github.com khdlr SoundingEarth.


High speed imaging of magnetized plasmas when electron temperature matters. High speed camera imaging is a powerful tool to probe the spatiotemporal features of unsteady processes in plasmas, usually assuming light fluctuations to be a proxy for the plasma density fluctuations. In this article, we systematically compare high speed camera imaging with simultaneous measurements of the plasma parameters plasma density, electron temperature, floating potential in a modestly magnetized Argon plasma column at low pressure (1 mTorr, magnetic fields ranging from 160 to 640 G). The light emission was filtered around 488 pm5 nm, 750 pm5 nm, 810 pm5 nm. We show that the light intensity cannot be interpreted as a proxy for the plasma density and that the electron temperature cannot be ignored when interpreting high speed imaging, both for the time averaged profiles and for the fluctuations. The features of plasma parameter fluctuations are investigated, with a focus on ion acoustic waves (at frequency around 70 kHz) at low magnetic field and low frequency azimuthal waves (around a few kHz) at larger magnetic fields. An excellent match is found between the high speed images fluctuations and an Arrhenius law functional form which incorporates fluctuations of the plasma density and of the electron temperature. These results explain the discrepancies between ion saturation current and narrow band imaging measurements previously reported in the literature.


Large scale regularity for the stationary Navier Stokes equations over non Lipschitz boundaries. In this paper we address the large scale regularity theory for the stationary Navier Stokes equations in highly oscillating bumpy John domains. These domains are very rough, possibly with fractals or cusps, at the microscopic scale, but are amenable to the mathematical analysis of the Navier Stokes equations. We prove (i) a large scale Calder 'on Zygmund estimate, (ii) a large scale Lipschitz estimate, (iii) large scale higher order regularity estimates, namely, C 1, gamma and C 2, gamma estimates. These nice regularity results are inherited only at mesoscopic scales, and clearly fail in general at the microscopic scales. We emphasize that the large scale C 1, gamma regularity is obtained by using first order boundary layers constructed via a new argument. The large scale C 2, gamma regularity relies on the construction of second order boundary layers, which allows for certain boundary data with linear growth at spatial infinity. To the best of our knowledge, our work is the first to carry out such an analysis. In the wake of many works in quantitative homogenization, our results strongly advocate in favor of considering the boundary regularity of the solutions to fluid equations as a multiscale problem, with improved regularity at or above a certain scale.


Skilled and Mobile Survey Evidence of AI Researchers' Immigration Preferences. Countries, companies, and universities are increasingly competing over top tier artificial intelligence (AI) researchers. Where are these researchers likely to immigrate and what affects their immigration decisions? We conducted a survey (n 524) of the immigration preferences and motivations of researchers that had papers accepted at one of two prestigious AI conferences the Conference on Neural Information Processing Systems (NeurIPS) and the International Conference on Machine Learning (ICML). We find that the U.S. is the most popular destination for AI researchers, followed by the U.K., Canada, Switzerland, and France. A country's professional opportunities stood out as the most common factor that influences immigration decisions of AI researchers, followed by lifestyle and culture, the political climate, and personal relations. The destination country's immigration policies were important to just under half of the researchers surveyed, while around a quarter noted current immigration difficulties to be a deciding factor. Visa and immigration difficulties were perceived to be a particular impediment to conducting AI research in the U.S., the U.K., and Canada. Implications of the findings for the future of AI talent policies and governance are discussed.


Improved selectivity of optical transmission through cascaded waveguide metal grating filters. The resonant transmission of two near field coupled, cascaded band pass filters, based on metallic stripe or patch gratings, is analysed. The response, in terms both of maximum efficiency and light rejection out of the resonance, overpasses the simple convolution of the responses of two isolated filters, while keeping good angular tolerance. Illustrations are given in the infrared range where sizing and technological integration of such compact structures are particularly relevant for detection applications.


Succinct Data Structure for Path Graphs. We consider the problem of designing a succinct data structure for it path graphs (which are a proper subclass of chordal graphs and a proper superclass of interval graphs) with n vertices while supporting degree, adjacency, and neighborhood queries efficiently. We provide two solutions for this problem. Our first data structure is succinct and occupies n log n o(n log n) bits while answering adjacency query in O( log n) time, and neighborhood and degree queries in O(d log 2 n) time where d is the degree of the queried vertex. Our second data structure answers adjacency queries faster at the expense of slightly more space. More specifically, we provide an O(n log 2 n) bit data structure that supports adjacency query in O(1) time, and the neighborhood query in O(d) time where d is the degree of the queried vertex. Central to our data structures is the usage of the classical heavy path decomposition, followed by a careful bookkeeping using an orthogonal range search data structure among others, which maybe of independent interest for designing succinct data structures for other graphs. It is the use of the results of Acan et al. cite HSSS in the second data structure that permits a simple and efficient implementation at the expense of more space.


Clipped Hyperbolic Classifiers Are Super Hyperbolic Classifiers. Hyperbolic space can embed hierarchical structures continuously. Hyperbolic Neural Networks (HNNs) exploit such representational power by lifting Euclidean features into hyperbolic space for classification, outperforming Euclidean neural networks (ENNs) on datasets with known hierarchical structures. However, HNNs underperform ENNs on standard benchmarks with unclear hierarchies, greatly restricting HNNs' practical applicability. Our key insight is that HNNs' poorer general classification performance results from vanishing gradients during backpropagation, caused by their hybrid architecture connecting Euclidean features to a hyperbolic classifier. We propose an effective solution by simply clipping the Euclidean feature magnitude while training HNNs. Our experimental results demonstrate that clipped HNNs become super hyperbolic classifiers They are not only consistently better than HNNs which already outperform ENNs on hierarchical data, but also on par with ENNs on MNIST, CIFAR10, CIFAR100 and ImageNet benchmarks, with better adversarial robustness and out of distribution detection.


Secure list decoding and its application to bit string commitment. We propose a new concept of secure list decoding, which is related to bit string commitment. While the conventional list decoding requires that the list contains the transmitted message, secure list decoding requires the following additional security conditions to work as a modification of bit string commitment. The first additional security condition is the receiver's uncertainty for the transmitted message, which is stronger than the impossibility of the correct decoding, even though the transmitted message is contained in the list. The other additional security condition is the impossibility for the sender to estimate another element of the decoded list except for the transmitted message. The first condition is evaluated by the equivocation rate. The asymptotic property is evaluated by three parameters, the rates of the message and list sizes, and the equivocation rate. We derive the capacity region of this problem. We show that the combination of hash function and secure list decoding yields the conventional bit string commitment. Our results hold even when the input and output systems are general probability spaces including continuous systems. When the input system is a general probability space, we formulate the abilities of the honest sender and the dishonest sender in a different way.


Universal approximation properties of shallow quadratic neural networks. In this paper we propose a new class of neural network functions which are linear combinations of compositions of activation functions with quadratic functions, replacing standard affine linear functions, often called neurons. We show the universality of this approximation and prove convergence rates results based on the theory of wavelets and statistical learning. We investigate the efficiency of our new approach numerically for simple test cases, by showing that it requires less numbers of neurons that standard affine linear neural networks. Similar observations are made when comparing deep (multi layer) networks.


iCub. In this chapter we describe the history and evolution of the iCub humanoid platform. We start by describing the first version as it was designed during the RobotCub EU project and illustrate how it evolved to become the platform that is adopted by more than 30 laboratories world wide. We complete the chapter by illustrating some of the research activities that are currently carried out on the iCub robot, i.e. visual perception, event driven sensing and dynamic control. We conclude the Chapter with a discussion of the lessons we learned and a preview of the upcoming next release of the robot, iCub 3.0.


Iconographic Image Captioning for Artworks. Image captioning implies automatically generating textual descriptions of images based only on the visual input. Although this has been an extensively addressed research topic in recent years, not many contributions have been made in the domain of art historical data. In this particular context, the task of image captioning is confronted with various challenges such as the lack of large scale datasets of image text pairs, the complexity of meaning associated with describing artworks and the need for expert level annotations. This work aims to address some of those challenges by utilizing a novel large scale dataset of artwork images annotated with concepts from the Iconclass classification system designed for art and iconography. The annotations are processed into clean textual description to create a dataset suitable for training a deep neural network model on the image captioning task. Motivated by the state of the art results achieved in generating captions for natural images, a transformer based vision language pre trained model is fine tuned using the artwork image dataset. Quantitative evaluation of the results is performed using standard image captioning metrics. The quality of the generated captions and the model's capacity to generalize to new data is explored by employing the model on a new collection of paintings and performing an analysis of the relation between commonly generated captions and the artistic genre. The overall results suggest that the model can generate meaningful captions that exhibit a stronger relevance to the art historical context, particularly in comparison to captions obtained from models trained only on natural image datasets.


Network Embedding via Deep Prediction Model. Network structured data becomes ubiquitous in daily life and is growing at a rapid pace. It presents great challenges to feature engineering due to the high non linearity and sparsity of the data. The local and global structure of the real world networks can be reflected by dynamical transfer behaviors among nodes. This paper proposes a network embedding framework to capture the transfer behaviors on structured networks via deep prediction models. We first design a degree weight biased random walk model to capture the transfer behaviors on the network. Then a deep network embedding method is introduced to preserve the transfer possibilities among the nodes. A network structure embedding layer is added into conventional deep prediction models, including Long Short Term Memory Network and Recurrent Neural Network, to utilize the sequence prediction ability. To keep the local network neighborhood, we further perform a Laplacian supervised space optimization on the embedding feature representations. Experimental studies are conducted on various datasets including social networks, citation networks, biomedical network, collaboration network and language network. The results show that the learned representations can be effectively used as features in a variety of tasks, such as clustering, visualization, classification, reconstruction and link prediction, and achieve promising performance compared with state of the arts.


Complex Factoid Question Answering with a Free Text Knowledge Graph. We introduce DELFT, a factoid question answering system which combines the nuance and depth of knowledge graph question answering approaches with the broader coverage of free text. DELFT builds a free text knowledge graph from Wikipedia, with entities as nodes and sentences in which entities co occur as edges. For each question, DELFT finds the subgraph linking question entity nodes to candidates using text sentences as edges, creating a dense and high coverage semantic graph. A novel graph neural network reasons over the free text graph combining evidence on the nodes via information along edge sentences to select a final answer. Experiments on three question answering datasets show DELFT can answer entity rich questions better than machine reading based models, bert based answer ranking and memory networks. DELFT's advantage comes from both the high coverage of its free text knowledge graph more than double that of dbpedia relations and the novel graph neural network which reasons on the rich but noisy free text evidence.


A Continuous Time Approach for 3D Radar to Camera Extrinsic Calibration. Reliable operation in inclement weather is essential to the deployment of safe autonomous vehicles (AVs). Robustness and reliability can be achieved by fusing data from the standard AV sensor suite (i.e., lidars, cameras) with weather robust sensors, such as millimetre wavelength radar. Critically, accurate sensor data fusion requires knowledge of the rigid body transform between sensor pairs, which can be determined through the process of extrinsic calibration. A number of extrinsic calibration algorithms have been designed for 2D (planar) radar sensors however, recently developed, low cost 3D millimetre wavelength radars are set to displace their 2D counterparts in many applications. In this paper, we present a continuous time 3D radar to camera extrinsic calibration algorithm that utilizes radar velocity measurements and, unlike the majority of existing techniques, does not require specialized radar retroreflectors to be present in the environment. We derive the observability properties of our formulation and demonstrate the efficacy of our algorithm through synthetic and real world experiments.


Sliding Spectrum Decomposition for Diversified Recommendation. Content feed, a type of product that recommends a sequence of items for users to browse and engage with, has gained tremendous popularity among social media platforms. In this paper, we propose to study the diversity problem in such a scenario from an item sequence perspective using time series analysis techniques. We derive a method called sliding spectrum decomposition (SSD) that captures users' perception of diversity in browsing a long item sequence. We also share our experiences in designing and implementing a suitable item embedding method for accurate similarity measurement under long tail effect. Combined together, they are now fully implemented and deployed in Xiaohongshu App's production recommender system that serves the main Explore Feed product for tens of millions of users every day. We demonstrate the effectiveness and efficiency of the method through theoretical analysis, offline experiments and online A B tests.


How to Attack and Defend 5G Radio Access Network Slicing with Reinforcement Learning. Reinforcement learning (RL) for network slicing is considered in the 5G radio access network, where the base station, gNodeB, allocates resource blocks (RBs) to the requests of user equipments and maximizes the total reward of accepted requests over time. Based on adversarial machine learning, a novel over the air attack is introduced to manipulate the RL algorithm and disrupt 5G network slicing. Subject to an energy budget, the adversary observes the spectrum and builds its own RL based surrogate model that selects which RBs to jam with the objective of maximizing the number of failed network slicing requests due to jammed RBs. By jamming the RBs, the adversary reduces the RL algorithm's reward. As this reward is used as the input to update the RL algorithm, the performance does not recover even after the adversary stops jamming. This attack is evaluated in terms of the recovery time and the (maximum and total) reward loss, and it is shown to be much more effective than benchmark (random and myopic) jamming attacks. Different reactive and proactive defense mechanisms (protecting the RL algorithm's updates or misleading the adversary's learning process) are introduced to show that it is viable to defend 5G network slicing against this attack.


Robustness via Synthesis Robust Training with Generative Adversarial Perturbations. Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning based systems. Adversarial training with first order attacks has been one of the most effective defenses against adversarial perturbations to this day. The majority of the adversarial training approaches focus on iteratively perturbing each pixel with the gradient of the loss function with respect to the input image. However, the adversarial training with gradient based attacks lacks diversity and does not generalize well to natural images and various attacks. This study presents a robust training algorithm where the adversarial perturbations are automatically synthesized from a random vector using a generator network. The classifier is trained with cross entropy loss regularized with the optimal transport distance between the representations of the natural and synthesized adversarial samples. Unlike prevailing generative defenses, the proposed one step attack generation framework synthesizes diverse perturbations without utilizing gradient of the classifier's loss. Experimental results show that the proposed approach attains comparable robustness with various gradient based and generative robust training techniques on CIFAR10, CIFAR100, and SVHN datasets. In addition, compared to the baselines, the proposed robust training framework generalizes well to the natural samples. Code and trained models will be made publicly available.


Massive Self Assembly in Grid Environments. Self assembly plays an essential role in many natural processes, involving the formation and evolution of living or non living structures, and shows potential applications in many emerging domains. In existing research and practice, there still lacks an ideal self assembly mechanism that manifests efficiency, scalability, and stability at the same time. Inspired by phototaxis observed in nature, we propose a computational approach for massive self assembly of connected shapes in grid environments. The key component of this approach is an artificial light field superimposed on a grid environment, which is determined by the positions of all agents and at the same time drives all agents to change their positions, forming a dynamic mutual feedback process. This work advances the understanding and potential applications of self assembly.


Ultrametric analogues of Ulam stability of groups. We study stability of metric approximations of countable groups with respect to groups endowed with ultrametrics, the main case study being a p adic analogue of Ulam stability, where we take mathrm GL n( mathbb Z p) as approximating groups instead of mathrm U (n) . For finitely presented groups, the ultrametric nature implies equivalence of the pointwise and uniform stability problems, and the profinite one implies that the corresponding approximation property is equivalent to residual finiteness. Moreover, a group is uniformly stable if and only if its largest residually finite quotient is. We provide several examples of uniformly stable groups these include finite groups, virtually free groups, some groups acting on rooted trees, and certain lamplighter and (Generalized) Baumslag Solitar groups.


VS Quant Per vector Scaled Quantization for Accurate Low Precision Neural Network Inference. Quantization enables efficient acceleration of deep neural networks by reducing model memory footprint and exploiting low cost integer math hardware units. Quantization maps floating point weights and activations in a trained model to low bitwidth integer values using scale factors. Excessive quantization, reducing precision too aggressively, results in accuracy degradation. When scale factors are shared at a coarse granularity across many dimensions of each tensor, effective precision of individual elements within the tensor are limited. To reduce quantization related accuracy loss, we propose using a separate scale factor for each small vector of ( approx 16 64) elements within a single dimension of a tensor. To achieve an efficient hardware implementation, the per vector scale factors can be implemented with low bitwidth integers when calibrated using a two level quantization scheme. We find that per vector scaling consistently achieves better inference accuracy at low precision compared to conventional scaling techniques for popular neural networks without requiring retraining. We also modify a deep learning accelerator hardware design to study the area and energy overheads of per vector scaling support. Our evaluation demonstrates that per vector scaled quantization with 4 bit weights and activations achieves 37 area saving and 24 energy saving while maintaining over 75 accuracy for ResNet50 on ImageNet. 4 bit weights and 8 bit activations achieve near full precision accuracy for both BERT base and BERT large on SQuAD while reducing area by 26 compared to an 8 bit baseline.


SLA 2 P Self supervised Anomaly Detection with Adversarial Perturbation. Anomaly detection is a fundamental yet challenging problem in machine learning due to the lack of label information. In this work, we propose a novel and powerful framework, dubbed as SLA 2 P, for unsupervised anomaly detection. After extracting representative embeddings from raw data, we apply random projections to the features and regard features transformed by different projections as belonging to distinct pseudo classes. We then train a classifier network on these transformed features to perform self supervised learning. Next we add adversarial perturbation to the transformed features to decrease their softmax scores of the predicted labels and design anomaly scores based on the predictive uncertainties of the classifier on these perturbed features. Our motivation is that because of the relatively small number and the decentralized modes of anomalies, 1) the pseudo label classifier's training concentrates more on learning the semantic information of normal data rather than anomalous data 2) the transformed features of the normal data are more robust to the perturbations than those of the anomalies. Consequently, the perturbed transformed features of anomalies fail to be classified well and accordingly have lower anomaly scores than those of the normal samples. Extensive experiments on image, text and inherently tabular benchmark datasets back up our findings and indicate that SLA 2 P achieves state of the art results on unsupervised anomaly detection tasks consistently.


The bipartite Ramsey numbers BR(C 8, C 2n ) . For given bipartite graphs G 1,G 2, ldots,G t , the multicolor bipartite Ramsey number BR(G 1,G 2, ldots,G t) is the smallest positive integer b such that any t edge coloring of K b,b contains a monochromatic subgraph isomorphic to G i , colored with the i th color for some 1 leq i leq t . We compute the exact values of the bipartite Ramsey numbers BR(C 8,C 2n ) for n geq2 .


The resolution and representation of time series in Banach space. We describe a systematic procedure to calculate the resolvent operator for a linear pencil on Banach space and thereby simplify, unify and extend known methods for resolution and representation of marginally stable time series. We pay particular attention to those time series commonly known as unit root processes. The new method uses infinite length Jordan chains to find the key spectral separation projections which enable separation and solution of the fundamental equations for the Laurent series coefficients of the resolvent. It is then possible to define the desired Granger Johansen representation for the time series. The method remains valid when the resolvent has an isolated essential singularity at unity.


Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation. Despite significant progress has been achieved in text summarization, factual inconsistency in generated summaries still severely limits its practical applications. Among the key factors to ensure factual consistency, a reliable automatic evaluation metric is the first and the most crucial one. However, existing metrics either neglect the intrinsic cause of the factual inconsistency or rely on auxiliary tasks, leading to an unsatisfied correlation with human judgments or increasing the inconvenience of usage in practice. In light of these challenges, we propose a novel metric to evaluate the factual consistency in text summarization via counterfactual estimation, which formulates the causal relationship among the source document, the generated summary, and the language prior. We remove the effect of language prior, which can cause factual inconsistency, from the total causal effect on the generated summary, and provides a simple yet effective way to evaluate consistency without relying on other auxiliary tasks. We conduct a series of experiments on three public abstractive text summarization datasets, and demonstrate the advantages of the proposed metric in both improving the correlation with human judgments and the convenience of usage. The source code is available at https github.com xieyxclack factual coco.


R2 A Distributed Remote Function Execution Mechanism With Built in Metadata. Named data networking (NDN) constructs a network by names, providing a flexible and decentralized way to manage resources within the edge computing continuum. This paper aims to solve the question, "Given a function with its parameters and metadata, how to select the executor in a distributed manner and obtain the result in NDN?" To answer it, we design R2 that involves the following stages. First, we design a name structure including data, function names, and other function parameters. Second, we develop a 2 phase mechanism, where in the first phase, the function request from a client first reaches the data source and retrieves the metadata, then the best node is selected while the metadata is responding to the client. In the second phase, the chosen node directly retrieves the data, executes the function, and provides the result to the client. Furthermore, we propose a stop condition to intelligently reduce the processing time of the first phase and provide a simple proof and range analysis. Simulations confirm that R2 outperforms the current solutions in terms of resource allocation, especially when the data volume and the function complexity are high. In the experiments, when the data size is 100 KiB and the function complexity is mathcal O (n 2) , the speedup ratio is 4.61. To further evaluate R2, we also implement a general intermediate data processing logic named Bolt'' implemented on an app level in ndnSIM. We believe that R2 shall help the researchers and developers to verify their ideas smoothly.


Cluster based Input Weight Initialization for Echo State Networks. Echo State Networks (ESNs) are a special type of recurrent neural networks (RNNs), in which the input and recurrent connections are traditionally generated randomly, and only the output weights are trained. Despite the recent success of ESNs in various tasks of audio, image and radar recognition, we postulate that a purely random initialization is not the ideal way of initializing ESNs. The aim of this work is to propose an unsupervised initialization of the input connections using the K Means algorithm on the training data. We show that for a large variety of datasets this initialization performs equivalently or superior than a randomly initialized ESN whilst needing significantly less reservoir neurons. Furthermore, we discuss that this approach provides the opportunity to estimate a suitable size of the reservoir based on prior knowledge about the data.


Pre train or Annotate? Domain Adaptation with a Constrained Budget. Recent work has demonstrated that pre training in domain language models can boost performance when adapting to a new domain. However, the costs associated with pre training raise an important question given a fixed budget, what steps should an NLP practitioner take to maximize performance? In this paper, we study domain adaptation under budget constraints, and approach it as a customer choice problem between data annotation and pre training. Specifically, we measure the annotation cost of three procedural text datasets and the pre training cost of three in domain language models. Then we evaluate the utility of different combinations of pre training and data annotation under varying budget constraints to assess which combination strategy works best. We find that, for small budgets, spending all funds on annotation leads to the best performance once the budget becomes large enough, a combination of data annotation and in domain pre training works more optimally. We therefore suggest that task specific data annotation should be part of an economical strategy when adapting an NLP model to a new domain.


FEEL Fast, Energy Efficient Localization for Autonomous Indoor Vehicles. Autonomous vehicles have created a sensation in both outdoor and indoor applications. The famous indoor use case is process automation inside a warehouse using Autonomous Indoor Vehicles (AIV). These vehicles need to locate themselves not only with an accuracy of a few centimetres but also within a few milliseconds in an energy efficient manner. Due to these challenges, localization is a holy grail. In this paper, we propose FEEL an indoor localization system that uses a fusion of three low energy sensors IMU, UWB, and radar. We provide detailed software and hardware architecture of FEEL. Further, we propose Adaptive Sensing Algorithm (ASA) for opportunistically minimizing energy consumption of FEEL by adjusting the sensing frequency to the dynamics of the physical environment. Our extensive performance evaluation over diverse test settings reveal that FEEL provides a localization accuracy of 7cm with ultra low latency of around 3ms. Further, ASA yields up to 20 energy saving with only a marginal trade off in accuracy.


Injecting Finiteness to Prove Completeness for Finite Linear Temporal Logic. Temporal logics over finite traces are not the same as temporal logics over potentially infinite traces. Ro c s u first proved completeness for linear temporal logic on finite traces (LTLf) with a novel coinductive axiom. We offer a different proof, with fewer, more conventional axioms. Our proof is a direct adaptation of Kr " o ger and Merz's Henkin Hasenjaeger style proof. The essence of our adaption is that we "inject" finiteness that is, we alter the proof structure to ensure that models are finite. We aim to present a thorough, accessible proof.


Non average price impact in order driven markets. We present a measurement of price impact in order driven markets that does not require averages across executions or scenarios. Given the order book data associated with one single execution of a sell metaorder, we measure its contribution to price decrease during the trade. We do so by modelling the limit order book using state dependent Hawkes processes, and by defining the price impact profile of the execution as a function of the compensator of a stochastic process in our model. We apply our measurement to a data set from NASDAQ, and we conclude that the clustering of sell child orders has a bigger impact on price than their sizes.


ICDAR 2021 Competition on Document VisualQuestion Answering. In this report we present results of the ICDAR 2021 edition of the Document Visual Question Challenges. This edition complements the previous tasks on Single Document VQA and Document Collection VQA with a newly introduced on Infographics VQA. Infographics VQA is based on a new dataset of more than 5,000 infographics images and 30,000 question answer pairs. The winner methods have scored 0.6120 ANLS in Infographics VQA task, 0.7743 ANLSL in Document Collection VQA task and 0.8705 ANLS in Single Document VQA. We present a summary of the datasets used for each task, description of each of the submitted methods and the results and analysis of their performance. A summary of the progress made on Single Document VQA since the first edition of the DocVQA 2020 challenge is also presented.


STR GQN Scene Representation and Rendering for Unknown Cameras Based on Spatial Transformation Routing. Geometry aware modules are widely applied in recent deep learning architectures for scene representation and rendering. However, these modules require intrinsic camera information that might not be obtained accurately. In this paper, we propose a Spatial Transformation Routing (STR) mechanism to model the spatial properties without applying any geometric prior. The STR mechanism treats the spatial transformation as the message passing process, and the relation between the view poses and the routing weights is modeled by an end to end trainable neural network. Besides, an Occupancy Concept Mapping (OCM) framework is proposed to provide explainable rationals for scene fusion processes. We conducted experiments on several datasets and show that the proposed STR mechanism improves the performance of the Generative Query Network (GQN). The visualization results reveal that the routing process can pass the observed information from one location of some view to the associated location in the other view, which demonstrates the advantage of the proposed model in terms of spatial cognition.


SD Regular Transducer Expressions for Aperiodic Transformations. FO transductions, aperiodic deterministic two way transducers, as well as aperiodic streaming string transducers are all equivalent models for first order definable functions. In this paper, we solve the long standing open problem of expressions capturing first order definable functions, thereby generalizing the seminal SF AP (star free expressions aperiodic languages) result of Sch "utzenberger. Our result also generalizes a lesser known characterization by Sch "utzenberger of aperiodic languages by SD regular expressions (SD AP). We show that every first order definable function over finite words captured by an aperiodic deterministic two way transducer can be described with an SD regular transducer expression (SDRTE). An SDRTE is a regular expression where Kleene stars are used in a restricted way they can appear only on aperiodic languages which are prefix codes of bounded synchronization delay. SDRTEs are constructed from simple functions using the combinators unambiguous sum (deterministic choice), Hadamard product, and unambiguous versions of the Cauchy product and the k chained Kleene star, where the star is restricted as mentioned. In order to construct an SDRTE associated with an aperiodic deterministic two way transducer, (i) we concretize Sch "utzenberger's SD AP result, by proving that aperiodic languages are captured by SD regular expressions which are unambiguous and stabilising (ii) by structural induction on the unambiguous, stabilising SD regular expressions describing the domain of the transducer, we construct SDRTEs. Finally, we also look at various formalisms equivalent to SDRTEs which use the function composition, allowing to trade the k chained star for a 1 star.


Tensor Random Projection for Low Memory Dimension Reduction. Random projections reduce the dimension of a set of vectors while preserving structural information, such as distances between vectors in the set. This paper proposes a novel use of row product random matrices in random projection, where we call it Tensor Random Projection (TRP). It requires substantially less memory than existing dimension reduction maps. The TRP map is formed as the Khatri Rao product of several smaller random projections, and is compatible with any base random projection including sparse maps, which enable dimension reduction with very low query cost and no floating point operations. We also develop a reduced variance extension. We provide a theoretical analysis of the bias and variance of the TRP, and a non asymptotic error analysis for a TRP composed of two smaller maps. Experiments on both synthetic and MNIST data show that our method performs as well as conventional methods with substantially less storage.


DataX A system for Data eXchange and transformation of streams. The exponential growth in smart sensors and rapid progress in 5G networks is creating a world awash with data streams. However, a key barrier to building performant multi sensor, distributed stream processing applications is high programming complexity. We propose DataX, a novel platform that improves programmer productivity by enabling easy exchange, transformations, and fusion of data streams. DataX abstraction simplifies the application's specification and exposes parallelism and dependencies among the application functions (microservices). DataX runtime automatically sets up appropriate data communication mechanisms, enables effortless reuse of microservices and data streams across applications, and leverages serverless computing to transform, fuse, and auto scale microservices. DataX makes it easy to write, deploy and reliably operate distributed applications at scale. Synthesizing these capabilities into a single platform is substantially more transformative than any available stream processing system.


Asymptotic stability of planar rarefaction wave to a 2D hyperbolic elliptic coupled system of the radiating gas on half space. This paper studies the asymptotic stability of solution to an initial boundary value problem for a hyperbolic elliptic coupled system on two dimensional half space, where the data on the boundary and at the far field are prescribed as u and u . We show that the solution to the problem converges to the corresponding planar rarefaction wave for 0 le u u as time tends to infinity under smallness assumptions on the initial perturbation and wave strength. These results are based on the analysis of div curl decomposition, the standard L 2 energy method, L 1 estimate, and the monotonicity of profile is given by the maximum principle.


QPIC Query Based Pairwise Human Object Interaction Detection with Image Wide Contextual Information. We propose a simple, intuitive yet powerful method for human object interaction (HOI) detection. HOIs are so diverse in spatial distribution in an image that existing CNN based methods face the following three major drawbacks they cannot leverage image wide features due to CNN's locality, they rely on a manually defined location of interest for the feature aggregation, which sometimes does not cover contextually important regions, and they cannot help but mix up the features for multiple HOI instances if they are located closely. To overcome these drawbacks, we propose a transformer based feature extractor, in which an attention mechanism and query based detection play key roles. The attention mechanism is effective in aggregating contextually important information image wide, while the queries, which we design in such a way that each query captures at most one human object pair, can avoid mixing up the features from multiple instances. This transformer based feature extractor produces so effective embeddings that the subsequent detection heads may be fairly simple and intuitive. The extensive analysis reveals that the proposed method successfully extracts contextually important features, and thus outperforms existing methods by large margins (5.37 mAP on HICO DET, and 5.7 mAP on V COCO). The source codes are available at href https github.com hitachi rd cv qpic text this https URL .


Approximating the Optimal Transport Plan via Particle Evolving Method. Optimal transport (OT) provides powerful tools for comparing probability measures in various types. The Wasserstein distance which arises naturally from the idea of OT is widely used in many machine learning applications. Unfortunately, computing the Wasserstein distance between two continuous probability measures always suffers from heavy computational intractability. In this paper, we propose an innovative algorithm that iteratively evolves a particle system to match the optimal transport plan for two given continuous probability measures. The derivation of the algorithm is based on the construction of the gradient flow of an Entropy Transport Problem which could be naturally understood as a classical Wasserstein optimal transport problem with relaxed marginal constraints. The algorithm comes with theoretical analysis and empirical evidence.


Event Detection in Twitter A Content and Time Based Analysis. The detection of events from online social networks is a recent, evolving field that attracts researchers from across a spectrum of disciplines and domains. Here we report a time series analysis for predicting events. In particular, we evaluated the frequency distribution of top n grams of terms over time, focusing on two indicators high frequency n grams over both short and long periods of time. Both indicators can refer to certain aspects of events as they evolve. To evaluate the models accuracy in detecting events, we built and used a Twitter dataset of the most popular hashtags that surrounded the well documented protests that occurred at the University of Missouri (Mizzou) in late 2015.


A Cantor dynamical system is slow if and only if all its finite orbits are attracting. In this paper, we completely solve the problem when a Cantor dynamical system (X,f) can be embedded in mathbb R with vanishing derivative everywhere. For this purpose, we construct a refining sequence of marked clopen partitions of X which is adapted to a dynamical system of this kind. It turns out that there is a huge class of such systems.


John Nirenberg inequality for Riemann type series. We obtain an improvement of the John Nirenberg inequality for the series of the form sum n 1 infty n 1 e 2 pi i n k x , k 2, on intervals consisting of points of a same convergent of their continued fractions. We also establish a convergence criterion for these series.


Incentivizing Exploration in Linear Bandits under Information Gap. We study the problem of incentivizing exploration for myopic users in linear bandits, where the users tend to exploit arm with the highest predicted reward instead of exploring. In order to maximize the long term reward, the system offers compensation to incentivize the users to pull the exploratory arms, with the goal of balancing the trade off among exploitation, exploration and compensation. We consider a new and practically motivated setting where the context features observed by the user are more informative than those used by the system, e.g., features based on users' private information are not accessible by the system. We propose a new method to incentivize exploration under such information gap, and prove that the method achieves both sublinear regret and sublinear compensation. We theoretical and empirically analyze the added compensation due to the information gap, compared with the case that the system has access to the same context features as the user, i.e., without information gap. We also provide a compensation lower bound of our problem.


Phase Field Methods for Spectral Shape and Topology Optimization. We optimize a selection of eigenvalues of the Laplace operator with Dirichlet or Neumann boundary conditions by adjusting the shape of the domain on which the eigenvalue problem is considered. Here, a phase field function is used to represent the shapes over which we minimize. The idea behind this method is to modify the Laplace operator by introducing phase field dependent coefficients in order to extend the eigenvalue problem on a fixed design domain containing all admissible shapes. The resulting shape and topology optimization problem can then be formulated as an optimal control problem with PDE constraints in which the phase field function acts as the control. For this optimal control problem, we establish first order necessary optimality conditions and we rigorously derive its sharp interface limit. Eventually, we present and discuss several numerical simulations for our optimization problem.


Improving Standing Balance Performance through the Assistance of a Mobile Collaborative Robot. This paper presents the design and development of a robotic system to give physical assistance to the elderly or people with neurological disorders such as Ataxia or Parkinson's. In particular, we propose using a mobile collaborative robot with an interaction assistive whole body interface to help people unable to maintain balance. The robotic system consists of an Omni directional mobile base, a high payload robotic arm, and an admittance type interface acting as a support handle while measuring human sourced interaction forces. The postural balance of the human body is estimated through the projection of the body Center of Mass (CoM) to the support polygon (SP) representing the quasi static Center of Pressure (CoP). In response to the interaction forces and the tracking of the human posture, the robot can create assistive forces to restore balance in case of its loss. Otherwise, during normal stance or walking, it will follow the user with minimum no opposing forces through the generation of coupled arm and base movements. As the balance restoring strategy, we propose two strategies and evaluate them in a laboratory setting on healthy human participants. Quantitative and qualitative results of a 12 subjects experiment are then illustrated and discussed, comparing the performances of the two strategies and the overall system.


A Hybrid Inference System for Improved Curvature Estimation in the Level Set Method Using Machine Learning. We present a novel hybrid strategy based on machine learning to improve curvature estimation in the level set method. The proposed inference system couples enhanced neural networks with standard numerical schemes to compute curvature more accurately. The core of our hybrid framework is a switching mechanism that relies on well established numerical techniques to gauge curvature. If the curvature magnitude is larger than a resolution dependent threshold, it uses a neural network to yield a better approximation. Our networks are multilayer perceptrons fitted to synthetic data sets composed of sinusoidal and circular interface samples at various configurations. To reduce data set size and training complexity, we leverage the problem's characteristic symmetry and build our models on just half of the curvature spectrum. These savings lead to a powerful inference system able to outperform any of its numerical or neural component alone. Experiments with stationary, smooth interfaces show that our hybrid solver is notably superior to conventional numerical methods in coarse grids and along steep interface regions. Compared to prior research, we have observed outstanding gains in precision after training the regression model with data pairs from more than a single interface type and transforming data with specialized input preprocessing. In particular, our findings confirm that machine learning is a promising venue for reducing or removing mass loss in the level set method.


A kiloelectron volt ultrafast electron micro diffraction apparatus using low emittance semiconductor photocathodes. We report the design and performance of a time resolved electron diffraction apparatus capable of producing intense bunches with simultaneously single digit micron probe size, long coherence length, and 200 fs rms time resolution. We measure the 5d (peak) beam brightness at the sample location in micro diffraction mode to be 7 times 10 13 mathrm A text m 2 text rad 2 . To generate high brightness electron bunches, the system employs high efficiency, low emittance semiconductor photocathodes driven with a wavelength near the photoemission threshold at a repetition rate up to 250 kHz. We characterize spatial, temporal, and reciprocal space resolution of the apparatus. We perform proof of principle measurements of ultrafast heating in single crystal Au samples and compare experimental results with simulations that account for the effects of multiple scattering.


Canadian Contributions to the Manhattan Project and Early Nuclear Research. During the second world war, Canada made several important contributions to the wartime work of the Manhattan Project. The three main contributions were establishing a domestic nuclear research laboratory in Montreal to investigate heavy water reactors, creating supply chains to provide uranium oxide, heavy water and polonium to the Manhattan Project, and the direct contributions of several Canadians living the United States. These wartime efforts helped establish a legacy of nuclear research in Canada which has persisted to the present day.


Iterative method for fast estimation of convective drying characteristics of biomass. Convective drying of biomass is an important technological solution required to increase the quality of biomass for efficient biomass conversion in heat and power generation sector. We propose a fully predictive method based on iteratively solving heat power conservation equation, which evaluates the convective drying rate for deep fixed porous material bed containing any type of evaporating liquid during a constant rate drying period with given inlet air parameters. The analysis of the heat power conservation equation during the constant rate period showed that the drying rate of deep fixed moist porous material bed is a linear function of the inlet air mass flow rate and is independent of the initial masses of water and dry material inside the bed when inlet air absolute humidity is constant. Furthermore, the proposed method estimates the theoretical maximum possible drying rate for a drying system with given inlet air conditions and therefore, it can be used as an important tool for designing industrial equipment and verifying the correctness of drying experiments.


Stochastic Adversarial Koopman Model for Dynamical Systems. Dynamical systems are ubiquitous and are often modeled using a non linear system of governing equations. Numerical solution procedures for many dynamical systems have existed for several decades, but can be slow due to high dimensional state space of the dynamical system. Thus, deep learning based reduced order models (ROMs) are of interest and one such family of algorithms along these lines are based on the Koopman theory. This paper extends a recently developed adversarial Koopman model (Balakrishnan Upadhyay, arXiv 2006.05547) to stochastic space, where the Koopman operator applies on the probability distribution of the latent encoding of an encoder. Specifically, the latent encoding of the system is modeled as a Gaussian, and is advanced in time by using an auxiliary neural network that outputs two Koopman matrices K mu and K sigma . Adversarial and gradient losses are used and this is found to lower the prediction errors. A reduced Koopman formulation is also undertaken where the Koopman matrices are assumed to have a tridiagonal structure, and this yields predictions comparable to the baseline model with full Koopman matrices. The efficacy of the stochastic Koopman model is demonstrated on different test problems in chaos, fluid dynamics, combustion, and reaction diffusion models. The proposed model is also applied in a setting where the Koopman matrices are conditioned on other input parameters for generalization and this is applied to simulate the state of a Lithium ion battery in time. The Koopman models discussed in this study are very promising for the wide range of problems considered.


cs.LG cs.NA math.DS math.NA physics.comp-ph

Data driven Prediction of General Hamiltonian Dynamics via Learning Exactly Symplectic Maps. We consider the learning and prediction of nonlinear time series generated by a latent symplectic map. A special case is (not necessarily separable) Hamiltonian systems, whose solution flows give such symplectic maps. For this special case, both generic approaches based on learning the vector field of the latent ODE and specialized approaches based on learning the Hamiltonian that generates the vector field exist. Our method, however, is different as it does not rely on the vector field nor assume its existence instead, it directly learns the symplectic evolution map in discrete time. Moreover, we do so by representing the symplectic map via a generating function, which we approximate by a neural network (hence the name GFNN). This way, our approximation of the evolution map is always emph exactly symplectic. This additional geometric structure allows the local prediction error at each step to accumulate in a controlled fashion, and we will prove, under reasonable assumptions, that the global prediction error grows at most emph linearly with long prediction time, which significantly improves an otherwise exponential growth. In addition, as a map based and thus purely data driven method, GFNN avoids two additional sources of inaccuracies common in vector field based approaches, namely the error in approximating the vector field by finite difference of the data, and the error in numerical integration of the vector field for making predictions. Numerical experiments further demonstrate our claims.


Distributed Banach Picard Iteration for Locally Contractive Maps. The Banach Picard iteration is widely used to find fixed points of locally contractive (LC) maps. This paper extends the Banach Picard iteration to distributed settings specifically, we assume the map of which the fixed point is sought to be the average of individual (not necessarily LC) maps held by a set of agents linked by a communication network. An additional difficulty is that the LC map is not assumed to come from an underlying optimization problem, which prevents exploiting strong global properties such as convexity or Lipschitzianity. Yet, we propose a distributed algorithm and prove its convergence, in fact showing that it maintains the linear rate of the standard Banach Picard iteration for the average LC map. As another contribution, our proof imports tools from perturbation theory of linear operators, which, to the best of our knowledge, had not been used before in the theory of distributed computation.


An Interoperable Open Data Portal for Climate Analysis. This work proposes an open interoperable data portal that offers access to a Web wide climate domain knowledge graph created for Ireland and England's NOAA climate daily data. There are three main components contributing to this data portal the first is the upper layer schema of the knowledge graph the climate analysis (CA) ontology the second is an ad hoc SPARQL server by which to store the graph data and provide public Web access, the last is a dereferencing engine deployed to resolve URIs for entity information. Our knowledge graph form of NOAA climate data facilitates the supply of semantic climate information to researchers and offers a variety of semantic applications that can be built on top of it.


Traffic control Management System and Collision Avoidance System. Many road accidents occur due to drivers failing to read sign board due to various reasons. Especially at night, the tiredness of driver reduces his perception to small things like speed limit of sign the board, curve ahead sign board. For the smooth movement of ambulance in cities during traffic, is to create an IOT device to detect sign boards and also able to com municate with the traffic light and makes way for ambulance. Implementation is done by detecting sign boards and measuring speed of vehicle using arduino and RF transmitter which transmits the specific beep sound to specific type of application like speed breaker, school zone etc. The vehicle also contains RF receiver and arduino, which starts receiving the beep sound when near to sign board. After receiving the code, arduino starts measuring the current speed of vehicle and if the speed is above recommended speed then it starts gives alert. If the vehicle speed is not reduced even after the alert then the vehicle will auto break. With the help of this Traffic Management System (TMS), we can record the number of users who do not reduce vehicle speed even when prompted by the system alerts.


Solving Systems of Equations of Raising to Powers Type. We address special cases of the analogues of the exponential algebraic closedness conjecture relative to the exponential maps of semiabelian varieties and to the modular j function. In particular, we show that the graph of the exponential of an abelian variety intersects products of free rotund varieties in which the subvariety of the domain is a sufficiently generic linear subspace, and that the graph of j intersects products of free broad varieties in which the subvariety of the domain is a M "obius subvariety.


Strongly Sublinear Algorithms for Testing Pattern Freeness. Given a permutation pi k to k , a function f n to mathbb R contains a pi appearance if there exists 1 leq i 1 i 2 dots i k leq n such that for all s,t in k , it holds that f(i s) f(i t) if and only if pi(s) pi(t) . The function is pi free if it has no pi appearances. In this paper, we investigate the problem of testing whether an input function f is pi free or whether at least varepsilon n values in f need to be changed in order to make it pi free. This problem is a generalization of the well studied monotonicity testing and was first studied by Newman, Rabinovich, Rajendraprasad and Sohler (Random Structures and Algorithms 2019). We show that for all constants k in mathbb N , varepsilon in (0,1) , and permutation pi k to k , there is a one sided error varepsilon testing algorithm for pi freeness of functions f n to mathbb R that makes tilde O (n o(1) ) queries. We improve significantly upon the previous best upper bound O(n 1 1 (k 1) ) by Ben Eliezer and Canonne (SODA 2018). Our algorithm is adaptive, while the earlier best upper bound is known to be tight for nonadaptive algorithms.


A Swarm Variant for the Schr "odinger Solver. This paper introduces application of the Exponentially Averaged Momentum Particle Swarm Optimization (EM PSO) as a derivative free optimizer for Neural Networks. It adopts PSO's major advantages such as search space exploration and higher robustness to local minima compared to gradient descent optimizers such as Adam. Neural network based solvers endowed with gradient optimization are now being used to approximate solutions to Differential Equations. Here, we demonstrate the novelty of EM PSO in approximating gradients and leveraging the property in solving the Schr "odinger equation, for the Particle in a Box problem. We also provide the optimal set of hyper parameters supported by mathematical proofs, suited for our algorithm.


Advanced Accelerator Concepts. Recent years have seen spectacular progress in the development of innovative acceleration methods that are not based on traditional RF accelerating structures. These novel developments are at the interface of laser, plasma and accelerator physics and may potentially lead to much more compact and cost effective accelerator facilities. While primarily focusing on the ability to accelerate charged particles with much larger gradients than traditional RF structures, these new techniques have yet to demonstrate comparable performances to RF structures in terms of both beam parameters and reproducibility. To guide the developments beyond the necessary basic R D and concept validations, a common understanding and definition of required performance and beam parameters for an operational user facility is now needed. These innovative user facilities can include "table top" light sources, medical accelerators, industrial accelerators or even high energy colliders. This paper will review the most promising developments in new acceleration methods and it will present the status of on going projects.


Multi label Classification with Partial Annotations using Class aware Selective Loss. Large scale multi label classification datasets are commonly, and perhaps inevitably, partially annotated. That is, only a small subset of labels are annotated per sample. Different methods for handling the missing labels induce different properties on the model and impact its accuracy. In this work, we analyze the partial labeling problem, then propose a solution based on two key ideas. First, un annotated labels should be treated selectively according to two probability quantities the class distribution in the overall dataset and the specific label likelihood for a given data sample. We propose to estimate the class distribution using a dedicated temporary model, and we show its improved efficiency over a naive estimation computed using the dataset's partial annotations. Second, during the training of the target model, we emphasize the contribution of annotated labels over originally un annotated labels by using a dedicated asymmetric loss. With our novel approach, we achieve state of the art results on OpenImages dataset (e.g. reaching 87.3 mAP on V6). In addition, experiments conducted on LVIS and simulated COCO demonstrate the effectiveness of our approach. Code is available at https github.com Alibaba MIIL PartialLabelingCSL.


Extinction time in growth models subject to geometric catastrophes. Recently, different dispersion strategies in population models subject to geometric catastrophes have been considered as strategies to improve the chance of po pu lation's survival. Such dispersion strategies have been contrasted with the strategy where there is no dispersion, comparing the probabilities of survival. In this article, we contrast survival strategies when extinction occurs almost surely, evaluating which strategy prolongs population's life span. Our results allow one to analyze what is the best strategy for survival based on parameters as the probability that each individual exposed to catastrophe survives, the growth rate of the colony, the type of dispersion and the spatial restrictions.


Measurement of the miscut angle in the determination of the Si lattice parameter. The measurement of the angle between the interferometer front mirror and the diffracting planes is a critical aspect of the Si lattice parameter measurement by combined x ray and optical interferometry. In addition to being measured off line by x ray diffraction, it was checked on line by transversely moving the analyser crystal and observing the phase shift of the interference fringe. We describe the measurement procedure and give the miscut angle of the 28 Si crystal whose lattice parameter was an essential input datum for, yesterday, the determination of the Avogadro constant and, today, the kilogram realisation by counting atoms. These data are a kindness to others that might wish to repeat the measurement of the lattice parameter of this unique crystal.


Value Function based Sequential Minimization for Bi level Optimization. Gradient based Bi Level Optimization (BLO) methods have been widely applied to solve modern machine learning problems. However, most existing solution strategies are theoretically designed based on restrictive assumptions (e.g., convexity of the lower level sub problem), and computationally not applicable for high dimensional tasks. Moreover, there are almost no gradient based methods that can efficiently handle BLO in those challenging scenarios, such as BLO with functional constraints and pessimistic BLO. In this work, by reformulating BLO into an approximated single level problem based on the value function, we provide a new method, named Bi level Value Function based Sequential Minimization (BVFSM), to partially address the above issues. To be specific, BVFSM constructs a series of value function based approximations, and thus successfully avoids the repeated calculations of recurrent gradient and Hessian inverse required by existing approaches, which are time consuming (especially for high dimensional tasks). We also extend BVFSM to address BLO with additional upper and lower level functional constraints. More importantly, we demonstrate that the algorithmic framework of BVFSM can also be used for the challenging pessimistic BLO, which has never been properly solved by existing gradient based methods. On the theoretical side, we strictly prove the convergence of BVFSM on these types of BLO, in which the restrictive lower level convexity assumption is completely discarded. To our best knowledge, this is the first gradient based algorithm that can solve different kinds of BLO problems (e.g., optimistic, pessimistic and with constraints) all with solid convergence guarantees. Extensive experiments verify our theoretical investigations and demonstrate the superiority of BVFSM on various real world applications.


On the area of empty axis parallel rectangles amidst 2 dimensional lattice points. The dispersion of a point set in the unit square is defined to be the area of the largest empty axis parallel box. In this paper we are interested in the dispersion of lattices in the plane, that is, the supremum of the area of the empty axis parallel boxes amidst the lattice points. We introduce a framework with which to study this based on the continued fractions expansions of the generators of the lattice. This framework proves so successful that we were unable to ask a question that we could not answer. We give necessary and sufficient conditions under which a lattice has finite dispersion. We obtain an exact formula for the dispersion of the lattices associated to subgroups of the ring of integer of a quadratic field. We have tight bounds for the dispersion of a lattice based the largest continued fraction coefficient of the generators, accurate to within one half. We know what the n th best lattice is. We provide an equivalent formulation of Zaremba's conjecture. Using our framework we are able to give alternative proofs of the results from two other papers in only a few lines.


Learning Graph Representations for Influence Maximization. As the field of machine learning for combinatorial optimization advances, traditional problems are resurfaced and readdressed through this new perspective. The overwhelming majority of the literature focuses on small graph problems, while several real world problems are devoted to large graphs. Here, we focus on two such problems influence estimation, a P hard counting problem, and influence maximization, an NP hard problem. We develop GLIE, a Graph Neural Network (GNN) that inherently parameterizes an upper bound of influence estimation and train it on small simulated graphs. Experiments show that GLIE provides accurate influence estimation for real graphs up to 10 times larger than the train set. More importantly, it can be used for influence maximization on considerably larger graphs, as the predictions ranking is not affected by the drop of accuracy. We develop a version of CELF optimization with GLIE instead of simulated influence estimation, surpassing the benchmark for influence maximization, although with a computational overhead. To balance the time complexity and quality of influence, we propose two different approaches. The first is a Q network that learns to choose seeds sequentially using GLIE's predictions. The second defines a provably submodular function based on GLIE's representations to rank nodes fast while building the seed set. The latter provides the best combination of time efficiency and influence spread, outperforming SOTA benchmarks.


On Addressing Heterogeneity in Federated Learning for Autonomous Vehicles Connected to a Drone Orchestrator. In this paper we envision a federated learning (FL) scenario in service of amending the performance of autonomous road vehicles, through a drone traffic monitor (DTM), that also acts as an orchestrator. Expecting non IID data distribution, we focus on the issue of accelerating the learning of a particular class of critical object (CO), that may harm the nominal operation of an autonomous vehicle. This can be done through proper allocation of the wireless resources for addressing learner and data heterogeneity. Thus, we propose a reactive method for the allocation of wireless resources, that happens dynamically each FL round, and is based on each learner's contribution to the general model. In addition to this, we explore the use of static methods that remain constant across all rounds. Since we expect partial work from each learner, we use the FedProx FL algorithm, in the task of computer vision. For testing, we construct a non IID data distribution of the MNIST and FMNIST datasets among four types of learners, in scenarios that represent the quickly changing environment. The results show that proactive measures are effective and versatile at improving system accuracy, and quickly learning the CO class when underrepresented in the network. Furthermore, the experiments show a tradeoff between FedProx intensity and resource allocation efforts. Nonetheless, a well adjusted FedProx local optimizer allows for an even better overall accuracy, particularly when using deeper neural network (NN) implementations.


Face Verification with Challenging Imposters and Diversified Demographics. Face verification aims to distinguish between genuine and imposter pairs of faces, which include the same or different identities, respectively. The performance reported in recent years gives the impression that the task is practically solved. Here, we revisit the problem and argue that existing evaluation datasets were built using two oversimplifying design choices. First, the usual identity selection to form imposter pairs is not challenging enough because, in practice, verification is needed to detect challenging imposters. Second, the underlying demographics of existing datasets are often insufficient to account for the wide diversity of facial characteristics of people from across the world. To mitigate these limitations, we introduce the FaVCI2D dataset. Imposter pairs are challenging because they include visually similar faces selected from a large pool of demographically diversified identities. The dataset also includes metadata related to gender, country and age to facilitate fine grained analysis of results. FaVCI2D is generated from freely distributable resources. Experiments with state of the art deep models that provide nearly 100 performance on existing datasets show a significant performance drop for FaVCI2D , confirming our starting hypothesis. Equally important, we analyze legal and ethical challenges which appeared in recent years and hindered the development of face analysis research. We introduce a series of design choices which address these challenges and make the dataset constitution and usage more sustainable and fairer. FaVCI2D is available at url https github.com AIMultimediaLab FaVCI2D Face Verification with Challenging Imposters and Diversified Demographics .


Hyperpolarization of cis 15N,15N' azobenzene by parahydrogen at ultralow magnetic fields. Development of the methods to exploit nuclear hyperpolarization and search for molecules whose nuclear spins can be efficiently hyperpolarized is an active area in nuclear magnetic resonance. Of particular interest are those molecules that have long nuclear relaxation times, making them to be suitable candidates as contrast agents in magnetic resonance imaging. In this work, we present a detailed study of SABRE SHEATH (Signal Amplification By Reversible Exchange in Shield Enabled Alignment Transfer to Heteronuclei) experiments of 15N,15N' azobenzene. In SABRE SHEATH experiments nuclear spins of the target are hyperpolarized by transfer of spin polarization from parahydrogen at ultralow fields during a reversible chemical process. The studied system is complicated, and we are concerned only about a subset of the data, presenting details for the molecules that experience fast chemical exchange at the catalytic complex and thus are involved in polarizing the free azobenzene. Azobenzene exists in two isomers trans and cis . We show that all nuclear spins in cis azobenzene can be efficiently hyperpolarized by SABRE at suitable magnetic fields. Enhancement factors (relative to 9.4 T) reach several thousands of times for 15N spins and a few tens of times for the 1H spins. There are two approaches to observe either hyperpolarized magnetization of 15N 1H spins or hyperpolarized singlet order of the 15N spin pair. We compare these approaches and present the field dependencies of SABRE experiments for them. No hyperpolarization of trans 15N,15N' azobenzene was observed. The results presented here will be useful for further experiments where hyperpolarized cis 15N,15N' azobenzene is switched by light to trans 15N,15N' azobenzene for storing the produced hyperpolarization in the long lived spin state of the 15N pair of trans 15N,15N' azobenzene.


Unsupervised Discovery of Actions in Instructional Videos. In this paper we address the problem of automatically discovering atomic actions in unsupervised manner from instructional videos. Instructional videos contain complex activities and are a rich source of information for intelligent agents, such as, autonomous robots or virtual assistants, which can, for example, automatically read' the steps from an instructional video and execute them. However, videos are rarely annotated with atomic activities, their boundaries or duration. We present an unsupervised approach to learn atomic actions of structured human tasks from a variety of instructional videos. We propose a sequential stochastic autoregressive model for temporal segmentation of videos, which learns to represent and discover the sequential relationship between different atomic actions of the task, and which provides automatic and unsupervised self labeling for videos. Our approach outperforms the state of the art unsupervised methods with large margins. We will open source the code.


Finding Structure in Silence The Role of Pauses in Aligning Speaker Expectations. Mutual predictability is a key component of spoken communication. Speakers must synchronize their expectations about a time variant source to distinguish signal from noise. Yet how this is achieved across speakers whose experience differs remains an open question. We examine the role of silence in speaker alignment, asking whether statistical regularities among pauses can satisfy the dynamic functional requirements associated with aligning expectations about spectral and temporal variation. We describe how pauses can provide information that allows for the maintenance of a time invariant template for structuring spontaneous articulations. An analysis of speech pauses in conversational English and Korean reveals that empirical distributions of pauses provide a memoryless information source. We then show how this can facilitate the initial structuring of noisy signals and the maintenance of predictability in complex structured articulations over time. The English pause distribution provides sparse patterns of local activity that can enable dynamic adaptation to the variable temporal resolution in signals, whereas Korean pause information appears to exert a more global influence. These results indicate that pauses provide a structuring signal that interacts with the morphological and rhythmical structure of language, further supporting the hypothesis that vocal communication in humans is a product of alignment in time.


Collimation and finite size effects in suspended resonant guided mode gratings. The optical transmission of resonant guided mode gratings patterned on suspended silicon nitride thin films and illuminated at normal incidence with a Gaussian beam are investigated both experimentally and theoretically. Effects due to the beam focusing and its finite size are accounted for by a phenomenological coupled mode model whose predictions are found to be in very good agreement with the experimentally measured spectra for various grating structures and beam sizes, and which allow for a detailed analysis of the respective magnitude of these effects. These results are highly relevant for the design and optimization of such suspended structured films which are widely used for photonics, sensing and optomechanics applications.


Structure aware Person Image Generation with Pose Decomposition and Semantic Correlation. In this paper we tackle the problem of pose guided person image generation, which aims to transfer a person image from the source pose to a novel target pose while maintaining the source appearance. Given the inefficiency of standard CNNs in handling large spatial transformation, we propose a structure aware flow based method for high quality person image generation. Specifically, instead of learning the complex overall pose changes of human body, we decompose the human body into different semantic parts (e.g., head, torso, and legs) and apply different networks to predict the flow fields for these parts separately. Moreover, we carefully design the network modules to effectively capture the local and global semantic correlations of features within and among the human parts respectively. Extensive experimental results show that our method can generate high quality results under large pose discrepancy and outperforms state of the art methods in both qualitative and quantitative comparisons.


Pedestrian Path Modification Mobile Tool for COVID 19 Social Distancing for Use in Multi Modal Trip Navigation. The novel Corona virus pandemic is one of the biggest worldwide problems right now. While hygiene and wearing masks make up a large portion of the currently suggested precautions by the Centers for Disease Control and Prevention (CDC) and World Health Organization (WHO), social distancing is another and arguably the most important precaution that would protect people since the airborne virus is easily transmitted through the air. Social distancing while walking outside, can be more effective, if pedestrians know locations of each other and even better if they know locations of people who are possible carriers. With this information, they can change their routes depending on the people walking nearby or they can stay away from areas that contain or have recently contained crowds. This paper presents a mobile device application that would be a very beneficial tool for social distancing during Coronavirus Disease 2019 (COVID 19). The application works, synced close to real time, in a networking fashion with all users obtaining their locations and drawing a virtual safety bubble around them. These safety bubbles are used with the constant velocity pedestrian model to predict possible future social distancing violations and warn the user with sound and vibration. Moreover, it takes into account the virus staying airborne for a certain time, hence, creating time decaying non safe areas in the past trajectories of the users. The mobile app generates collision free paths for navigating around the undesired locations for the pedestrian mode of transportation when used as part of a multi modal trip planning app. Results are applicable to other modes of transportation also. Features and the methods used for implementation are discussed in the paper. The application is tested using previously collected real pedestrian walking data in a realistic environment.


Data Driven Modeling of Coarse Mesh Turbulence for Reactor Transient Analysis Using Convolutional Recurrent Neural Networks. Advanced nuclear reactors often exhibit complex thermal fluid phenomena during transients. To accurately capture such phenomena, a coarse mesh three dimensional (3 D) modeling capability is desired for modern nuclear system code. In the coarse mesh 3 D modeling of advanced reactor transients that involve flow and heat transfer, accurately predicting the turbulent viscosity is a challenging task that requires an accurate and computationally efficient model to capture the unresolved fine scale turbulence. In this paper, we propose a data driven coarse mesh turbulence model based on local flow features for the transient analysis of thermal mixing and stratification in a sodium cooled fast reactor. The model has a coarse mesh setup to ensure computational efficiency, while it is trained by fine mesh computational fluid dynamics (CFD) data to ensure accuracy. A novel neural network architecture, combining a densely connected convolutional network and a long short term memory network, is developed that can efficiently learn from the spatial temporal CFD transient simulation results. The neural network model was trained and optimized on a loss of flow transient and demonstrated high accuracy in predicting the turbulent viscosity field during the whole transient. The trained model's generalization capability was also investigated on two other transients with different inlet conditions. The study demonstrates the potential of applying the proposed data driven approach to support the coarse mesh multi dimensional modeling of advanced reactors.


Beyond the Weyl barrier for mathrm GL (2) exponential sums. In this paper, we use the Bessel delta method, along with new variants of the van der Corput method in two dimensions, to prove non trivial bounds for mathrm GL (2) exponential sums beyond the Weyl barrier. More explicitly, for sums of mathrm GL (2) Fourier coefficients twisted by e(f(n)) , with length N and phase f(n) N beta log n 2 pi or a n beta , non trivial bounds are established for beta 1.63651... , which is beyond the Weyl barrier at beta 3 2 .


Action Shuffle Alternating Learning for Unsupervised Action Segmentation. This paper addresses unsupervised action segmentation. Prior work captures the frame level temporal structure of videos by a feature embedding that encodes time locations of frames in the video. We advance prior work with a new self supervised learning (SSL) of a feature embedding that accounts for both frame and action level structure of videos. Our SSL trains an RNN to recognize positive and negative action sequences, and the RNN's hidden layer is taken as our new action level feature embedding. The positive and negative sequences consist of action segments sampled from videos, where in the former the sampled action segments respect their time ordering in the video, and in the latter they are shuffled. As supervision of actions is not available and our SSL requires access to action segments, we specify an HMM that explicitly models action lengths, and infer a MAP action segmentation with the Viterbi algorithm. The resulting action segmentation is used as pseudo ground truth for estimating our action level feature embedding and updating the HMM. We alternate the above steps within the Generalized EM framework, which ensures convergence. Our evaluation on the Breakfast, YouTube Instructions, and 50Salads datasets gives superior results to those of the state of the art.


A note on the Maximum Principle and the Iteration Method for elliptic equations. We use an iteration procedure propped up by a a classical form of the maximum principle to show the existence of solutions to a nonlinear Poisson equation with Dirichlet boundary conditions. These methods can be applied to the case of special unbounded domains, and can be adapted to show the existence of nontrivial solutions to systems, which we show via some examples.


Answering Chinese Elementary School Social Study Multiple Choice Questions. We present a novel approach to answer the Chinese elementary school Social Study Multiple Choice questions. Although BERT has demonstrated excellent performance on Reading Comprehension tasks, it is found not good at handling some specific types of questions, such as Negation, All of the above, and None of the above. We thus propose a novel framework to cascade BERT with a Pre Processor and an Answer Selector modules to tackle the above challenges. Experimental results show the proposed approach effectively improves the performance of BERT, and thus demonstrate the feasibility of supplementing BERT with additional modules.


Interactive Inverse Reinforcement Learning for Cooperative Games. We study the problem of designing AI agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic two agent Markov decision process. We assume control over only the first of the two agents in a Stackelberg formulation of the game, where the second agent is acting so as to maximise expected utility given the first agent's policy. How should the first agent act in order to learn the joint reward function as quickly as possible, and so that the joint policy is as close to optimal as possible? In this paper, we analyse how knowledge about the reward function can be gained in this interactive two agent scenario. We show that when the learning agent's policies have a significant effect on the transition function, the reward function can be learned efficiently.


Efficient training for future video generation based on hierarchical disentangled representation of latent variables. Generating videos predicting the future of a given sequence has been an area of active research in recent years. However, an essential problem remains unsolved most of the methods require large computational cost and memory usage for training. In this paper, we propose a novel method for generating future prediction videos with less memory usage than the conventional methods. This is a critical stepping stone in the path towards generating videos with high image quality, similar to that of generated images in the latest works in the field of image generation. We achieve high efficiency by training our method in two stages (1) image reconstruction to encode video frames into latent variables, and (2) latent variable prediction to generate the future sequence. Our method achieves an efficient compression of video into low dimensional latent variables by decomposing each frame according to its hierarchical structure. That is, we consider that video can be separated into background and foreground objects, and that each object holds time varying and time independent information independently. Our experiments show that the proposed method can efficiently generate future prediction videos, even for complex datasets that cannot be handled by previous methods.


A Finsler Geometrical Programming for the Nonlinear Complementarity Problem of Traffic Equilibrium. This work is a geometrical approach to the optimization problem motivated by transportation system management. First, an attempt has been made to furnish a comprehensive account of geometric programming based on the elementary Finsler geometry in I ! !R n . Then, a Finslerian dynamical model for the nonlinear complementarity problem of traffic equilibrium is presented that may be applied for different equilibrium problems.


Dataset and Benchmarking of Real Time Embedded Object Detection for RoboCup SSL. When producing a model to object detection in a specific context, the first obstacle is to have a dataset labeling the desired classes. In RoboCup, some leagues already have more than one dataset to train and evaluate a model. However, in the Small Size League (SSL), there is not such dataset available yet. This paper presents an open source dataset to be used as a benchmark for real time object detection in SSL. This work also presented a pipeline to train, deploy, and evaluate Convolutional Neural Networks (CNNs) models in a low power embedded system. This pipeline was used to evaluate the proposed dataset with state of art optimized models. In this dataset, the MobileNet SSD v1 achieves 44.88 AP (68.81 AP50) at 94 Frames Per Second (FPS) while running on an SSL robot.


Random Embeddings and Linear Regression can Predict Protein Function. Large self supervised models pretrained on millions of protein sequences have recently gained popularity in generating embeddings of protein sequences for protein function prediction. However, the absence of random baselines makes it difficult to conclude whether pretraining has learned useful information for protein function prediction. Here we show that one hot encoding and random embeddings, both of which do not require any pretraining, are strong baselines for protein function prediction across 14 diverse sequence to function tasks.


Rotation of polarization of light propagating through a gas of molecular super rotors. We present a detailed theoretical and experimental study of the rotation of the plane of polarization of light traveling through a gas of fast spinning molecules. This effect is similar to the polarization drag phenomenon predicted by Fermi a century ago and it is a mechanical analog of the Faraday effect. In our experiments, molecules were spun up by an optical centrifuge and brought to the super rotor state that retains its rotation for a relatively long time. Polarizability properties of fast rotating molecules were analyzed considering the rotational Doppler effect and Coriolis forces. We used molecular dynamics simulations to account for intermolecular collisions. We found, both experimentally and theoretically, a nontrivial nonmonotonic time dependence of the polarization rotation angle. This time dependence reflects transfer of the angular momentum from rotating molecules to the macroscopic gas flow, which may lead to the birth of gas vortices. Moreover, we show that the long term behavior of the polarization rotation is sensitive to the details of the intermolecular potential. Thus, the polarization drag effect appears as a novel diagnostic tool for the characterization of intermolecular interaction potentials and studies of collisional processes in gases.


An Attention Based Neural Network for Code Switching Detection English Roman Urdu. Code switching is a common phenomenon among people with diverse lingual background and is widely used on the internet for communication purposes. In this paper, we present a Recurrent Neural Network combined with the Attention Model for Language Identification in Code Switched Data in English and low resource Roman Urdu. The attention model enables the architecture to learn the important features of the languages hence classifying the code switched data. We demonstrated our approach by comparing the results with state of the art models i.e. Hidden Markov Models, Conditional Random Field and Bidirectional LSTM. The models evaluation, using confusion matrix metrics, showed that the attention mechanism provides improved the precision and accuracy as compared to the other models.


Dynamic Proportional Rankings. Proportional ranking rules aggregate approval style preferences of agents into a collective ranking such that groups of agents with similar preferences are adequately represented. Motivated by the application of live Q A platforms, where submitted questions need to be ranked based on the interests of the audience, we study a dynamic extension of the proportional rankings setting. In our setting, the goal is to maintain the proportionality of a ranking when alternatives (i.e., questions) not necessarily from the top of the ranking get selected sequentially. We propose generalizations of well known aggregation rules to this setting and study their monotonicity and proportionality properties. We also evaluate the performance of these rules experimentally, using realistic probabilistic assumptions on the selection procedure.


From one to many rainbow Hamiltonian cycles. Given a graph G and a family mathcal G G 1, ldots,G n of subgraphs of G , a transversal of mathcal G is a pair (T, phi) such that T subseteq E(G) and phi T rightarrow n is a bijection satisfying e in G phi(e) for each e in T . We call a transversal Hamiltonian if T corresponds to the edge set of a Hamiltonian cycle in G . We show that, under certain conditions on the maximum degree of G and the minimum degrees of the G i in mathcal G , for every mathcal G which contains a Hamiltonian transversal, the number of Hamiltonian transversals contained in mathcal G is bounded below by a function of G 's maximum degree. This generalizes a theorem of Thomassen stating that, for m geq 300 , no m regular graph is uniquely Hamiltonian. We also extend Joos and Kim's recent result that, if G K n and each G i in mathcal G has minimum degree at least frac n 2 , then mathcal G has a Hamiltonian transversal we show that, in this setting, mathcal G has exponentially many Hamiltonian transversals. Finally, we prove analogues of both of these theorems for transversals which form perfect matchings of G .


Dynamical clustering of U.S. states reveals four distinct infection patterns that predict SARS CoV 2 pandemic behavior. The SARS CoV 2 pandemic has so far unfolded diversely across the fifty United States of America, reflected both in different time progressions of infection "waves" and in magnitudes of local infection rates. Despite a marked diversity of presentations, most U.S. states experienced their single greatest surge in daily new cases during the transition from Fall 2020 to Winter 2021. Popular media also cite additional similarities between states often despite disparities in governmental policies, reported mask wearing compliance rates, and vaccination percentages. Here, we identify a set of robust, low dimensional clusters that 1) summarize the timings and relative heights of four historical COVID 19 "wave opportunities" accessible to all 50 U.S. states, 2) correlate with geographical and intervention patterns associated with those groups of states they encompass, and 3) predict aspects of the "fifth wave" of new infections in the late Summer of 2021. In particular, we argue that clustering elucidates a negative relationship between vaccination rates and subsequent case load variabilities within state groups. We advance the hypothesis that vaccination acts as a seat belt," in effect constraining the likely range of new case upticks, even in the context of the Summer 2021, variant driven surge.


Information flows of diverse autoencoders. The outstanding performance of deep learning in various fields has been a fundamental query, which can be potentially examined using information theory that interprets the learning process as the transmission and compression of information. Information plane analyses of the mutual information between the input hidden output layers demonstrated two distinct learning phases of fitting and compression. It is debatable if the compression phase is necessary to generalize the input output relations extracted from training data. In this study, we investigated this through experiments with various species of autoencoders and evaluated their information processing phase with an accurate kernel based estimator of mutual information. Given sufficient training data, vanilla autoencoders demonstrated the compression phase, which was amplified after imposing sparsity regularization for hidden activities. However, we found that the compression phase is not universally observed in different species of autoencoders, including variational autoencoders, that have special constraints on network weights or manifold of hidden space. These types of autoencoders exhibited perfect generalization ability for test data without requiring the compression phase. Thus, we conclude that the compression phase is not necessary for generalization in representation learning.