I Can See it in Your Eyes Gaze as an Implicit Cue of Uncanniness and Task Performance in Repeated Interactions. Over the past years, extensive research has been dedicated to developing robust platforms and data driven dialog models to support long term human robot interactions. However, little is known about how people's perception of robots and engagement with them develop over time and how these can be accurately assessed through implicit and continuous measurement techniques. In this paper, we explore this by involving participants in three interaction sessions with multiple days of zero exposure in between. Each session consists of a joint task with a robot as well as two short social chats with it before and after the task. We measure participants' gaze patterns with a wearable eye tracker and gauge their perception of the robot and engagement with it and the joint task using questionnaires. Results disclose that aversion of gaze in a social chat is an indicator of a robot's uncanniness and that the more people gaze at the robot in a joint task, the worse they perform. In contrast with most HRI literature, our results show that gaze towards an object of shared attention, rather than gaze towards a robotic partner, is the most meaningful predictor of engagement in a joint task. Furthermore, the analyses of gaze patterns in repeated interactions disclose that people's mutual gaze in a social chat develops congruently with their perceptions of the robot over time. These are key findings for the HRI community as they entail that gaze behavior can be used as an implicit measure of people's perception of robots in a social chat and of their engagement and task performance in a joint task.


A note on extremal numbers of the triangle plus the four cycle. For a family mathcal F of graphs, let ex(n, mathcal F ) denote the maximum number of edges in an n vertex graph which contains none of the members of mathcal F as a subgraph. A longstanding problem in extremal graph theory asks to determine the function ex(n, C 3,C 4 ) . In this note, we give a new construction for dense graphs of girth at least five with arbitrary number of vertices, providing the first improvement on the lower bound of ex(n, C 3,C 4 ) since 1976. This shows that the behavior of ex(n, C 3,C 4 ) is different from ex(n, C 4,C 2k 1 ) for all integers k geq 2 .


Design and fabrication of solar powered remote controlled all terrain sprayer and mower robot. Manual spraying of pesticides and herbicides to crops and weed inhibitors onto the field are quite laborious work to humans. Manual trimming of selected unwanted plants or harvested crops from the field is also difficult. Our project proposes a multipurpose solar powered, flexible, Remote Controlled, semi automated spraying robot with 4 Degrees of Freedom (DoF) in spatial movement, with an additional plant mowing equipment. The robot is designed to spray pesticide insecticide directly onto individual lesions minimizing wastage or excess chemical spraying, hence making the system cost effective and also environment friendly. It is designed to cut down undesired plants selectively by remotely controlling the start and stop of the mowing system. Alternatively, it also serves the purpose of maintaining lawns and sports field made of grass. The same system can be used for water spraying and mowing the grass to desired levels, leading to proper maintenance of the field. The robot is designed to move at 1.4m s, with an effective spraying area of 0.98 sq. m. by the nozzle and an effective cutting area of 0.3 sq. m. by the mower, when stationary. The prototype has a battery back up of 7.2hrs under minimum load conditions.


Increase of barium ion trap lifetime via photodissociation. The lifetime of Ba ions confined in a Paul trap is found, under typical conditions, to be limited by chemical reactions with residual background gas. An integrated ion trap and time of flight mass spectrometer are used to analyze the reactions of the trapped Ba ions with three common gases in an ultrahigh vacuum system (H 2 , CO 2 and H 2 O). It is found that the products of these reactions can all be photodissociated by a single ultraviolet laser at 225 nm, thereby allowing the recovery of the Ba ions and leading to an increase of the effective trap lifetime. For a Coulomb crystal, the lifetime increased from roughly 6 hours to 2 days at room temperature. It is suggested that higher enhancement factors are possible in systems with stronger traps. In addition, photodissociation wavelengths for other common trapped ion systems are provided.


Pentagram Rigidity for Centrally Symmetric Octagons. In this paper I will establish a special case of a conjecture that intertwines the deep diagonal pentagram maps and Poncelet polygons. The special case is that of the 3 diagonal map acting on affine equivalence classes of centrally symmetric octagons. This is the simplest case that goes beyond an analysis of elliptic curves. The proof involves establishing that the map is Arnold Liouville integrable in this case, and then exploring the Lagrangian surface foliation in detail.


On the eigenvalues of signed complete bipartite graphs. Let Gamma (G, sigma) be a signed graph, where sigma is the sign function on the edges of G . The adjacency matrix of Gamma (G, sigma) is a square matrix A( Gamma) A(G, sigma) left(a i j sigma right) , where a i j sigma sigma left(v i v j right) a i j . In this paper, we determine the eigenvalues of the signed complete bipartite graphs. Let (K p, q , sigma) , p leq q , be a signed complete bipartite graph with bipartition (U p, V q) , where U p u 1,u 2, ldots,u p and V q v 1,v 2, ldots,v q . Let (K p, q , sigma) U r cup V s , r leq p and s leq q , be an induced signed subgraph on minimum vertices r s , which contains all negative edges of the signed graph (K p, q , sigma) . We show that the multiplicity of eigenvalue 0 in (K p, q , sigma) is at least p q 2k 2 , where k min(r,s) . We determine the spectrum of signed complete bipartite graph whose negative edges induce disjoint complete bipartite subgraphs and path. We obtain the spectrum of signed complete bipartite graph whose negative edges (positive edges) induce an r regular subgraph H . We find a relation between the eigenvalues of this signed complete bipartite graph and the non negative eigenvalues of H .


Towards Latent Space Based Manipulation of Elastic Rods using Autoencoder Models and Robust Centerline Extractions. The automatic shape control of deformable objects is a challenging (and currently hot) manipulation problem due to their high dimensional geometric features and complex physical properties. In this study, a new methodology to manipulate elastic rods automatically into 2D desired shapes is presented. An efficient vision based controller that uses a deep autoencoder network is designed to compute a compact representation of the object's infinite dimensional shape. An online algorithm that approximates the sensorimotor mapping between the robot's configuration and the object's shape features is used to deal with the latter's (typically unknown) mechanical properties. The proposed approach computes the rod's centerline from raw visual data in real time by introducing an adaptive algorithm on the basis of a self organizing network. Its effectiveness is thoroughly validated with simulations and experiments.


Wavelet Design in a Learning Framework. Wavelets have proven to be highly successful in several signal and image processing applications. Wavelet design has been an active field of research for over two decades, with the problem often being approached from an analytical perspective. In this paper, we introduce a learning based approach to wavelet design. We draw a parallel between convolutional autoencoders and wavelet multiresolution approximation, and show how the learning angle provides a coherent computational framework for addressing the design problem. We aim at designing data independent wavelets by training filterbank autoencoders, which precludes the need for customized datasets. In fact, we use high dimensional Gaussian vectors for training filterbank autoencoders, and show that a near zero training loss implies that the learnt filters satisfy the perfect reconstruction property with very high probability. Properties of a wavelet such as orthogonality, compact support, smoothness, symmetry, and vanishing moments can be incorporated by designing the autoencoder architecture appropriately and with a suitable regularization term added to the mean squared error cost used in the learning process. Our approach not only recovers the well known Daubechies family of orthogonal wavelets and the Cohen Daubechies Feauveau family of symmetric biorthogonal wavelets, but also learns wavelets outside these families.


Knowledge Aware Meta learning for Low Resource Text Classification. Meta learning has achieved great success in leveraging the historical learned knowledge to facilitate the learning process of the new task. However, merely learning the knowledge from the historical tasks, adopted by current meta learning algorithms, may not generalize well to testing tasks when they are not well supported by training tasks. This paper studies a low resource text classification problem and bridges the gap between meta training and meta testing tasks by leveraging the external knowledge bases. Specifically, we propose KGML to introduce additional representation for each sentence learned from the extracted sentence specific knowledge graph. The extensive experiments on three datasets demonstrate the effectiveness of KGML under both supervised adaptation and unsupervised adaptation settings.


Latent Space Inpainting for Packet Loss Concealment in Collaborative Object Detection. Edge devices, such as cameras and mobile units, are increasingly capable of performing sophisticated computation in addition to their traditional roles in sensing and communicating signals. The focus of this paper is on collaborative object detection, where deep features computed on the edge device from input images are transmitted to the cloud for further processing. We consider the impact of packet loss on the transmitted features and examine several ways for recovering the missing data. In particular, through theory and experiments, we show that methods for image inpainting based on partial differential equations work well for the recovery of missing features in the latent space. The obtained results represent the new state of the art for missing data recovery in collaborative object detection.


Regularity Conditions for Iterated Shuffle on Commutative Regular Languages. We identify a subclass of the regular commutative languages that is closed under the iterated shuffle, or shuffle closure. In particular, it is regularity preserving on this subclass. This subclass contains the commutative group languages and, for every alphabet Sigma , the class textbf Com ( Sigma ) given by the ordered variety textbf Com . Then, we state a simple characterization when the iterated shuffle on finite commutative languages gives a regular language again and state partial results for aperiodic commutative languages. We also show that the aperiodic, or star free, commutative languages and the commutative group languages are closed under projection.


Anisotropic Sobolev spaces with weights. We study Sobolev spaces with weights in the half space mathbb R N 1 (x,y) x in mathbb R N, y 0 , adapted to the singular elliptic operators begin equation mathcal L y alpha 1 Delta x y alpha 2 left(D yy frac c y D y frac b y 2 right). end equation


Variants of Jacobi polynomials in coding theory. In this paper, we introduce the notion of the complete joint Jacobi polynomial of two linear codes of length n over mathbb F q and mathbb Z k . We give the MacWilliams type identity for the complete joint Jacobi polynomials of codes. We also introduce the concepts of the average Jacobi polynomial and the average complete joint Jacobi polynomial over mathbb F q and mathbb Z k . We give a representation of the average of the complete joint Jacobi polynomials of two linear codes of length n over mathbb F q and mathbb Z k in terms of the compositions of n and its distribution in the codes. Further we present a generalization of the representation for the average of the (g 1) fold complete joint Jacobi polynomials of codes over mathbb F q and mathbb Z k . Finally, we give the notion of the average Jacobi intersection number of two codes.


Learning to Generate Scene Graph from Natural Language Supervision. Learning from image text data has demonstrated recent success for many recognition tasks, yet is currently limited to visual features or individual visual concepts such as objects. In this paper, we propose one of the first methods that learn from image sentence pairs to extract a graphical representation of localized objects and their relationships within an image, known as scene graph. To bridge the gap between images and texts, we leverage an off the shelf object detector to identify and localize object instances, match labels of detected regions to concepts parsed from captions, and thus create "pseudo" labels for learning scene graph. Further, we design a Transformer based model to predict these "pseudo" labels via a masked token prediction task. Learning from only image sentence pairs, our model achieves 30 relative gain over a latest method trained with human annotated unlocalized scene graphs. Our model also shows strong results for weakly and fully supervised scene graph generation. In addition, we explore an open vocabulary setting for detecting scene graphs, and present the first result for open set scene graph generation. Our code is available at https github.com YiwuZhong SGG from NLS.


MV TON Memory based Video Virtual Try on network. With the development of Generative Adversarial Network, image based virtual try on methods have made great progress. However, limited work has explored the task of video based virtual try on while it is important in real world applications. Most existing video based virtual try on methods usually require clothing templates and they can only generate blurred and low resolution results. To address these challenges, we propose a Memory based Video virtual Try On Network (MV TON), which seamlessly transfers desired clothes to a target person without using any clothing templates and generates high resolution realistic videos. Specifically, MV TON consists of two modules 1) a try on module that transfers the desired clothes from model images to frame images by pose alignment and region wise replacing of pixels 2) a memory refinement module that learns to embed the existing generated frames into the latent space as external memory for the following frame generation. Experimental results show the effectiveness of our method in the video virtual try on task and its superiority over other existing methods.


On Hilbert evolution algebras of a graph. Evolution algebras are a special class of non associative algebras exhibiting connections with different fields of Mathematics. Hilbert evolution algebras generalize the concept through a framework of Hilbert spaces. This allows to deal with a wide class of infinite dimensional spaces. In this work we study Hilbert evolution algebras associated to a graph. Inspired in definitions of evolution algebras we define the Hilbert evolution algebra associated to a given graph and the Hilbert evolution algebra associated to the symmetric random walk on a graph. For a given graph, we provide conditions under which these structures are or are not isomorphic. Our definitions and results extend to graphs with infinitely many vertices a similar theory developed for evolution algebras associated to finite graphs.


Geometric feature performance under downsampling for EEG classification tasks. We experimentally investigate a collection of feature engineering pipelines for use with a CNN for classifying eyes open or eyes closed from electroencephalogram (EEG) time series from the Bonn dataset. Using the Takens' embedding a geometric representation of time series we construct simplicial complexes from EEG data. We then compare epsilon series of Betti numbers and epsilon series of graph spectra (a novel construction) two topological invariants of the latent geometry from these complexes to raw time series of the EEG to fill in a gap in the literature for benchmarking. These methods, inspired by Topological Data Analysis, are used for feature engineering to capture local geometry of the time series. Additionally, we test these feature pipelines' robustness to downsampling and data reduction. This paper seeks to establish clearer expectations for both time series classification via geometric features, and how CNNs for time series respond to data of degraded resolution.


wChain A Fast Fault Tolerant Blockchain Protocol for Multihop Wireless Networks. This paper presents mathit wChain , a blockchain protocol specifically designed for multihop wireless networks that deeply integrates wireless communication properties and blockchain technologies under the realistic SINR model. We adopt a hierarchical spanner as the communication backbone to address medium contention and achieve fast data aggregation within O( log N log Gamma) slots where N is the network size and Gamma refers to the ratio of the maximum distance to the minimum distance between any two nodes. Besides, mathit wChain employs data aggregation and reaggregation, and node recovery mechanisms to ensure efficiency, fault tolerance, persistence, and liveness. The worst case runtime of mathit wChain is upper bounded by O(f log N log Gamma) , where f lfloor frac N 2 rfloor is the upper bound of the number of faulty nodes. To validate our design, we conduct both theoretical analysis and simulation studies, and the results only demonstrate the nice properties of mathit wChain , but also point to a vast new space for the exploration of blockchain protocols in wireless networks.


Towards Secure and Practical Machine Learning via Secret Sharing and Random Permutation. With the increasing demands for privacy protection, privacy preserving machine learning has been drawing much attention in both academia and industry. However, most existing methods have their limitations in practical applications. On the one hand, although most cryptographic methods are provable secure, they bring heavy computation and communication. On the other hand, the security of many relatively efficient private methods (e.g., federated learning and split learning) is being questioned, since they are non provable secure. Inspired by previous work on privacy preserving machine learning, we build a privacy preserving machine learning framework by combining random permutation and arithmetic secret sharing via our compute after permutation technique. Since our method reduces the cost for element wise function computation, it is more efficient than existing cryptographic methods. Moreover, by adopting distance correlation as a metric for privacy leakage, we demonstrate that our method is more secure than previous non provable secure methods. Overall, our proposal achieves a good balance between security and efficiency. Experimental results show that our method not only is up to 6x faster and reduces up to 85 network traffic compared with state of the art cryptographic methods, but also leaks less privacy during the training process compared with non provable secure methods.


Finding Significant Features for Few Shot Learning using Dimensionality Reduction. Few shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent approaches, such as metric learning, adopt the meta learning strategy in which we have episodic tasks conformed by support (training) data and query (test) data. Metric learning methods have demonstrated that simple models can achieve good performance by learning a similarity function to compare the support and the query data. However, the feature space learned by a given metric learning approach may not exploit the information given by a specific few shot task. In this work, we explore the use of dimension reduction techniques as a way to find task significant features helping to make better predictions. We measure the performance of the reduced features by assigning a score based on the intra class and inter class distance, and selecting a feature reduction method in which instances of different classes are far away and instances of the same class are close. This module helps to improve the accuracy performance by allowing the similarity function, given by the metric learning method, to have more discriminative features for the classification. Our method outperforms the metric learning baselines in the miniImageNet dataset by around 2 in accuracy performance.


Rotation Averaging in a Split Second A Primal Dual Method and a Closed Form for Cycle Graphs. A cornerstone of geometric reconstruction, rotation averaging seeks the set of absolute rotations that optimally explains a set of measured relative orientations between them. In spite of being an integral part of bundle adjustment and structure from motion, averaging rotations is both a non convex and high dimensional optimization problem. In this paper, we address it from a maximum likelihood estimation standpoint and make a twofold contribution. Firstly, we set forth a novel initialization free primal dual method which we show empirically to converge to the global optimum. Further, we derive what is to our knowledge, the first optimal closed form solution for rotation averaging in cycle graphs and contextualize this result within spectral graph theory. Our proposed methods achieve a significant gain both in precision and performance.


On the distance sets spanned by sets of dimension d 2 in mathbb R d . We establish the dimension version of Falconer's distance set conjecture for sets of equal Hausdorff and packing dimension (in particular, for Ahlfors regular sets) in all ambient dimensions. In dimensions d 2 or 3 , we obtain the first explicit estimates for the dimensions of distance sets of general Borel sets of dimension d 2 for example, we show that the set of distances spanned by a planar Borel set of Hausdorff dimension 1 has Hausdorff dimension at least ( sqrt 5 1) 2 approx 0.618 . In higher dimensions we obtain explicit estimates for the lower Minkowski dimension of the distance sets of sets of dimension d 2 . These results rely on new estimates for the dimensions of radial projections that may have independent interest.


Energy Efficient MAC for Cellular IoT State of the Art, Challenges, and Standardization. In the modern world, the connectivity as we go model is gaining popularity. Internet of Things (IoT) envisions a future in which human beings communicate with each other and with devices that have identities and virtual personalities, as well as sensing, processing, and networking capabilities, which will allow the developing of smart environments that operate with little or no human intervention. In such IoT environments, that will have battery operated sensors and devices, energy efficiency becomes a fundamental concern. Thus, energy efficient (EE) connectivity is gaining significant attention from the industrial and academic communities. This work aims to provide a comprehensive state of the art survey on the energy efficiency of medium access control (MAC) protocols for cellular IoT. we provide a detailed discussion on the sources of energy dissipation at the MAC layer and then propose solutions. In addition to reviewing the proposed MAC designs, we also provide insights and suggestions that can guide practitioners and researchers in designing EE MAC protocols that extend the battery life of IoT devices. Finally, we identify a range of challenging open problems that should be solved for providing EE MAC services for IoT devices, along with corresponding opportunities and future research ideas to address these challenges.


A Data Centric Optimization Framework for Machine Learning. Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize optimization to patterns in popular networks, they implicitly constrain novel and diverse models that drive progress in research. We empower deep learning researchers by defining a flexible and user customizable pipeline for optimizing training of arbitrary deep neural networks, based on data movement minimization. The pipeline begins with standard networks in PyTorch or ONNX and transforms computation through progressive lowering. We define four levels of general purpose transformations, from local intra operator optimizations to global data movement reduction. These operate on a data centric graph intermediate representation that expresses computation and data movement at all levels of abstraction, including expanding basic operators such as convolutions to their underlying computations. Central to the design is the interactive and introspectable nature of the pipeline. Every part is extensible through a Python API, and can be tuned interactively using a GUI. We demonstrate competitive performance or speedups on ten different networks, with interactive optimizations discovering new opportunities in EfficientNet.


Differentiable Programming of Reaction Diffusion Patterns. Reaction Diffusion (RD) systems provide a computational framework that governs many pattern formation processes in nature. Current RD system design practices boil down to trial and error parameter search. We propose a differentiable optimization method for learning the RD system parameters to perform example based texture synthesis on a 2D plane. We do this by representing the RD system as a variant of Neural Cellular Automata and using task specific differentiable loss functions. RD systems generated by our method exhibit robust, non trivial 'life like' behavior.


UltraBot Autonomous Mobile Robot for Indoor UV C Disinfection. The paper focuses on the development of the autonomous robot UltraBot to reduce COVID 19 transmission and other harmful bacteria and viruses. The motivation behind the research is to develop such a robot that is capable of performing disinfection tasks without the use of harmful sprays and chemicals that can leave residues, require airing the room afterward for a long time, and can cause the corrosion of the metal structures. UltraBot technology has the potential to offer the most optimal autonomous disinfection performance along with taking care of people, keeping them from getting under UV C radiation. The paper highlights UltraBot's mechanical and electrical structures as well as low level and high level control systems. The conducted experiments demonstrate the effectiveness of the robot localization module and optimal trajectories for UV C disinfection. The results of UV C disinfection performance revealed a decrease of the total bacterial count (TBC) by 94 on the distance of 2.8 meters from the robot after 10 minutes of UV C irradiation.


On the Approximability of Multistage Min Sum Set Cover. We investigate the polynomial time approximability of the multistage version of Min Sum Set Cover ( mathrm DSSC ), a natural and intriguing generalization of the classical List Update problem. In mathrm DSSC , we maintain a sequence of permutations ( pi 0, pi 1, ldots, pi T) on n elements, based on a sequence of requests (R 1, ldots, R T) . We aim to minimize the total cost of updating pi t 1 to pi t , quantified by the Kendall tau distance mathrm D mathrm KT ( pi t 1 , pi t) , plus the total cost of covering each request R t with the current permutation pi t , quantified by the position of the first element of R t in pi t . Using a reduction from Set Cover, we show that mathrm DSSC does not admit an O(1) approximation, unless mathrm P mathrm NP , and that any o( log n) (resp. o(r) ) approximation to mathrm DSSC implies a sublogarithmic (resp. o(r) ) approximation to Set Cover (resp. where each element appears at most r times). Our main technical contribution is to show that mathrm DSSC can be approximated in polynomial time within a factor of O( log 2 n) in general instances, by randomized rounding, and within a factor of O(r 2) , if all requests have cardinality at most r , by deterministic rounding.


On the number of inequivalent monotone Boolean functions of 8 variables. In this paper, the author presents algorithms that allow determining the number of fixed points in permutations of a set of monotone Boolean functions. Then, using Burnside's lemma, the author determines the number of inequivalent monotone Boolean functions of 8 variables. The number obtained is 1,392,195,548,889,993,358.


Joint Beamforming and Reconfigurable Intelligent Surface Design for Two Way Relay Networks. In this paper, we consider a reconfigurable intelligent surface (RIS) assisted two way relay network, in which two users exchange information through the base station (BS) with the help of an RIS. By jointly designing the phase shifts at the RIS and beamforming matrix at the BS, our objective is to maximize the minimum signal to noise ratio (SNR) of the two users, under the transmit power constraint at the BS. We first consider the single antenna BS case, and propose two algorithms to design the RIS phase shifts and the BS power amplification parameter, namely the SNR upper bound maximization (SUM) method, and genetic SNR maximization (GSM) method. When there are multiple antennas at the BS, the optimization problem can be approximately addressed by successively solving two decoupled subproblems, one to optimize the RIS phase shifts, the other to optimize the BS beamforming matrix. The first subproblem can be solved by using SUM or GSM method, while the second subproblem can be solved by using optimized beamforming or maximum ratio beamforming method. The proposed algorithms have been verified through numerical results with computational complexity analysis.


Q Rater Non Convex Optimization for Post Training Uniform Quantization. Various post training uniform quantization methods have usually been studied based on convex optimization. As a result, most previous ones rely on the quantization error minimization and or quadratic approximations. Such approaches are computationally efficient and reasonable when a large number of quantization bits are employed. When the number of quantization bits is relatively low, however, non convex optimization is unavoidable to improve model accuracy. In this paper, we propose a new post training uniform quantization technique considering non convexity. We empirically show that hyper parameters for clipping and rounding of weights and activations can be explored by monitoring task loss. Then, an optimally searched set of hyper parameters is frozen to proceed to the next layer such that an incremental non convex optimization is enabled for post training quantization. Throughout extensive experimental results using various models, our proposed technique presents higher model accuracy, especially for a low bit quantization.


Situated Live Programming for Human Robot Collaboration. We present situated live programming for human robot collaboration, an approach that enables users with limited programming experience to program collaborative applications for human robot interaction. Allowing end users, such as shop floor workers, to program collaborative robots themselves would make it easy to "retask" robots from one process to another, facilitating their adoption by small and medium enterprises. Our approach builds on the paradigm of trigger action programming (TAP) by allowing end users to create rich interactions through simple trigger action pairings. It enables end users to iteratively create, edit, and refine a reactive robot program while executing partial programs. This live programming approach enables the user to utilize the task space and objects by incrementally specifying situated trigger action pairs, substantially lowering the barrier to entry for programming or reprogramming robots for collaboration. We instantiate situated live programming in an authoring system where users can create trigger action programs by annotating an augmented video feed from the robot's perspective and assign robot actions to trigger conditions. We evaluated this system in a study where participants (n 10) developed robot programs for solving collaborative light manufacturing tasks. Results showed that users with little programming experience were able to program HRC tasks in an interactive fashion and our situated live programming approach further supported individualized strategies and workflows. We conclude by discussing opportunities and limitations of the proposed approach, our system implementation, and our study and discuss a roadmap for expanding this approach to a broader range of tasks and applications.


Citadel Protecting Data Privacy and Model Confidentiality for Collaborative Learning with SGX. With the advancement of machine learning (ML) and its growing awareness, many organizations who own data but not ML expertise (data owner) would like to pool their data and collaborate with those who have expertise but need data from diverse sources to train truly generalizable models (model owner). In such collaborative ML, the data owner wants to protect the privacy of its training data, while the model owner desires the confidentiality of the model and the training method which may contain intellectual properties. However, existing private ML solutions, such as federated learning and split learning, cannot meet the privacy requirements of both data and model owners at the same time. This paper presents Citadel, a scalable collaborative ML system that protects the privacy of both data owner and model owner in untrusted infrastructures with the help of Intel SGX. Citadel performs distributed training across multiple training enclaves running on behalf of data owners and an aggregator enclave on behalf of the model owner. Citadel further establishes a strong information barrier between these enclaves by means of zero sum masking and hierarchical aggregation to prevent data model leakage during collaborative training. Compared with the existing SGX protected training systems, Citadel enables better scalability and stronger privacy guarantees for collaborative ML. Cloud deployment with various ML models shows that Citadel scales to a large number of enclaves with less than 1.73X slowdown caused by SGX.


Mild solutions to semilinear stochastic partial differential equations with locally monotone coefficients. We provide an existence and uniqueness result for mild solutions to semilinear stochastic partial differential equations in the framework of the semigroup approach with locally monotone coefficients. An important component of the proof is an application of the dilation theorem of Nagy, which allows us to reduce the problem to infinite dimensional stochastic differential equations on a larger Hilbert space. Properties of the solutions like the Markov property are discussed as well.


Fishr Invariant Gradient Variances for Out of distribution Generalization. Learning robust models that generalize well under changes in the data distribution is critical for real world applications. To this end, there has been a growing surge of interest to learn simultaneously from multiple training domains while enforcing different types of invariance across those domains. Yet, all existing approaches fail to show systematic benefits under controlled evaluation protocols. In this paper, we introduce a new regularization named Fishr that enforces domain invariance in the space of the gradients of the loss specifically, the domain level variances of gradients are matched across training domains. Our approach is based on the close relations between the gradient covariance, the Fisher Information and the Hessian of the loss in particular, we show that Fishr eventually aligns the domain level loss landscapes locally around the final weights. Extensive experiments demonstrate the effectiveness of Fishr for out of distribution generalization. Notably, Fishr improves the state of the art on the DomainBed benchmark and performs consistently better than Empirical Risk Minimization. The code is released at https github.com alexrame fishr.


Generative Adversarial Reward Learning for Generalized Behavior Tendency Inference. Recent advances in reinforcement learning have inspired increasing interest in learning user modeling adaptively through dynamic interactions, e.g., in reinforcement learning based recommender systems. Reward function is crucial for most of reinforcement learning applications as it can provide the guideline about the optimization. However, current reinforcement learning based methods rely on manually defined reward functions, which cannot adapt to dynamic and noisy environments. Besides, they generally use task specific reward functions that sacrifice generalization ability. We propose a generative inverse reinforcement learning for user behavioral preference modelling, to address the above issues. Instead of using predefined reward functions, our model can automatically learn the rewards from user's actions based on discriminative actor critic network and Wasserstein GAN. Our model provides a general way of characterizing and explaining underlying behavioral tendencies, and our experiments show our method outperforms state of the art methods in a variety of scenarios, namely traffic signal control, online recommender systems, and scanpath prediction.


Localization operators associated with the windowed Opdam Cherednik transform on modulation spaces. In this paper, we study a class of pseudodifferential operators known as time frequency localization operators, which depend on a symbol varsigma and two windows functions g 1 and g 2 . We first present some basic properties of the windowed Opdam Cherednik transform. Then, we use modulation spaces associated with the Opdam Cherednik transform as appropriate classes for symbols and windows, and study the boundedness and compactness of the localization operators associated with the windowed Opdam Cherednik transform on modulation spaces. Finally, we show that these operators are in the Schatten von Neumann class.


Non redundant optical phased array. Optical phased array (OPA) is a promising beam steering device for various applications such as light detection and ranging (LiDAR), optical projection, free space optical communication and switching. However, the previously reported OPAs suffer from either an insufficiently small number of resolvable points, or a complicated control requirement due to an extremely large number of phase shifters. This work introduces a novel array configuration for OPA devices based on the non redundant array (NRA) concept. Based on this design, we can realize high resolution OPA whose number of resolvable points scales with N2. In contrast, that of traditional OPAs scales only with N. Thus, a significant reduction in the number of required phase shifters can be attained without sacrificing the number of resolvable points. We first investigate the impact of employing the NRA theoretically by considering the autocorrelation function of the array layout. We then develop a Costas array based silicon OPA and experimentally demonstrate 2D beam steering with 19,000 resolvable points using only 127 phase shifters. This corresponds to the largest number of resolvable points achieved by an OPA without sweeping the wavelength to the best of our knowledge.


SSTN Self Supervised Domain Adaptation Thermal Object Detection for Autonomous Driving. The sensibility and sensitivity of the environment play a decisive role in the safe and secure operation of autonomous vehicles. This perception of the surrounding is way similar to human visual representation. The human's brain perceives the environment by utilizing different sensory channels and develop a view invariant representation model. Keeping in this context, different exteroceptive sensors are deployed on the autonomous vehicle for perceiving the environment. The most common exteroceptive sensors are camera, Lidar and radar for autonomous vehicle's perception. Despite being these sensors have illustrated their benefit in the visible spectrum domain yet in the adverse weather conditions, for instance, at night, they have limited operation capability, which may lead to fatal accidents. In this work, we explore thermal object detection to model a view invariant model representation by employing the self supervised contrastive learning approach. For this purpose, we have proposed a deep neural network Self Supervised Thermal Network (SSTN) for learning the feature embedding to maximize the information between visible and infrared spectrum domain by contrastive learning, and later employing these learned feature representation for the thermal object detection using multi scale encoder decoder transformer network. The proposed method is extensively evaluated on the two publicly available datasets the FLIR ADAS dataset and the KAIST Multi Spectral dataset. The experimental results illustrate the efficacy of the proposed method.


A shape optimization problem on planar sets with prescribed topology. We consider shape optimization problems involving functionals depending on perimeter, torsional rigidity and Lebesgue measure. The scaling free cost functionals are of the form P( Omega)T q( Omega) Omega 2q 1 2 and the class of admissible domains consists of two dimensional open sets Omega satisfying the topological constraints of having a prescribed number k of bounded connected components of the complementary set. A relaxed procedure is needed to have a well posed problem and we show that when q 1 2 an optimal relaxed domain exists. When q 1 2 the problem is ill posed and for q 1 2 the explicit value of the infimum is provided in the cases k 0 and k 1 .


Coarse Grained Smoothness for RL in Metric Spaces. Principled decision making in continuous state action spaces is impossible without some assumptions. A common approach is to assume Lipschitz continuity of the Q function. We show that, unfortunately, this property fails to hold in many typical domains. We propose a new coarse grained smoothness definition that generalizes the notion of Lipschitz continuity, is more widely applicable, and allows us to compute significantly tighter bounds on Q functions, leading to improved learning. We provide a theoretical analysis of our new smoothness definition, and discuss its implications and impact on control and exploration in continuous domains.


On the Sensitivity and Stability of Model Interpretations in NLP. Recent years have witnessed the emergence of a variety of post hoc interpretations that aim to uncover how natural language processing (NLP) models make predictions. Despite the surge of new interpretation methods, it remains an open problem how to define and quantitatively measure the faithfulness of interpretations, i.e., to what extent interpretations reflect the reasoning process by a model. We propose two new criteria, sensitivity and stability, that provide complementary notions of faithfulness to the existed removal based criteria. Our results show that the conclusion for how faithful interpretations are could vary substantially based on different notions. Motivated by the desiderata of sensitivity and stability, we introduce a new class of interpretation methods that adopt techniques from adversarial robustness. Empirical results show that our proposed methods are effective under the new criteria and overcome limitations of gradient based methods on removal based criteria. Besides text classification, we also apply interpretation methods and metrics to dependency parsing. Our results shed light on understanding the diverse set of interpretations.


Image2Lego Customized LEGO Set Generation from Images. Although LEGO sets have entertained generations of children and adults, the challenge of designing customized builds matching the complexity of real world or imagined scenes remains too great for the average enthusiast. In order to make this feat possible, we implement a system that generates a LEGO brick model from 2D images. We design a novel solution to this problem that uses an octree structured autoencoder trained on 3D voxelized models to obtain a feasible latent representation for model reconstruction, and a separate network trained to predict this latent representation from 2D images. LEGO models are obtained by algorithmic conversion of the 3D voxelized model to bricks. We demonstrate first of its kind conversion of photographs to 3D LEGO models. An octree architecture enables the flexibility to produce multiple resolutions to best fit a user's creative vision or design needs. In order to demonstrate the broad applicability of our system, we generate step by step building instructions and animations for LEGO models of objects and human faces. Finally, we test these automatically generated LEGO sets by constructing physical builds using real LEGO bricks.


Simultaneous recovery of a locally rough interface and the embedded obstacle with its surrounding medium. Consider the scattering of time harmonic point sources by an infinite locally rough interface with bounded obstacles embedded in the lower half space. The model problem is first reduced to an equivalent integral equation formulation defined in a bounded domain, where the well posedness is obtained in L p by the classical Fredholm theory. Then a global uniqueness theorem is proved for the inverse problem of recovering the locally rough interface, the embedded obstacles and the wave number in the lower half space by means of near field measurements above the interface.


Effect of dust ion collision on superthermal plasmas in cylindrical and spherical geometry. Dust ion collisional effect in dust ion acoustic waves is investigated in the framework of spherical and cylindrical geometry. For such study the fluid equation are takes and collisional effect is consider in the equation of momentum balance. Using reductive perturbation technique the evolution equation is derived with additional damping term for non planner geometry. Using the conservation principle an analytical time dependent solitary wave solution is obtained for the evolution equation. It is seen that dust ion collisional frequency has an significant effect on the width and amplitude of the solitary wave solution.


Crossing the Format Boundary of Text and Boxes Towards Unified Vision Language Modeling. In this paper, we propose UNICORN, a vision language (VL) model that unifies text generation and bounding box prediction into a single architecture. Specifically, we quantize each box into four discrete box tokens and serialize them as a sequence, which can be integrated with text tokens. We formulate all VL problems as a generation task, where the target sequence consists of the integrated text and box tokens. We then train a transformer encoder decoder to predict the target in an auto regressive manner. With such a unified framework and input output format, UNICORN achieves comparable performance to task specific state of the art on 7 VL benchmarks, covering the visual grounding, grounded captioning, visual question answering, and image captioning tasks. When trained with multi task finetuning, UNICORN can approach different VL tasks with a single set of parameters, thus crossing downstream task boundary. We show that having a single model not only saves parameters, but also further boosts the model performance on certain tasks. Finally, UNICORN shows the capability of generalizing to new tasks such as ImageNet object localization.


Stabilization of stochastic McKean Vlasov equations with feedback control based on discrete time state observation. In this paper, we study the stability of solutions of stochastic McKean Vlasov equations (SMVEs) via feedback control based on discrete time state observation. By using a specific Lyapunov function, the H infty stability, asymptotic stability and exponential stability in mean square for the solution of the controlled systems are obtained. Since the distribution of solution is difficult to be observed, we study the corresponding particle system which can be observed for the feedback control. We prove that the exponential stability of control system is equivalent to the the exponential stability of the corresponding particle system. Finally, an example is provided to show the effectiveness of the theory.


Visibility network analysis of large scale intermittency in convective surface layer turbulence. Large scale intermittency is a widely observed phenomenon in convective surface layer turbulence that induces non Gaussian temperature statistics, while such signature is not observed for velocity signals. Although approaches based on probability density functions have been used so far, those are not able to explain to what extent the signals' temporal structure impacts the statistical characteristics of the velocity and temperature fluctuations. To tackle this issue, a visibility network analysis is carried out on a field experimental dataset from a convective atmospheric surface layer flow. Through surrogate data and network based measures, we demonstrate that the temperature intermittency is related to strong non linear dependencies in the temperature signals. Conversely, a competition between linear and non linear effects tends to inhibit the temperature like intermittency behaviour in streamwise and vertical velocities. Based on present findings, new research avenues are likely to be opened up in studying large scale intermittency in convective turbulence.


Velocity profiles of cyclones and anticyclones in a rotating turbulent flow. Strong rotation makes an underlying turbulent flow quasi two dimensional that leads to the upscale energy transfer. Recent numerical simulations show that under certain conditions, the energy is accumulated at the largest scales of the system, forming coherent vortex structures known as condensates. We analytically describe the interaction of a strong condensate with weak small scale turbulent pulsations and obtain an equation that allows us to determine the radial velocity profile U(r) of a coherent vortex. When external rotation is fast, the velocity profiles of cyclones and anticyclones are identical to each other and are well described by the dependence U(r) propto pm r ln (R r) , where R is the transverse size of the vortex. As the external rotation decreases, this symmetry disappears the maximum velocity in cyclones is greater and the position of the maximum is closer to the axis of the vortex in comparison with anticyclones. Besides, our analysis shows that the size R of the anticyclone cannot exceed a certain critical value, which depends on the Rossby and Reynolds numbers. The maximum size of the cyclones is limited only by the system size under the same conditions. Our predictions are based on the linear evolution of turbulent pulsations on the background of the coherent vortex flow and are accompanied by estimates following from the nonlinear Navier Stokes equation.


In situ ultrasound imaging of shear shock waves in the porcine brain. Using high frame rate ultrasound and high sensitivity motion tracking, we recently showed that shear waves sent to the ex vivo porcine brain develop into shear shock waves with destructive local accelerations inside the brain which may be a key mechanism behind deep traumatic brain injuries. Direct measurement of brain motion at an adequate frame rate during impacts has been a persistent challenge. Here we present the ultrasound observation of shear shock waves in the acoustically challenging environment of the in situ porcine brain during a single shot impact. The brain was attached to a plate source which was vibrated at a moderate amplitude of 25g, to propagate a 40 Hz shear wave into the brain. Simultaneously, images of the moving brain were acquired at 2193 images s, using a custom imaging sequence with 8 interleaved ultrasound transmit receive events, designed to accurately track shear shocks. To achieve a long field of view, wide beam emissions were designed using time reversal ultrasound simulations and no compounding was used to avoid motion blurring. A peak acceleration of 102g was measured at the shock front, 7.1 mm deep inside the brain. It is also shown that experimental shear velocity, acceleration, and strain rate waveforms in brain are in excellent agreement with theoretical predictions from a custom higher order finite volume method hence demonstrating the capabilities to measure rapid brain motion even in the presence of strong acoustical reverberations from the porcine skull.


Left Ventricle Contouring in Cardiac Images Based on Deep Reinforcement Learning. Medical image segmentation is one of the important tasks of computer aided diagnosis in medical image analysis. Since most medical images have the characteristics of blurred boundaries and uneven intensity distribution, through existing segmentation methods, the discontinuity within the target area and the discontinuity of the target boundary are likely to lead to rough or even erroneous boundary delineation. In this paper, we propose a new iterative refined interactive segmentation method for medical images based on agent reinforcement learning, which focuses on the problem of target segmentation boundaries. We model the dynamic process of drawing the target contour in a certain order as a Markov Decision Process (MDP) based on a deep reinforcement learning method. In the dynamic process of continuous interaction between the agent and the image, the agent tracks the boundary point by point in order within a limited length range until the contour of the target is completely drawn. In this process, the agent can quickly improve the segmentation performance by exploring an interactive policy in the image. The method we proposed is simple and effective. At the same time, we evaluate our method on the cardiac MRI scan data set. Experimental results show that our method has a better segmentation effect on the left ventricle in a small number of medical image data sets, especially in terms of segmentation boundaries, this method is better than existing methods. Based on our proposed method, the dynamic generation process of the predicted contour trajectory of the left ventricle will be displayed online at https github.com H1997ym LV contour trajectory.


Mean field game for modeling of COVID 19 spread. The paper presents the one of possible approach to model the epidemic propagation. The proposed model is based on the mean field control inside separate groups of population, namely, suspectable (S), infected (I), removed (R) and cross immune (C). In the paper the numerical algorithm to solve such a problem is presented, which ensures the conservation the total mass of population during timeline. Numerical experiments demonstrate the result of modelling the propagation of COVID 19 virus during two 100 day periods in Novosibirsk (Russia).


Deep Gait Recognition A Survey. Gait recognition is an appealing biometric modality which aims to identify individuals based on the way they walk. Deep learning has reshaped the research landscape in this area since 2015 through the ability to automatically learn discriminative representations. Gait recognition methods based on deep learning now dominate the state of the art in the field and have fostered real world applications. In this paper, we present a comprehensive overview of breakthroughs and recent developments in gait recognition with deep learning, and cover broad topics including datasets, test protocols, state of the art solutions, challenges, and future research directions. We first review the commonly used gait datasets along with the principles designed for evaluating them. We then propose a novel taxonomy made up of four separate dimensions namely body representation, temporal representation, feature representation, and neural architecture, to help characterize and organize the research landscape and literature in this area. Following our proposed taxonomy, a comprehensive survey of gait recognition methods using deep learning is presented with discussions on their performances, characteristics, advantages, and limitations. We conclude this survey with a discussion on current challenges and mention a number of promising directions for future research in gait recognition.


Mind the Gap Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networks. We present a new method for one shot domain adaptation. The input to our method is trained GAN that can produce images in domain A and a single reference image I B from domain B. The proposed algorithm can translate any output of the trained GAN from domain A to domain B. There are two main advantages of our method compared to the current state of the art First, our solution achieves higher visual quality, e.g. by noticeably reducing overfitting. Second, our solution allows for more degrees of freedom to control the domain gap, i.e. what aspects of image I B are used to define the domain B. Technically, we realize the new method by building on a pre trained StyleGAN generator as GAN and a pre trained CLIP model for representing the domain gap. We propose several new regularizers for controlling the domain gap to optimize the weights of the pre trained StyleGAN generator to output images in domain B instead of domain A. The regularizers prevent the optimization from taking on too many attributes of the single reference image. Our results show significant visual improvements over the state of the art as well as multiple applications that highlight improved control.


The no beta McMullen game and the perfect set property. Given a target set A subseteq mathbb R d and a real number beta in (0,1) , McMullen introduced the notion of A being an absolutely beta winning set. This involves a two player game which we call the beta McMullen game. We consider the version of this game in which the parameter beta is removed, which we call the no beta McMullen game. More generally, we consider the game with respect to arbitrary norms on mathbb R d , and even more generally with respect to general convex sets. We show that for strictly convex sets in mathbb R d , polytopes in mathbb R d , and general convex sets in mathbb R 2 , that player boldsymbol I wins the no beta McMullen game iff A contains a perfect set and player boldsymbol I kern 0.05cm boldsymbol I wins iff A is countable. So, the no beta McMullen game is equivalent to the perfect set game for A in these cases. The proofs of these results use a connection between the geometry of the game and techniques from logic. Because of the geometry of this game, this result has strong implications for the geometry of uncountable sets in mathbb R d . We also present an example of a compact, convex set in mathbb R 3 to which our methods do not apply, and also an example due to D. Simmons of a closed, convex set in ell 2( mathbb R ) which illustrate the obstacles in extending the results further.


On the generalized parabolic Hardy H 'enon equation Existence, blow up, self similarity and large time asymptotic behaviour. This paper deals with the Cauchy problem for the Hardy H ' e non equation (and its fractional analogue). Local well posedness for initial data in the class of continuous functions with slow decay at infinity is investigated. Small data (in critical weak Lebesgue space) global well posedness is obtained in C b ( 0, infty) L q c, infty ( RR n )) . As a direct consequence, global existence for data in strong critical Lebesgue L q c ( RR n ) follows under a smallness condition while uniqueness is unconditional. Besides, we prove the existence of self similar solutions and examine the long time behavior of globally defined solutions. The zero solution u equiv 0 is shown to be asymptotically stable in L q c ( RR n ) it is the only self similar solution which is initially small in L q c ( RR n ) . Moreover, blow up results are obtained under mild assumptions on the initial data and the corresponding Fujita critical exponent is found.


Data QuestEval A Referenceless Metric for Data to Text Semantic Evaluation. QuestEval is a reference less metric used in text to text tasks, that compares the generated summaries directly to the source text, by automatically asking and answering questions. Its adaptation to Data to Text tasks is not straightforward, as it requires multimodal Question Generation and Answering systems on the considered tasks, which are seldom available. To this purpose, we propose a method to build synthetic multimodal corpora enabling to train multimodal components for a data QuestEval metric. The resulting metric is reference less and multimodal it obtains state of the art correlations with human judgment on the WebNLG and WikiBio benchmarks. We make data QuestEval's code and models available for reproducibility purpose, as part of the QuestEval project.


Closed geodesics with prescribed intersection numbers. Let ( Sigma, g) be a closed, oriented, negatively curved surface, and fix pairwise disjoint simple closed geodesics gamma star,1 , dots gamma star, r . We give an asymptotic growth as L to infty of the number of primitive closed geodesic of length less than L intersecting gamma star,j exactly n j times, where n 1, dots, n r are fixed nonnegative integers. This is done by introducing a dynamical scattering operator associated to the surface with boundary obtained by cutting Sigma along gamma star,1 , dots, gamma star, r and by using the theory of Pollicott Ruelle resonances for open systems.


Solving Challenging Large Scale QAPs. We report our progress on the project for solving larger scale quadratic assignment problems (QAPs). Our main approach to solve large scale NP hard combinatorial optimization problems such as QAPs is a parallel branch and bound method efficiently implemented on a powerful computer system using the Ubiquity Generator (UG) framework that can utilize more than 100,000 cores. Lower bounding procedures incorporated in the branch and bound method play a crucial role in solving the problems. For a strong lower bounding procedure, we employ the Lagrangian doubly nonnegative (DNN) relaxation and the Newton bracketing method developed by the authors' group. In this report, we describe some basic tools used in the project including the lower bounding procedure and branching rules, and present some preliminary numerical results. Our next target problem is QAPs with dimension at least 50, as we have succeeded to solve tai30a and sko42 from QAPLIB for the first time.


Who's Afraid of Adversarial Transferability?. Adversarial transferability, namely the ability of adversarial perturbations to simultaneously fool multiple learning models, has long been the "big bad wolf" of adversarial machine learning. Successful transferability based attacks requiring no prior knowledge of the attacked model's parameters or training data have been demonstrated numerous times in the past, implying that machine learning models pose an inherent security threat to real life systems. However, all of the research performed in this area regarded transferability as a probabilistic property and attempted to estimate the percentage of adversarial examples that are likely to mislead a target model given some predefined evaluation set. As a result, those studies ignored the fact that real life adversaries are often highly sensitive to the cost of a failed attack. We argue that overlooking this sensitivity has led to an exaggerated perception of the transferability threat, when in fact real life transferability based attacks are quite unlikely. By combining theoretical reasoning with a series of empirical results, we show that it is practically impossible to predict whether a given adversarial example is transferable to a specific target model in a black box setting, hence questioning the validity of adversarial transferability as a real life attack tool for adversaries that are sensitive to the cost of a failed attack.


Investigation of Flow Characteristics inside a Dual Bell Nozzle with and without Film Cooling. In this study, we perform a two dimensional axisymmetric simulation to assess the flow characteristics and understand the film cooling process in a dual bell nozzle. The secondary stream with low temperature is injected at three different axial locations on the nozzle wall, and the simulations are carried out to emphasize the impact of injection location (secondary flow) on film cooling of the dual bell nozzle. The cooling effect is demonstrated through the temperature and pressure distributions on the nozzle wall or, in turn, the separation point movement. Downstream of the injection point, the Mach number and temperature profiles document the mixing of the main flow and secondary flow. The inflection region is observed to be the most promising location for the injection of the secondary flow. We have further investigated the effect of Mach number of the secondary stream. The current study demonstrates that one can control the separation point in a dual bell nozzle with the help of secondary injection (Mach number) so that an optimum amount of thrust can be achieved.


Trying an IP Over NDN Packet Gateway. Even though the TCP IP architecture has served the Internet quite satisfactorily during its more than forty years of lifespan, there are doubts about whether this host centric paradigm is well suited for the communication patterns of modern applications. These applications mainly need to get information pieces without being bothered about where they are located in the network. Additionally, the lack of both in built security mechanisms and proper global multicast support may also be a symptom of fundamental problems with the classic architecture. Proponents of the novel Information Centric Networking (ICN) paradigm assert that the replacement of the TCP IP architecture with one based on the information itself could be the ideal solution to all these problems. However, if such a replacement ever takes place, it will need the help of some transition mechanisms, for instance, for the transmission of legacy IP traffic on top of the new ICN based networks. In this paper we design and optimize such an open source IP over ICN transition application using the Named Data Networking (NDN) proposal as our target ICN network. We performed several tests that confirm that our prototype is able to transparently transport IP traffic across a pure NDN network with negligible packets losses, low jitter, and good performance.


Representations for Question Answering from Documents with Tables and Text. Tables in Web documents are pervasive and can be directly used to answer many of the queries searched on the Web, motivating their integration in question answering. Very often information presented in tables is succinct and hard to interpret with standard language representations. On the other hand, tables often appear within textual context, such as an article describing the table. Using the information from an article as additional context can potentially enrich table representations. In this work we aim to improve question answering from tables by refining table representations based on information from surrounding text. We also present an effective method to combine text and table based predictions for question answering from full documents, obtaining significant improvements on the Natural Questions dataset.


Age of Information in Energy Harvesting Aided Massive Multiple Access Networks. Given the proliferation of the massive machine type communication devices (MTCDs) in beyond 5G (B5G) wireless networks, energy harvesting (EH) aided next generation multiple access (NGMA) systems have drawn substantial attention in the context of energy efficient data sensing and transmission. However, without adaptive time slot (TS) and power allocation schemes, NGMA systems relying on stochastic sampling instants might lead to tardy actions associated both with high age of information (AoI) as well as high power consumption. For mitigating the energy consumption, we exploit a pair of sleep scheduling policies, namely the multiple vacation (MV) policy and start up threshold (ST) policy, which are characterized in the context of three typical multiple access protocols, including time division multiple access (TDMA), frequency division multiple access (FDMA) and non orthogonal multiple access (NOMA). Furthermore, we derive closed form expressions for the MTCD system's peak AoI, which are formulated as the optimization objective under the constraints of EH power, status update rate and stability conditions. An exact linear search based algorithm is proposed for finding the optimal solution by fixing the status update rate. As a design alternative, a low complexity concave convex procedure (CCP) is also formulated for finding a near optimal solution relying on the original problem's transformation into a form represented by the difference of two convex problems. Our simulation results show that the proposed algorithms are beneficial in terms of yielding a lower peak AoI at a low power consumption in the context of the multiple access protocols considered.


Stochastic Opinion Dynamics for Interest Prediction in Social Networks. We exploit the core periphery structure and the strong homophilic properties of online social networks to develop faster and more accurate algorithms for user interest prediction. The core of modern social networks consists of relatively few influential users, whose interest profiles are publicly available, while the majority of peripheral users follow enough of them based on common interests. Our approach is to predict the interests of the peripheral nodes starting from the interests of their influential connections. To this end, we need a formal model that explains how common interests lead to network connections. Thus, we propose a stochastic interest formation model, the Nearest Neighbor Influence Model (NNIM), which is inspired by the Hegselmann Krause opinion formation model and aims to explain how homophily shapes the network. Based on NNIM, we develop an efficient approach for predicting the interests of the peripheral users. At the technical level, we use Variational Expectation Maximization to optimize the instantaneous likelihood function using a mean field approximation of NNIM. We prove that our algorithm converges fast and is capable of scaling smoothly to networks with millions of nodes. Our experiments on standard network benchmarks demonstrate that our algorithm runs up to two orders of magnitude faster than the best known node embedding methods and achieves similar accuracy.


Bohr chaoticity of topological dynamical systems. We introduce the notion of Bohr chaoticity, which is a topological invariant for topological dynamical systems, and which is opposite to the property required by Sarnak's conjecture. We prove the Bohr chaoticity for all systems which have a horseshoe and for all toral affine dynamical systems of positive entropy, some of which don't have a horseshoe. But uniquely ergodic dynamical systems are not Bohr chaotic.


Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal Difference Loss. Although deep feedforward neural networks share some characteristics with the primate visual system, a key distinction is their dynamics. Deep nets typically operate in serial stages wherein each layer completes its computation before processing begins in subsequent layers. In contrast, biological systems have cascaded dynamics information propagates from neurons at all layers in parallel but transmission occurs gradually over time, leading to speed accuracy trade offs even in feedforward architectures. We explore the consequences of biologically inspired parallel hardware by constructing cascaded ResNets in which each residual block has propagation delays but all blocks update in parallel in a stateful manner. Because information transmitted through skip connections avoids delays, the functional depth of the architecture increases over time, yielding anytime predictions that improve with internal processing time. We introduce a temporal difference training loss that achieves a strictly superior speed accuracy profile over standard losses and enables the cascaded architecture to outperform state of the art anytime prediction methods. The cascaded architecture has intriguing properties, including it classifies typical instances more rapidly than atypical instances it is more robust to both persistent and transient noise than is a conventional ResNet and its time varying output trace provides a signal that can be exploited to improve information processing and inference.


Learning based Preference Prediction for Constrained Multi Criteria Path Planning. Learning based methods are increasingly popular for search algorithms in single criterion optimization problems. In contrast, for multiple criteria optimization there are significantly fewer approaches despite the existence of numerous applications. Constrained path planning for Autonomous Ground Vehicles (AGV) is one such application, where an AGV is typically deployed in disaster relief or search and rescue applications in off road environments. The agent can be faced with the following dilemma optimize a source destination path according to a known criterion and an uncertain criterion under operational constraints. The known criterion is associated to the cost of the path, representing the distance. The uncertain criterion represents the feasibility of driving through the path without requiring human intervention. It depends on various external parameters such as the physics of the vehicle, the state of the explored terrains or weather conditions. In this work, we leverage knowledge acquired through offline simulations by training a neural network model to predict the uncertain criterion. We integrate this model inside a path planner which can solve problems online. Finally, we conduct experiments on realistic AGV scenarios which illustrate that the proposed framework requires human intervention less frequently, trading for a limited increase in the path distance.


Games and Scott sentences for positive distances between metric structures. We develop various Ehrenfeucht Fra " i ss ' e games for distances between metric structures. We study two forms of distances pseudometrics stemming from mapping spaces onto each other with some form of approximate isomorphism, and metrics stemming from measuring the distances between two spaces isometrically embedded into a third space. Using an infinitary version of Henson's positive bounded logic with approximations, we form Scott sentences capturing fixed distances to a given space. The Scott sentences of separable spaces are in mathcal L omega 1 omega for 0 distances and in mathcal L omega 2 omega for positive distances.


Arithmetic inflection of superelliptic curves. In this paper, we explore the inflectionary behavior of linear series on superelliptic curves X over fields of arbitrary characteristic. Here we give a precise description of the inflection of linear series over the ramification locus of the superelliptic projection and we initiate a study of those inflectionary varieties that parameterize the inflection points of linear series on X supported away from the superelliptic ramification locus that is predicated on the behavior of their Newton polytopes.


PIVODL Privacy preserving vertical federated learning over distributed labels. Federated learning (FL) is an emerging privacy preserving machine learning protocol that allows multiple devices to collaboratively train a shared global model without revealing their private local data. Non parametric models like gradient boosting decision trees (GBDT) have been commonly used in FL for vertically partitioned data. However, all these studies assume that all the data labels are stored on only one client, which may be unrealistic for real world applications. Therefore, in this work, we propose a secure vertical FL framework, named PIVODL, to train GBDT with data labels distributed on multiple devices. Both homomorphic encryption and differential privacy are adopted to prevent label information from being leaked through transmitted gradients and leaf values. Our experimental results show that both information leakage and model performance degradation of the proposed PIVODL are negligible.


On the Torelli Lie algebra. We prove two theorems about the Malcev Lie algebra associated to the Torelli group of a surface of genus g stably, it is Koszul and the kernel of the Johnson homomorphism consists only of trivial Sp 2g (Z) representations lying in the centre.


State based Episodic Memory for Multi Agent Reinforcement Learning. Multi agent reinforcement learning (MARL) algorithms have made promising progress in recent years by leveraging the centralized training and decentralized execution (CTDE) paradigm. However, existing MARL algorithms still suffer from the sample inefficiency problem. In this paper, we propose a simple yet effective approach, called state based episodic memory (SEM), to improve sample efficiency in MARL. SEM adopts episodic memory (EM) to supervise the centralized training procedure of CTDE in MARL. To the best of our knowledge, SEM is the first work to introduce EM into MARL. We can theoretically prove that, when using for MARL, SEM has lower space complexity and time complexity than state and action based EM (SAEM), which is originally proposed for single agent reinforcement learning. Experimental results on StarCraft multi agent challenge (SMAC) show that introducing episodic memory into MARL can improve sample efficiency and SEM can reduce storage cost and time cost compared with SAEM.


Proof Search on Bilateralist Judgments over Non deterministic Semantics. The bilateralist approach to logical consequence maintains that judgments of different qualities should be taken into account in determining what follows from what. We argue that such an approach may be actualized by a two dimensional notion of entailment induced by semantic structures that also accommodate non deterministic and partial interpretations, and propose a proof theoretical apparatus to reason over bilateralist judgments using symmetrical two dimensional analytical Hilbert style calculi. We also provide a proof search algorithm for finite analytic calculi that runs in at most exponential time, in general, and in polynomial time when only rules having at most one formula in the succedent are present in the concerned calculus.


Node Level Membership Inference Attacks Against Graph Neural Networks. Many real world data comes in the form of graphs, such as social networks and protein structure. To fully utilize the information contained in graph data, a new family of machine learning (ML) models, namely graph neural networks (GNNs), has been introduced. Previous studies have shown that machine learning models are vulnerable to privacy attacks. However, most of the current efforts concentrate on ML models trained on data from the Euclidean space, like images and texts. On the other hand, privacy risks stemming from GNNs remain largely unstudied. In this paper, we fill the gap by performing the first comprehensive analysis of node level membership inference attacks against GNNs. We systematically define the threat models and propose three node level membership inference attacks based on an adversary's background knowledge. Our evaluation on three GNN structures and four benchmark datasets shows that GNNs are vulnerable to node level membership inference even when the adversary has minimal background knowledge. Besides, we show that graph density and feature similarity have a major impact on the attack's success. We further investigate two defense mechanisms and the empirical results indicate that these defenses can reduce the attack performance but with moderate utility loss.


Fine Grained Attention for Weakly Supervised Object Localization. Although recent advances in deep learning accelerated an improvement in a weakly supervised object localization (WSOL) task, there are still challenges to identify the entire body of an object, rather than only discriminative parts. In this paper, we propose a novel residual fine grained attention (RFGA) module that autonomously excites the less activated regions of an object by utilizing information distributed over channels and locations within feature maps in combination with a residual operation. To be specific, we devise a series of mechanisms of triple view attention representation, attention expansion, and feature calibration. Unlike other attention based WSOL methods that learn a coarse attention map, having the same values across elements in feature maps, our proposed RFGA learns fine grained values in an attention map by assigning different attention values for each of the elements. We validated the superiority of our proposed RFGA module by comparing it with the recent methods in the literature over three datasets. Further, we analyzed the effect of each mechanism in our RFGA and visualized attention maps to get insights.


Model estimates for contribution of natural and anthropogenic CO 2 and CH 4 emissions into the atmosphere from the territory of Russia, China, USA and Canada to global climate changes in the 21st century. The contribution of anthropogenic and natural greenhouse gases to the atmosphere from the territory of Russia, China, USA and Canada to global climate change under different scenarios of anthropogenic emissions in the 21st century has been assessed. It is shown that the consideration of the changes in climate conditions can affect the impact indicators of greenhouse gas emissions on the climate system, especially over long time horizons. In making decisions, it is necessary to take into account that the role of natural fluxes of greenhouse gases into the atmosphere from the terrestrial ecosystems can change. For all the countries considered, the uptake of CO 2 by terrestrial ecosystems under all scenarios of anthropogenic impact begins to decrease in the second half of the 21st century, so its stabilizing effect may gradually lose importance. At the same time, methane emissions in all of the considered regions are increasing significantly. The net effect of these greenhouse gas natural fluxes in some cases can even lead to warming acceleration by the end of the 21 st century.


Near Field Linear Sampling Method forAxisymmetric Eddy Current Tomography. This paper is concerned with Eddy Current (EC) nondestructive testing of conductive materials and focuses, in particular, on extending the well known LinearSampling Method (LSM) to the case of EC equations. We first present the theoretical foundation of the LSM in the present context and in the case of point sources. We then explain how this method can be adapted to a realistic setting of EC probes. In the case of identifying the shape of external deposits from impedance measurements taken from inside of the tube (steam generator), we show how the method can be applied to measurements obtained from a sweeping set of coils. Numerical experiments suggest that good results can be achieved using only a few coils and even in the limiting case of backscattering data.


Cascade Bagging for Accuracy Prediction with Few Training Samples. Accuracy predictor is trained to predict the validation accuracy of an network from its architecture encoding. It can effectively assist in designing networks and improving Neural Architecture Search(NAS) efficiency. However, a high performance predictor depends on adequate trainning samples, which requires unaffordable computation overhead. To alleviate this problem, we propose a novel framework to train an accuracy predictor under few training samples. The framework consists ofdata augmentation methods and an ensemble learning algorithm. The data augmentation methods calibrate weak labels and inject noise to feature space. The ensemble learning algorithm, termed cascade bagging, trains two level models by sampling data and features. In the end, the advantages of above methods are proved in the Performance Prediciton Track of CVPR2021 1st Lightweight NAS Challenge. Our code is made public at https github.com dlongry Solutionto CVPR2021 NAS Track2.


VUT Versatile UI Transformer for Multi Modal Multi Task User Interface Modeling. User interface modeling is inherently multimodal, which involves several distinct types of data images, structures and language. The tasks are also diverse, including object detection, language generation and grounding. In this paper, we present VUT, a Versatile UI Transformer that takes multimodal input and simultaneously accomplishes 5 distinct tasks with the same model. Our model consists of a multimodal Transformer encoder that jointly encodes UI images and structures, and performs UI object detection when the UI structures are absent in the input. Our model also consists of an auto regressive Transformer model that encodes the language input and decodes output, for both question answering and command grounding with respect to the UI. Our experiments show that for most of the tasks, when trained jointly for multi tasks, VUT substantially reduces the number of models and footprints needed for performing multiple tasks, while achieving accuracy exceeding or on par with baseline models trained for each individual task.


Examples of surfaces with canonical map of degree 4. We give two examples of surfaces with canonical map of degree 4 onto a canonical surface.


A zero one law for random walks in random environments on mathbb Z 2 with bounded jumps. Zerner and Merkl proved a 0 1 law for directional transience for planar random walks in random environments. Later, Zerner provided a simplified proof. We extend the result to non planar i.i.d. random walks in random environments on mathbb Z 2 with bounded jumps. As an application, we complete a characterization of directional transience (for a given direction) for random walks in Dirichlet environments with bounded jumps in all dimensions. Such a characterization was previously known for the nearest neighbor case of Dirichlet environments.


Log transform and the weak Harnack inequality for kinetic Fokker Planck equations. This article deals with kinetic Fokker Planck equations with essentially bounded coefficients. A weak Harnack inequality for non negative super solutions is derived by considering their Log transform and following S. N. Kruzhkov (1963). Such a result rests on a new weak Poincar 'e inequality sharing similarities with the one introduced by W. Wang and L. Zhang in a series of works about ultraparabolic equations (2009, 2011, 2017). This functional inequality is combined with a classical covering argument recently adapted by L. Silvestre and the second author (2020) to kinetic equations.


Hi BEHRT Hierarchical Transformer based model for accurate prediction of clinical events using multimodal longitudinal electronic health records. Electronic health records represent a holistic overview of patients' trajectories. Their increasing availability has fueled new hopes to leverage them and develop accurate risk prediction models for a wide range of diseases. Given the complex interrelationships of medical records and patient outcomes, deep learning models have shown clear merits in achieving this goal. However, a key limitation of these models remains their capacity in processing long sequences. Capturing the whole history of medical encounters is expected to lead to more accurate predictions, but the inclusion of records collected for decades and from multiple resources can inevitably exceed the receptive field of the existing deep learning architectures. This can result in missing crucial, long term dependencies. To address this gap, we present Hi BEHRT, a hierarchical Transformer based model that can significantly expand the receptive field of Transformers and extract associations from much longer sequences. Using a multimodal large scale linked longitudinal electronic health records, the Hi BEHRT exceeds the state of the art BEHRT 1 to 5 for area under the receiver operating characteristic (AUROC) curve and 3 to 6 for area under the precision recall (AUPRC) curve on average, and 3 to 6 (AUROC) and 3 to 11 (AUPRC) for patients with long medical history for 5 year heart failure, diabetes, chronic kidney disease, and stroke risk prediction. Additionally, because pretraining for hierarchical Transformer is not well established, we provide an effective end to end contrastive pre training strategy for Hi BEHRT using EHR, improving its transferability on predicting clinical events with relatively small training dataset.


DREAMS Drilling and Extraction Automated System. Drilling and Extraction Automated System (DREAMS) is a fully automated prototype drilling rig that can drill, extract water and assess subsurface density profiles from simulated lunar and Martian subsurface ice. DREAMS system is developed by the Texas A M drilling automation team and composed of four main components 1 tensegrity rig structure, 2 drilling system, 3 water extracting and heating system, and 4 electronic hardware, controls, and machine algorithm. The vertical and rotational movements are controlled by using an Acme rod, stepper, and rotary motor. DREAMS is a unique system and different from other systems presented before in the NASA Rascal Al competition because 1 It uses the tensegrity structure concept to decrease the system weight, improve mobility, and easier installation in space. 2 It cuts rock layers by using a short bit length connected to drill pipes. This drilling methodology is expected to drill hundreds and thousands of meters below the moon and Martian surfaces without any anticipated problems (not only 1 m.). 3 Drilling, heating, and extraction systems are integrated into one system that can work simultaneously or individually to save time and cost.


Hanner's Inequality For Positive Semidefinite Matrices. We prove an analogous Hanner's Inequality of L p spaces for positive semidefinite matrices. Let X p text Tr (X ast X) p 2 1 p denote the p Schatten norm of a matrix X in M n times n ( mathbb C ) . We show that the inequality X Y p p X Y p p geq ( X p Y p) p ( X p Y p ) p holds for 1 leq p leq 2 and reverses for p geq 2 when X,Y in M n times n ( mathbb C ) . This was previously known in the 1 p leq 4 3 , p 2 , and p geq 4 cases, or with additional special assumptions. We outline these previous methods, and comment on their failure to extend to the general case. We further show that there is equality if and only if Y cX , which is analogous to the equality case in L p . With the general inequality, it is confirmed that the unit ball in C p has the same moduli of smoothness and convexity as the unit ball in L p .


The Golden Age of the Mathematical Finance. This paper is devoted to show that the last quarter of the past century can be considered as the golden age of the Mathematical Finance. In this period the collaboration of great economists and the best generation of probabilists, most of them from the Strasbourg's School led by Paul Andr 'e Meyer, gave rise to the foundations of this discipline. They established the two fundamentals theorems of arbitrage theory, close formulas for options, the main modelling a


Standard monomial theory and toric degenerations of Richardson varieties in the Grassmannian. Richardson varieties are obtained as intersections of Schubert and opposite Schubert varieties. We provide a new family of toric degenerations of Richardson varieties inside Grassmannians by studying Gr "obner degenerations of their corresponding ideals. These degenerations are parametrised by block diagonal matching fields in the sense of Sturmfels Zelevinsky. We associate a weight vector to each block diagonal matching field and study its corresponding initial ideal. In particular, we characterise when such ideals are toric, hence providing a family of toric degenerations for Richardson varieties. Given a Richardson variety X w v and a weight vector bf w ell arising from a matching field, we consider two ideals an ideal G k,n, ell w v obtained by restricting the initial of the Pl "ucker ideal to a smaller polynomial ring, and a toric ideal defined as the kernel of a monomial map phi ell w v . We first characterise the monomial free ideals of form G k,n, ell w v . Then we construct a family of tableaux in bijection with semi standard Young tableaux which leads to a monomial basis for the corresponding quotient ring. Finally, we prove that when G k,n, ell w v is monomial free and the initial ideal in bf w ell (I(X w v)) is quadratically generated, then all three ideals in bf w ell (I(X w v)) , G k,n, ell w v and ker ( phi ell w v) coincide, and provide a toric degeneration of X w v .


Effective Use of Graph Convolution Network and Contextual Sub Tree forCommodity News Event Extraction. Event extraction in commodity news is a less researched area as compared to generic event extraction. However, accurate event extraction from commodity news is useful in abroad range of applications such as under standing event chains and learning event event relations, which can then be used for commodity price prediction. The events found in commodity news exhibit characteristics different from generic events, hence posing a unique challenge in event extraction using existing methods. This paper proposes an effective use of Graph Convolutional Networks(GCN) with a pruned dependency parse tree, termed contextual sub tree, for better event ex traction in commodity news. The event ex traction model is trained using feature embed dings from ComBERT, a BERT based masked language model that was produced through domain adaptive pre training on a commodity news corpus. Experimental results show the efficiency of the proposed solution, which out performs existing methods with F1 scores as high as 0.90. Furthermore, our pre trained language model outperforms GloVe by 23 , and BERT and RoBERTa by 7 in terms of argument roles classification. For the goal of re producibility, the code and trained models are made publicly available1.


Lah distribution Stirling numbers, records on compositions, and convex hulls of high dimensional random walks. Let xi 1, xi 2, ldots be a sequence of independent copies of a random vector in mathbb R d having an absolutely continuous distribution. Consider a random walk S i xi 1 cdots xi i , and let C n,d text conv (0,S 1,S 2, ldots,S n) be the convex hull of the first n 1 points it has visited. The polytope C n,d is called k neighborly if for every indices 0 leq i 0 cdots i k leq n the convex hull of the k 1 points S i 0 , ldots, S i k is a k dimensional face of C n,d . We study the probability that C n,d is k neighborly in various high dimensional asymptotic regimes, i.e. when n , d , and possibly also k diverge to infty . There is an explicit formula for the expected number of k dimensional faces of C n,d which involves Stirling numbers of both kinds. Motivated by this formula, we introduce a distribution, called the Lah distribution, and study its properties. In particular, we provide a combinatorial interpretation of the Lah distribution in terms of random compositions and records, and explicitly compute its factorial moments. Limit theorems which we prove for the Lah distribution imply neighborliness properties of C n,d . This yields a new class of random polytopes exhibiting phase transitions parallel to those discovered by Vershik and Sporyshev, Donoho and Tanner for random projections of regular simplices and crosspolytopes.


Topologically Consistent Multi View Face Inference Using Volumetric Sampling. High fidelity face digitization solutions often combine multi view stereo (MVS) techniques for 3D reconstruction and a non rigid registration step to establish dense correspondence across identities and expressions. A common problem is the need for manual clean up after the MVS step, as 3D scans are typically affected by noise and outliers and contain hairy surface regions that need to be cleaned up by artists. Furthermore, mesh registration tends to fail for extreme facial expressions. Most learning based methods use an underlying 3D morphable model (3DMM) to ensure robustness, but this limits the output accuracy for extreme facial expressions. In addition, the global bottleneck of regression architectures cannot produce meshes that tightly fit the ground truth surfaces. We propose ToFu, Topologically consistent Face from multi view, a geometry inference framework that can produce topologically consistent meshes across facial identities and expressions using a volumetric representation instead of an explicit underlying 3DMM. Our novel progressive mesh generation network embeds the topological structure of the face in a feature volume, sampled from geometry aware local features. A coarse to fine architecture facilitates dense and accurate facial mesh predictions in a consistent mesh topology. ToFu further captures displacement maps for pore level geometric details and facilitates high quality rendering in the form of albedo and specular reflectance maps. These high quality assets are readily usable by production studios for avatar creation, animation and physically based skin rendering. We demonstrate state of the art geometric and correspondence accuracy, while only taking 0.385 seconds to compute a mesh with 10K vertices, which is three orders of magnitude faster than traditional techniques. The code and the model are available for research purposes at https tianyeli.github.io tofu.


On level set type methods for elliptic Cauchy problems. Two methods of level set type are proposed for solving the Cauchy problem for an elliptic equation. Convergence and stability results for both methods are proven, characterizing the iterative methods as regularization methods for this ill posed problem. Some numerical experiments are presented, showing the efficiency of our approaches and verifying the convergence results.