Knowing When to Quit Selective Cascaded Regression with Patch Attention for Real Time Face Alignment. Facial landmarks (FLM) estimation is a critical component in many face related applications. In this work, we aim to optimize for both accuracy and speed and explore the trade off between them. Our key observation is that not all faces are created equal. Frontal faces with neutral expressions converge faster than faces with extreme poses or expressions. To differentiate among samples, we train our model to predict the regression error after each iteration. If the current iteration is accurate enough, we stop iterating, saving redundant iterations while keeping the accuracy in check. We also observe that as neighboring patches overlap, we can infer all facial landmarks (FLMs) with only a small number of patches without a major accuracy sacrifice. Architecturally, we offer a multi scale, patch based, lightweight feature extractor with a fine grained local patch attention module, which computes a patch weighting according to the information in the patch itself and enhances the expressive power of the patch features. We analyze the patch attention data to infer where the model is attending when regressing facial landmarks and compare it to face attention in humans. Our model runs in real time on a mobile device GPU, with 95 Mega Multiply Add (MMA) operations, outperforming all state of the art methods under 1000 MMA, with a normalized mean error of 8.16 on the 300W challenging dataset.


A Case for a Programmable Edge Storage Middleware. Edge computing is a fast growing computing paradigm where data is processed at the local site where it is generated, close to the end devices. This can benefit a set of disruptive applications like autonomous driving, augmented reality, and collaborative machine learning, which produce incredible amounts of data that need to be shared, processed and stored at the edge to meet low latency requirements. However, edge storage poses new challenges due to the scarcity and heterogeneity of edge infrastructures and the diversity of edge applications. In particular, edge applications may impose conflicting constraints and optimizations that are hard to be reconciled on the limited, hard to scale edge resources. In this vision paper we argue that a new middleware for constrained edge resources is needed, providing a unified storage service for diverse edge applications. We identify programmability as a critical feature that should be leveraged to optimize the resource sharing while delivering the specialization needed for edge applications. Following this line, we make a case for eBPF and present the design for Griffin a flexible, lightweight programmable edge storage middleware powered by eBPF.


Oblique Derivative Boundary Value Problems on Families of Planar Domains. We consider second order elliptic equations with oblique derivative boundary conditions, defined on a family of bounded domains in mathbb C that depend smoothly on a real parameter lambda in 0,1 . We derive the precise regularity of the solutions in all variables, including the parameter lambda . More specifically we show that the solution and its derivatives are continuous in all variables, and the H "older norms of the space variables are bounded uniformly in lambda .


Deadlock free asynchronous message reordering in Rust with multiparty session types. Rust is a modern systems language focused on performance and reliability. Complementing Rust's promise to provide "fearless concurrency", developers frequently exploit asynchronous message passing. Unfortunately, arbitrarily ordering sending and receiving messages to maximise computation communication overlap (a popular optimisation to message passing applications) opens up a Pandora's box of further subtle concurrency bugs. To guarantee deadlock freedom by construction, we present Rumpsteak a new Rust framework based on multiparty session types. Previous session type implementations in Rust are either built upon synchronous and blocking communication and or limited to two party interactions. Crucially, none support the arbitrary ordering of messages for efficiency. Rumpsteak instead targets asynchronous async await code. Its unique ability is allowing developers to arbitrarily order send receive messages while preserving deadlock freedom. For this, Rumpsteak incorporates two recent advanced session type theories (1) k multiparty compatibility (kmc), which globally verifies the safety of a set of participants, and (2) asynchronous multiparty session subtyping, which locally verifies optimisations in the context of a single participant. Specifically, we propose a novel algorithm for asynchronous subtyping that is both sound and decidable. We first evaluate the performance and expressiveness of Rumpsteak against three previous Rust implementations. We discover that Rumpsteak is around 1.7 8.6x more efficient and can safely express many more examples by virtue of offering arbitrary message ordering. Secondly, we analyse the complexity of our new algorithm and benchmark it against kmc and a binary session subtyping algorithm. We find they are exponentially slower than Rumpsteak's.


Revisit Visual Representation in Analytics Taxonomy A Compression Perspective. Visual analytics have played an increasingly critical role in the Internet of Things, where massive visual signals have to be compressed and fed into machines. But facing such big data and constrained bandwidth capacity, existing image video compression methods lead to very low quality representations, while existing feature compression techniques fail to support diversified visual analytics applications tasks with low bit rate representations. In this paper, we raise and study the novel problem of supporting multiple machine vision analytics tasks with the compressed visual representation, namely, the information compression problem in analytics taxonomy. By utilizing the intrinsic transferability among different tasks, our framework successfully constructs compact and expressive representations at low bit rates to support a diversified set of machine vision tasks, including both high level semantic related tasks and mid level geometry analytic tasks. In order to impose compactness in the representations, we propose a codebook based hyperprior, which helps map the representation into a low dimensional manifold. As it well fits the signal structure of the deep visual feature, it facilitates more accurate entropy estimation, and results in higher compression efficiency. With the proposed framework and the codebook based hyperprior, we further investigate the relationship of different task features owning different levels of abstraction granularity. Experimental results demonstrate that with the proposed scheme, a set of diversified tasks can be supported at a significantly lower bit rate, compared with existing compression schemes.


A beginner guide to Iris, Coq and separation logic. Creating safe concurrent algorithms is challenging and error prone. For this reason, a formal verification framework is necessary especially when those concurrent algorithms are used in safety critical systems. The goal of this guide is to provide resources for beginners to get started in their journey of formal verification using the powerful tool Iris. The difference between this guide and many others is that it provides (i) an in depth explanation of examples and tactics, (ii) an explicit discussion of separation logic, and (iii) a thorough coverage of Iris and Coq. References to other guides and to papers are included throughout to provide readers with resources through which to continue their learning.


Representation Learning for Short Text Clustering. Effective representation learning is critical for short text clustering due to the sparse, high dimensional and noise attributes of short text corpus. Existing pre trained models (e.g., Word2vec and BERT) have greatly improved the expressiveness for short text representations with more condensed, low dimensional and continuous features compared to the traditional Bag of Words (BoW) model. However, these models are trained for general purposes and thus are suboptimal for the short text clustering task. In this paper, we propose two methods to exploit the unsupervised autoencoder (AE) framework to further tune the short text representations based on these pre trained text models for optimal clustering performance. In our first method Structural Text Network Graph Autoencoder (STN GAE), we exploit the structural text information among the corpus by constructing a text network, and then adopt graph convolutional network as encoder to fuse the structural features with the pre trained text features for text representation learning. In our second method Soft Cluster Assignment Autoencoder (SCA AE), we adopt an extra soft cluster assignment constraint on the latent space of autoencoder to encourage the learned text representations to be more clustering friendly. We tested two methods on seven popular short text datasets, and the experimental results show that when only using the pre trained model for short text clustering, BERT performs better than BoW and Word2vec. However, as long as we further tune the pre trained representations, the proposed method like SCA AE can greatly increase the clustering performance, and the accuracy improvement compared to use BERT alone could reach as much as 14 .


PQ Transformer Jointly Parsing 3D Objects and Layouts from Point Clouds. 3D scene understanding from point clouds plays a vital role for various robotic applications. Unfortunately, current state of the art methods use separate neural networks for different tasks like object detection or room layout estimation. Such a scheme has two limitations 1) Storing and running several networks for different tasks are expensive for typical robotic platforms. 2) The intrinsic structure of separate outputs are ignored and potentially violated. To this end, we propose the first transformer architecture that predicts 3D objects and layouts simultaneously, using point cloud inputs. Unlike existing methods that either estimate layout keypoints or edges, we directly parameterize room layout as a set of quads. As such, the proposed architecture is termed as P(oint)Q(uad) Transformer. Along with the novel quad representation, we propose a tailored physical constraint loss function that discourages object layout interference. The quantitative and qualitative evaluations on the public benchmark ScanNet show that the proposed PQ Transformer succeeds to jointly parse 3D objects and layouts, running at a quasi real time (8.91 FPS) rate without efficiency oriented optimization. Moreover, the new physical constraint loss can improve strong baselines, and the F1 score of the room layout is significantly promoted from 37.9 to 57.9 .


Non Adaptive and Adaptive Two Sided Search with Fast Objects. In 1946 Koopman introduced a two sided search model. In this model, a searched object is active and can move at most one step after each test.We analyze the model of a combinatorial two sided search by allowing more moves of the searched object after each test. We give strategies and show that they are optimal. We consider adaptive and non adaptive strategies.We show the surprising result that with the combinatorial two sided search on a path graph, the optimal non adaptive search needs the same number of questions as the corresponding adaptive strategy does. The strategy obtained can also be used as encoding strategy to sent the position of a moving element through a transmission channel.


Dwork crystals III. This paper is a continuation of our Dwork crystals series. Here we exploit the Cartier operation to prove supercongruences for expansion coefficients of rational functions. We also define excellent Frobenius lifts and show that for Dwork's families of hypersurfaces such lifts can be approximated p adically by rational functions with powers of the first and second Hasse Witt determinants in denominators.


False Positive Detection and Prediction Quality Estimation for LiDAR Point Cloud Segmentation. We present a novel post processing tool for semantic segmentation of LiDAR point cloud data, called LidarMetaSeg, which estimates the prediction quality segmentwise. For this purpose we compute dispersion measures based on network probability outputs as well as feature measures based on point cloud input features and aggregate them on segment level. These aggregated measures are used to train a meta classification model to predict whether a predicted segment is a false positive or not and a meta regression model to predict the segmentwise intersection over union. Both models can then be applied to semantic segmentation inferences without knowing the ground truth. In our experiments we use different LiDAR segmentation models and datasets and analyze the power of our method. We show that our results outperform other standard approaches.


Fractional Korn's inequality on subsets of the Euclidean space. We give a new, simpler proof of the fractional Korn's inequality for subsets of mathbb R d . We also show a framework for obtaining Korn's inequality directly from the appropriate Hardy type inequality.


Efficient Reinforcement Learning in Resource Allocation Problems Through Permutation Invariant Multi task Learning. One of the main challenges in real world reinforcement learning is to learn successfully from limited training samples. We show that in certain settings, the available data can be dramatically increased through a form of multi task learning, by exploiting an invariance property in the tasks. We provide a theoretical performance bound for the gain in sample efficiency under this setting. This motivates a new approach to multi task learning, which involves the design of an appropriate neural network architecture and a prioritized task sampling strategy. We demonstrate empirically the effectiveness of the proposed approach on two real world sequential resource allocation tasks where this invariance property occurs financial portfolio optimization and meta federated learning.


Reliable Adversarial Distillation with Unreliable Teachers. In ordinary distillation, student networks are trained with soft labels (SLs) given by pretrained teacher networks, and students are expected to improve upon teachers since SLs are stronger supervision than the original hard labels. However, when considering adversarial robustness, teachers may become unreliable and adversarial distillation may not work teachers are pretrained on their own adversarial data, and it is too demanding to require that teachers are also good at every adversarial data queried by students. Therefore, in this paper, we propose reliable introspective adversarial distillation (IAD) where students partially instead of fully trust their teachers. Specifically, IAD distinguishes between three cases given a query of a natural data (ND) and the corresponding adversarial data (AD) (a) if a teacher is good at AD, its SL is fully trusted (b) if a teacher is good at ND but not AD, its SL is partially trusted and the student also takes its own SL into account (c) otherwise, the student only relies on its own SL. Experiments demonstrate the effectiveness of IAD for improving upon teachers in terms of adversarial robustness.


DGCN Diversified Recommendation with Graph Convolutional Networks. These years much effort has been devoted to improving the accuracy or relevance of the recommendation system. Diversity, a crucial factor which measures the dissimilarity among the recommended items, received rather little scrutiny. Directly related to user satisfaction, diversification is usually taken into consideration after generating the candidate items. However, this decoupled design of diversification and candidate generation makes the whole system suboptimal. In this paper, we aim at pushing the diversification to the upstream candidate generation stage, with the help of Graph Convolutional Networks (GCN). Although GCN based recommendation algorithms have shown great power in modeling complex collaborative filtering effect to improve the accuracy of recommendation, how diversity changes is ignored in those advanced works. We propose to perform rebalanced neighbor discovering, category boosted negative sampling and adversarial learning on top of GCN. We conduct extensive experiments on real world datasets. Experimental results verify the effectiveness of our proposed method on diversification. Further ablation studies validate that our proposed method significantly alleviates the accuracy diversity dilemma.


Motivic stable homotopy theory is strictly commutative at the characteristic. We show that mapping spaces in the p local motivic stable category over an Fp scheme are strictly commutative monoids (whence HZ modules) in a canonical way.


Random Hyperplanes of a Convex Body, Sylvester's Problem and Crofton's Formula. Motivated by a problem on the 67th William Lowell Putnam Mathematical Competition, we will summarize three different solutions found on a website. This Putman problem is a special case of Sylvester's four point problem! Suppose four points are taken at random in a convex body what is the probability that they form a convex quadrilateral? We will see that there exists a relationship among Crofton's formula, random secants in two dimensions and the solution to this question. We will then present the solution following Kingman 3 to the Sylvester's four point problem in two and three dimensions for a unit ball by looking at convex bodies in three and four dimensions, respectively.


Random Sampling in Reproducing Kernel Subspace of Mixed Lebesgue Spaces. In this article, we consider the random sampling in the image space V of mixed Lebesgue space L p,q ( mathbb R n 1 ) under an idempotent integral operator. We assume some decay and regularity conditions of the kernel and approximate the unit sphere in V on a bounded cube C R,S by a finite dimensional subspace of V . Consequently, the set of concentrated functions is totally bounded. We prove with an overwhelming probability that the random sample set uniformly distributed over C R,S is a stable set of sampling for the set of concentrated functions on C R,S . Moreover, we propose an iterative scheme to reconstruct the concentrated signal from its random measurements.


Joint Implicit Image Function for Guided Depth Super Resolution. Guided depth super resolution is a practical task where a low resolution and noisy input depth map is restored to a high resolution version, with the help of a high resolution RGB guide image. Existing methods usually view this task as a generalized guided filtering problem that relies on designing explicit filters and objective functions, or a dense regression problem that directly predicts the target image via deep neural networks. These methods suffer from either model capability or interpretability. Inspired by the recent progress in implicit neural representation, we propose to formulate the guided super resolution as a neural implicit image interpolation problem, where we take the form of a general image interpolation but use a novel Joint Implicit Image Function (JIIF) representation to learn both the interpolation weights and values. JIIF represents the target image domain with spatially distributed local latent codes extracted from the input image and the guide image, and uses a graph attention mechanism to learn the interpolation weights at the same time in one unified deep implicit function. We demonstrate the effectiveness of our JIIF representation on guided depth super resolution task, significantly outperforming state of the art methods on three public benchmarks. Code can be found at url https git.io JC2sU .


Communication Efficient Parallel Reinforcement Learning. We consider the problem where M agents interact with M identical and independent environments with S states and A actions using reinforcement learning for T rounds. The agents share their data with a central server to minimize their regret. We aim to find an algorithm that allows the agents to minimize the regret with infrequent communication rounds. We provide NAM which runs at each agent and prove that the total cumulative regret of M agents is upper bounded as Tilde O (DS sqrt MAT ) for a Markov Decision Process with diameter D , number of states S , and number of actions A . The agents synchronize after their visitations to any state action pair exceeds a certain threshold. Using this, we obtain a bound of O left(MSA log(MT) right) on the total number of communications rounds. Finally, we evaluate the algorithm against multiple environments and demonstrate that the proposed algorithm performs at par with an always communication version of the UCRL2 algorithm, while with significantly lower communication.


Broken mirror symmetry of tracer's trajectories in turbulence. Topological properties of physical systems play a crucial role in our understanding of nature, yet their experimental determination remains elusive. We show that the mean helicity, a dynamical invariant in ideal flows, quantitatively affects trajectories of fluid elements the linking number of Lagrangian trajectories depends on the mean helicity. Thus, a global topological invariant and a topological number of fluid trajectories become related, and we provide an empirical expression linking them. The relation shows the existence of long term memory in the trajectories the links can be made of the trajectory up to a given time, with particles positions in the past. This property also allows experimental measurements of mean helicity.


Straight line Drawings of 1 Planar Graphs. A graph is 1 planar if it can be drawn in the plane so that each edge is crossed at most once. However, there are 1 planar graphs which do not admit a straight line 1 planar drawing. We show that every 1 planar graph has a straight line drawing with a two coloring of the edges, so that edges of the same color do not cross. Hence, 1 planar graphs have geometric thickness two. In addition, each edge is crossed by edges with a common vertex if it is crossed more than twice. The drawings use high precision arithmetic with numbers with O(n log n) digits and can be computed in linear time from a 1 planar drawing


Nilpotent invariance of semi topological K theory of dg algebras and the lattice conjecture. We show existence of a natural rational structure on periodic cyclic homology, conjectured by L. Katzarkov, M. Kontsevich, T. Pantev, for several classes of dg categories, including proper connective mathbb C dg algebras and dg categories of local systems. The main ingredient is derived nilpotent invariance of A. Blanc's semi topological K theory, which we establish along the way.


DeepHunter A Graph Neural Network Based Approach for Robust Cyber Threat Hunting. Cyber Threat hunting is a proactive search for known attack behaviors in the organizational information system. It is an important component to mitigate advanced persistent threats (APTs). However, the attack behaviors recorded in provenance data may not be completely consistent with the known attack behaviors. In this paper, we propose DeepHunter, a graph neural network (GNN) based graph pattern matching approach that can match provenance data against known attack behaviors in a robust way. Specifically, we design a graph neural network architecture with two novel networks attribute embedding networks that could incorporate Indicators of Compromise (IOCs) information, and graph embedding networks that could capture the relationships between IOCs. To evaluate DeepHunter, we choose five real and synthetic APT attack scenarios. Results show that DeepHunter can hunt all attack behaviors, and the accuracy and robustness of DeepHunter outperform the state of the art method, Poirot.


Extracting Deformation Aware Local Features by Learning to Deform. Despite the advances in extracting local features achieved by handcrafted and learning based descriptors, they are still limited by the lack of invariance to non rigid transformations. In this paper, we present a new approach to compute features from still images that are robust to non rigid deformations to circumvent the problem of matching deformable surfaces and objects. Our deformation aware local descriptor, named DEAL, leverages a polar sampling and a spatial transformer warping to provide invariance to rotation, scale, and image deformations. We train the model architecture end to end by applying isometric non rigid deformations to objects in a simulated environment as guidance to provide highly discriminative local features. The experiments show that our method outperforms state of the art handcrafted, learning based image, and RGB D descriptors in different datasets with both real and realistic synthetic deformable objects in still images. The source code and trained model of the descriptor are publicly available at https www.verlab.dcc.ufmg.br descriptors neurips2021.


Modular Idempotents for the Descent Algebras of Type A and Higher Lie Powers and Modules. The article focuses on four aspects related to the descent algebras of type A . They are modular idempotents, higher Lie powers, higher Lie modules and the right ideals of the symmetric group algebras generated by the Solomon's descent elements. More precisely, we give a construction for the modular idempotents, describe the dimension and character for higher Lie powers and study the structures of the higher Lie modules and the right ideals both in the ordinary and modular cases.


Cylindrical contact homology of links of simple singularities. We compute the cylindrical contact homology of the links of the simple singularities. These manifolds are contactomorphic to S 3 G for finite subgroups G subset text SU (2) . We perturb the degenerate contact form on S 3 G with a Morse function, invariant under the corresponding H subset text SO (3) action on S 2 , to achieve nondegeneracy up to an action threshold. The cylindrical contact homology is recovered by taking a direct limit of the action filtered homology groups. The ranks of this homology are given in terms of text Conj (G) , demonstrating a form of the McKay correspondence.


3D Fully Convolutional Neural Networks with Intersection Over Union Loss for Crop Mapping from Multi Temporal Satellite Images. Information on cultivated crops is relevant for a large number of food security studies. Different scientific efforts are dedicated to generating this information from remote sensing images by means of machine learning methods. Unfortunately, these methods do not take account of the spatial temporal relationships inherent in remote sensing images. In our paper, we explore the capability of a 3D Fully Convolutional Neural Network (FCN) to map crop types from multi temporal images. In addition, we propose the Intersection Over Union (IOU) loss function for increasing the overlap between the predicted classes and ground reference data. The proposed method was applied to identify soybean and corn from a study area situated in the US corn belt using multi temporal Landsat images. The study shows that our method outperforms related methods, obtaining a Kappa coefficient of 91.8 . We conclude that using the IOU loss function provides a superior choice to learn individual crop types.


Risk Aware and Multi Objective Decision Making with Distributional Monte Carlo Tree Search. In many risk aware and multi objective reinforcement learning settings, the utility of the user is derived from the single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For example, in a medical setting a patient may only have one opportunity to treat their illness. When making a decision, just the expected return known in reinforcement learning as the value cannot account for the potential range of adverse or positive outcomes a decision may have. Our key insight is that we should use the distribution over expected future returns differently to represent the critical information that the agent requires at decision time. In this paper, we propose Distributional Monte Carlo Tree Search, an algorithm that learns a posterior distribution over the utility of the different possible returns attainable from individual policy executions, resulting in good policies for both risk aware and multi objective settings. Moreover, our algorithm outperforms the state of the art in multi objective reinforcement learning for the expected utility of the returns.


Birds Eye View Social Distancing Analysis System. Social distancing can reduce the infection rates in respiratory pandemics such as COVID 19. Traffic intersections are particularly suitable for monitoring and evaluation of social distancing behavior in metropolises. We propose and evaluate a privacy preserving social distancing analysis system (B SDA), which uses bird's eye view video recordings of pedestrians who cross traffic intersections. We devise algorithms for video pre processing, object detection and tracking which are rooted in the known computer vision and deep learning techniques, but modified to address the problem of detecting very small objects pedestrians captured by a highly elevated camera. We propose a method for incorporating pedestrian grouping for detection of social distancing violations. B SDA is used to compare pedestrian behavior based on pre pandemic and pandemic videos in a major metropolitan area. The accomplished pedestrian detection performance is 63.0 AP 50 and the tracking performance is 47.6 MOTA. The social distancing violation rate of 15.6 during the pandemic is notably lower than 31.4 pre pandemic baseline, indicating that pedestrians followed CDC prescribed social distancing recommendations. The proposed system is suitable for deployment in real world applications.


The Space Complexity of Sum Labelling. A graph is called a sum graph if its vertices can be labelled by distinct positive integers such that there is an edge between two vertices if and only if the sum of their labels is the label of another vertex of the graph. Most papers on sum graphs consider combinatorial questions like the minimum number of isolated vertices that need to be added to a given graph to make it a sum graph. In this paper, we initiate the study of sum graphs from the viewpoint of computational complexity. Notice that every n vertex sum graph can be represented by a sorted list of n positive integers where edge queries can be answered in O( log n) time. Therefore, limiting the size of the vertex labels also upper bounds the space complexity of storing the graph in the database. We show that every n vertex, m edge, d degenerate graph can be made a sum graph by adding at most m isolated vertices to it, such that the size of each vertex label is at most O(n 2d) . This enables us to store the graph using O(m log n) bits of memory. For sparse graphs (graphs with O(n) edges), this matches the trivial lower bound of Omega(n log n) . Since planar graphs and forests have constant degeneracy, our result implies an upper bound of O(n 2) on their label size. The previously best known upper bound on the label size of general graphs with the minimum number of isolated vertices was O(4 n) , due to Kratochv 'il, Miller Nguyen. Furthermore, their proof was existential, whereas our labelling can be constructed in polynomial time.


Content aware Directed Propagation Network with Pixel Adaptive Kernel Attention. Convolutional neural networks (CNNs) have been not only widespread but also achieved noticeable results on numerous applications including image classification, restoration, and generation. Although the weight sharing property of convolutions makes them widely adopted in various tasks, its content agnostic characteristic can also be considered a major drawback. To solve this problem, in this paper, we propose a novel operation, called pixel adaptive kernel attention (PAKA). PAKA provides directivity to the filter weights by multiplying spatially varying attention from learnable features. The proposed method infers pixel adaptive attention maps along the channel and spatial directions separately to address the decomposed model with fewer parameters. Our method is trainable in an end to end manner and applicable to any CNN based models. In addition, we propose an improved information aggregation module with PAKA, called the hierarchical PAKA module (HPM). We demonstrate the superiority of our HPM by presenting state of the art performance on semantic segmentation compared to the conventional information aggregation modules. We validate the proposed method through additional ablation studies and visualizing the effect of PAKA providing directivity to the weights of convolutions. We also show the generalizability of the proposed method by applying it to multi modal tasks especially color guided depth map super resolution.


Density Aware Federated Imitation Learning for Connected and Automated Vehicles with Unsignalized Intersection. Intelligent Transportation System (ITS) has become one of the essential components in Industry 4.0. As one of the critical indicators of ITS, efficiency has attracted wide attention from researchers. However, the next generation of urban traffic carried by multiple transport service providers may prohibit the raw data interaction among multiple regions for privacy reasons, easily ignored in the existing research. This paper puts forward a federated learning based vehicle control framework to solve the above problem, including interactors, trainers, and an aggregator. In addition, the density aware model aggregation method is utilized in this framework to improve vehicle control. What is more, to promote the performance of the end to end learning algorithm in the safety aspect, this paper proposes an imitation learning algorithm, which can obtain collision avoidance capabilities from a set of collision avoidance rules. Furthermore, a loss aware experience selection strategy is also explored, reducing the communication overhead between the interactors and the trainers via extra computing. Finally, the experiment results demonstrate that the proposed imitation learning algorithm obtains the ability to avoid collisions and reduces discomfort by 55.71 . Besides, density aware model aggregation can further reduce discomfort by 41.37 , and the experience selection scheme can reduce the communication overhead by 12.80 while ensuring model convergence.


Code Perfumes Reporting Good Code to Encourage Learners. Block based programming languages like Scratch enable children to be creative while learning to program. Even though the block based approach simplifies the creation of programs, learning to program can nevertheless be challenging. Automated tools such as linters therefore support learners by providing feedback about potential bugs or code smells in their programs. Even when this feedback is elaborate and constructive, it still represents purely negative criticism and by construction ignores what learners have done correctly in their programs. In this paper we introduce an orthogonal approach to linting We complement the criticism produced by a linter with positive feedback. We introduce the concept of code perfumes as the counterpart to code smells, indicating the correct application of programming practices considered to be good. By analysing not only what learners did wrong but also what they did right we hope to encourage learners, to provide teachers and students a better understanding of learners' progress, and to support the adoption of automated feedback tools. Using a catalogue of 25 code perfumes for Scratch, we empirically demonstrate that these represent frequent practices in Scratch, and we find that better programs indeed contain more code perfumes.


Performance and application of an open source automated magnetic optical density meter for analyzing magnetotactic bacteria. We present a spectrophotometer (optical density meter) combined with electromagnets dedicated to the analysis of magnetotactic bacteria. We have ensured that our system, called MagOD, can be easily reproduced by providing the source of the 3D prints for the housing, electronic designs, circuit board layouts, and microcontroller software. We compare the performance of this novel system to existing adapted commercial spectrophotometers. In addition, we demonstrate its use by analyzing the absorbance of magnetotactic bacteria as a function of their orientation with respect to the light path and their speed of reorientation after the field has been rotated by 90o. We continuously monitored the development of a culture of magnetotactic bacteria over a period of five days, and measured the development of their velocity distribution over a period of one hour. Even though this dedicated spectrophotometer is relatively simple to construct and cost effective, a range of magnetic field dependent parameters can be extracted from suspensions of magnetotactic bacteria. Therefore, this instrument will help the magnetotactic research community to understand and apply this intriguing micro organism.


Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats. Controlling systems of ordinary differential equations (ODEs) is ubiquitous in science and engineering. For finding an optimal feedback controller, the value function and associated fundamental equations such as the Bellman equation and the Hamilton Jacobi Bellman (HJB) equation are essential. The numerical treatment of these equations poses formidable challenges due to their non linearity and their (possibly) high dimensionality. In this paper we consider a finite horizon control system with associated Bellman equation. After a time discretization, we obtain a sequence of short time horizon problems which we call local optimal control problems. For solving the local optimal control problems we apply two different methods, one being the well known policy iteration, where a fixed point iteration is required for every time step. The other algorithm borrows ideas from Model Predictive Control (MPC), by solving the local optimal control problem via open loop control methods on a short time horizon, allowing us to replace the fixed point iteration by an adjoint method. For high dimensional systems we apply low rank hierarchical tensor product approximation tree based tensor formats, in particular tensor trains (TT tensors) and multi polynomials, together with high dimensional quadrature, e.g. Monte Carlo. We prove a linear error propagation with respect to the time discretization and give numerical evidence by controlling a diffusion equation with unstable reaction term and an Allen Kahn equation.


Reducing Boolean Networks with Backward Boolean Equivalence. Boolean Networks (BNs) are established models to qualitatively describe biological systems. The analysis of BNs might be infeasible for medium to large BNs due to the state space explosion problem. We propose a novel reduction technique called emph Backward Boolean Equivalence (BBE), which preserves some properties of interest of BNs. In particular, reduced BNs provide a compact representation by grouping variables that, if initialized equally, are always updated equally. The resulting reduced state space is a subset of the original one, restricted to identical initialization of grouped variables. The corresponding trajectories of the original BN can be exactly restored. We show the effectiveness of BBE by performing a large scale validation on the whole GINsim BN repository. In selected cases, we show how our method enables analyses that would be otherwise intractable. Our method complements, and can be combined with, other reduction methods found in the literature.


RoboKit MV an Educational Initiative. In this paper, we present a robot model and code base for affordable education in the field of humanoid robotics. We give an overview of the software and hardware of a robot that won several competitions with the team RoboKit in 2019 2021, provide analysis of the contemporary market of education in robotics, and highlight the reasoning beyond certain design solutions.


To Smooth or Not? When Label Smoothing Meets Noisy Labels. Label smoothing (LS) is an arising learning paradigm that uses the positively weighted average of both the hard training labels and uniformly distributed soft labels. It was shown that LS serves as a regularizer for training data with hard labels and therefore improves the generalization of the model. Later it was reported LS even helps with improving robustness when learning with noisy labels. However, we observed that the advantage of LS vanishes when we operate in a high label noise regime. Intuitively speaking, this is due to the increased entropy of mathbb P ( text noisy label X) when the noise rate is high, in which case, further applying LS tends to "oversmooth" the estimated posterior. We proceeded to discover that several learning with noisy labels solutions in the literature instead relate more closely to negative not label smoothing (NLS), which acts counter to LS and defines as using a negative weight to combine the hard and soft labels! We provide understandings for the properties of LS and NLS when learning with noisy labels. Among other established properties, we theoretically show NLS is considered more beneficial when the label noise rates are high. We provide extensive experimental results on multiple benchmarks to support our findings too.


Generalized indefinite strings with purely discrete spectrum. We establish criteria for the spectrum of a generalized indefinite string to be purely discrete and to satisfy Schatten von Neumann properties. The results can be applied to the isospectral problem associated with the conservative Camassa Holm flow and to Schr "odinger operators with delta' interactions.


A molecular perspective on induced charges on a metallic surface. Understanding the response of the surface of metallic solids to external electric field sources is crucial to characterize electrode electrolyte interfaces. Continuum electrostatics offer a simple description of the induced charge density at the electrode surface. However, such a simple description does not take into account features related to the atomic structure of the solid and to the molecular nature of the solvent and of the dissolved ions. In order to illustrate such effects and assess the ability of continuum electrostatics to describe the induced charge distribution, we investigate the behaviour of a gold electrode interacting with sodium or chloride ions fixed at various positions, in vacuum or in water, using all atom constant potential classical molecular dynamics simulations. Our analysis highlights important similarities between the two approaches, especially in vacuum conditions and when the ion is sufficiently far from the surface, as well as some limitations of the continuum description, namely neglecting the charges induced by the adsorbed solvent molecules and the screening effect of the solvent when the ion is close to the surface. While the detailed features of the charge distribution are system specific, we expect some of our generic conclusions on the induced charge density to hold for other ions, solvents and electrode surfaces. Beyond this particular case, the present study also illustrates the relevance of such molecular simulations to serve as a reference for the design of improved implicit solvent models of electrode electrolyte interfaces.


Recurrence Transience criteria for excited random walks with finite drift cookie stacks. We consider excited random walk (ERW) on mathbb Z in environments with identical stacks of infinitely many cookies at each site, subject to the constraint that the total drift per site delta sum (2p j 1) is finite. Building on the methods of Kozma, Orenshtein, and Shinkar (arXiv 1311.7439), we show that ERW in finite drift environments is recurrent when delta 1 and transient when delta 1 . In the case delta 1 we prove that ERW is recurrent under mild assumptions on the environment. In addition, we show that ERW may be transient when delta 1 , an interesting new behavior that was not present in previously studied models.


Deep Learning Inversion Method for the Interpretation of Noisy Logging While Drilling Resistivity Measurements. Deep Learning (DL) inversion is a promising method for real time interpretation of logging while drilling (LWD) resistivity measurements for well navigation applications. In this context, measurement noise may significantly affect inversion results. Existing publications examining the effects of measurement noise on DL inversion results are scarce. We develop a method to generate training data sets and construct DL architectures that enhance the robustness of DL inversion methods in the presence of noisy LWD resistivity measurements. We use two synthetic resistivity models to test three approaches that explicitly consider the presence of noise (1) adding noise to the measurements in the training set, (2) augmenting the training set by replicating it and adding varying noise realizations, and (3) adding a noise layer in the DL architecture. Numerical results confirm that the three approaches produce a denoising effect, yielding better inversion results in both predicted earth model and measurements compared not only to the basic DL inversion but also to traditional gradient based inversion results. A combination of the second and third approaches delivers the best results. The proposed methods can be readily generalized to multi dimensional DL inversion.


Calculating a function of a matrix with a real spectrum. Let T be a square matrix with a real spectrum, and let f be an analytic function. The problem of the approximate calculation of f(T) is discussed. Applying the Schur triangular decomposition and the reordering, one can assume that T is triangular and its diagonal entries t ii are arranged in increasing order. To avoid calculations using the differences t ii t jj with close (including equal) t ii and t jj , it is proposed to represent T in a block form and calculate the two main block diagonals using interpolating polynomials. The rest of the f(T) entries can be calculated using the Parlett recurrence algorithm. It is also proposed to perform scalar operations (such as the building of interpolating polynomials) with an enlarged number of decimal digits.


Improved Sensitivity of Base Layer on the Performance of Rigid Pavement. The performance of rigid pavement is greatly affected by the properties of base subbase as well as subgrade layer. However, the performance predicted by the AASHTOWare Pavement ME design shows low sensitivity to the properties of base and subgrade layers. To improve the sensitivity and better reflect the influence of unbound layers a new set of improved models i.e., resilient modulus (MR) and modulus of subgrade reaction (k value) are adopted in this study. An Artificial Neural Network (ANN) model is developed to predict the modified k value based on finite element (FE) analysis. The training and validation datasets in the ANN model consist of 27000 simulation cases with different combinations of pavement layer thickness, layer modulus and slab base interface bond ratio. To examine the sensitivity of modified MR and k values on pavement response, eight pavement sections data are collected from the Long Term Pavement performance (LTPP) database and modeled by using the FE software ISLAB2000. The computational results indicate that the modified MR values have higher sensitivity to water content in base layer on critical stress and deflection response of rigid pavements compared to the results using the Pavement ME design model. It is also observed that the k values using ANN model has the capability of predicting critical pavement response at any partially bonded conditions whereas the Pavement ME design model can only calculate at two extreme bonding conditions (i.e., fully bonding and no bonding).


Factorizations in evaluation monoids of Laurent semirings. For a positive real number alpha , let mathbb N 0 alpha, alpha 1 be the semiring of all real numbers f( alpha) for f(x) lying in mathbb N 0 x,x 1 , which is the semiring of all Laurent polynomials over the set of nonnegative integers mathbb N 0 . In this paper, we study various factorization properties of the additive structure of mathbb N 0 alpha, alpha 1 . We characterize when mathbb N 0 alpha, alpha 1 is atomic. Then we characterize when mathbb N 0 alpha, alpha 1 satisfies the ascending chain condition on principal ideals in terms of certain well studied factorization properties. Finally, we characterize when mathbb N 0 alpha, alpha 1 satisfies the unique factorization property and show that, when this is not the case, mathbb N 0 alpha, alpha 1 has infinite elasticity.


SoK Opportunities for Software Hardware Security Codesign for Next Generation Secure Computing. Users are demanding increased data security. As a result, security is rapidly becoming a first order design constraint in next generation computing systems. Researchers and practitioners are exploring various security technologies to meet user demand such as trusted execution environments (e.g., Intel SGX, ARM TrustZone), homomorphic encryption, and differential privacy. Each technique provides some degree of security, but differs with respect to threat coverage, performance overheads, as well as implementation and deployment challenges. In this paper, we present a systemization of knowledge (SoK) on these design considerations and trade offs using several prominent security technologies. Our study exposes the need for textit software hardware security codesign to realize efficient and effective solutions of securing user data. In particular, we explore how design considerations across applications, hardware, and security mechanisms must be combined to overcome fundamental limitations in current technologies so that we can minimize performance overhead while achieving sufficient threat model coverage. Finally, we propose a set of guidelines to facilitate putting these secure computing technologies into practice.


LongChecker Improving scientific claim verification by modeling full abstract context. We introduce the LongChecker system for scientific claim verification. Given a scientific claim and an evidence containing research abstract, LongChecker predicts a veracity label and identifies supporting rationales in a multitask fashion based on a shared encoding of the claim and abstract. We perform experiments on the SciFact dataset, and find that LongChecker achieves state of the art performance. We conduct analysis to understand the source of this improvement, and find that identifying the relationship between a claim and a rationale reporting a scientific finding often requires understanding the context in which the rationale appears. By making labeling decisions based on all available context, LongChecker achieves better performance on cases requiring this type of understanding. In addition, we show that LongChecker is able to leverage weakly supervised in domain data to facilitate few shot domain adaptation for scientific claim verification.


Signature, Toledo invariant and surface group representations in the real symplectic group. In this paper, by using Atiyah Patodi Singer index theorem, we obtain a formula for the signature of a flat symplectic vector bundle over a surface with boundary, which is related to the Toledo invariant of a surface group representation in the real symplectic group and the Rho invariant on the boundary. As an application, we obtain a Milnor Wood type inequality for the signature. In particular, we give a new proof of the Milnor Wood inequality for the Toledo invariant in the case of closed surfaces and obtain some modified inequalities for the surface with boundary.


Restricted Log Exp Analytic Functions and some Differentiability Results. In this article we define restricted log exp analytic functions as compositions of log analytic functions and exponentials whose logarithm are locally bounded. We prove that the derivative of a restricted log exp analytic function is again restricted log exp analytic and that such a function exhibits strong quasianalytic properties. We establish the parametric version of Tamm's theorem for this class of functions.


Classification of irreducible integrable modules for extended affine Lie algebras with center acting trivially. We classify the irreducible integrable modules for the twisted toroidal extended affine Lie algebras with fnite diemnsional weight spaces where the fnite dimensional center acts trivially. We have proved that the entire central extension part acts trivially on the modules and our modules turn out to be highest weight modules.


Chronic Pain and Language A Topic Modelling Approach to Personal Pain Descriptions. Chronic pain is recognized as a major health problem, with impacts not only at the economic, but also at the social, and individual levels. Being a private and subjective experience, it is impossible to externally and impartially experience, describe, and interpret chronic pain as a purely noxious stimulus that would directly point to a causal agent and facilitate its mitigation, contrary to acute pain, the assessment of which is usually straightforward. Verbal communication is, thus, key to convey relevant information to health professionals that would otherwise not be accessible to external entities, namely, intrinsic qualities about the painful experience and the patient. We propose and discuss a topic modelling approach to recognize patterns in verbal descriptions of chronic pain, and use these patterns to quantify and qualify experiences of pain. Our approaches allow for the extraction of novel insights on chronic pain experiences from the obtained topic models and latent spaces. We argue that our results are clinically relevant for the assessment and management of chronic pain.


Weighted Relaxation for Multigrid Reduction in Time. Based on current trends in computer architectures, faster compute speeds must come from increased parallelism rather than increased clock speeds, which are currently stagnate. This situation has created the well known bottleneck for sequential time integration, where each individual time value (i.e., time step) is computed sequentially. One approach to alleviate this and achieve parallelism in time is with multigrid. In this work, we consider multigrid reduction in time (MGRIT), a multilevel method applied to the time dimension that computes multiple time steps in parallel. Like all multigrid methods, MGRIT relies on the complementary relationship between relaxation on a fine grid and a correction from the coarse grid to solve the problem. All current MGRIT implementations are based on unweighted Jacobi relaxation here we introduce the concept of weighted relaxation to MGRIT. We derive new convergence bounds for weighted relaxation, and use this analysis to guide the selection of relaxation weights. Numerical results then demonstrate that non unitary relaxation weights consistently yield faster convergence rates and lower iteration counts for MGRIT when compared with unweighted relaxation. In most cases, weighted relaxation yields a 10 20 saving in iterations. For A stable integration schemes, results also illustrate that under relaxation can restore convergence in some cases where unweighted relaxation is not convergent.


Aristotle Cloud Federation Container Runtimes Technical Report. A National Science Foundation sponsored container runtimes investigation was conducted by the Aristotle Cloud Federation to better understand the challenges of selecting and using Docker, Singularity, and X Containers. The main goal of this investigation was to identify the "pain points" experienced by users when selecting and using containers for scientific research and to share lessons learned. Application performance characteristics are included in this report as well as user experiences with Kubernetes and container orchestration on cloud and HPC platforms. Scientists, research computing practitioners, and educators may find value in this report when considering the use and or deployment of containers or when preparing students to meet the unique challenges of using containers in scientific research.


A Curious Use of Extra Dimension in Classical Mechanics. Extra dimensions can be utilized to simplify problems in classical mechanics, offering new insights. Here we show a simple example of how the motion of a test particle under the influence of an inverse quadratic potential in 1D is equivalent to that of another test particle moving freely in 2D Euclidean space and 3D Minkowskian space.


PatternMonitor a whole pipeline with a much higher level of automation for guessing Android lock pattern based on videos. Pattern lock is a general technique used to realize identity authentication and access authorization on mobile terminal devices such as Android platform devices, but it is vulnerable to the attack proposed by recent researches that exploit information leaked by users while drawing patterns. However, the existing attacks on pattern lock are environmentally sensitive, and rely heavily on manual work, which constrains the practicability of these attack approaches. To attain a more practical attack, this paper designs the PatternMonitor, a whole pipeline with a much higher level of automation system againsts pattern lock, which extracts the guessed candidate patterns from a video containing pattern drawing instead of manually cutting the target video and setting thresholds, it first employs recognition models to locate the target phone and keypoints of pattern drawing hand, which enables the gesture can be recognized even when the fingertips are shaded. Then, we extract the frames from the video where the drawing starts and ends. These pre processed frames are inputs of target tracking model to generate trajectories, and further transformed into possible candidate patterns by performing our designed algorithm. To the best of our knowledge, our work is the first attack system to generate candidate patterns by only relying on hand movement instead of accurate fingertips capture. The experimental results demonstrates that our work is as accurate as previous work, which gives more than 90 success rate within 20 attempts.


A Discrete Time Switching System Analysis of Q learning. This paper develops a novel control theoretic framework to analyze the non asymptotic convergence of Q learning. We show that the dynamics of asynchronous Q learning with a constant step size can be naturally formulated as a discrete time stochastic affine switching system. Moreover, the evolution of the Q learning estimation error is over and underestimated by trajectories of two simpler dynamical systems. Based on these two systems, we derive a new finite time error bound of asynchronous Q learning when a constant stepsize is used. Our analysis also sheds light on the overestimation phenomenon of Q learning. We further illustrate and validate the analysis through numerical simulations.


Pinpointing the Memory Behaviors of DNN Training. The training of deep neural networks (DNNs) is usually memory hungry due to the limited device memory capacity of DNN accelerators. Characterizing the memory behaviors of DNN training is critical to optimize the device memory pressures. In this work, we pinpoint the memory behaviors of each device memory block of GPU during training by instrumenting the memory allocators of the runtime system. Our results show that the memory access patterns of device memory blocks are stable and follow an iterative fashion. These observations are useful for the future optimization of memory efficient training from the perspective of raw memory access patterns.


Classification of Contract Amendment Relationships. In Contract Life cycle Management (CLM), managing and tracking the master agreements and their associated amendments is essential, in order to be kept informed with different due dates and obligations. An automatic solution can facilitate the daily jobs and improve the efficiency of legal practitioners. In this paper, we propose an approach based on machine learning (ML) and Natural Language Processing (NLP) to detect the amendment relationship between two documents. The algorithm takes two PDF documents preprocessed by OCR (Optical Character Recognition) and NER (Named Entity Recognition) as input, and then it builds the features of each document pair and classifies the relationship. We experimented with different configurations on a dataset consisting of 1124 pairs of contract amendment documents in English and French. The best result obtained a F1 score of 91 , which outperformed 23 compared to a heuristic based baseline.


Deeper Learning By Doing Integrating Hands On Research Projects Into a Machine Learning Course. Machine learning has seen a vast increase of interest in recent years, along with an abundance of learning resources. While conventional lectures provide students with important information and knowledge, we also believe that additional project based learning components can motivate students to engage in topics more deeply. In addition to incorporating project based learning in our courses, we aim to develop project based learning components aligned with real world tasks, including experimental design and execution, report writing, oral presentation, and peer reviewing. This paper describes the organization of our project based machine learning courses with a particular emphasis on the class project components and shares our resources with instructors who would like to include similar elements in their courses.


On the Optimality of Batch Policy Optimization Algorithms. Batch policy optimization considers leveraging existing data for policy construction before interacting with an environment. Although interest in this problem has grown significantly in recent years, its theoretical foundations remain under developed. To advance the understanding of this problem, we provide three results that characterize the limits and possibilities of batch policy optimization in the finite armed stochastic bandit setting. First, we introduce a class of confidence adjusted index algorithms that unifies optimistic and pessimistic principles in a common framework, which enables a general analysis. For this family, we show that any confidence adjusted index algorithm is minimax optimal, whether it be optimistic, pessimistic or neutral. Our analysis reveals that instance dependent optimality, commonly used to establish optimality of on line stochastic bandit algorithms, cannot be achieved by any algorithm in the batch setting. In particular, for any algorithm that performs optimally in some environment, there exists another environment where the same algorithm suffers arbitrarily larger regret. Therefore, to establish a framework for distinguishing algorithms, we introduce a new weighted minimax criterion that considers the inherent difficulty of optimal value prediction. We demonstrate how this criterion can be used to justify commonly used pessimistic principles for batch policy optimization.


Uniqueness and Regularity of the Fractional Harmonic Gradient Flow in S n 1 . In this paper, we study the fractional harmonic gradient flow on S 1 taking values in S n 1 subset mathbb R n for every n geq 2 , in particular addressing uniqueness and regularity of solutions in the so called energy class with sufficiently small energy, adding to the existing body of knowledge which includes existence of solutions and certain bubbling phenomena.


1 absorbing primary submodules. Let R be a commutative ring with non zero identity and M be a unitary R module. The goal of this paper is to extend the concept of 1 absorbing primary ideals to 1 absorbing primary submodules. A proper submodule N of M is said to be a 1 absorbing primary submodule if whenever non unit elements a,b in R and m in M with abm in N , then either ab in(N R M) or m in M rad(N). Various properties and chacterizations of this class of submodules are considered. Moreover, 1 absorbing primary avoidance theorem is proved.


Unfolding the multiscale structure of networks with dynamical Ollivier Ricci curvature. Describing networks geometrically through low dimensional latent metric spaces has helped design efficient learning algorithms, unveil network symmetries and study dynamical network processes. However, latent space embeddings are limited to specific classes of networks because incompatible metric spaces generally result in information loss. Here, we study arbitrary networks geometrically by defining a dynamic edge curvature measuring the similarity between pairs of dynamical network processes seeded at nearby nodes. We show that the evolution of the curvature distribution exhibits gaps at characteristic timescales indicating bottleneck edges that limit information spreading. Importantly, curvature gaps are robust to large fluctuations in node degrees, encoding communities until the phase transition of detectability, where spectral and node clustering methods fail. Using this insight, we derive geometric modularity to find multiscale communities based on deviations from constant network curvature in generative and real world networks, significantly outperforming most previous methods. Our work suggests using network geometry for studying and controlling the structure of and information spreading on networks.


Donnan Equilibrium Revisited Coupling between Ion Concentrations, Osmotic Pressure, and Donnan Potential. This paper discusses the little known fact that Donnan's equilibrium criteria established over 100 years ago neglected the coupling between ion concentrations and the osmotic pressure. Such coupling can be treated based on general thermodynamic considerations including the solvent equilibrium, leading to a membrane potential that consists of not only the classical Donnan potential term but also an additional term due to the osmotic pressure, and the existence of a membrane potential even when the impermeable species are not charged. This coupled treatment is in conflict with the well established Poisson Boltzmann equation and Nernst Planck equation, but is consistent with the extension of these equations including the solvent effects by Freise and Schlogl, enables us to view the electrical double layer equilibrium as Donnan equilibrium.


Sequence to Sequence Lexical Normalization with Multilingual Transformers. Current benchmark tasks for natural language processing contain text that is qualitatively different from the text used in informal day to day digital communication. This discrepancy has led to severe performance degradation of state of the art NLP models when fine tuned on real world data. One way to resolve this issue is through lexical normalization, which is the process of transforming non standard text, usually from social media, into a more standardized form. In this work, we propose a sentence level sequence to sequence model based on mBART, which frames the problem as a machine translation problem. As the noisy text is a pervasive problem across languages, not just English, we leverage the multi lingual pre training of mBART to fine tune it to our data. While current approaches mainly operate at the word or subword level, we argue that this approach is straightforward from a technical standpoint and builds upon existing pre trained transformer networks. Our results show that while word level, intrinsic, performance evaluation is behind other methods, our model improves performance on extrinsic, downstream tasks through normalization compared to models operating on raw, unprocessed, social media text.


PASS Protected Attribute Suppression System for Mitigating Bias in Face Recognition. Face recognition networks encode information about sensitive attributes while being trained for identity classification. Such encoding has two major issues (a) it makes the face representations susceptible to privacy leakage (b) it appears to contribute to bias in face recognition. However, existing bias mitigation approaches generally require end to end training and are unable to achieve high verification accuracy. Therefore, we present a descriptor based adversarial de biasing approach called Protected Attribute Suppression System (PASS)'. PASS can be trained on top of descriptors obtained from any previously trained high performing network to classify identities and simultaneously reduce encoding of sensitive attributes. This eliminates the need for end to end training. As a component of PASS, we present a novel discriminator training strategy that discourages a network from encoding protected attribute information. We show the efficacy of PASS to reduce gender and skintone information in descriptors from SOTA face recognition networks like Arcface. As a result, PASS descriptors outperform existing baselines in reducing gender and skintone bias on the IJB C dataset, while maintaining a high verification accuracy.


Graph approximation and generalized Tikhonov regularization for signal deblurring. Given a compact linear operator K , the (pseudo) inverse K dagger is usually substituted by a family of regularizing operators R alpha which depends on K itself. Naturally, in the actual computation we are forced to approximate the true continuous operator K with a discrete operator K (n) characterized by a finesses discretization parameter n , and obtaining then a discretized family of regularizing operators R alpha (n) . In general, the numerical scheme applied to discretize K does not preserve, asymptotically, the full spectrum of K . In the context of a generalized Tikhonov type regularization, we show that a graph based approximation scheme that guarantees, asymptotically, a zero maximum relative spectral error can significantly improve the approximated solutions given by R alpha (n) . This approach is combined with a graph based regularization technique with respect to the penalty term.


Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning. In this work, we present and study a training set up that achieves fast policy generation for real world robotic tasks by using massive parallelism on a single workstation GPU. We analyze and discuss the impact of different training algorithm components in the massively parallel regime on the final policy performance and training times. In addition, we present a novel game inspired curriculum that is well suited for training with thousands of simulated robots in parallel. We evaluate the approach by training the quadrupedal robot ANYmal to walk on challenging terrain. The parallel approach allows training policies for flat terrain in under four minutes, and in twenty minutes for uneven terrain. This represents a speedup of multiple orders of magnitude compared to previous work. Finally, we transfer the policies to the real robot to validate the approach. We open source our training code to help accelerate further research in the field of learned legged locomotion.


RandomRooms Unsupervised Pre training from Synthetic Shapes and Randomized Layouts for 3D Object Detection. 3D point cloud understanding has made great progress in recent years. However, one major bottleneck is the scarcity of annotated real datasets, especially compared to 2D object detection tasks, since a large amount of labor is involved in annotating the real scans of a scene. A promising solution to this problem is to make better use of the synthetic dataset, which consists of CAD object models, to boost the learning on real datasets. This can be achieved by the pre training and fine tuning procedure. However, recent work on 3D pre training exhibits failure when transfer features learned on synthetic objects to other real world applications. In this work, we put forward a new method called RandomRooms to accomplish this objective. In particular, we propose to generate random layouts of a scene by making use of the objects in the synthetic CAD dataset and learn the 3D scene representation by applying object level contrastive learning on two random scenes generated from the same set of synthetic objects. The model pre trained in this way can serve as a better initialization when later fine tuning on the 3D object detection task. Empirically, we show consistent improvement in downstream 3D detection tasks on several base models, especially when less training data are used, which strongly demonstrates the effectiveness and generalization of our method. Benefiting from the rich semantic knowledge and diverse objects from synthetic data, our method establishes the new state of the art on widely used 3D detection benchmarks ScanNetV2 and SUN RGB D. We expect our attempt to provide a new perspective for bridging object and scene level 3D understanding.


Subpicosecond dynamics of pre plasma on a solid, formed by a ultra high contrast, relativistic intensity pulse. Using spectral interferometry technique, we measured subpicosecond time resolved pre plasma scale lengths and early expansion ( 12 ps) of the plasma produced by a high intensity (2 times 10 18 W cm 2 ) pulse with ultra high contrast (10 9 ). We measured pre plasma scale lengths in the range of 3 15 nm. This measurement plays a crucial role in understanding the mechanism of laser coupling its energy to hot electrons and hence important for laser driven ion acceleration and fast ignition approach to fusion.


Design and Analysis of Modular Pipe Climber III with a Multi Output Differential Mechanism. This paper presents the design of an in pipe climbing robot that operates using a novel Three output open differential'(3 OOD) mechanism to traverse complex networks of pipes. Conventional wheeled tracked in pipe climbing robots are prone to slip and drag while traversing in pipe bends. The 3 OOD mechanism helps in achieving the novel result of eliminating slip and drag in the robot tracks during motion. The proposed differential realizes the functional abilities of the traditional two output differential, which is achieved the first time for a differential with three outputs. The 3 OOD mechanism mechanically modulates the track speeds of the robot based on the forces exerted on each track inside the pipe network, by eliminating the need for any active control. The simulation of the robot traversing in the pipe network in different orientations and in pipe bends without slip shows the proposed design's effectiveness.


Gradient estimates for a weighted parabolic equation under geometric flow. Let (M n ,g,e phi dv) be a weighted Riemannian manifold evolving by geometric flow frac partial g partial t 2h(t), , , , frac partial phi partial t Delta phi . In this paper, we obtain a series of space time gradient estimates for positive solutions of a parabolic partial equation ( Delta phi partial t )u(x,t) q(x,t)u a 1 (x,t) p(x,t)A(u(x,t))), , , , ,(x,t) in M times 0,T on a weighted Riemannian manifold under geometric flow. By integrating the gradient estimates, we find the corresponding Harnack inequalities.


From Fragmentation to Liberation. In this paper, I argue that "Internet fragmentation" as a phenomenon is only meaningful in the context of the US's hegemonic control over the Internet. I propose a broader and, I argue, more richly predictive frame Internet conflict. I show how this frame provides fresh analytical purchase to some of the questions I list above, using it to contextualize several apparently distinct phenomena. I conclude by arguing that only one question gives this analytical frame, or any other, a higher purpose what particular interventions to Internet governance can produce meaningfully liberatory outcomes? Any descriptive framework is only useful insofar as it can be mobilized to answer this normative question.


Heading Estimation Using Ultra Wideband Received Signal Strength and Gaussian Processes. It is essential that a robot has the ability to determine its position and orientation to execute tasks autonomously. Heading estimation is especially challenging in indoor environments where magnetic distortions make magnetometer based heading estimation difficult. Ultra wideband (UWB) transceivers are common in indoor localization problems. This letter experimentally demonstrates how to use UWB range and received signal strength (RSS) measurements to estimate robot heading. The RSS of a UWB antenna varies with its orientation. As such, a Gaussian process (GP) is used to learn a data driven relationship from UWB range and RSS inputs to orientation outputs. Combined with a gyroscope in an invariant extended Kalman filter, this realizes a heading estimation method that uses only UWB and gyroscope measurements.


A Self Distillation Embedded Supervised Affinity Attention Model for Few Shot Segmentation. Few shot semantic segmentation is a challenging task of predicting object categories in pixel wise with only few annotated samples. However, existing approaches still face two main challenges. First, huge feature distinction between support and query images causes knowledge transferring barrier, which harms the segmentation performance. Second, few support samples cause unrepresentative of support features, hardly to guide high quality query segmentation. To deal with the above two issues, we propose self distillation embedded supervised affinity attention model (SD AANet) to improve the performance of few shot segmentation task. Specifically, the self distillation guided prototype module (SDPM) extracts intrinsic prototype by self distillation between support and query to capture representative features. The supervised affinity attention module (SAAM) adopts support ground truth to guide the production of high quality query attention map, which can learn affinity information to focus on whole area of query target. Extensive experiments prove that our SD AANet significantly improves the performance comparing with existing methods. Comprehensive ablation experiments and visualization studies also show the significant effect of SDPM and SAAM for few shot segmentation task. On benchmark datasets, PASCAL 5i and COCO 20i, our proposed SD AANet both achieve state of the art results. Our code is available on https github.com cv516Buaa SD AANet.


Discovering and Exploiting Sparse Rewards in a Learned Behavior Space. Learning optimal policies in sparse rewards settings is difficult as the learning agent has little to no feedback on the quality of its actions. In these situations, a good strategy is to focus on exploration, hopefully leading to the discovery of a reward signal to improve on. A learning algorithm capable of dealing with this kind of settings has to be able to (1) explore possible agent behaviors and (2) exploit any possible discovered reward. Efficient exploration algorithms have been proposed that require to define a behavior space, that associates to an agent its resulting behavior in a space that is known to be worth exploring. The need to define this space is a limitation of these algorithms. In this work, we introduce STAX, an algorithm designed to learn a behavior space on the fly and to explore it while efficiently optimizing any reward discovered. It does so by separating the exploration and learning of the behavior space from the exploitation of the reward through an alternating two steps process. In the first step, STAX builds a repertoire of diverse policies while learning a low dimensional representation of the high dimensional observations generated during the policies evaluation. In the exploitation step, emitters are used to optimize the performance of the discovered rewarding solutions. Experiments conducted on three different sparse reward environments show that STAX performs comparably to existing baselines while requiring much less prior information about the task as it autonomously builds the behavior space.


Time dependent equations on networks. We study well posedness of time dependent Hamilton Jacobi equations on a network, coupled with a continuous initial datum and a flux limiter. We show existence and uniqueness of solutions as well as stability properties. The novelty of our approach is that comparison results are proved linking the equation to a suitable semidiscrete problem, bypassing doubling variable method. Further, we do not need special test functions, and perform tests relative to the equations on different arcs separately.


Impact of major hurricanes on electric energy production. After major hurricanes, electric production is significantly reduced owing to not only electric infrastructure destruction, but also the economic crisis associated with damage to private and public activities. The full restoration of the electric infrastructure is not always simultaneously performed with the full restoration of electric production. Here, we describe the electric production curves for the islands of Saint Martin, Saint Barthelemy, and Puerto Rico in the Caribbean, where two major hurricanes occurred in 2017. After the major hurricanes, the electric energy production was characterised by a slow recovery followed by a stable phase during several months, corresponding to approximately 75 of the initial electric production. A resilience time of several months (1 month t s 5 months) is necessary to attain the new electric energy production equilibrium E is , which is lower than the initial electric energy production E i . The reduction in electric energy consumption per capita is of 20 25 . In Saint Martin, during the post hurricane stable phase, the electric production was only approximately 60 of the initial electric energy production instead of 75 . The reduction of 15 percent in the electric production of Saint Martin after Hurricane Irma could be attributed to the migration of approximately 8 000 inhabitants (approximately 23 ) outside the island. This approach makes it possible to anticipate the production of electricity during several months after a major hurricane in the Caribbean islands.


Higher Order Information Identifies Tie Strength. A key question in the analysis of sociological processes on networks is to identify pairs of individuals who have strong or weak social ties. Existing approaches mathematically model the social network as a graph, and tie strength is often inferred by examining the number of shared neighbors between individuals, or equivalently, the number of triangles in the graph which contain a specific pair of individuals. However, this approach misses out on critical information because it does not distinguish the case where interactions occur among groups involving more than two individuals. In this work, we measure tie strength by explicitly accounting for these higher order interactions in the network, through the use of a new measure called Edge PageRank. We show how Edge PageRank can be interpreted as the steady state outcome of a dynamic, message passing social process that characterizes the strength of weak ties by appropriately discounting the effect of higher order interactions involving three individuals. Empirically, we find that Edge PageRank outperforms standard measures in identifying tie strength in several large scale social networks. These results provide a new perspective on tie strength and demonstrate the importance of incorporating higher order interactions in social network analysis.


CRD CGAN Category Consistent and Relativistic Constraints for Diverse Text to Image Generation. Generating photo realistic images from a text description is a challenging problem in computer vision. Previous works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks (GANs). In this paper, we focus on the category consistent and relativistic diverse constraints to optimize the diversity of synthetic images. Based on those constraints, a category consistent and relativistic diverse conditional GAN (CRD CGAN) is proposed to synthesize K photo realistic images simultaneously. We use the attention loss and diversity loss to improve the sensitivity of the GAN to word attention and noises. Then, we employ the relativistic conditional loss to estimate the probability of relatively real or fake for synthetic images, which can improve the performance of basic conditional loss. Finally, we introduce a category consistent loss to alleviate the over category issues between K synthetic images. We evaluate our approach using the Birds 200 2011, Oxford 102 flower and MSCOCO 2014 datasets, and the extensive experiments demonstrate superiority of the proposed method in comparison with state of the art methods in terms of photorealistic and diversity of the generated synthetic images.


Are Training Resources Insufficient? Predict First Then Explain!. Natural language free text explanation generation is an efficient approach to train explainable language processing models for commonsense knowledge requiring tasks. The most predominant form of these models is the explain then predict (EtP) structure, which first generates explanations and uses them for making decisions. The performance of EtP models is highly dependent on that of the explainer by the nature of their structure. Therefore, large sized explanation data are required to train a good explainer model. However, annotating explanations is expensive. Also, recent works reveal that free text explanations might not convey sufficient information for decision making. These facts cast doubts on the effectiveness of EtP models. In this paper, we argue that the predict then explain (PtE) architecture is a more efficient approach in terms of the modelling perspective. Our main contribution is twofold. First, we show that the PtE structure is the most data efficient approach when explanation data are lacking. Second, we reveal that the PtE structure is always more training efficient than the EtP structure. We also provide experimental results that confirm the theoretical advantages.


Hardware Acceleration of HPC Computational Flow Dynamics using HBM enabled FPGAs. Scientific computing is at the core of many High Performance Computing applications, including computational flow dynamics. Because of the uttermost importance to simulate increasingly larger computational models, hardware acceleration is receiving increased attention due to its potential to maximize the performance of scientific computing. A Field Programmable Gate Array is a reconfigurable hardware accelerator that is fully customizable in terms of computational resources and memory storage requirements of an application during its lifetime. Therefore, it is an ideal candidate to accelerate scientific computing applications because of the possibility to fully customize the memory hierarchy important in irregular applications such as iterative linear solvers found in scientific libraries. In this paper, we study the potential of using FPGA in HPC because of the rapid advances in reconfigurable hardware, such as the increase in on chip memory size, increasing number of logic cells, and the integration of High Bandwidth Memories on board. To perform this study, we first propose a novel ILU0 preconditioner tightly integrated with a BiCGStab solver kernel designed using a mixture of High Level Synthesis and Register Transfer Level hand coded design. Second, we integrate the developed preconditioned iterative solver in Flow from the Open Porous Media (OPM) project, a state of the art open source reservoir simulator. Finally, we perform a thorough evaluation of the FPGA solver kernel in both standalone mode and integrated into the reservoir simulator that includes all the on chip URAM and BRAM, on board High Bandwidth Memory, and off chip CPU memory data transfers required in a complex simulator software such as OPM's Flow. We evaluate the performance on the Norne field, a real world case reservoir model using a grid with more than 10 5 cells and using 3 unknowns per cell.


Weight preserving bijections between integer partitions and a class of alternating sign trapezoids. We construct weight preserving bijections between column strict shifted plane partitions with one row and alternating sign trapezoids with exactly one column in the left half that sums to 1 . Amongst other things, they relate the number of 1 s in the alternating sign trapezoids to certain elements in the column strict shifted plane partitions that generalise the notion of special parts in descending plane partitions. The advantage of these bijections is that they include configurations with 1 s, which is a feature that many of the bijections in the realm of alternating sign arrays lack.


Data Flow Dissemination in a Network. We consider the following network model motivated, in particular, by blockchains and peer to peer live streaming. Data packet flows originate at the network nodes and need to be disseminated to all other nodes. Packets are relayed through the network via links of limited capacity. A packet leaves the network when it is disseminated to all nodes. The network is stable when it is positive recurrent and when it is, the age of the oldest packet, referred to as Age of Information (AoI) is stochastically bounded. Under the Random Useful (RU) discipline a node u communicates on link (u,v) a randomly chosen available packet not present at v . RU discipline is known to have the maximum stability region for a single flow we show that this extends to arbitrary number of flows. Our main results concern the Oldest Useful (OU) discipline, under which a node u communicates on link (u,v) the oldest available packet not present at v . OU discipline is a natural candidate for reducing the AoI. We show that, surprisingly, OU emph does not provide the maximum stability region. As the main result of this paper, we prove that OU emph does have the maximum stability region in the important special case of a complete graph network with equal capacities on all links and equal flow rates originating in all nodes. Simulation results show that, in the latter special case, OU out performs RU in terms of AoI.


Weaker forms of unconditionality of bases in greedy approximation. In this paper we study a new class of bases, weaker than quasi greedy bases, which retain their unconditionality properties and can provide the same optimality for the thresholding greedy algorithm. We measure how far these bases are from being unconditional and use this concept to give a new characterization of nearly unconditional bases.


Scaffold Induced Molecular Graph (SIMG) Effective Graph Sampling Methods for High Throughput Computational Drug Discovery. Scaffold based drug discovery (SBDD) is a technique for drug discovery which pins chemical scaffolds as the framework of design. Scaffolds, or molecular frameworks, organize the design of compounds into local neighborhoods. We formalize scaffold based drug discovery into a network design. Utilizing docking data from SARS CoV 2 virtual screening studies and JAK2 kinase assay data, we showcase how a scaffold based conception of chemical space is intuitive for design. Lastly, we highlight the utility of scaffold based networks for chemical space as a potential solution to the intractable enumeration problem of chemical space by working inductively on local neighborhoods.


The Lawson Hanson Algorithm with Deviation Maximization Finite Convergence and Sparse Recovery. In this work we apply the "deviation maximization", a new column selection strategy, to the Lawson Hanson algorithm for the solution of NonNegative Least Squares (NNLS), devising a new algorithm we call Lawson Hanson with Deviation Maximization (LHDM). This algorithm allows to exploit BLAS 3 operations, leading to higher performances. We show the finite convergence of this algorithm and explore the sparse recovery ability of LHDM. The results are presented with an extensive campaign of experiments, where we compare its performance against several ell 1 minimization solvers. An implementation of the proposed algorithm is available on a public repository.


Semi Supervised Domain Generalization in Real World New Benchmark and Strong Baseline. Conventional domain generalization aims to learn domain invariant representation from multiple domains, which requires accurate annotations. In realistic application scenarios, however, it is too cumbersome or even infeasible to collect and annotate the large mass of data. Yet, web data provides a free lunch to access a huge amount of unlabeled data with rich style information that can be harnessed to augment domain generalization ability. In this paper, we introduce a novel task, termed as semi supervised domain generalization, to study how to interact the labeled and unlabeled domains, and establish two benchmarks including a web crawled dataset, which poses a novel yet realistic challenge to push the limits of existing technologies. To tackle this task, a straightforward solution is to propagate the class information from the labeled to the unlabeled domains via pseudo labeling in conjunction with domain confusion training. Considering narrowing domain gap can improve the quality of pseudo labels and further advance domain invariant feature learning for generalization, we propose a cycle learning framework to encourage the positive feedback between label propagation and domain generalization, in favor of an evolving intermediate domain bridging the labeled and unlabeled domains in a curriculum learning manner. Experiments are conducted to validate the effectiveness of our framework. It is worth highlighting that web crawled data benefits domain generalization as demonstrated in our results. Our code will be available later.


Control Analysis of Packet Transmission Algorithms Study on Fairness and Stability. This document is a study of fairness, feedback and stability notions of different packet transmission algorithms. We start the discussion with defining two scalable control algorithms namely primal and dual algorithm. We discuss the dual algorithm model and then understand the fair dual algorithm. Further, we discuss different notions of fairness under fair dual algorithm those correspond to TCP and RCP congestion control protocols. Feedback parameters are analyzed in each of these fairness algorithms and thus their stability is studied.


The Definitions of Interpretability and Learning of Interpretable Models. As machine learning algorithms getting adopted in an ever increasing number of applications, interpretation has emerged as a crucial desideratum. In this paper, we propose a mathematical definition for the human interpretable model. In particular, we define interpretability between two information process systems. If a prediction model is interpretable by a human recognition system based on the above interpretability definition, the prediction model is defined as a completely human interpretable model. We further design a practical framework to train a completely human interpretable model by user interactions. Experiments on image datasets show the advantages of our proposed model in two aspects 1) The completely human interpretable model can provide an entire decision making process that is human understandable 2) The completely human interpretable model is more robust against adversarial attacks.


Engineering an Efficient Boolean Functional Synthesis Engine. Given a Boolean specification between a set of inputs and outputs, the problem of Boolean functional synthesis is to synthesise each output as a function of inputs such that the specification is met. Although the past few years have witnessed intense algorithmic development, accomplishing scalability remains the holy grail. The state of the art approach combines machine learning and automated reasoning to efficiently synthesise Boolean functions. In this paper, we propose four algorithmic improvements for a data driven framework for functional synthesis using a dependency driven multi classifier to learn candidate function, extracting uniquely defined functions by interpolation, variables retention, and using lexicographic MaxSAT to repair candidates. We implement these improvements in the state of the art framework, called Manthan. The proposed framework is called Manthan2. Manthan2 shows significantly improved runtime performance compared to Manthan. In an extensive experimental evaluation on 609 benchmarks, Manthan2 is able to synthesise a Boolean function vector for 509 instances compared to 356 instances solved by Manthan an increment of 153 instances over the state of the art. To put this into perspective, Manthan improved on the prior state of the art by only 76 instances.


Regularization with Multilevel Non stationary Tight Framelets for Image Restoration. Variational regularization models are one of the popular and efficient approaches for image restoration. The regularization functional in the model carries prior knowledge about the image to be restored. The prior knowledge, in particular for natural images, are the first order (i.e. variance in luminance) and second order (i.e. contrast and texture) information. In this paper, we propose a model for image restoration, using a multilevel non stationary tight framelet system that can capture the image's first order and second order information. We develop an algorithm to solve the proposed model and the numerical experiments show that the model is effective and efficient as compared to other higher order models.


Asymptotic Preserving Neural Networks for Multiscale Time Dependent Linear Transport Equations. In this paper we develop a neural network for the numerical simulation of time dependent linear transport equations with diffusive scaling and uncertainties. The goal of the network is to resolve the computational challenges of curse of dimensionality and multiple scales of the problem. We first show that a standard Physics Informed Neural Network (PINNs) fails to capture the multiscale nature of the problem, hence justifies the need to use Asymptotic Preserving Neural Networks (APNNs). We show that not all classical AP formulations are fit for the neural network approach. We construct a micro macro decomposition based neutral network, and also build in a mass conservation mechanism into the loss function, in order to capture the dynamic and multiscale nature of the solutions. Numerical examples are used to demonstrate the effectiveness of this APNNs.


Continuous Weight Balancing. We propose a simple method by which to choose sample weights for problems with highly imbalanced or skewed traits. Rather than naively discretizing regression labels to find binned weights, we take a more principled approach we derive sample weights from the transfer function between an estimated source and specified target distributions. Our method outperforms both unweighted and discretely weighted models on both regression and classification tasks. We also open source our implementation of this method (https github.com Daniel Wu Continuous Weight Balancing) to the scientific community.