All Optical Synthesis of an Arbitrary Linear Transformation Using Diffractive Surfaces. We report the design of diffractive surfaces to all optically perform arbitrary complex valued linear transformations between an input (N i) and output (N o), where N i and N o represent the number of pixels at the input and output fields of view (FOVs), respectively. First, we consider a single diffractive surface and use a matrix pseudoinverse based method to determine the complex valued transmission coefficients of the diffractive features neurons to all optically perform a desired target linear transformation. In addition to this data free design approach, we also consider a deep learning based design method to optimize the transmission coefficients of diffractive surfaces by using examples of input output fields corresponding to the target transformation. We compared the all optical transformation errors and diffraction efficiencies achieved using data free designs as well as data driven (deep learning based) diffractive designs to all optically perform (i) arbitrarily chosen complex valued transformations including unitary, nonunitary and noninvertible transforms, (ii) 2D discrete Fourier transformation, (iii) arbitrary 2D permutation operations, and (iv) high pass filtered coherent imaging. Our analyses reveal that if the total number (N) of spatially engineered diffractive features neurons is N i x N o or larger, both design methods succeed in all optical implementation of the target transformation, achieving negligible error. However, compared to data free designs, deep learning based diffractive designs are found to achieve significantly larger diffraction efficiencies for a given N and their all optical transformations are more accurate for N N i x N o. These conclusions are generally applicable to various optical processors that employ spatially engineered diffractive surfaces.


A monotone scheme for nonlinear partial integro differential equations with the convergence rate of alpha stable limit theorem under sublinear expectation. In this paper, we propose a monotone approximation scheme for a class of fully nonlinear partial integro differential equations (PIDEs) which characterize the nonlinear alpha stable L ' e vy processes under sublinear expectation space with alpha in(1,2) . Two main results are obtained (i) the error bounds for the monotone approximation scheme of nonlinear PIDEs, and (ii) the convergence rates of a generalized central limit theorem of Bayraktar Munk for alpha stable random variables under sublinear expectation. Our proofs use and extend techniques introduced by Krylov and Barles Jakobsen.


English to Chinese Transliteration with Phonetic Back transliteration. Transliteration is a task of translating named entities from a language to another, based on phonetic similarity. The task has embraced deep learning approaches in recent years, yet, most ignore the phonetic features of the involved languages. In this work, we incorporate phonetic information into neural networks in two ways we synthesize extra data using forward and back translation but in a phonetic manner and we pre train models on a phonetic task before learning transliteration. Our experiments include three language pairs and six directions, namely English to and from Chinese, Hebrew and Thai. Results indicate that our proposed approach brings benefits to the model and achieves better or similar performance when compared to state of the art.


Paradigms of Computational Agency. Agent based models have emerged as a promising paradigm for addressing ever increasing complexity of information systems. In its initial days in the 1990s when object oriented modeling was at its peak, an agent was treated as a special kind of "object" that had a persistent state and its own independent thread of execution. Since then, agent based models have diversified enormously to even open new conceptual insights about the nature of systems in general. This paper presents a perspective on the disparate ways in which our understanding of agency, as well as computational models of agency have evolved. Advances in hardware like GPUs, that brought neural networks back to life, may also similarly infuse new life into agent based models, as well as pave the way for advancements in research on Artificial General Intelligence (AGI).


Online Knowledge Distillation for Efficient Pose Estimation. Existing state of the art human pose estimation methods require heavy computational resources for accurate predictions. One promising technique to obtain an accurate yet lightweight pose estimator is knowledge distillation, which distills the pose knowledge from a powerful teacher model to a less parameterized student model. However, existing pose distillation works rely on a heavy pre trained estimator to perform knowledge transfer and require a complex two stage learning procedure. In this work, we investigate a novel Online Knowledge Distillation framework by distilling Human Pose structure knowledge in a one stage manner to guarantee the distillation efficiency, termed OKDHP. Specifically, OKDHP trains a single multi branch network and acquires the predicted heatmaps from each, which are then assembled by a Feature Aggregation Unit (FAU) as the target heatmaps to teach each branch in reverse. Instead of simply averaging the heatmaps, FAU which consists of multiple parallel transformations with different receptive fields, leverages the multi scale information, thus obtains target heatmaps with higher quality. Specifically, the pixel wise Kullback Leibler (KL) divergence is utilized to minimize the discrepancy between the target heatmaps and the predicted ones, which enables the student network to learn the implicit keypoint relationship. Besides, an unbalanced OKDHP scheme is introduced to customize the student networks with different compression rates. The effectiveness of our approach is demonstrated by extensive experiments on two common benchmark datasets, MPII and COCO.


Global analytic hypoellipticity and solvability of certain operators subject to group actions. On T times G , where T is a compact real analytic manifold and G is a compact Lie group, we consider differential operators P which are invariant by left translations on G and are elliptic in T . Under a mild technical condition, we prove that global hypoellipticity of P implies its global analytic hypoellipticity (actually Gevrey of any order s geq 1 ). We also study the connection between the latter property and the notion of global analytic (resp. Gevrey) solvability, but in a much more general setup.


Inexact Loops in Robotics Problems. Loops are pervasive in robotics problems, appearing in mapping and localization, where one is interested in finding loop closure constraints to better approximate robot poses or other estimated quantities, as well as planning and prediction, where one is interested in the homotopy classes of the space through which a robot is moving. We generalize the standard topological definition of a loop to cases where a trajectory passes close to itself, but doesn't necessarily touch, giving a definition that is more practical for real robotics problems. This relaxation leads to new and useful properties of inexact loops, such as their ability to be partitioned into topologically connected sets closely matching the concept of a "loop closure", and the existence of simple and nonsimple loops. Building from these ideas, we introduce several ways to measure properties and quantities of inexact loops on a trajectory, such as the trajectory's "loop area" and "loop density", and use them to compare strategies for sampling representative inexact loops to build constraints in mapping and localization problems.


Full satisfaction classes, definability, and automorphisms. We show that for every countable recursively saturated model M of Peano Arithmetic and every subset A subseteq M , there exists a full satisfaction class S A subset M 2 such that A is definable in (M,S A) without parametres. It follows that in every such model, there exists a full satisfaction class which makes every element definable and thus the expanded model is minimal and rigid. On the other hand, we show that for every full satisfaction class S there are two elements which have the same arithmetical type, but exactly one of them is in S . In particular, the automorphism group of a model expanded with a satisfaction class is never equal to the automorphism group of the original model. The analogue of many of the results proved here for full satisfaction classes were obtained by Roman Kossak for partial inductive satisfaction classes. However, most of the proofs relied heavily on the induction scheme in a crucial way, so recapturing the results in the setting of full satisfaction classes requires quite different arguments.


Fully Nonlinear Singularly perturbed models with non homogeneous degeneracy. In our work we study non variational, nonlinear singularly perturbed elliptic models enjoying a double degeneracy character with prescribed boundary value in a domain. In such a scenario, we establish the existence of solutions. We also prove that solutions are locally (uniformly) Lipschitz continuous, and they grow in a linear fashion. Moreover, solutions and their free boundaries possess a sort of measure theoretic and weak geometric properties. Moreover, for a restricted class of non linearities, we prove the finiteness of the (N 1) dimensional Hausdorff measure of level sets. We also address a complete analysis concerning the asymptotic limit as the singular parameter, which is related to one phase solutions of inhomogeneous nonlinear free boundary problems in flame propagation and combustion theory.


Virtual Barriers in Augmented Reality for Safe and Effective Human Robot Cooperation in Manufacturing. Safety is a fundamental requirement in any human robot collaboration scenario. To ensure the safety of users for such scenarios, we propose a novel Virtual Barrier system facilitated by an augmented reality interface. Our system provides two kinds of Virtual Barriers to ensure safety 1) a Virtual Person Barrier which encapsulates and follows the user to protect them from colliding with the robot, and 2) Virtual Obstacle Barriers which users can spawn to protect objects or regions that the robot should not enter. To enable effective human robot collaboration, our system includes an intuitive robot programming interface utilizing speech commands and hand gestures, and features the capability of automatic path re planning when potential collisions are detected as a result of a barrier intersecting the robot's planned path. We compared our novel system with a standard 2D display interface through a user study, where participants performed a task mimicking an industrial manufacturing procedure. Results show that our system increases the user's sense of safety and task efficiency, and makes the interaction more intuitive.


Target dependent UNITER A Transformer Based Multimodal Language Comprehension Model for Domestic Service Robots. Currently, domestic service robots have an insufficient ability to interact naturally through language. This is because understanding human instructions is complicated by various ambiguities and missing information. In existing methods, the referring expressions that specify the relationships between objects are insufficiently modeled. In this paper, we propose Target dependent UNITER, which learns the relationship between the target object and other objects directly by focusing on the relevant regions within an image, rather than the whole image. Our method is an extension of the UNITER based Transformer that can be pretrained on general purpose datasets. We extend the UNITER approach by introducing a new architecture for handling the target candidates. Our model is validated on two standard datasets, and the results show that Target dependent UNITER outperforms the baseline method in terms of classification accuracy.


Dynamic Coded Caching in Wireless Networks Using Multi Agent Reinforcement Learning. We consider distributed caching of content across several small base stations (SBSs) in a wireless network, where the content is encoded using a maximum distance separable code. Specifically, we apply soft time to live (STTL) cache management policies, where coded packets may be evicted from the caches at periodic times. We propose a reinforcement learning (RL) approach to find coded STTL policies minimizing the overall network load. We demonstrate that such caching policies achieve almost the same network load as policies obtained through optimization, where the latter assumes perfect knowledge of the distribution of times between file requests as well the distribution of the number of SBSs within communication range of a user placing a request. We also suggest a multi agent RL (MARL) framework for the scenario of non uniformly distributed requests in space. For such a scenario, we show that MARL caching policies achieve lower network load as compared to optimized caching policies assuming a uniform request placement. We also provide convincing evidence that synchronous updates offer a lower network load than asynchronous updates for spatially homogeneous renewal request processes due to the memory of the renewal processes.


Standard monomials and invariant theory for arc spaces I general linear group. This is the first in a series of papers on standard monomial theory and invariant theory of arc spaces. For any algebraically closed field K , we construct a standard monomial basis for the arc space of the determinantal variety over K . As an application, we prove the arc space analogue of the first and second fundamental theorems of invariant theory for the general linear group.


Recommending best course of treatment based on similarities of prognostic markers. With the advancement in the technology sector spanning over every field, a huge influx of information is inevitable. Among all the opportunities that the advancements in the technology have brought, one of them is to propose efficient solutions for data retrieval. This means that from an enormous pile of data, the retrieval methods should allow the users to fetch the relevant and recent data over time. In the field of entertainment and e commerce, recommender systems have been functioning to provide the aforementioned. Employing the same systems in the medical domain could definitely prove to be useful in variety of ways. Following this context, the goal of this paper is to propose collaborative filtering based recommender system in the healthcare sector to recommend remedies based on the symptoms experienced by the patients. Furthermore, a new dataset is developed consisting of remedies concerning various diseases to address the limited availability of the data. The proposed recommender system accepts the prognostic markers of a patient as the input and generates the best remedy course. With several experimental trials, the proposed model achieved promising results in recommending the possible remedy for given prognostic markers.


A Taxonomy of Explainable Bayesian Networks. Artificial Intelligence (AI), and in particular, the explainability thereof, has gained phenomenal attention over the last few years. Whilst we usually do not question the decision making process of these systems in situations where only the outcome is of interest, we do however pay close attention when these systems are applied in areas where the decisions directly influence the lives of humans. It is especially noisy and uncertain observations close to the decision boundary which results in predictions which cannot necessarily be explained that may foster mistrust among end users. This drew attention to AI methods for which the outcomes can be explained. Bayesian networks are probabilistic graphical models that can be used as a tool to manage uncertainty. The probabilistic framework of a Bayesian network allows for explainability in the model, reasoning and evidence. The use of these methods is mostly ad hoc and not as well organised as explainability methods in the wider AI research field. As such, we introduce a taxonomy of explainability in Bayesian networks. We extend the existing categorisation of explainability in the model, reasoning or evidence to include explanation of decisions. The explanations obtained from the explainability methods are illustrated by means of a simple medical diagnostic scenario. The taxonomy introduced in this paper has the potential not only to encourage end users to efficiently communicate outcomes obtained, but also support their understanding of how and, more importantly, why certain predictions were made.


Optimal Trajectories of a UAV Base Station Using Hamilton Jacobi Equations. We consider the problem of optimizing the trajectory of an Unmanned Aerial Vehicle (UAV). Assuming a traffic intensity map of users to be served, the UAV must travel from a given initial location to a final position within a given duration and serves the traffic on its way. The problem consists in finding the optimal trajectory that minimizes a certain cost depending on the velocity and on the amount of served traffic. We formulate the problem using the framework of Lagrangian mechanics. We derive closed form formulas for the optimal trajectory when the traffic intensity is quadratic (single phase) using Hamilton Jacobi equations. When the traffic intensity is bi phase, i.e. made of two quadratics, we provide necessary conditions of optimality that allow us to propose a gradient based algorithm and a new algorithm based on the linear control properties of the quadratic model. These two solutions are of very low complexity because they rely on fast convergence numerical schemes and closed form formulas. These two approaches return a trajectory satisfying the necessary conditions of optimality. At last, we propose a data processing procedure based on a modified K means algorithm to derive a bi phase model and an optimal trajectory simulation from real traffic data.


Multi sequence Spreading Random Access (MSRA) for Compressive Sensing based Grant free Communication. The performance of grant free random access (GF RA) is limited by the number of accessible random access resources (RRs) due to the absence of collision resolution. Compressive sensing (CS) based RA schemes scale up the RRs at the expense of increased non orthogonality among transmitted signals. This paper presents the design of multi sequence spreading random access (MSRA) which employs multiple spreading sequences to spread the different symbols of a user as opposed to the conventional schemes in which a user employs the same spreading sequence for each symbol. We show that MSRA provides code diversity, enabling the multi user detection (MUD) to be modeled into a well conditioned multiple measurement vector (MMV) CS problem. The code diversity is quantified by the decrease in the average Babel mutual coherence among the spreading sequences. Moreover, we present a two stage active user detection (AUD) scheme for both wideband and narrowband implementation. Our theoretical analysis shows that with MSRA activity misdetection falls exponentially while the size of GF RA frame is increased. Finally, the simulation results show that about 82 increase in utilization of RRs, i.e., more active users, is supported by MSRA than the conventional schemes while achieving the RA failure rate lower bound set by random access collision.


Towards an Automatic Proof of Lamport's Paxos. Lamport's celebrated Paxos consensus protocol is generally viewed as a complex hard to understand algorithm. Notwithstanding its complexity, in this paper, we take a step towards automatically proving the safety of Paxos by taking advantage of three structural features in its specification spatial regularity in its unordered domains, temporal regularity in its totally ordered domain, and its hierarchical composition. By carefully integrating these structural features in IC3PO, a novel model checking algorithm, we were able to infer an inductive invariant that identically matches the human written one previously derived with significant manual effort using interactive theorem proving. While various attempts have been made to verify different versions of Paxos, to the best of our knowledge, this is the first demonstration of an automatically inferred inductive invariant for Lamport's original Paxos specification. We note that these structural features are not specific to Paxos and that IC3PO can serve as an automatic general purpose protocol verification tool.


Treatise on Hearing The Temporal Auditory Imaging Theory Inspired by Optics and Communication. A new theory of mammalian hearing is presented, which accounts for the auditory image in the midbrain (inferior colliculus) of objects in the acoustical environment of the listener. It is shown that the ear is a temporal imaging system that comprises three transformations of the envelope functions cochlear group delay dispersion, cochlear time lensing, and neural group delay dispersion. These elements are analogous to the optical transformations in vision of diffraction between the object and the eye, spatial lensing by the lens, and second diffraction between the lens and the retina. Unlike the eye, it is established that the human auditory system is naturally defocused, so that coherent stimuli do not react to the defocus, whereas completely incoherent stimuli are impacted by it and may be blurred by design. It is argued that the auditory system can use this differential focusing to enhance or degrade the images of real world acoustical objects that are partially coherent. The theory is founded on coherence and temporal imaging theories that were adopted from optics. In addition to the imaging transformations, the corresponding inverse domain modulation transfer functions are derived and interpreted with consideration to the nonuniform neural sampling operation of the auditory nerve. These ideas are used to rigorously initiate the concepts of sharpness and blur in auditory imaging, auditory aberrations, and auditory depth of field. In parallel, ideas from communication theory are used to show that the organ of Corti functions as a multichannel phase locked loop (PLL) that constitutes the point of entry for auditory phase locking and hence conserves the signal coherence. It provides an anchor for a dual coherent and noncoherent auditory detection in the auditory brain that culminates in auditory accommodation. Implications on hearing impairments are discussed as well.


Modeling liquid water by climbing up Jacob's ladder in density functional theory facilitated by using deep neural network potentials. Within the framework of Kohn Sham density functional theory (DFT), the ability to provide good predictions of water properties by employing a strongly constrained and appropriately normed (SCAN) functional has been extensively demonstrated in recent years. Here, we further advance the modeling of water by building a more accurate model on the fourth rung of Jacob's ladder with the hybrid functional, SCAN0. In particular, we carry out both classical and Feynman path integral molecular dynamics calculations of water with the SCAN0 functional and the isobaric isothermal ensemble. In order to generate the equilibrated structure of water, a deep neural network potential is trained from the atomic potential energy surface based on ab initio data obtained from SCAN0 DFT calculations. For the electronic properties of water, a separate deep neural network potential is trained using the Deep Wannier method based on the maximally localized Wannier functions of the equilibrated trajectory at the SCAN0 level. The structural, dynamic, and electric properties of water were analyzed. The hydrogen bond structures, density, infrared spectra, diffusion coefficients, and dielectric constants of water, in the electronic ground state, are computed using a large simulation box and long simulation time. For the properties involving electronic excitations, we apply the GW approximation within many body perturbation theory to calculate the quasiparticle density of states and bandgap of water. Compared to the SCAN functional, mixing exact exchange mitigates the self interaction error in the meta generalized gradient approximation and further softens liquid water towards the experimental direction. For most of the water properties, the SCAN0 functional shows a systematic improvement over the SCAN functional.


Secure Process Algebra. Based on our previous work on truly concurrent process algebras APTC, we use it to verify the security protocols. This work (called Secure APTC, abbreviated SAPTC) have the following advantages in verifying security protocols (1) It has a firmly theoretic foundations, including equational logics, structured operational semantics, and axiomatizations between them (2) It has rich expressive powers to describe security protocols. Cryptographic operations are modeled as atomic actions and can be extended, explicit parallelism and communication mechanism to modeling communication operations and principals, rich computational properties to describing computational logics in the security protocols, including conditional guards, alternative composition, sequential composition, parallelism and communication, encapsulation and deadlock, recursion, abstraction. (3) Especially by abstraction, it is convenient and obvious to observe the relations between the inputs and outputs of a security protocols, including the relations without any attack, the relations under each known attack, and the relations under unknown attacks if the unknown attacks can be described.


One Semantic Parser to Parse Them All Sequence to Sequence Multi Task Learning on Semantic Parsing Datasets. Semantic parsers map natural language utterances to meaning representations. The lack of a single standard for meaning representations led to the creation of a plethora of semantic parsing datasets. To unify different datasets and train a single model for them, we investigate the use of Multi Task Learning (MTL) architectures. We experiment with five datasets (Geoquery, NLMaps, TOP, Overnight, AMR). We find that an MTL architecture that shares the entire network across datasets yields competitive or better parsing accuracies than the single task baselines, while reducing the total number of parameters by 68 . We further provide evidence that MTL has also better compositional generalization than single task models. We also present a comparison of task sampling methods and propose a competitive alternative to widespread proportional sampling strategies.


On a class of critical double phase problems. In this paper we study a class of double phase problems involving critical growth, namely text div big( nabla u p 2 nabla u mu(x) nabla u q 2 nabla u big) lambda u vartheta 2 u u p 2 u in Omega and u 0 on partial Omega , where Omega subset mathbb R N is a bounded Lipschitz domain, 1 vartheta p q N , frac q p 1 frac 1 N and mu( cdot) is a nonnegative Lipschitz continuous weight function. The operator involved is the so called double phase operator, which reduces to the p Laplacian or the (p,q) Laplacian when mu equiv 0 or inf mu 0 , respectively. Based on variational and topological tools such as truncation arguments and genus theory, we show the existence of lambda 0 such that the problem above has infinitely many weak solutions with negative energy values for any lambda in (0, lambda ) .


Marked nodal curves with vector fields. We study bubbling up' on nodal curves in the style of Knudsen's proof that overline mathcal M g,n 1 is the universal curve over overline mathcal M g,n , in the presence of a (logarithmic) vector field on the nodal curve. We propose a two step bubbling up procedure. The first step is simply Knudsen stabilization with the additional data to keep track of. The second step ensures that the vector field doesn't vanish at the inserted point. These operations work in families. As an application, we prove that the Losev Manin compactification of the space of configurations of n points on mathbb P 1 backslash 0, infty modulo scaling degenerates isotrivially to a compactification of the space of configurations of n points on mathbb A 1 modulo translation. The latter is related to the compactification constructed by Ziltener and Mau Woodward, but allows the marked points to coincide, making it a mathbb G a n 1 variety, which mirrors the fact that the Losev Manin space is toric. Its combinatorics is dual to that of the space of phylogenetic trees of Billera Holmes Vogtmann. The degeneration is compatible with the actions of mathbb G m n 1 and mathbb G a n 1 in the sense that these actions fit together globally.


OPANAS One Shot Path Aggregation Network Architecture Search for Object Detection. Recently, neural architecture search (NAS) has been exploited to design feature pyramid networks (FPNs) and achieved promising results for visual object detection. Encouraged by the success, we propose a novel One Shot Path Aggregation Network Architecture Search (OPANAS) algorithm, which significantly improves both searching efficiency and detection accuracy. Specifically, we first introduce six heterogeneous information paths to build our search space, namely top down, bottom up, fusing splitting, scale equalizing, skip connect and none. Second, we propose a novel search space of FPNs, in which each FPN candidate is represented by a densely connected directed acyclic graph (each node is a feature pyramid and each edge is one of the six heterogeneous information paths). Third, we propose an efficient one shot search method to find the optimal path aggregation architecture, that is, we first train a super net and then find the optimal candidate with an evolutionary algorithm. Experimental results demonstrate the efficacy of the proposed OPANAS for object detection (1) OPANAS is more efficient than state of the art methods (e.g., NAS FPN and Auto FPN), at significantly smaller searching cost (e.g., only 4 GPU days on MS COCO) (2) the optimal architecture found by OPANAS significantly improves main stream detectors including RetinaNet, Faster R CNN and Cascade R CNN, by 2.3 3.2 mAP comparing to their FPN counterparts and (3) a new state of the art accuracy speed trade off (52.2 mAP at 7.6 FPS) at smaller training costs than comparable state of the arts. Code will be released at https github.com VDIGPKU OPANAS.


Recommendations on using VPN over SATCOM. VPN are a secured tunnel that help service providers to exchange data over non secured networks. There is a large variety of VPN solutions that have variable deployment impacts on the target architecture as well as performance limitations or opportunities. This technical report compares Wireguard and OpenVPN for various SATCOM deployment scenarios and topologies.


Efficient Global Optimization of Non differentiable, Symmetric Objectives for Multi Camera Placement. We propose a novel iterative method for optimally placing and orienting multiple cameras in a 3D scene. Sample applications include improving the accuracy of 3D reconstruction, maximizing the covered area for surveillance, or improving the coverage in multi viewpoint pedestrian tracking. Our algorithm is based on a block coordinate ascent combined with a surrogate function and an exclusion area technique. This allows to flexibly handle difficult objective functions that are often expensive and quantized or non differentiable. The solver is globally convergent and easily parallelizable. We show how to accelerate the optimization by exploiting special properties of the objective function, such as symmetry. Additionally, we discuss the trade off between non optimal stationary points and the cost reduction when optimizing the viewpoints consecutively.


Optimization and variational principles for the shear strength reduction method. This paper is focused on the definition, analysis and numerical solution of a new optimization variant (OPT) of the shear strength reduction (SSR) problem with applications to slope stability problems. This new variant is derived on the basis of recent results by Tschuchnigg et al. 2015, where limit analysis and a modified Davis approach were used for approximation of the standard SSR method. The OPT SSR method computes the factor of safety without performing an elasto plastic analysis, similarly as in limit analysis. It is shown that this optimization problem is well defined. Next, the duality between the static and kinematic principles of OPT SSR is derived. For the numerical solution, a regularization method is introduced and analyzed. This method is combined with the finite element method, mesh adaptivity and a damped Newton method. In house codes (Matlab) are used for the implementation of this solution concept. Finally, two slope stability problems are considered, one of which follows from analysis of a real slope. The softwares packages Plaxis and Comsol Multiphysics are used for comparison of the results.


Scaled ReLU Matters for Training Vision Transformers. Vision transformers (ViTs) have been an alternative design paradigm to convolutional neural networks (CNNs). However, the training of ViTs is much harder than CNNs, as it is sensitive to the training parameters, such as learning rate, optimizer and warmup epoch. The reasons for training difficulty are empirically analysed in cite xiao2021early , and the authors conjecture that the issue lies with the textit patchify stem of ViT models and propose that early convolutions help transformers see better. In this paper, we further investigate this problem and extend the above conclusion only early convolutions do not help for stable training, but the scaled ReLU operation in the textit convolutional stem ( textit conv stem ) matters. We verify, both theoretically and empirically, that scaled ReLU in textit conv stem not only improves training stabilization, but also increases the diversity of patch tokens, thus boosting peak performance with a large margin via adding few parameters and flops. In addition, extensive experiments are conducted to demonstrate that previous ViTs are far from being well trained, further showing that ViTs have great potential to be a better substitute of CNNs.


Lower bounds for Galois orbits of special points on Shimura varieties a point counting approach. Let S be a Shimura variety and let h be a Weil height function on S . We conjecture that the heights of special points in S are discriminant negligible. Assuming this conjecture to be true, we prove that the sizes of the Galois orbits of special points grow as a fixed power of their discriminant (an invariant we will define in the text). In the case of Shimura varieties of abelian type, the height bound holds by the recently proved averaged Colmez formula, and our theorem gives a new proof of Tsimerman's Galois lower bound in this case. The main novelty is that our approach avoids the use of Masser W "ustholz isogeny estimates, replacing them by a point counting argument, and establishes lower bounds for Galois orbits conditional on height bounds for emph arbitrary Shimura varieties. In particular, following the Pila Zannier strategy (and Gao's work in the mixed case) this implies that the Andre Oort conjecture for an arbitrary (mixed) Shimura variety follows from the corresponding conjecture on heights of special points.


Fractional Oscillator Harmonic Oscillator with Memory Effects. The importance of fractional time derivative to take care of memory effects has been brought out by considering the example of a simple oscillator.


The slip deficit on the North Anatolian Fault (Turkey) in the Marmara Sea insights from paleoseismicity, seismicity and geodetic data. The North Anatolian Fault experienced large earthquakes with 250 400 years recurrence time. In the Marmara Sea region, the 1999 (Mw 7.4) and the 1912 (Mw 7.4) earthquake ruptures bound the Central Marmara Sea fault segment. Using historical instrumental seismicity catalogue and paleoseismic results ( 2000 year database), the mapped fault segments, fault kinematic and GPS data, we compute the paleoseismic seismic moment rate and geodetic moment rate. A clear discrepancy appears between the moment rates and implies a significant delay in the seismic slip along the fault in the Marmara Sea. The rich database allows us to identify and model the size of the seismic gap and related fault segment and estimate the moment rate deficit. Our modeling suggest that the locked Central Marmara Sea fault segment even including a creeping section bears a moment rate deficit M d 6.4 times 10 17 N.m. yr that corresponds to Mw 7.4 for a future earthquake with an average 3.25 m coseismic slip. Taking into account the uncertainty in the strain accumulation along the 130 km long Central fault segment, our estimate of the seismic slip deficit being 10 mm yr implies that the size of the future earthquake ranges between Mw 7.4 and 7.5.


Bounded Exhaustive Search of Alloy Specification Repairs. The rising popularity of declarative languages and the hard to debug nature thereof have motivated the need for applicable, automated repair techniques for such languages. However, despite significant advances in the program repair of imperative languages, there is a dearth of repair techniques for declarative languages. This paper presents BeAFix, an automated repair technique for faulty models written in Alloy, a declarative language based on first order relational logic. BeAFix is backed with a novel strategy for bounded exhaustive, yet scalable, exploration of the spaces of fix candidates and a formally rigorous, sound pruning of such spaces. Moreover, different from the state of the art in Alloy automated repair, that relies on the availability of unit tests, BeAFix does not require tests and can work with assertions that are naturally used in formal declarative languages. Our experience with using BeAFix to repair thousands of realworld faulty models, collected by other researchers, corroborates its ability to effectively generate correct repairs and outperform the state of the art.


An infinite clique of high filling rays in the plane minus a Cantor set. The study of the mapping class group of the plane minus a Cantor set uses a graph of loops, which is an analogous of the curve graph in the study of mapping class groups of compact surfaces. The Gromov boundary of this loop graph can be described in terms of "cliques of high filling rays" high filling rays are simple geodesics of the surface which are complicated enough to be infinitely far away from any loop in the graph. Moreover, these rays are arranged in cliques any two high filling rays which are both disjoint from a third one are necessarily mutually disjoint. Every such clique is a point of the Gromov boundary of the loop graph. Some examples of cliques with any finite number of high filling rays are already known. In this paper, we construct an infinite clique of high filling rays.


Real time smart vehicle surveillance system. Over the last decade, there has been a spike in criminal activity all around the globe. According to the Indian police department, vehicle theft is one of the least solved offenses, and almost 19 of all recorded cases are related to motor vehicle theft. To overcome these adversaries, we propose a real time vehicle surveillance system, which detects and tracks the suspect vehicle using the CCTV video feed. The proposed system extracts various attributes of the vehicle such as Make, Model, Color, License plate number, and type of the license plate. Various image processing and deep learning algorithms are employed to meet the objectives of the proposed system. The extracted features can be used as evidence to report violations of law. Although the system uses more parameters, it is still able to make real time predictions with minimal latency and accuracy loss.


RMNet Equivalently Removing Residual Connection from Networks. Although residual connection enables training very deep neural networks, it is not friendly for online inference due to its multi branch topology. This encourages many researchers to work on designing DNNs without residual connections at inference. For example, RepVGG re parameterizes multi branch topology to a VGG like (single branch) model when deploying, showing great performance when the network is relatively shallow. However, RepVGG can not transform ResNet to VGG equivalently because re parameterizing methods can only be applied to linear blocks and the non linear layers (ReLU) have to be put outside of the residual connection which results in limited representation ability, especially for deeper networks. In this paper, we aim to remedy this problem and propose to remove the residual connection in a vanilla ResNet equivalently by a reserving and merging (RM) operation on ResBlock. Specifically, the RM operation allows input feature maps to pass through the block while reserving their information and merges all the information at the end of each block, which can remove residual connections without changing the original output. As a plug in method, RM Operation basically has three advantages 1) its implementation makes it naturally friendly for high ratio network pruning. 2) it helps break the depth limitation of RepVGG. 3) it leads to better accuracy speed trade off network (RMNet) compared to ResNet and RepVGG. We believe the ideology of RM Operation can inspire many insights on model design for the community in the future. Code is available at https github.com fxmeng RMNet.


A Context Aware and Self Adaptation Strategy for Cloud Service Selection and Configuration in Run Time. Day after day, the number of mobile applications deployed on cloud computing continues in increasing because o f smartphone capabilities improvement. Cloud computing has already succeeded in the web based application, for that reason, the demand for context aware services provided by cloud computing increases. To customize a cloud service that takes into account th e consumer requirements, which depend on information change, it brings to light many recent challenges to cloud computing about environment aware, location aware, time aware. The cloud provider, moreover, has to manage personalized applications and the con straints of mobile devices in matters of interaction abilities and communication restrictions. This paper proposes a strategy for selecting automatically an appropriate cloud environment that runs out whole requirements, defines a configuration for the ass ociated cloud environment and able to easily adapt to the change of the environment on either the user or the cloud side or both. This process builds on the principles of dynamic software product lines, Agent oriented software engineering, and the MAPE k m odel to select and configure cloud environments according to the consumer needs and the context change.


Design and Experimental Evaluation of a Hierarchical Controller for an Autonomous Ground Vehicle with Large Uncertainties. Autonomous ground vehicles (AGVs) are receiving increasing attention, and the motion planning and control problem for these vehicles has become a hot research topic. In real applications such as material handling, an AGV is subject to large uncertainties and its motion planning and control become challenging. In this paper, we investigate this problem by proposing a hierarchical control scheme, which is integrated by a model predictive control (MPC) based path planning and trajectory tracking control at the high level, and a reduced order extended state observer (RESO) based dynamic control at the low level. The control at the high level consists of an MPC based improved path planner, a velocity planner, and an MPC based tracking controller. Both the path planning and trajectory tracking control problems are formulated under an MPC framework. The control at the low level employs the idea of active disturbance rejection control (ADRC). The uncertainties are estimated via a RESO and then compensated in the control in real time. We show that, for the first order uncertain AGV dynamic model, the RESO based control only needs to know the control direction. Finally, simulations and experiments on an AGV with different payloads are conducted. The results illustrate that the proposed hierarchical control scheme achieves satisfactory motion planning and control performance with large uncertainties.


Mastering Visual Continuous Control Improved Data Augmented Reinforcement Learning. We present DrQ v2, a model free reinforcement learning (RL) algorithm for visual continuous control. DrQ v2 builds on DrQ, an off policy actor critic approach that uses data augmentation to learn directly from pixels. We introduce several improvements that yield state of the art results on the DeepMind Control Suite. Notably, DrQ v2 is able to solve complex humanoid locomotion tasks directly from pixel observations, previously unattained by model free RL. DrQ v2 is conceptually simple, easy to implement, and provides significantly better computational footprint compared to prior work, with the majority of tasks taking just 8 hours to train on a single GPU. Finally, we publicly release DrQ v2's implementation to provide RL practitioners with a strong and computationally efficient baseline.


Goal constrained Sparse Reinforcement Learning for End to End Driving. Deep reinforcement Learning for end to end driving is limited by the need of complex reward engineering. Sparse rewards can circumvent this challenge but suffers from long training time and leads to sub optimal policy. In this work, we explore full control driving with only goal constrained sparse reward and propose a curriculum learning approach for end to end driving using only navigation view maps that benefit from small virtual to real domain gap. To address the complexity of multiple driving policies, we learn concurrent individual policies selected at inference by a navigation system. We demonstrate the ability of our proposal to generalize on unseen road layout, and to drive significantly longer than in the training.


physics.app-ph physics.class-ph physics.comp-ph physics.optics

Part 2 Spatially Dispersive Metasurfaces IE GSTC SD Field Solver with Extended GSTCs. An Integral Equation (IE) based field solver to compute the scattered fields from spatially dispersive metasurfaces is proposed and numerically confirmed using various examples involving physical unit cells. The work is a continuation of 1 , which proposed the basic methodology of representing spatially dispersive metasurface structure in the spatial frequency domain, boldsymbol k . By representing the angular dependence of the surface susceptibilities in boldsymbol k as a ratio of two polynomials, the standard Generalized Sheet Transition Conditions (GSTCs) have been extended to include the spatial derivatives of both the difference and average fields around the metasurface. These extended boundary conditions are successfully integrated here into a standard IE GSTC solver, which leads to the new IE GSTC SD simulation framework presented here. The proposed IE GSTC SD platform is applied to various uniform metasurfaces, including a practical short conducting wire unit cell, as a representative practical example, for various cases of finite sized flat and curvilinear surfaces. In all cases, computed field distributions are successfully validated, either against the semi analytical Fourier decomposition method or the brute force full wave simulation of volumetric metasurfaces in the commercial Ansys FEM HFSS simulator.


Permutation Invariant Subgraph Discovery. We introduce Permutation and Structured Perturbation Inference (PSPI), a new problem formulation that abstracts many graph matching tasks that arise in systems biology. PSPI can be viewed as a robust formulation of the permutation inference or graph matching, where the objective is to find a permutation between two graphs under the assumption that a set of edges may have undergone a perturbation due to an underlying cause. For example, suppose there are two gene regulatory networks X and Y from a diseased and normal tissue respectively. Then, the PSPI problem can be used to detect if there has been a structural change between the two networks which can serve as a signature of the disease. Besides the new problem formulation, we propose an ADMM algorithm (STEPD) to solve a relaxed version of the PSPI problem. An extensive case study on comparative gene regulatory networks (GRNs) is used to demonstrate that STEPD is able to accurately infer structured perturbations and thus provides a tool for computational biologists to identify novel prognostic signatures. A spectral analysis confirms that STEPD can recover small clique like perturbations making it a useful tool for detecting permutation invariant changes in graphs.


Towards Sympathetic Cooling of Single (Anti )Protons. We present methods to manipulate and detect the motional state and the spin state of a single antiproton or proton which are currently under development within the BASE (Baryon Antibaryon Symmetry Experiment) collaboration. These methods include sympathetic laser cooling of a single (anti )proton using a co trapped atomic ion as well as quantum logic spectroscopy with the two particles and could be implemented within the collaboration for state preparation and state readout in the antiproton g factor measurement experiment at CERN. In our project, these techniques shall be applied using a single 9 text Be ion as the atomic ion in a Penning trap system at a magnetic field of 5 T. As an intermediate step, a controlled interaction of two beryllium ions in a double well potential as well as sympathetic cooling of one ion by the other shall be demonstrated.


DVD A Diagnostic Dataset for Multi step Reasoning in Video Grounded Dialogue. A video grounded dialogue system is required to understand both dialogue, which contains semantic dependencies from turn to turn, and video, which contains visual cues of spatial and temporal scene variations. Building such dialogue systems is a challenging problem, involving various reasoning types on both visual and language inputs. Existing benchmarks do not have enough annotations to thoroughly analyze dialogue systems and understand their capabilities and limitations in isolation. These benchmarks are also not explicitly designed to minimise biases that models can exploit without actual reasoning. To address these limitations, in this paper, we present DVD, a Diagnostic Dataset for Video grounded Dialogues. The dataset is designed to contain minimal biases and has detailed annotations for the different types of reasoning over the spatio temporal space of video. Dialogues are synthesized over multiple question turns, each of which is injected with a set of cross turn semantic relationships. We use DVD to analyze existing approaches, providing interesting insights into their abilities and limitations. In total, DVD is built from 11k CATER synthetic videos and contains 10 instances of 10 round dialogues for each video, resulting in more than 100k dialogues and 1M question answer pairs. Our code and dataset are publicly available at https github.com facebookresearch DVDialogues.


Deep Learned Approximate Message Passing for Asynchronous Massive Connectivity. This paper considers the massive connectivity problem in an asynchronous grant free random access system, where a huge number of devices sporadically transmit data to a base station (BS) with imperfect synchronization. The goal is to design algorithms for joint user activity detection, delay detection, and channel estimation. By exploiting the sparsity on both user activity and delays, we formulate a hierarchical sparse signal recovery problem in both the single antenna and the multiple antenna scenarios. While traditional compressed sensing algorithms can be applied to these problems, they suffer high computational complexity and often require the perfect statistical information of channel and devices. This paper solves these problems by designing the Learned Approximate Message Passing (LAMP) network, which belongs to model driven deep learning approaches and ensures efficient performance without tremendous training data. Particularly, in the multiple antenna scenario, we design three different LAMP structures, namely, distributed, centralized and hybrid ones, to balance the performance and complexity. Simulation results demonstrate that the proposed LAMP networks can significantly outperform the conventional AMP method thanks to their ability of parameter learning. It is also shown that LAMP has robust performance to the maximal delay spread of the asynchronous users.


Counting r graphs without forbidden configurations. One of the major problems in combinatorics is to determine the number of r uniform hypergraphs ( r graphs) on n vertices which are free of certain forbidden structures. This problem dates back to the work of Erd H o s, Kleitman and Rothschild, who showed that the number of K r free graphs on n vertices is 2 text ex (n,K r) o(n 2) . Their work was later extended to forbidding graphs as induced subgraphs by Pr "omel and Steger. Here, we consider one of the most basic counting problems for 3 graphs. Let E 1 be the 3 graph with 4 vertices and 1 edge. What is the number of induced K 4 3,E 1 free 3 graphs on n vertices? We show that the number of such 3 graphs is of order n Theta(n 2) . More generally, we determine asymptotically the number of induced mathcal F free 3 graphs on n vertices for all families mathcal F of 3 graphs on 4 vertices. We also provide upper bounds on the number of r graphs on n vertices which do not induce i in L edges on any set of k vertices, where L subseteq big 0,1, ldots, binom k r big is a list which does not contain 3 consecutive integers in its complement. Our bounds are best possible up to a constant multiplicative factor in the exponent when k r 1 . The main tool behind our proof is counting the solutions of a constraint satisfaction problem.


L 2 estimates for commutators of the Dirichlet to Neumann Map associated to elliptic operators with complex valued bounded measurable coefficients on mathbb R n 1 . In this paper we establish commmutator estimates for the Dirichlet to Neumann Map associated to a divergence form elliptic operator in the upper half space mathbb R n 1 (x,t) in mathbb R n times (0, infty) , with uniformly complex elliptic, L infty , t independent coefficients. By a standard pull back mechanism, these results extend corresponding results of Kenig, Lin and Shen for the Laplacian in a Lipschitz domain, which have application to the theory of homogenization.


A Donaldson Uhlenbeck Yau theorem for normal varieties and semistable bundles on degenerating families. In this paper, we first prove a Donaldson Uhlenbeck Yau theorem over projective normal varieties smooth in codimension two. As a consequence we deduce the polystability of (dual) tensor products of stable reflexive sheaves, and we give a new proof of the Bogomolov Gieseker inequality, along with a precise characterization of the case of equality. This also improves several previously known algebro geometric results on normalized tautological classes. We also study the limiting behavior of semistable bundles over a degenerating family of projective normal varieties. In the case of a family of stable torsion free sheaves, we study the degeneration of the corresponding HYM connections and these can be characterized from the algebro geometric perspective. This proves another version of singular Donaldson Uhlenbeck Yau theorem for normal projective varieties for the central fiber. As an application, we apply the results to the degeneration of stable bundles through the deformation to projective cones, and we explain how our results are related to the Mehta Ramanathan restriction theorem.


Effective and interpretable dispatching rules for dynamic job shops via guided empirical learning. The emergence of Industry 4.0 is making production systems more flexible and also more dynamic. In these settings, schedules often need to be adapted in real time by dispatching rules. Although substantial progress was made until the '90s, the performance of these rules is still rather limited. The machine learning literature is developing a variety of methods to improve them, but the resulting rules are difficult to interpret and do not generalise well for a wide range of settings. This paper is the first major attempt at combining machine learning with domain problem reasoning for scheduling. The idea consists of using the insights obtained with the latter to guide the empirical search of the former. Our hypothesis is that this guided empirical learning process should result in dispatching rules that are effective and interpretable and which generalise well to different instance classes. We test our approach in the classical dynamic job shop scheduling problem minimising tardiness, which is one of the most well studied scheduling problems. Nonetheless, results suggest that our approach was able to find new state of the art rules, which significantly outperform the existing literature in the vast majority of settings, from loose to tight due dates and from low utilisation conditions to congested shops. Overall, the average improvement is 19 . Moreover, the rules are compact, interpretable, and generalise well to extreme, unseen scenarios.


Classes in Zakharevich K groups constructed from Quillen K theory. We show that the K groups K n (O) for O the integers or an order in a CM field and n 0 appear as direct summands of the homotopy groups of various localisations of Zakharevich's K theory space. After rationalisation and going to the 1 connective cover, this even becomes a retract of spaces. As an application, we provide the first construction of classes of infinite order in the higher Zakharevich K groups.


An Empirical Characterization of Event Sourced Systems and Their Schema Evolution Lessons from Industry. Event sourced systems are increasing in popularity because they are reliable, flexible, and scalable. In this article, we point a microscope at a software architecture pattern that is rapidly gaining popularity in industry, but has not received as much attention from the scientific community. We do so through constructivist grounded theory, which proves a suitable qualitative method for extracting architectural knowledge from practitioners. Based on the discussion of 19 event sourced systems we explore the rationale for and the context of the event sourcing pattern. A description of the pattern itself and its relation to other patterns as discussed with practitioners is given. The description itself is grounded in the experience of 25 engineers, making it a reliable source for both new practitioners and scientists. We identify five challenges that practitioners experience event system evolution, the steep learning curve, lack of available technology, rebuilding projections, and data privacy. For the first challenge of event system evolution, we uncover five tactics and solutions that support practitioners in their design choices when developing evolving event sourced systems versioned events, weak schema, upcasting, in place transformation, and copy and transform.


Independence, infinite dimension, and operators. An interesting operatorial condition ensuring the equivalence between infinite dimension and linear independence of a sequence (e n) n in mathbb N of vectors recently appeared in a paper made by O. Christensen and M. Hasannasab (proposition 2.3 of the paper "Frame properties of systems arising via iterative actions of operators"). It relies on the existence of an operator T sending e n to e n 1 for all n in mathbb N . In this article, we recover this result as a particular case of a general order theory based model theoretic result. Returning to vector spaces, we then show that, if we want to use a condition like T(e i) e phi(i) for all i in I where I is countable as a replacement of the previous one, the conclusion will only stay true if phi I to I is conjugate to the successor function succ n mapsto n 1 defined on mathbb N . We finally prove a tentative generalization of the result, where we replace the condition T(e i) e phi(i) for all i in I where phi is conjugate to the successor function with a more sophisticated one, and to which we have not managed to find a new application yet.


Geographic characterization of railway systems. Railway systems provide pivotal support to modern societies, making their efficiency and robustness important to ensure. However, these systems are susceptible to disruptions and delays, leading to accumulating economic damage. The large spatial scale of delay spreading typically make it difficult to distinguish which regions will ultimately affected from an initial disruption, creating uncertainty for risk assessment. In this paper, we identify geographical structures that reflect how delay spreads through railway networks. We do so by proposing a graph based, hybrid schedule and empirical based model for delay propagation and apply spectral clustering. We apply the model to four European railway systems the Netherlands, Germany, Switzerland and Italy. We characterize geographical structures in the railway systems of these countries and interpret these regions in terms of delay severity and how dynamically disconnected they are from the rest. The method also allows us to point out important differences between these countries' railway systems. For practitioners, this geographical characterization of railways provide natural boundaries for local decision making structures and a first order prioritization on which regions are at risk, given an initial disruption.


Cascading Bandit under Differential Privacy. This paper studies emph differential privacy (DP) and emph local differential privacy (LDP) in cascading bandits. Under DP, we propose an algorithm which guarantees epsilon indistinguishability and a regret of mathcal O (( frac log T epsilon ) 1 xi ) for an arbitrarily small xi . This is a significant improvement from the previous work of mathcal O ( frac log 3 T epsilon ) regret. Under ( epsilon , delta ) LDP, we relax the K 2 dependence through the tradeoff between privacy budget epsilon and error probability delta , and obtain a regret of mathcal O ( frac K log (1 delta) log T epsilon 2 ) , where K is the size of the arm subset. This result holds for both Gaussian mechanism and Laplace mechanism by analyses on the composition. Our results extend to combinatorial semi bandit. We show respective lower bounds for DP and LDP cascading bandits. Extensive experiments corroborate our theoretic findings.


A Model Driven Approach to Machine Learning and Software Modeling for the IoT. Models are used in both Software Engineering (SE) and Artificial Intelligence (AI). SE models may specify the architecture at different levels of abstraction and for addressing different concerns at various stages of the software development life cycle, from early conceptualization and design, to verification, implementation, testing and evolution. However, AI models may provide smart capabilities, such as prediction and decision making support. For instance, in Machine Learning (ML), which is currently the most popular sub discipline of AI, mathematical models may learn useful patterns in the observed data and can become capable of making predictions. The goal of this work is to create synergy by bringing models in the said communities together and proposing a holistic approach to model driven software development for intelligent systems that require ML. We illustrate how software models can become capable of creating and dealing with ML models in a seamless manner. The main focus is on the domain of the Internet of Things (IoT), where both ML and model driven SE play a key role. In the context of the need to take a Cyber Physical System of Systems perspective of the targeted architecture, an integrated design environment for both SE and ML sub systems would best support the optimization and overall efficiency of the implementation of the resulting system. In particular, we implement the proposed approach, called ML Quadrat, based on ThingML, and validate it using a case study from the IoT domain, as well as through an empirical user evaluation. It transpires that the proposed approach is not only feasible, but may also contribute to the performance leap of software development for smart Cyber Physical Systems (CPS) which are connected to the IoT, as well as an enhanced user experience of the practitioners who use the proposed modeling solution.


A Machine Learning Framework Towards Transparency in Experts' Decision Quality. Expert workers make non trivial decisions with significant implications. Experts' decision accuracy is thus a fundamental aspect of their judgment quality, key to both management and consumers of experts' services. Yet, in many important settings, transparency in experts' decision quality is rarely possible because ground truth data for evaluating the experts' decisions is costly and available only for a limited set of decisions. Furthermore, different experts typically handle exclusive sets of decisions, and thus prior solutions that rely on the aggregation of multiple experts' decisions for the same instance are inapplicable. We first formulate the problem of estimating experts' decision accuracy in this setting and then develop a machine learning based framework to address it. Our method effectively leverages both abundant historical data on workers' past decisions, and scarce decision instances with ground truth information. We conduct extensive empirical evaluations of our method's performance relative to alternatives using both semi synthetic data based on publicly available datasets, and purposefully compiled dataset on real workers' decisions. The results show that our approach is superior to existing alternatives across diverse settings, including different data domains, experts' qualities, and the amount of ground truth data. To our knowledge, this paper is the first to posit and address the problem of estimating experts' decision accuracies from historical data with scarcely available ground truth, and it is the first to offer comprehensive results for this problem setting, establishing the performances that can be achieved across settings, as well as the state of the art performance on which future work can build.


A weak law of large numbers for the sequence of uncorrelated fuzzy random variables. We shall prove a weak law of large numbers for the uncorrelated (see Definition 3.1) fuzzy random variable sequence with respect to the uniform Hausdorff metric d H infty , which is an extension of weak law of large numbers for independent fuzzy random variables.


On a quantum classical correspondence from graphs to manifolds. We establish conditions for which graph Laplacians Delta lambda, epsilon on compact, boundaryless, smooth submanifolds mathcal M of Euclidean space are semiclassical pseudodifferential operators ( Psi DOs) essentially, that the graph Laplacian's kernel bandwidth ( bias term ) sqrt epsilon decays faster than the semiclassical parameter h , i.e. , h gg sqrt epsilon and we compute the symbol. Coupling this with Egorov's theorem and coherent states psi h localized at (x 0, xi 0) in T mathcal M , we show that with U lambda, epsilon t e i t sqrt Delta lambda, epsilon spectrally defined, the (co )geodesic flow Gamma t on T mathcal M is approximated by langle U lambda, epsilon t operatorname Op h(a) U lambda, epsilon t psi h, psi h rangle a circ Gamma t(x 0, xi 0) O(h) . Then, we turn to the discrete setting for Delta lambda, epsilon,N a normalized graph Laplacian defined on a set of N points x 1, ldots, x N sampled i.i.d. from a probability distribution with smooth density, we establish Bernstein type lower bounds on the probability that U lambda, epsilon,N t u U lambda, epsilon t u L infty leq delta with U lambda, epsilon,N t e i t sqrt Delta lambda, epsilon,N . We apply this to coherent states to show that the geodesic flow on mathcal M can be approximated by matrix dynamics on the discrete sample set, namely that with high probability , c t,N 1 sum j 1 N U lambda, epsilon,N t psi h (x j) 2 u(x j) u(x t) O(h) for c t,N sum j 1 N U lambda, epsilon,N t psi h (x j) 2 and x t the projection of Gamma t(x 0, xi 0) onto mathcal M .


Memory Efficient Modeling and Slicing of Large Scale Adaptive Lattice Structures. Lattice structures have been widely used in various applications of additive manufacturing due to its superior physical properties. If modeled by triangular meshes, a lattice structure with huge number of struts would consume massive memory. This hinders the use of lattice structures in large scale applications (e.g., to design the interior structure of a solid with spatially graded material properties). To solve this issue, we propose a memory efficient method for the modeling and slicing of adaptive lattice structures. A lattice structure is represented by a weighted graph where the edge weights store the struts' radii. When slicing the structure, its solid model is locally evaluated through convolution surfaces and in a streaming manner. As such, only limited memory is needed to generate the toolpaths of fabrication. Also, the use of convolution surfaces leads to natural blending at intersections of struts, which can avoid the stress concentration at these regions. We also present a computational framework for optimizing supporting structures and adapting lattice structures with prescribed density distributions. The presented methods have been validated by a series of case studies with large number (up to 100M) of struts to demonstrate its applicability to large scale lattice structures.


On the design of autonomous agents from multiple data sources. This paper is concerned with the problem of designing agents able to dynamically select information from multiple data sources in order to tackle tasks that involve tracking a target behavior while optimizing a reward. We formulate this problem as a data driven optimal control problem with integer decision variables and give an explicit expression for its solution. The solution determines how (and when) the data from the sources should be used by the agent. We also formalize a notion of agent's regret and, by relaxing the problem, give a regret upper bound. Simulations complement the results.


Besov Reconstruction. Reconstruction theorems tackle the problem of building a global distribution on mathbb R d or on a manifold, given a sufficiently coherent family of local approximations, see M.Hairer, Invent. Math. 198 (2014), no. 2,269 504 , M,Hairer and Labb 'e, C, J. Funct. Anal. 273 (2017), no. 8, 2578 2618 , Caravenna, F and Zambotti, L, EMS Surv. Math. Sci. 7 (2020), no. 2, 207 251 , Rinaldi, P and Sclavi, F, J. Math. Anal. Appl. 501 (2021), no. 2, 125215, 14 pp for examples of such results. In this paper, we establish a reconstruction theorem in the Besov setting, generalising results both of Caravenna, F and Zambotti, L, EMS Surv. Math. Sci. 7 (2020), no. 2, 207 251 and M,Hairer and Labb 'e, C, J. Funct. Anal. 273 (2017), no. 8, 2578 2618 . While M,Hairer and Labb 'e, C, J. Funct. Anal. 273 (2017), no. 8, 2578 2618 is written in the context of regularity structures and exploits nontrivial results from wavelet analysis, our calculations follow the more elementary and more general approach of Caravenna, F and Zambotti, L, EMS Surv. Math. Sci. 7 (2020), no. 2, 207 251 . In particular, as in Caravenna, F and Zambotti, L, EMS Surv. Math. Sci. 7 (2020), no. 2, 207 251 , our results are both stated and proved with tools from the theory of distributions. As an application, we present an alternative proof of a (Besov) Young multiplication theorem which does not require the use of paraproducts.


Lipschitz regularity for solutions of the parabolic p Laplacian in the Heisenberg group. We prove local Lipschitz regularity for weak solutions to a class of degenerate parabolic PDEs modeled on the parabolic p Laplacian p t u sum i 1 2n X i ( nabla 0 u p 2 X i u), in a cylinder Omega times R , where Omega is domain in the Heisenberg group Hn , and 2 le p le 4 . The result continues to hold in the more general setting of contact sub Riemannian manifolds.


Residual Quantity in Percentage of Factory Machines Using Computer Vision and Mathematical Methods. Computer vision has been thriving since AI development was gaining thrust. Using deep learning techniques has been the most popular way which computer scientists thought the solution of. However, deep learning techniques tend to show lower performance than manual processing. Using deep learning is not always the answer to a problem related to computer vision.


Detection of E scooter Riders in Naturalistic Scenes. E scooters have become ubiquitous vehicles in major cities around the world.The numbers of e scooters keep escalating, increasing their interactions with other cars on the road. Normal behavior of an e scooter rider varies enormously to other vulnerable road users. This situation creates new challenges for vehicle active safety systems and automated driving functionalities, which require the detection of e scooter riders as the first step. To our best knowledge, there is no existing computer vision model to detect these e scooter riders. This paper presents a novel vision based system to differentiate between e scooter riders and regular pedestrians and a benchmark data set for e scooter riders in natural scenes. We propose an efficient pipeline built over two existing state of the art convolutional neural networks (CNN), You Only Look Once (YOLOv3) and MobileNetV2. We fine tune MobileNetV2 over our dataset and train the model to classify e scooter riders and pedestrians. We obtain a recall of around 0.75 on our raw test sample to classify e scooter riders with the whole pipeline. Moreover, the classification accuracy of trained MobileNetV2 on top of YOLOv3 is over 91 , with precision and recall over 0.9.


Rethinking gradient sparsification as total error minimization. Gradient compression is a widely established remedy to tackle the communication bottleneck in distributed training of large deep neural networks (DNNs). Under the error feedback framework, Top k sparsification, sometimes with k as little as 0.1 of the gradient size, enables training to the same model quality as the uncompressed case for a similar iteration count. From the optimization perspective, we find that Top k is the communication optimal sparsifier given a per iteration k element budget. We argue that to further the benefits of gradient sparsification, especially for DNNs, a different perspective is necessary one that moves from per iteration optimality to consider optimality for the entire training. We identify that the total error the sum of the compression errors for all iterations encapsulates sparsification throughout training. Then, we propose a communication complexity model that minimizes the total error under a communication budget for the entire training. We find that the hard threshold sparsifier, a variant of the Top k sparsifier with k determined by a constant hard threshold, is the optimal sparsifier for this model. Motivated by this, we provide convex and non convex convergence analyses for the hard threshold sparsifier with error feedback. Unlike with Top k sparsifier, we show that hard threshold has the same asymptotic convergence and linear speedup property as SGD in the convex case and has no impact on the data heterogeneity in the non convex case. Our diverse experiments on various DNNs and a logistic regression model demonstrated that the hard threshold sparsifier is more communication efficient than Top k .


ElasticFace Elastic Margin Loss for Deep Face Recognition. Learning discriminative face features plays a major role in building high performing face recognition models. The recent state of the art face recognition solutions proposed to incorporate a fixed penalty margin on commonly used classification loss function, softmax loss, in the normalized hypersphere to increase the discriminative power of face recognition models, by minimizing the intra class variation and maximizing the inter class variation. Marginal penalty softmax losses, such as ArcFace and CosFace, assume that the geodesic distance between and within the different identities can be equally learned using a fixed penalty margin. However, such a learning objective is not realistic for real data with inconsistent inter and intra class variation, which might limit the discriminative and generalizability of the face recognition model. In this paper, we relax the fixed penalty margin constrain by proposing elastic penalty margin loss (ElasticFace) that allows flexibility in the push for class separability. The main idea is to utilize random margin values drawn from a normal distribution in each training iteration. This aims at giving the decision boundary chances to extract and retract to allow space for flexible class separability learning. We demonstrate the superiority of our ElasticFace loss over ArcFace and CosFace losses, using the same geometric transformation, on a large set of mainstream benchmarks. From a wider perspective, our ElasticFace has advanced the state of the art face recognition performance on seven out of nine mainstream benchmarks.


A novel testbed for investigating the impact of teleoperator dynamics on perceived environment dynamics. Human in the loop telerobotic systems (HiLTS) are robotic tools designed to extend and in some circumstances improve the dexterous capabilities of the human operator in virtual and remote environments. Dexterous manipulation, however, depends on how well the telerobot is incorporated into the operator's sensorimotor control scheme. Empirical evidence suggests that haptic feedback can lead to improved dexterity. Unfortunately, haptic feedback can also introduce dynamics between the leader and follower of the telerobot that affect both stability and device performance. While concerted research effort has focused on masking these device dynamics or bypassing them altogether, it is not well understood how human operators incorporate these dynamics into their control scheme. We believe that to advance dexterous telerobotic manipulation, it is crucial to understand the process by which humans operators incorporate teleoperator dynamics and distinguish them from the dynamics of the environment. Key to this knowledge is an understanding of how advanced telerobotic architectures compare to the gold standard, the rigid mechanical teleoperators first introduced in the 1950's. In this manuscript, we present a teleoperator testbed that has reconfigurable transmissions between the leader and follower to change its dynamic behavior. The intent of this testbed is to investigate the effect of the teleoperator's dynamics on perception of and task performance in the remote virtual environment. We describe the hardware and software components of the testbed and then demonstrate how the different teleoperator transmissions can lead to differences, sometimes significant, in the dynamics that would be felt by the operator when exploring the same environment.


Global Solvability of 2D MHD Boundary Layer Equations in Analytic Function Spaces. In this paper we are concerned with the global well posedness of solutions to magnetohydrodynamics (MHD) boundary layer equations in analytic function spaces. When the initial data is a small perturbation around a selected profile, and such a profile is governed by an one dimensional heat equation with a source term, we establish the global in time existence and uniqueness of analytic solutions to the two dimensional (2D) MHD boundary layer equations. It is noted that the far field state of velocity is not required to be small initially, but decays to zero as time tends to infinity with suitable decay rates. The whole analysis is divided into two parts When the initial far field states are not small, we reformulate the original problem into a small perturbation problem by extracting a suitable background profile which is governed by a heat equation, then we prove a long time existence of solutions, and the lower bound of lifespan of solutions is given in term of the small parameter of initial perturbation After establishing the long time existence, combining the decay properties of far field state and the properties of solutions to the heat equation, it is shown that both the solution obtained in the first part and the background profile indeed satisfy some smallness requirements when time goes to the lower bound of lifespan of solutions. Then we can show the global existence of solutions after this moment.


Computational graphs for matrix functions. Many numerical methods for evaluating matrix functions can be naturally viewed as computational graphs. Rephrasing these methods as directed acyclic graphs (DAGs) is a particularly effective approach to study existing techniques, improve them, and eventually derive new ones. The accuracy of these matrix techniques can be characterized by the accuracy of their scalar counterparts, thus designing algorithms for matrix functions can be regarded as a scalar valued optimization problem. The derivatives needed during the optimization can be calculated automatically by exploiting the structure of the DAG, in a fashion analogous to backpropagation. This paper describes GraphMatFun.jl, a Julia package that offers the means to generate and manipulate computational graphs, optimize their coefficients, and generate Julia, MATLAB, and C code to evaluate them efficiently at a matrix argument. The software also provides tools to estimate the accuracy of a graph based algorithm and thus obtain numerically reliable methods. For the exponential, for example, using a particular form (degree optimal) of polynomials produces implementations that in many cases are cheaper, in terms of computational cost, than the Pad 'e based techniques typically used in mathematical software. The optimized graphs and the corresponding generated code are available online.


An Inference Approach To Question Answering Over Knowledge Graphs. Knowledge Graphs (KG) act as a great tool for holding distilled information from large natural language text corpora. The problem of natural language querying over knowledge graphs is essential for the human consumption of this information. This problem is typically addressed by converting the natural language query to a structured query and then firing the structured query on the KG. Direct answering models over knowledge graphs in literature are very few. The query conversion models and direct models both require specific training data pertaining to the domain of the knowledge graph. In this work, we convert the problem of natural language querying over knowledge graphs to an inference problem over premise hypothesis pairs. Using trained deep learning models for the converted proxy inferencing problem, we provide the solution for the original natural language querying problem. Our method achieves over 90 accuracy on MetaQA dataset, beating the existing state of the art. We also propose a model for inferencing called Hierarchical Recurrent Path Encoder(HRPE). The inferencing models can be fine tuned to be used across domains with less training data. Our approach does not require large domain specific training data for querying on new knowledge graphs from different domains.


Contextualized Knowledge aware Attentive Neural Network Enhancing Answer Selection with Knowledge. Answer selection, which is involved in many natural language processing applications such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real world background knowledge. In this paper, we extensively investigate approaches to enhancing the answer selection model with external knowledge from knowledge graph (KG). First, we present a context knowledge interaction learning framework, Knowledge aware Neural Network (KNN), which learns the QA sentence representations by considering a tight interaction with the external knowledge from KG and the textual information. Then, we develop two kinds of knowledge aware attention mechanism to summarize both the context based and knowledge based interactions between questions and answers. To handle the diversity and complexity of KG information, we further propose a Contextualized Knowledge aware Attentive Neural Network (CKANN), which improves the knowledge representation learning with structure information via a customized Graph Convolutional Network (GCN) and comprehensively learns context based and knowledge based sentence representation via the multi view knowledge aware attention mechanism. We evaluate our method on four widely used benchmark QA datasets, including WikiQA, TREC QA, InsuranceQA and Yahoo QA. Results verify the benefits of incorporating external knowledge from KG, and show the robust superiority and extensive applicability of our method.


POINTREC A Test Collection for Narrative driven Point of Interest Recommendation. This paper presents a test collection for contextual point of interest (POI) recommendation in a narrative driven scenario. There, user history is not available, instead, user requests are described in natural language. The requests in our collection are manually collected from social sharing websites, and are annotated with various types of metadata, including location, categories, constraints, and example POIs. These requests are to be resolved from a dataset of POIs, which are collected from a popular online directory, and are further linked to a geographical knowledge base and enriched with relevant web snippets. Graded relevance assessments are collected using crowdsourcing, by pooling both manual and automatic recommendations, where the latter serve as baselines for future performance comparison. This resource supports the development of novel approaches for end to end POI recommendation as well as for specific semantic annotation tasks on natural language requests.


BFClass A Backdoor free Text Classification Framework. Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers, however, defending such attacks remains an open problem. In this work, we propose BFClass, a novel efficient backdoor free training framework for text classification. The backbone of BFClass is a pre trained discriminator that predicts whether each token in the corrupted input was replaced by a masked language model. To identify triggers, we utilize this discriminator to locate the most suspicious token from each training sample and then distill a concise set by considering their association strengths with particular labels. To recognize the poisoned subset, we examine the training samples with these identified triggers as the most suspicious token, and check if removing the trigger will change the poisoned model's prediction. Extensive experiments demonstrate that BFClass can identify all the triggers, remove 95 poisoned training samples with very limited false alarms, and achieve almost the same performance as the models trained on the benign training data.


Oriented regular representations of out valency two for finite simple groups. In this paper, we show that every finite simple group of order at least 5 admits an oriented regular representation of out valency 2 .


SOAR A Synthesis Approach for Data Science API Refactoring. With the growth of the open source data science community, both the number of data science libraries and the number of versions for the same library are increasing rapidly. To match the evolving APIs from those libraries, open source organizations often have to exert manual effort to refactor the APIs used in the code base. Moreover, due to the abundance of similar open source libraries, data scientists working on a certain application may have an abundance of libraries to choose, maintain and migrate between. The manual refactoring between APIs is a tedious and error prone task. Although recent research efforts were made on performing automatic API refactoring between different languages, previous work relies on statistical learning with collected pairwise training data for the API matching and migration. Using large statistical data for refactoring is not ideal because such training data will not be available for a new library or a new version of the same library. We introduce Synthesis for Open Source API Refactoring (SOAR), a novel technique that requires no training data to achieve API migration and refactoring. SOAR relies only on the documentation that is readily available at the release of the library to learn API representations and mapping between libraries. Using program synthesis, SOAR automatically computes the correct configuration of arguments to the APIs and any glue code required to invoke those APIs. SOAR also uses the interpreter's error messages when running refactored code to generate logical constraints that can be used to prune the search space. Our empirical evaluation shows that SOAR can successfully refactor 80 of our benchmarks corresponding to deep learning models with up to 44 layers with an average run time of 97.23 seconds, and 90 of the data wrangling benchmarks with an average run time of 17.31 seconds.


Neumann Series in GMRES and Algebraic Multigrid Smoothers. Neumann series underlie both Krylov methods and algebraic multigrid smoothers. A low synch modified Gram Schmidt (MGS) GMRES algorithm is described that employs a Neumann series to accelerate the projection step. A corollary to the backward stability result of Paige et al. (2006) demonstrates that the truncated Neumann series approximation is sufficient for convergence of GMRES. The lower triangular solver associated with the correction matrix T m ( I L m ) 1 may then be replaced by a matrix vector product with T m I L m . Next, Neumann series are applied to accelerate the classical R "uge Stuben algebraic multigrid preconditioner using both a polynomial Gauss Seidel or incomplete ILU smoother. The sparse triangular solver employed in these smoothers is replaced by an inner iteration based upon matrix vector products. Henrici's departure from normality of the associated iteration matrices leads to a better understanding of these series. Connections are made between the (non)normality of the L and U factors and nonlinear stability analysis, as well as the pseudospectra of the coefficient matrix. Furthermore, re orderings that preserve structural symmetry also reduce the departure from normality of the upper triangular factor and improve the relative residual of the triangular solves. To demonstrate the effectiveness of this approach on many core architectures, the proposed solver and preconditioner are applied to the pressure continuity equation for the incompressible Navier Stokes equations of fluid motion. The pressure solve time is reduced considerably with no change in the convergence rate and the polynomial Gauss Seidel smoother is compared with a Jacobi smoother. Numerical and timing results are presented for Nalu Wind and the PeleLM combustion codes, where ILU with iterative triangular solvers is shown to be much more effective than polynomial Gauss Seidel.


Power Modeling for Effective Datacenter Planning and Compute Management. Datacenter power demand has been continuously growing and is the key driver of its cost. An accurate mapping of compute resources (CPU, RAM, etc.) and hardware types (servers, accelerators, etc.) to power consumption has emerged as a critical requirement for major Web and cloud service providers. With the global growth in datacenter capacity and associated power consumption, such models are essential for important decisions around datacenter design and operation. In this paper, we discuss two classes of statistical power models designed and validated to be accurate, simple, interpretable and applicable to all hardware configurations and workloads across hyperscale datacenters of Google fleet. To the best of our knowledge, this is the largest scale power modeling study of this kind, in both the scope of diverse datacenter planning and real time management use cases, as well as the variety of hardware configurations and workload types used for modeling and validation. We demonstrate that the proposed statistical modeling techniques, while simple and scalable, predict power with less than 5 Mean Absolute Percent Error (MAPE) for more than 95 diverse Power Distribution Units (more than 2000) using only 4 features. This performance matches the reported accuracy of the previous started of the art methods, while using significantly less features and covering a wider range of use cases.


Schwarz Pick Lemma for Harmonic and Hyperbolic Harmonic Functions. We establish some inequalities of Schwarz Pick type for harmonic and hyperbolic harmonic functions on the unit ball of and we disprove a recent conjecture of Liu Schwarz Pick Lemma for Harmonic Functions, International Mathematics Research Notices, 2021 .


On Spectral Theory of Random Fields in the Ball. The paper investigates random fields in the ball. It studies three types of such fields restrictions of scalar random fields in the ball to the sphere, spin, and vector random fields. The review of the existing results and new spectral theory for each of these classes of random fields are given. Examples of applications to classical and new models of these three types are presented. In particular, the Mat ' e rn model is used for illustrative examples. The derived spectral representations can be utilised to further study theoretical properties of such fields and to simulate their realisations. The obtained results can also find various applications for modelling and investigating ball data in cosmology, geosciences and embryology.


GPT3Mix Leveraging Large scale Language Models for Text Augmentation. Large scale language models such as GPT 3 are excellent few shot learners, allowing them to be controlled via natural text prompts. Recent studies report that prompt based direct classification eliminates the need for fine tuning but lacks data and inference scalability. This paper proposes a novel data augmentation technique that leverages large scale language models to generate realistic text samples from a mixture of real samples. We also propose utilizing soft labels predicted by the language models, effectively distilling knowledge from the large scale language models and creating textual perturbations simultaneously. We perform data augmentation experiments on diverse classification tasks and show that our method hugely outperforms existing text augmentation methods. Ablation studies and a qualitative analysis provide more insights into our approach.


Anomalous particle diffusion influenced by angular heterogeneity. A generalized persistent random walk (GPRW) model to study anomalous particle diffusion influenced by angular heterogeneity is presented. Consider the motion of a particle is composed of many consecutive straight line segments. At the end of each straight motion, the particle can switch to a new moving direction. Angular heterogeneity occurs when the probability of choosing a moving direction is non uniformly distributed and influenced by surrounding environment and by the particle past conditions. Based on the model, we show that particles perform Gaussian Fickian diffusion with directional drifting in a memoryless system with spatial dependent angular heterogeneity. When the probability of maintaining the current moving direction is correlated with the particle speed, these particles perform Fickian diffusion, but their full distribution diverges from Gaussian. When the probability of maintaining te current moving direction is correlated with the historical moving distance, particles perform superdiffusion. The GPRW framework presented can be applied to study protein diffusion, cell migration and solute transport in complex heterogeneous environments.


Dimension independent atomic decoposition for dyadic martingale H 1 . We introduce atoms for dyadic atomic H 1 for which the equivalence between atomic and maximal function defnitions is dimension independent. We give the sharp, up to log(d) factor, estimates for the H 1 to L 1 norm estimates for the special maximal function.


Approximate viscosity solutions of path dependent PDEs and Dupire's vertical differentiability. We introduce a notion of approximate viscosity solution for a class of nonlinear path dependent PDEs (PPDEs), including the Hamilton Jacobi Bellman type equations. Existence, comparaison and stability results are established under fairly general conditions. It is also consistent with smooth solutions when the dimension is less or equal to two, or the non linearity is concave in the second order space derivative. We finally investigate the regularity (in the sense of Dupire) of the solution to the PPDE.


Explainable Sentence Level Sentiment Analysis for Amazon Product Reviews. In this paper, we conduct a sentence level sentiment analysis on the product reviews from Amazon and thorough analysis on the model interpretability. For the sentiment analysis task, we use the BiLSTM model with attention mechanism. For the study of interpretability, we consider the attention weights distribution of single sentence and the attention weights of main aspect terms. The model has an accuracy of up to 0.96. And we find that the aspect terms have the same or even more attention weights than the sentimental words in sentences.