Can You Fix My Neural Network? Real Time Adaptive Waveform Synthesis for Resilient Wireless Signal Classification. Thanks to its capability of classifying complex phenomena without explicit modeling, deep learning (DL) has been demonstrated to be a key enabler of Wireless Signal Classification (WSC). Although DL can achieve a very high accuracy under certain conditions, recent research has unveiled that the wireless channel can disrupt the features learned by the DL model during training, thus drastically reducing the classification performance in real world live settings. Since retraining classifiers is cumbersome after deployment, existing work has leveraged the usage of carefully tailored Finite Impulse Response (FIR) filters that, when applied at the transmitter's side, can restore the features that are lost because of the the channel actions, i.e., waveform synthesis. However, these approaches compute FIRs using offline optimization strategies, which limits their efficacy in highly dynamic channel settings. In this paper, we improve the state of the art by proposing Chares, a Deep Reinforcement Learning (DRL) based framework for channel resilient adaptive waveform synthesis. Chares adapts to new and unseen channel conditions by optimally computing through DRL the FIRs in real time. Chares is a DRL agent whose architecture is based upon the Twin Delayed Deep Deterministic Policy Gradients (TD3), which requires minimal feedback from the receiver and explores a continuous action space. Chares has been extensively evaluated on two well known datasets. We have also evaluated the real time latency of Chares with an implementation on field programmable gate array (FPGA). Results show that Chares increases the accuracy up to 4.1x when no waveform synthesis is performed, by 1.9x with respect to existing work, and can compute new actions within 41us.


Actinium 225 Production with an Electron Accelerator. There has been growing clinical evidence of the value of targeted alpha therapy for treatment of several cancers. The work has been slowed by the lack of availability of the key alpha emitting isotopes, especially Ac 225. Until this time, most of the supply has been from three Th 229 generators that are milked to produce hundreds of mCi of Ac 225 every month. There has been a growing effort to produce new sources of Ac 225 from several different accelerator based routes. It can be produced with medical isotope cyclotrons with a proton energy of at least 16 MeV using the reaction Ra 226(p,2n)Ac 225. It can also be produced by using high energy protons (150 to 800 MeV) for spallation of a thorium target. Significant experimental work has been applied to both processes. It can also be produced by the photonuclear reaction, Ra 226( gamma ,n)Ra 225. The Ra 225 decays via beta decay to Ac 225 with a half life of 14.9 days. The photons are produced by an intense beam of electrons with an energy about 25 to 30 MeV. This paper will provide a technical description of radium targets and a target chamber that would be capable of producing a yield of four curies of Ra 225 from a 10 day irradiation of one gram of radium segmented into two to four separate encapsulated targets, at a beam power of 20 kW. These targets could be milked at least three times, yielding nearly four curies of Ac 225. There is also a description of a method to reduce production of Ac 227 to values less than a few parts per million of the yield of Ac 225. The Monte Carlo code Fluka has been used to model the yields of Ra 225 and support the design concept to reduce the production of Ac 227. It has also been used to model the experimental results by Maslov et al. https doi.org 10.1134 S1066362206020184 to provide reasonable confidence in the cross section value used by the code.


Learn to Match Automatic Matching Network Design for Visual Tracking. Siamese tracking has achieved groundbreaking performance in recent years, where the essence is the efficient matching operator cross correlation and its variants. Besides the remarkable success, it is important to note that the heuristic matching network design relies heavily on expert experience. Moreover, we experimentally find that one sole matching operator is difficult to guarantee stable tracking in all challenging environments. Thus, in this work, we introduce six novel matching operators from the perspective of feature fusion instead of explicit similarity learning, namely Concatenation, Pointwise Addition, Pairwise Relation, FiLM, Simple Transformer and Transductive Guidance, to explore more feasibility on matching operator selection. The analyses reveal these operators' selective adaptability on different environment degradation types, which inspires us to combine them to explore complementary features. To this end, we propose binary channel manipulation (BCM) to search for the optimal combination of these operators. BCM determines to retrain or discard one operator by learning its contribution to other tracking steps. By inserting the learned matching networks to a strong baseline tracker Ocean, our model achieves favorable gains by 67.2 rightarrow 71.4 , 52.6 rightarrow 58.3 , 70.3 rightarrow 76.0 success on OTB100, LaSOT, and TrackingNet, respectively. Notably, Our tracker, dubbed AutoMatch, uses less than half of training data time than the baseline tracker, and runs at 50 FPS using PyTorch. Code and model will be released at https github.com JudasDie SOTS.


Limit theorems for additive functionals of random walks in random scenery. We study the asymptotic behaviour of additive functionals of random walks in random scenery. We establish bounds for the moments of the local time of the Kesten and Spitzer process.These bounds combined with a previous moment convergence result (and an ergodicity result) imply the convergence in distribution of additive observables (with a normalization in n (1 4)).When the sum of the observable is null, the previous limit vanishes and we prove the convergence in the sense of moments (with a normalization in n (1 8)).


DebIE A Platform for Implicit and Explicit Debiasing of Word Embedding Spaces. Recent research efforts in NLP have demonstrated that distributional word vector spaces often encode stereotypical human biases, such as racism and sexism. With word representations ubiquitously used in NLP models and pipelines, this raises ethical issues and jeopardizes the fairness of language technologies. While there exists a large body of work on bias measures and debiasing methods, to date, there is no platform that would unify these research efforts and make bias measuring and debiasing of representation spaces widely accessible. In this work, we present DebIE, the first integrated platform for (1) measuring and (2) mitigating bias in word embeddings. Given an (i) embedding space (users can choose between the predefined spaces or upload their own) and (ii) a bias specification (users can choose between existing bias specifications or create their own), DebIE can (1) compute several measures of implicit and explicit bias and modify the embedding space by executing two (mutually composable) debiasing models. DebIE's functionality can be accessed through four different interfaces (a) a web application, (b) a desktop application, (c) a REST ful API, and (d) as a command line application. DebIE is available at debie.informatik.uni mannheim.de.


Convergence Rates in Uniform Ergodicity by Hitting Times and L 2 exponential Convergence Rates. Generally the convergence rate in exponential ergodicity lambda is an upper bound for the convergence rate kappa in uniform ergodicity for a Markov process, that is lambda geqslant kappa . In this paper, we prove that kappa geqslant inf lambda,1 M H , where M H is a uniform bound on the moment of the hitting time to a "compact" set H . In the case where M H can be made arbitrarily small for H large enough, we obtain that lambda kappa . The general results are applied to Markov chains, diffusion processes and solutions to SDEs driven by symmetric stable processes.


The non abelian Brill Noether divisor on overline mathcal M 13 and the Kodaira dimension of overline mathcal R 13 . The paper is devoted to highlighting several novel aspects of the moduli space of curves of genus 13, the first genus g where phenomena related to K3 surfaces no longer govern the birational geometry of M g. We compute the class of the non abelian Brill Noether divisor on M 13 of curves that have a stable rank 2 vector bundle with many sections. This provides the first example of an effective divisor on M g with slope less than 6 10 g. Earlier work on the Slope Conjecture suggested that such divisors may not exist. The main geometric application of our result is a proof that the Prym moduli space of genus 13 is of general type. Among other things, we also prove the Bertram Feinberg Mukai and the Strong Maximal Rank Conjectures on M 13


A multivariate CLT for typical weighted sums with rate of convergence of order O(1 n). The "typical" asymptotic behavior of the weighted sums of independent random vectors in k dimensional space is considered. It is shown that in this case the rate of convergence in the multivariate central limit theorem is of order O(1 n) . This extends the one dimensional Klartag and Sodin (2011) result.


Adaptive Nearest Neighbor Machine Translation. kNN MT, recently proposed by Khandelwal et al. (2020a), successfully combines pre trained neural machine translation (NMT) model with token level k nearest neighbor (kNN) retrieval to improve the translation accuracy. However, the traditional kNN algorithm used in kNN MT simply retrieves a same number of nearest neighbors for each target token, which may cause prediction errors when the retrieved neighbors include noises. In this paper, we propose Adaptive kNN MT to dynamically determine the number of k for each target token. We achieve this by introducing a light weight Meta k Network, which can be efficiently trained with only a few training samples. On four benchmark machine translation datasets, we demonstrate that the proposed method is able to effectively filter out the noises in retrieval results and significantly outperforms the vanilla kNN MT model. Even more noteworthy is that the Meta k Network learned on one domain could be directly applied to other domains and obtain consistent improvements, illustrating the generality of our method. Our implementation is open sourced at https github.com zhengxxn adaptive knn mt.


Learning from Perturbations Diverse and Informative Dialogue Generation with Inverse Adversarial Training. In this paper, we propose Inverse Adversarial Training (IAT) algorithm for training neural dialogue systems to avoid generic responses and model dialogue history better. In contrast to standard adversarial training algorithms, IAT encourages the model to be sensitive to the perturbation in the dialogue history and therefore learning from perturbations. By giving higher rewards for responses whose output probability reduces more significantly when dialogue history is perturbed, the model is encouraged to generate more diverse and consistent responses. By penalizing the model when generating the same response given perturbed dialogue history, the model is forced to better capture dialogue history and generate more informative responses. Experimental results on two benchmark datasets show that our approach can better model dialogue history and generate more diverse and consistent responses. In addition, we point out a problem of the widely used maximum mutual information (MMI) based methods for improving the diversity of dialogue response generation models and demonstrate it empirically.


Telescopic, Multiplicative, and Rational Extensions of Summations. A summation is a shift invariant rm R module homomorphism from a submodule of rm R sigma to rm R or another ring. 11 formalized a method for extending a summation to a larger domain by telescoping. In this paper, we revisit telescoping, we study multiplicative closures of summations (such as the usual summation on convergent series) that are not themselves multiplicatively closed, and we study rational extensions as a generalization of telescoping.


Control of COVID 19 dynamics through a fractional order model. We investigate, through a fractional mathematical model, the effects of physical distance on the SARS CoV 2 virus transmission. Two controls are considered in our model for eradication of the spread of COVID 19 media education, through campaigns explaining the importance of social distancing, use of face masks, etc., towards all population, while the second one is quarantine social isolation of the exposed individuals. A general fractional order optimal control problem, and associated optimality conditions of Pontryagin type, are discussed, with the goal to minimize the number of susceptible and infected while maximizing the number of recovered. The extremals are then numerically obtained.


Creating and Reenacting Controllable 3D Humans with Differentiable Rendering. This paper proposes a new end to end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure, jointly with differentiable rendering, to synthesize new videos of people in different contexts from where they were initially recorded. Unlike recent appearance transferring methods, our approach can reconstruct a fully controllable 3D texture mapped model of a person, while taking into account the manifold structure from body shape and texture appearance in the view synthesis. Specifically, our approach models mesh deformations with a three stage GCN trained in a self supervised manner on rendered silhouettes of the human body. It also infers texture appearance with a convolutional network in the texture domain, which is trained in an adversarial regime to reconstruct human texture from rendered images of actors in different poses. Experiments on different videos show that our method successfully infers specific body deformations and avoid creating texture artifacts while achieving the best values for appearance in terms of Structural Similarity (SSIM), Learned Perceptual Image Patch Similarity (LPIPS), Mean Squared Error (MSE), and Fr 'echet Video Distance (FVD). By taking advantages of both differentiable rendering and the 3D parametric model, our method is fully controllable, which allows controlling the human synthesis from both pose and rendering parameters. The source code is available at https www.verlab.dcc.ufmg.br retargeting motion wacv2022.


Random Choices can Facilitate the Solving of Collective Network Coloring Problems by Artificial Agents. Global coordination is required to solve a wide variety of challenging collective action problems from network colorings to the tragedy of the commons. Recent empirical study shows that the presence of a few noisy autonomous agents can greatly improve collective performance of humans in solving networked color coordination games. To provide further analytical insights into the role of behavioral randomness, here we study myopic artificial agents attempt to solve similar network coloring problems using decision update rules that are only based on local information but allow random choices at various stages of their heuristic reasonings. We consider that agents are distributed over a random bipartite network which is guaranteed to be solvable with two colors. Using agent based simulations and theoretical analysis, we show that the resulting efficacy of resolving color conflicts is dependent on the specific implementation of random behavior of agents, including the fraction of noisy agents and at which decision stage noise is introduced. Moreover, behavioral randomness can be finely tuned to the specific underlying population structure such as network size and average network degree in order to produce advantageous results in finding collective coloring solutions. Our work demonstrates that distributed greedy optimization algorithms exploiting local information should be deployed in combination with occasional exploration via random choices in order to overcome local minima and achieve global coordination.


RobustFed A Truth Inference Approach for Robust Federated Learning. Federated learning is a prominent framework that enables clients (e.g., mobile devices or organizations) to train a collaboratively global model under a central server's orchestration while keeping local training datasets' privacy. However, the aggregation step in federated learning is vulnerable to adversarial attacks as the central server cannot manage clients' behavior. Therefore, the global model's performance and convergence of the training process will be affected under such attacks.To mitigate this vulnerability issue, we propose a novel robust aggregation algorithm inspired by the truth inference methods in crowdsourcing via incorporating the worker's reliability into aggregation. We evaluate our solution on three real world datasets with a variety of machine learning models. Experimental results show that our solution ensures robust federated learning and is resilient to various types of attacks, including noisy data attacks, Byzantine attacks, and label flipping attacks.


Real time Monocular Depth Estimation with Sparse Supervision on Mobile. Monocular (relative or metric) depth estimation is a critical task for various applications, such as autonomous vehicles, augmented reality and image editing. In recent years, with the increasing availability of mobile devices, accurate and mobile friendly depth models have gained importance. Increasingly accurate models typically require more computational resources, which inhibits the use of such models on mobile devices. The mobile use case is arguably the most unrestricted one, which requires highly accurate yet mobile friendly architectures. Therefore, we try to answer the following question How can we improve a model without adding further complexity (i.e. parameters)? Towards this end, we systematically explore the design space of a relative depth estimation model from various dimensions and we show, with key design choices and ablation studies, even an existing architecture can reach highly competitive performance to the state of the art, with a fraction of the complexity. Our study spans an in depth backbone model selection process, knowledge distillation, intermediate predictions, model pruning and loss rebalancing. We show that our model, using only DIW as the supervisory dataset, achieves 0.1156 WHDR on DIW with 2.6M parameters and reaches 37 FPS on a mobile GPU, without pruning or hardware specific optimization. A pruned version of our model achieves 0.1208 WHDR on DIW with 1M parameters and reaches 44 FPS on a mobile GPU.


The Maintenance Scheduling and Location Choice Problem for Railway Rolling Stock. Due to increasing railway use, the capacity at railway yards and maintenance locations is becoming limiting. Therefore, the scheduling of rolling stock maintenance and the choice regarding optimal locations to perform maintenance is increasingly complicated. This research introduces a Maintenance Scheduling and Location Choice Problem (MSLCP). It simultaneously determines maintenance locations and maintenance schedules of rolling stock, while it also considers the available capacity of maintenance locations, measured in the number of available teams. To solve the MSLCP, an optimization framework based on Logic Based Benders' Decomposition (LBBD) is proposed by combining two models, the Maintenance Location Choice Problem (MLCP) and the Activity Planning Problem (APP), to assess the capacity of a MLCP solution. Within the LBBD, four cut generation procedures are introduced to improve the computational performance a naive procedure, two heuristic procedures and the so called min cut procedure that aims to exploit the specific characteristics of the problem at hand. The framework is demonstrated on a realistic scenarios from the Dutch railways. It is shown that the best choice for cut generation procedure depends on the objective when aiming to find a good but not necessarily optimal solution, the min cut procedure performs best, whereas when aiming for the optimal solution, one of the heuristic procedures is the preferred option. The techniques used in the current research are new to the current field and offer interesting next research opportunities.


Case Relation Transformer A Crossmodal Language Generation Model for Fetching Instructions. There have been many studies in robotics to improve the communication skills of domestic service robots. Most studies, however, have not fully benefited from recent advances in deep neural networks because the training datasets are not large enough. In this paper, our aim is to augment the datasets based on a crossmodal language generation model. We propose the Case Relation Transformer (CRT), which generates a fetching instruction sentence from an image, such as "Move the blue flip flop to the lower left box." Unlike existing methods, the CRT uses the Transformer to integrate the visual features and geometry features of objects in the image. The CRT can handle the objects because of the Case Relation Block. We conducted comparison experiments and a human evaluation. The experimental results show the CRT outperforms baseline methods.


User Behavior Discovery in the COVID 19 Era through the Sentiment Analysis of User Tweet Texts. The coronavirus disease (COVID 19) outbreak was declared a pandemic in March 2020 and since then it has had a significant effect on all aspects of life. Although we live in an information era, we do not have accurate information about this disease. Online social networks (OSNs) play a vital role in society, especially people who do not have trust in the government would tend to have more confidence in the evidence that is formed by social networks. The advantages of OSNs in the COVID 19 era are clear. For instance, social media enables people to connect with each other without the need for real world face to face social interaction. Social media networks also act as a collective intelligence in the absence of world leadership. Therefore, in this study, considering the phenomenon of information diffusion in OSNs, we focus on the effects of COVID 19 on user sentiment and show the user behavior trend during the early months of the pandemic through mining and analyzing OSN data. Moreover, we propose a data driven model to demonstrate how user sentiment changes over a period of time and how OSNs help us to obtain information on user behavior that is very important for the accurate prediction of future behavior. For this purpose, this study uses tweet texts about COVID 19 and the related network structure to extract significant features, and then presents a model attempting to provide a more comprehensive real picture of current and future conditions.


Giant and bidirectionally tunable thermopower in non aqueous ionogels enabled by selective ion doping. Ionic thermoelectrics show great potential in low grade heat harvesting and thermal sensing owing to their ultrahigh thermopower, low cost and ease in production. However, the lack of effective n type ionic thermoelectric materials seriously hinders their applications. Here, we report giant and bidirectionally tunable thermopowers within an ultrawide range from 23 to 32 mV K 1 at 90 RH in solid ionic liquid based ionogels, rendering it among the best n and p type ionic thermoelectric materials. A novel thermopower regulation strategy through ion doping to selectively induce ion aggregates via strong ion ion interactions is proposed. These charged aggregates are found decisive in modulating the sign and enlarging the magnitude of the thermopower in the ionogels. A prototype wearable device integrated with 12 p n pairs is demonstrated with a total thermopower of 0.358 V K 1 in general indoor conditions, showing promise for ultrasensitive body heat detection.


Improving filling level classification with adversarial training. We investigate the problem of classifying from a single image the level of content in a cup or a drinking glass. This problem is made challenging by several ambiguities caused by transparencies, shape variations and partial occlusions, and by the availability of only small training datasets. In this paper, we tackle this problem with an appropriate strategy for transfer learning. Specifically, we use adversarial training in a generic source dataset and then refine the training with a task specific dataset. We also discuss and experimentally evaluate several training strategies and their combination on a range of container types of the CORSMAL Containers Manipulation dataset. We show that transfer learning with adversarial training in the source domain consistently improves the classification accuracy on the test set and limits the overfitting of the classifier to specific features of the training data.


Global and local bifurcations, three dimensional Henon maps and discrete Lorenz attractors. Lorenz attractors play an important role in the modern theory of dynamical systems. The reason is that they are robust, i.e. preserve their chaotic properties under various kinds of perturbations. This means that such attractors can exist in applied models and be observed in experiments. It is known that discrete Lorenz attractors can appear in local and global bifurcations of multidimensional diffeomorphisms. However, to date, only partial cases were investigated. In this paper bifurcations of homoclinic and heteroclinic cycles with quadratic tangencies of invariant manifolds are studied. A full list of such bifurcations, leading to the appearance of discrete Lorenz attractors is provided. In addition, with help of numerical techniques, it was proved that if one reverses time in the diffeomorphisms described above, the resulting systems also have such attractors. This result is an important step in the systematic studies of chaos and hyperchaos.


Adaptive Gradient Descent Methods for Computing Implied Volatility. In this paper, a new numerical method based on adaptive gradient descent optimizers is provided for computing the implied volatility from the Black Scholes (B S) option pricing model. It is shown that the new method is more accurate than the close form approximation. Compared with the Newton Raphson method, the new method obtains a reliable rate of convergence and tends to be less sensitive to the beginning point.


MarsExplorer Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environments. This paper is an initial endeavor to bridge the gap between powerful Deep Reinforcement Learning methodologies and the problem of exploration coverage of unknown terrains. Within this scope, MarsExplorer, an openai gym compatible environment tailored to exploration coverage of unknown areas, is presented. MarsExplorer translates the original robotics problem into a Reinforcement Learning setup that various off the shelf algorithms can tackle. Any learned policy can be straightforwardly applied to a robotic platform without an elaborate simulation model of the robot's dynamics to apply a different learning adaptation phase. One of its core features is the controllable multi dimensional procedural generation of terrains, which is the key for producing policies with strong generalization capabilities. Four different state of the art RL algorithms (A3C, PPO, Rainbow, and SAC) are trained on the MarsExplorer environment, and a proper evaluation of their results compared to the average human level performance is reported. In the follow up experimental analysis, the effect of the multi dimensional difficulty setting on the learning capabilities of the best performing algorithm (PPO) is analyzed. A milestone result is the generation of an exploration policy that follows the Hilbert curve without providing this information to the environment or rewarding directly or indirectly Hilbert curve like trajectories. The experimental analysis is concluded by evaluating PPO learned policy algorithm side by side with frontier based exploration strategies. A study on the performance curves revealed that PPO based policy was capable of performing adaptive to the unknown terrain sweeping without leaving expensive to revisit areas uncovered, underlying the capability of RL based methodologies to tackle exploration tasks efficiently. The source code can be found at https github.com dimikout3 MarsExplorer.


Systematic design and experimental demonstration of transmission type multiplexed acoustic meta holograms. Acoustic holograms have promising applications in sound field reconstruction, particle manipulation, ultrasonic haptics and therapy. This paper reports on the theoretical, numerical, and experimental investigation of multiplexed acoustic holograms at both audio and ultrasonic frequencies via a rationally designed transmission type acoustic metamaterial. The proposed meta hologram is composed of two Fabry Perot resonant channels per unit cell, which enables the simultaneous modulation of the transmitted amplitude and phase at two desired frequencies. In contrast to conventional acoustic metamaterial based holograms, the design strategy proposed here, provides a new degree of freedom (frequency) that can actively tailor holograms that are otherwise completely passive and hence significantly enhances the information encoded in acoustic metamaterials. To demonstrate the multiplexed acoustic metamaterial, we first show the projection of two different high quality meta holograms at 14 kHz and 17 kHz, with the patterns of the letters, N and S. We then demonstrate two channel ultrasound focusing and annular beams generation for the incident ultrasonic frequencies of 35 kHz and 42.5 kHz. These multiplexed acoustic meta holograms offer a technical advance to tackle the rising challenges in the fields of acoustic metamaterials, architectural acoustics, and medical ultrasound.


Explanation as a process user centric construction of multi level and multi modal explanations. In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and requirements of stakeholders. Explanations must not only suit developers of models, but also domain experts as well as end users. Thus, in order to satisfy different stakeholders, explanation methods need to be combined. While multi modal explanations have been used to make model predictions more transparent, less research has focused on treating explanation as a process, where users can ask for information according to the level of understanding gained at a certain point in time. Consequently, an opportunity to explore explanations on different levels of abstraction should be provided besides multi modal explanations. We present a process based approach that combines multi level and multi modal explanations. The user can ask for textual explanations or visualizations through conversational interaction in a drill down manner. We use Inductive Logic Programming, an interpretable machine learning approach, to learn a comprehensible model. Further, we present an algorithm that creates an explanatory tree for each example for which a classifier decision is to be explained. The explanatory tree can be navigated by the user to get answers of different levels of detail. We provide a proof of concept implementation for concepts induced from a semantic net about living beings.


Cylindric plane partitions, Lambda determinants, Commutants in semicircular systems. This thesis is divided into three parts. The first part deals with cylindric plane partitions. The second with lambda determinants and the third with commutators in semi circular systems. For more detailed abstract please see inside. Cylindric plane partitions may be thought of as a natural generalization of reverse plane partitions. A generating series for the enumeration of cylindric plane partitions was recently given by Borodin. The first result of section one is a new bijective proof of Borodin's identity which makes use of Fomin's growth diagram framework for generalized RSK correspondences. The second result is a (q,t) analog of Borodin's identity which extends previous work by Okada in the reverse plane partition case. The third result is an explicit combinatorial interpretation of the Macdonald weight occurring in the (q,t) analog using the non intersecting lattice path model for cylindric plane partitions. Alternating sign matrices were discovered by Robbins and Rumsey whilst studying emph lambda determinants . In the second part of this thesis we prove a multi parameter generalization of the lambda determinant, generalizing a recent result by di Francesco. Like the original lambda determinant, our formula exhibits the emph Laurent phenomenon . Semicircular systems were first introduced by Voiculescu as a part of his study of von Neumann algebras. In the third part of this thesis we study certain commutator subalgebras of the semicircular system. We find a projection matrix with an interesting self similar structure. Making use of our projection formula we given an alternative, elementary proof that the semicircular system is a factor.


Property Aware Robot Object Manipulation a Generative Approach. When transporting an object, we unconsciously adapt our movement to its properties, for instance by slowing down when the item is fragile. The most relevant features of an object are immediately revealed to a human observer by the way the handling occurs, without any need for verbal description. It would greatly facilitate collaboration to enable humanoid robots to perform movements that convey similar intuitive cues to the observers. In this work, we focus on how to generate robot motion adapted to the hidden properties of the manipulated objects, such as their weight and fragility. We explore the possibility of leveraging Generative Adversarial Networks to synthesize new actions coherent with the properties of the object. The use of a generative approach allows us to create new and consistent motion patterns, without the need of collecting a large number of recorded human led demonstrations. Besides, the informative content of the actions is preserved. Our results show that Generative Adversarial Nets can be a powerful tool for the generation of novel and meaningful transportation actions, which result effectively modulated as a function of the object weight and the carefulness required in its handling.


Deep Learning Chromatic and Clique Numbers of Graphs. Deep neural networks have been applied to a wide range of problems across different application domains with great success. Recently, research into combinatorial optimization problems in particular has generated much interest in the machine learning community. In this work, we develop deep learning models to predict the chromatic number and maximum clique size of graphs, both of which represent classical NP complete combinatorial optimization problems encountered in graph theory. The neural networks are trained using the most basic representation of the graph, the adjacency matrix, as opposed to undergoing complex domain specific feature engineering. The experimental results show that deep neural networks, and in particular convolutional neural networks, obtain strong performance on this problem.


Everything is Relative Understanding Fairness with Optimal Transport. To study discrimination in automated decision making systems, scholars have proposed several definitions of fairness, each expressing a different fair ideal. These definitions require practitioners to make complex decisions regarding which notion to employ and are often difficult to use in practice since they make a binary judgement a system is fair or unfair instead of explaining the structure of the detected unfairness. We present an optimal transport based approach to fairness that offers an interpretable and quantifiable exploration of bias and its structure by comparing a pair of outcomes to one another. In this work, we use the optimal transport map to examine individual, subgroup, and group fairness. Our framework is able to recover well known examples of algorithmic discrimination, detect unfairness when other metrics fail, and explore recourse opportunities.


SAR Net A Scenario Aware Ranking Network for Personalized Fair Recommendation in Hundreds of Travel Scenarios. The travel marketing platform of Alibaba serves an indispensable role for hundreds of different travel scenarios from Fliggy, Taobao, Alipay apps, etc. To provide personalized recommendation service for users visiting different scenarios, there are two critical issues to be carefully addressed. First, since the traffic characteristics of different scenarios, it is very challenging to train a unified model to serve all. Second, during the promotion period, the exposure of some specific items will be re weighted due to manual intervention, resulting in biased logs, which will degrade the ranking model trained using these biased data. In this paper, we propose a novel Scenario Aware Ranking Network (SAR Net) to address these issues. SAR Net harvests the abundant data from different scenarios by learning users' cross scenario interests via two specific attention modules, which leverage the scenario features and item features to modulate the user behavior features, respectively. Then, taking the encoded features of previous module as input, a scenario specific linear transformation layer is adopted to further extract scenario specific features, followed by two groups of debias expert networks, i.e., scenario specific experts and scenario shared experts. They output intermediate results independently, which are further fused into the final result by a multi scenario gating module. In addition, to mitigate the data fairness issue caused by manual intervention, we propose the concept of Fairness Coefficient (FC) to measures the importance of individual sample and use it to reweigh the prediction in the debias expert networks. Experiments on an offline dataset covering over 80 million users and 1.55 million travel items and an online A B test demonstrate the effectiveness of our SAR Net and its superiority over state of the art methods.


Distance one surgeries on the lens space L(n,1) . In this paper, we show that the lens space L(s,1) for s neq 0 is obtained by a distance one surgery along a knot in the lens space L(n,1) with n geq 5 odd only if n and s satisfy one of the following cases (1) n geq 5 is any odd integer and s pm 1, n, n pm 1 or n pm 4 (2) n 5 and s 5 (3) n 5 and s 9 (4) n 9 and s 5 . As a corollary, we prove that the torus link T(2,s) for s neq 0 is obtained by a band surgery from T(2,n) with n geq 5 odd only if n and s are as listed above. Combined with the result of Lidman, Moore and Vazquez, it immediately follows that the only nontrivial torus knot T(2,n) admitting chirally cosmetic banding is T(2,5) . The key ingredient of our proof is the Heegaard Floer mapping cone formula.


Primitive elements and k th powers in finite fields. Let mathbb F q be the finite field of q elements, and let k mid q 1 be a positive integer. Let f(x) ax 2 bx c be a quadratic polynomial in mathbb F q x with b 2 4ac ne0 . In this paper, we show that if q max e e 3 ,(2k) 6 , then there is a primitive element g of mathbb F q such that f(g) in mathbb F q times k x k x in mathbb F q setminus 0 . Moreover, we shall confirm a conjecture posed by Sun.


Efficient Wind Speed Nowcasting with GPU Accelerated Nearest Neighbors Algorithm. This paper proposes a simple yet efficient high altitude wind nowcasting pipeline. It processes efficiently a vast amount of live data recorded by airplanes over the whole airspace and reconstructs the wind field with good accuracy. It creates a unique context for each point in the dataset and then extrapolates from it. As creating such context is computationally intensive, this paper proposes a novel algorithm that reduces the time and memory cost by efficiently fetching nearest neighbors in a data set whose elements are organized along smooth trajectories that can be approximated with piece wise linear structures. We introduce an efficient and exact strategy implemented through algebraic tensorial operations, which is well suited to modern GPU based computing infrastructure. This method employs a scalable Euclidean metric and allows masking data points along one dimension. When applied, this method is more efficient than plain Euclidean k NN and other well known data selection methods such as KDTrees and provides a several fold speedup. We provide an implementation in PyTorch and a novel data set to allow the replication of empirical results.


Deeper Learning with CoLU Activation. In neural networks, non linearity is introduced by activation functions. One commonly used activation function is Rectified Linear Unit (ReLU). ReLU has been a popular choice as an activation but has flaws. State of the art functions like Swish and Mish are now gaining attention as a better choice as they combat many flaws presented by other activation functions. CoLU is an activation function similar to Swish and Mish in properties. It is defined as f(x) x (1 xe (x e x)). It is smooth, continuously differentiable, unbounded above, bounded below, non saturating, and non monotonic. Based on experiments done with CoLU with different activation functions, it is observed that CoLU usually performs better than other functions on deeper neural networks. While training different neural networks on MNIST on an incrementally increasing number of convolutional layers, CoLU retained the highest accuracy for more layers. On a smaller network with 8 convolutional layers, CoLU had the highest mean accuracy, closely followed by ReLU. On VGG 13 trained on Fashion MNIST, CoLU had a 4.20 higher accuracy than Mish and 3.31 higher accuracy than ReLU. On ResNet 9 trained on Cifar 10, CoLU had 0.05 higher accuracy than Swish, 0.09 higher accuracy than Mish, and 0.29 higher accuracy than ReLU. It is observed that activation functions may behave better than other activation functions based on different factors including the number of layers, types of layers, number of parameters, learning rate, optimizer, etc. Further research can be done on these factors and activation functions for more optimal activation functions and more knowledge on their behavior.


Graph Neural Pre training for Enhancing Recommendations using Side Information. Leveraging the side information associated with entities (i.e. users and items) to enhance the performance of recommendation systems has been widely recognized as an important modelling dimension. While many existing approaches focus on the integration scheme to incorporate entity side information by combining the recommendation loss function with an extra side information aware loss in this paper, we propose instead a novel pre training scheme for leveraging the side information. In particular, we first pre train a representation model using the side information of the entities, and then fine tune it using an existing general representation based recommendation model. Specifically, we propose two pre training models, named GCN P and COM P, by considering the entities and their relations constructed from side information as two different types of graphs respectively, to pre train entity embeddings. For the GCN P model, two single relational graphs are constructed from all the users' and items' side information respectively, to pre train entity representations by using the Graph Convolutional Networks. For the COM P model, two multi relational graphs are constructed to pre train the entity representations by using the Composition based Graph Convolutional Networks. An extensive evaluation of our pre training models fine tuned under four general representation based recommender models, i.e. MF, NCF, NGCF and LightGCN, shows that effectively pre training embeddings with both the user's and item's side information can significantly improve these original models in terms of both effectiveness and stability.


Building Goal Oriented Dialogue Systems with Situated Visual Context. Most popular goal oriented dialogue agents are capable of understanding the conversational context. However, with the surge of virtual assistants with screen, the next generation of agents are required to also understand screen context in order to provide a proper interactive experience, and better understand users' goals. In this paper, we propose a novel multimodal conversational framework, where the dialogue agent's next action and their arguments are derived jointly conditioned both on the conversational and the visual context. Specifically, we propose a new model, that can reason over the visual context within a conversation and populate API arguments with visual entities given the user query. Our model can recognize visual features such as color and shape as well as the metadata based features such as price or star rating associated with a visual entity. In order to train our model, due to a lack of suitable multimodal conversational datasets, we also propose a novel multimodal dialog simulator to generate synthetic data and also collect realistic user data from MTurk to improve model robustness. The proposed model achieves a reasonable 85 model accuracy, without high inference latency. We also demonstrate the proposed approach in a prototypical furniture shopping experience for a multimodal virtual assistant.


Serrin type regularity criteria for the 3D MHD equations via one velocity component and one magnetic component. In this paper, we consider the Cauchy problem to the 3D MHD equations. We show that the Serrin type conditions imposed on one component of the velocity u 3 and one component of magnetic fields b 3 with u 3 in L p 0 ,1 ( 1,0 L q 0 (B(2))), b 3 in L p 1 ,1 ( 1,0 L q 1 (B(2))), frac 2 p 0 frac 3 q 0 frac 2 p 1 frac 3 q 1 1 and 3 q 0 ,q 1 infty imply that the suitable weak solution is regular at (0,0) . The proof is based on the new local energy estimates introduced by Chae Wolf (Arch. Ration. Mech. Anal. 2021) and Wang Wu Zhang (arXiv 2005.11906).


Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attacks. Although the adoption rate of deep neural networks (DNNs) has tremendously increased in recent years, a solution for their vulnerability against adversarial examples has not yet been found. As a result, substantial research efforts are dedicated to fix this weakness, with many studies typically using a subset of source images to generate adversarial examples, treating every image in this subset as equal. We demonstrate that, in fact, not every source image is equally suited for this kind of assessment. To do so, we devise a large scale model to model transferability scenario for which we meticulously analyze the properties of adversarial examples, generated from every suitable source image in ImageNet by making use of three of the most frequently deployed attacks. In this transferability scenario, which involves seven distinct DNN models, including the recently proposed vision transformers, we reveal that it is possible to have a difference of up to 12.5 in model to model transferability success, 1.01 in average L 2 perturbation, and 0.03 ( 8 225 ) in average L infty perturbation when 1,000 source images are sampled randomly among all suitable candidates. We then take one of the first steps in evaluating the robustness of images used to create adversarial examples, proposing a number of simple but effective methods to identify unsuitable source images, thus making it possible to mitigate extreme cases in experimentation and support high quality benchmarking.


Almost proximal extensions of minimal flows. In this paper we study almost proximal extensions of minimal flows. Let pi (X,T) rightarrow (Y,T) be an extension of minimal flows. pi is called an almost proximal extension if there is some N in mathbb N such that the cardinality of any almost periodic subset in each fiber is not greater than N . When N 1 , pi is proximal. We will give the structure of pi and give a dichotomy theorem any almost proximal extension of minimal flows is either almost finite to one, or almost all fibers contain an uncountable strongly scrambled subset. Using category method Glasner and Weiss showed the existence of proximal but not almost one to one extensions 18 . In this paper, we will give explicit such examples, and also examples of almost proximal but not almost finite to one extensions.


GhostMinion A Strictness Ordered Cache System for Spectre Mitigation. Out of order speculation, a technique ubiquitous since the early 1990s, remains a fundamental security flaw. Via attacks such as Spectre and Meltdown, an attacker can trick a victim, in an otherwise entirely correct program, into leaking its secrets through the effects of misspeculated execution, in a way that is entirely invisible to the programmer's model. This has serious implications for application sandboxing and inter process communication. Designing efficient mitigations, that preserve the performance of out of order execution, has been a challenge. The speculation hiding techniques in the literature have been shown to not close such channels comprehensively, allowing adversaries to redesign attacks. Strong, precise guarantees are necessary, but at the same time mitigations must achieve high performance to be adopted. We present Strictness Ordering, a new constraint system that shows how we can comprehensively eliminate transient side channel attacks, while still allowing complex speculation and data forwarding between speculative instructions. We then present GhostMinion, a cache modification built using a variety of new techniques designed to provide Strictness Order at only 2.5 overhead.


Critical parameters for singular perturbation reductions of chemical reaction networks. We are concerned with polynomial ordinary differential systems that arise from modelling chemical reaction networks. For such systems, which may be of high dimension and may depend on many parameters, it is frequently of interest to obtain a reduction of dimension in certain parameter ranges. Singular perturbation theory, as initiated by Tikhonov and Fenichel, provides a path toward such reductions. In the present paper we discuss parameter values that lead to singular perturbation reductions (so called Tikhonov Fenichel parameter values, or TFPVs). An algorithmic approach is known, but it is feasible for small dimensions only. Here we characterize conditions for classes of reaction networks for which TFPVs arise by turning off reactions (by setting rate parameters to zero), or by removing certain species (which relates to the classical quasi steady state approach to model reduction). In particular, we obtain definitive results for the class of complex balanced reaction networks (of deficiency zero) and first order reaction networks.


The Pieri formulas for hook type Schur multiple zeta functions. We study the Pieri type formulas for the Schur multiple zeta functions along with those for the Schur polynomials. To formulate these formulas, we introduce a new insertion rule for adding boxes in the Young tableaux and obtain the results for the hook type Schur multiple zeta functions. For the proof, we show certain extended Jacobi Trudi formulas for the Schur multiple zeta functions.


Bad Characters Imperceptible NLP Attacks. Several years of research have shown that machine learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and machine perception. Although text based models have also been attacked with adversarial examples, such attacks struggled to preserve semantic meaning and indistinguishability. In this paper, we explore a large class of adversarial examples that can be used to attack text based models in a black box setting without making any human perceptible visual modification to inputs. We use encoding specific perturbations that are imperceptible to the human eye to manipulate the outputs of a wide range of Natural Language Processing (NLP) systems from neural machine translation pipelines to web search engines. We find that with a single imperceptible encoding injection representing one invisible character, homoglyph, reordering, or deletion an attacker can significantly reduce the performance of vulnerable models, and with three injections most models can be functionally broken. Our attacks work against currently deployed commercial systems, including those produced by Microsoft and Google, in addition to open source models published by Facebook, IBM, and HuggingFace. This novel series of attacks presents a significant threat to many language processing systems an attacker can affect systems in a targeted manner without any assumptions about the underlying model. We conclude that text based NLP systems require careful input sanitization, just like conventional applications, and that given such systems are now being deployed rapidly at scale, the urgent attention of architects and operators is required.


Unified and Multilingual Author Profiling for Detecting Haters. This paper presents a unified user profiling framework to identify hate speech spreaders by processing their tweets regardless of the language. The framework encodes the tweets with sentence transformers and applies an attention mechanism to select important tweets for learning user profiles. Furthermore, the attention layer helps to explain why a user is a hate speech spreader by producing attention weights at both token and post level. Our proposed model outperformed the state of the art multilingual transformer models.


End to end grasping policies for human in the loop robots via deep reinforcement learning. State of the art human in the loop robot grasping is hugely suffered by Electromyography (EMG) inference robustness issues. As a workaround, researchers have been looking into integrating EMG with other signals, often in an ad hoc manner. In this paper, we are presenting a method for end to end training of a policy for human in the loop robot grasping on real reaching trajectories. For this purpose we use Reinforcement Learning (RL) and Imitation Learning (IL) in DEXTRON (DEXTerity enviRONment), a stochastic simulation environment with real human trajectories that are augmented and selected using a Monte Carlo (MC) simulation method. We also offer a success model which once trained on the expert policy data and the RL policy roll out transitions, can provide transparency to how the deep policy works and when it is probably going to fail.


Human Pose Transfer with Augmented Disentangled Feature Consistency. Deep generative models have made great progress in synthesizing images with arbitrary human poses and transferring poses of one person to others. Though many different methods have been proposed to generate images with high visual fidelity, the main challenge remains and comes from two fundamental issues pose ambiguity and appearance inconsistency. To alleviate the current limitations and improve the quality of the synthesized images, we propose a pose transfer network with augmented Disentangled Feature Consistency (DFC Net) to facilitate human pose transfer. Given a pair of images containing the source and target person, DFC Net extracts pose and static information from the source and target respectively, then synthesizes an image of the target person with the desired pose from the source. Moreover, DFC Net leverages disentangled feature consistency losses in the adversarial training to strengthen the transfer coherence and integrates a keypoint amplifier to enhance the pose feature extraction. With the help of the disentangled feature consistency losses, we further propose a novel data augmentation scheme that introduces unpaired support data with the augmented consistency constraints to improve the generality and robustness of DFC Net. Extensive experimental results on Mixamo Pose and EDN 10k have demonstrated DFC Net achieves state of the art performance on pose transfer.


Learning the tuned liquid damper dynamics by means of a robust EKF. The tuned liquid dampers (TLD) technology is a feasible and cost effective seismic design. In order to improve its efficiency it is fundamental to find accurate models describing their dynamic. A TLD system can be modeled through the Housner model and its parameters can be estimated by solving a nonlinear state estimation problem. We propose a robust extended Kalman filter which alleviates the model discretization and the fact that the noise process is not known. We test the effectiveness of the proposed approach by using some experimental data corresponding to two classical seismic waves, namely the El Centro wave and the Hachinohe wave.


Conformal upper bounds for the volume spectrum. In this paper, we prove upper bounds for the volume spectrum of a Riemannian manifold that depend only on the volume, dimension and a conformal invariant.


Leaf Recognition Using Convolutional Neural Networks Based Features. There is a warning light for the loss of plant habitats worldwide that entails concerted efforts to conserve plant biodiversity. Thus, plant species classification is of crucial importance to address this environmental challenge. In recent years, there is a considerable increase in the number of studies related to plant taxonomy. While some researchers try to improve their recognition performance using novel approaches, others concentrate on computational optimization for their framework. In addition, a few studies are diving into feature extraction to gain significantly in terms of accuracy. In this paper, we propose an effective method for the leaf recognition problem. In our proposed approach, a leaf goes through some pre processing to extract its refined color image, vein image, xy projection histogram, handcrafted shape, texture features, and Fourier descriptors. These attributes are then transformed into a better representation by neural network based encoders before a support vector machine (SVM) model is utilized to classify different leaves. Overall, our approach performs a state of the art result on the Flavia leaf dataset, achieving the accuracy of 99.58 on test sets under random 10 fold cross validation and bypassing the previous methods. We also release our codes (Scripts are available at https github.com dinhvietcuong1996 LeafRecognition) for contributing to the research community in the leaf classification problem.


Sylow branching coefficients and a conjecture of Malle and Navarro. We prove that a finite group G has a normal Sylow p subgroup P if, and only if, every irreducible character of G appearing in the permutation character ( bf 1 P) G with multiplicity coprime to p has degree coprime to p . This confirms a prediction by Malle and Navarro from 2012. Our proof of the above result depends on a reduction to simple groups and ultimately on a combinatorial analysis of the properties of Sylow branching coefficients for symmetric groups.


CoMPS Continual Meta Policy Search. We develop a new continual meta learning method to address challenges in sequential multi task learning. In this setting, the agent's goal is to achieve high reward over any sequence of tasks quickly. Prior meta reinforcement learning algorithms have demonstrated promising results in accelerating the acquisition of new tasks. However, they require access to all tasks during training. Beyond simply transferring past experience to new tasks, our goal is to devise continual reinforcement learning algorithms that learn to learn, using their experience on previous tasks to learn new tasks more quickly. We introduce a new method, continual meta policy search (CoMPS), that removes this limitation by meta training in an incremental fashion, over each task in a sequence, without revisiting prior tasks. CoMPS continuously repeats two subroutines learning a new task using RL and using the experience from RL to perform completely offline meta learning to prepare for subsequent task learning. We find that CoMPS outperforms prior continual learning and off policy meta reinforcement methods on several sequences of challenging continuous control tasks.


Slow entropy for some Anosov Katok diffeomorphisms. The Anosov Katok method is one of the most powerful tools of constructing smooth volume preserving diffeomorphisms of entropy zero with prescribed ergodic or topological properties. To measure the complexity of systems with entropy zero, invariants like slow entropy have been introduced. In this article we develop several mechanisms facilitating computation of topological and measure theoretic slow entropy of Anosov Katok diffeomorphisms.


Projective Manifold Gradient Layer for Deep Rotation Regression. Regressing rotations on SO(3) manifold using deep neural networks is an important yet unsolved problem. The gap between the Euclidean network output space and the non Euclidean SO(3) manifold imposes a severe challenge for neural network learning in both forward and backward passes. While several works have proposed different regression friendly rotation representations, very few works have been devoted to improving the gradient backpropagating in the backward pass. In this paper, we propose a manifold aware gradient that directly backpropagates into deep network weights. Leveraging Riemannian optimization to construct a novel projective gradient, our proposed regularized projective manifold gradient (RPMG) method helps networks achieve new state of the art performance in a variety of rotation estimation tasks. Our proposed gradient layer can also be applied to other smooth manifolds such as the unit sphere. Our project page is at https jychen18.github.io RPMG.


Reachability of Nonlinear Systems with Unknown Dynamics. Determining the reachable set for a given nonlinear control system is crucial for system control and planning. However, computing such a set is impossible if the system's dynamics are not fully known. This paper is motivated by a scenario where a system suffers an adverse event mid operation, resulting in a substantial change to the system's dynamics, rendering them largely unknown. Our objective is to conservatively approximate the system's reachable set solely from its local dynamics at a single point and the bounds on the rate of change of its dynamics. We translate this knowledge about the system dynamics into an ordinary differential inclusion. We then derive a conservative approximation of the velocities available to the system at every system state. An inclusion using this approximation can be interpreted as a control system the trajectories of the derived control system are guaranteed to be trajectories of the unknown system. To illustrate the practical implementation and consequences of our work, we apply our algorithm to a simplified model of an unmanned aerial vehicle.


On Shafarevich Tate groups and analytic ranks in families of modular forms, II. Coleman families. This is the second article in a two part project whose aim is to study algebraic and analytic ranks in p adic families of modular forms. Let f be a newform of weight 2 , square free level N and trivial character, let A f be the abelian variety attached to f , whose dimension will be denoted by d f , and for every prime number p nmid N at which f has finite slope let boldsymbol f (p) be a p adic Coleman family through f over a suitable open disc in the p adic weight space. We prove that, for all but finitely many primes p as above, if A f( mathbb Q) has rank r in 0,d f and the p primary part of the Shafarevich Tate group of A f over mathbb Q is finite, then all classical specializations of boldsymbol f (p) of weight congruent to 2 modulo 2(p 1) and trivial character have finite p primary Shafarevich Tate group and r d f dimensional image of the relevant p adic 'etale Abel Jacobi map. As a second contribution, assuming the non degeneracy of certain height pairings a la Gillet Soul 'e between Heegner cycles, we show that, for all but finitely many p , if f has analytic rank r in 0,1 , then all classical specializations of boldsymbol f (p) of weight congruent to 2 modulo 2(p 1) and trivial character have analytic rank r . This result provides some evidence for a conjecture of Greenberg on analytic ranks in families of modular forms.


Non negative divisors and the Grauert metric. Grauert showed that it is possible to construct complete K " a hler metrics on the complement of complex analytic sets in a domain of holomorphy. In this note, we study the holomorphic sectional curvatures of such metrics on the complement of a principal divisor in mathbb C n , n ge 1 . In addition, we also study how this metric and its holomorphic sectional curvature behaves when the corresponding principal divisors vary continuously.


Anchor Distance for 3D Multi Object Distance Estimation from 2D Single Shot. Visual perception of the objects in a 3D environment is a key to successful performance in autonomous driving and simultaneous localization and mapping (SLAM). In this paper, we present a real time approach for estimating the distances to multiple objects in a scene using only a single shot image. Given a 2D Bounding Box (BBox) and object parameters, a 3D distance to the object can be calculated directly using 3D reprojection however, such methods are prone to significant errors because an error from the 2D detection can be amplified in 3D. In addition, it is also challenging to apply such methods to a real time system due to the computational burden. In the case of the traditional multi object detection methods, they mostly pay attention to existing works have been developed for specific tasks such as object segmentation or 2D BBox regression. These methods introduce the concept of anchor BBox for elaborate 2D BBox estimation, and predictors are specialized and trained for specific 2D BBoxes. In order to estimate the distances to the 3D objects from a single 2D image, we introduce the notion of textit anchor distance based on an object's location and propose a method that applies the anchor distance to the multi object detector structure. We let the predictors catch the distance prior using anchor distance and train the network based on the distance. The predictors can be characterized to the objects located in a specific distance range. By propagating the distance prior using a distance anchor to the predictors, it is feasible to perform the precise distance estimation and real time execution simultaneously. The proposed method achieves about 30 FPS speed, and shows the lowest RMSE compared to the existing methods.


Clark representation formula for the solution to equation with interaction. In this paper Clark Ocone representation for solution to measure valued equation with interaction is studied. It is proven that the integrand is absolutely continuous with respect to Lebesgue measure.


Ergodic dynamical systems over the Cartesian power of the ring of p adic integers. For any 1 lipschitz ergodic map F mathbb Z k p mapsto mathbb Z k p , k 1 in mathbb N , there are 1 lipschitz ergodic map G mathbb Z p mapsto mathbb Z p and two bijection H k , T k, P that G H k circ T k, P circ F circ H 1 k text and F H 1 k circ T k, P 1 circ G circ H k .


Cleaning Dirty Books Post OCR Processing for Previously Scanned Texts. Substantial amounts of work are required to clean large collections of digitized books for NLP analysis, both because of the presence of errors in the scanned text and the presence of duplicate volumes in the corpora. In this paper, we consider the issue of deduplication in the presence of optical character recognition (OCR) errors. We present methods to handle these errors, evaluated on a collection of 19,347 texts from the Project Gutenberg dataset and 96,635 texts from the HathiTrust Library. We demonstrate that improvements in language models now enable the detection and correction of OCR errors without consideration of the scanning image itself. The inconsistencies found by aligning pairs of scans of the same underlying work provides training data to build models for detecting and correcting errors. We identify the canonical version for each of 17,136 repeatedly scanned books from 58,808 scans. Finally, we investigate methods to detect and correct errors in single copy texts. We show that on average, our method corrects over six times as many errors as it introduces. We also provide interesting analysis on the relation between scanning quality and other factors such as location and publication year.


Asymptotic expansion of the Dulac map and time for unfoldings of hyperbolic saddles Coefficient properties. We consider a mathscr C infty family of planar vector fields X hat mu hat mu in hat W having a hyperbolic saddle and we study the Dulac map D(s hat mu) and the Dulac time T(s hat mu) from a transverse section at the stable separatrix to a transverse section at the unstable separatrix, both at arbitrary distance from the saddle. Since the hyperbolicity ratio lambda of the saddle plays an important role, we consider it as an independent parameter, so that hat mu ( lambda, mu) in hat W (0, infty) times W , where W is an open subset of mathbb R N. For each hat mu 0 in hat W and L 0 , the functions D(s hat mu) and T(s hat mu) have an asymptotic expansion at s 0 and hat mu approx hat mu 0 with the remainder being uniformly L flat with respect to the parameters. The principal part of both asymptotic expansions is given in a monomial scale containing a deformation of the logarithm, the so called Ecalle Roussarie compensator. In this paper we are interested in the coefficients of these monomials, which are functions depending on hat mu that can be shown to be mathscr C infty in their respective domains and "universally" defined, meaning that their existence is stablished before fixing the flatness L and the unfolded parameter hat mu 0. Each coefficient has its own domain and it is of the form ((0, infty) setminus D) times W , where D a discrete set of rational numbers at which a resonance of the hyperbolicity ratio lambda occurs. In our main result we give the explicit expression of some of these coefficients and to this end a fundamental tool is the employment of a sort of incomplete Mellin transform. With regard to these coefficients we also prove that they have poles of order at most two at D times W and we give the corresponding residue, that plays an important role when compensators appear in the principal part.


Universal Representation Learning from Multiple Domains for Few shot Classification. In this paper, we look at the problem of few shot classification that aims to learn a classifier for previously unseen classes and domains from few labeled samples. Recent methods use adaptation networks for aligning their features to new domains or select the relevant features from multiple domain specific feature extractors. In this work, we propose to learn a single set of universal deep representations by distilling knowledge of multiple separately trained networks after co aligning their features with the help of adapters and centered kernel alignment. We show that the universal representations can be further refined for previously unseen domains by an efficient adaptation step in a similar spirit to distance learning methods. We rigorously evaluate our model in the recent Meta Dataset benchmark and demonstrate that it significantly outperforms the previous methods while being more efficient. Our code will be available at https github.com VICO UoE URL.


Reducing the Paging Overhead in Highly Directional Systems. New Radio (NR) supports operations at high frequency bands (e.g., millimeter wave frequencies) by using narrow beam based directional transmissions to compensate high propagation losses at such frequencies. Due to the limited spatial coverage with each beam, the broadcast transmission of paging in NR is performed using beam sweeping, which takes multiple time slots. Thus, the paging procedure used in NR would substantially increase the downlink resource overhead of the network with directional transmissions. Such overhead would further increase as we move higher in the frequency bands, such as terahertz bands, which is being viewed as one of the potential candidates for future generation networks. Therefore, the NR based paging solution is infeasible for supporting highly directional systems. In this paper, we propose a novel minimal feedback enabled paging mechanism, which instead of using all the beams for paging transmissions, only activates sub set of beams having one or more UEs under the coverage. UE presence indications are implemented to identify the correct set of beams to be activated. Our analytical analysis and simulations show that the proposed solution significantly reduces the downlink paging overhead compared to the NR based solution (e.g., more than 80 gain for a system supporting 64 number of beams at a UE density of 200 UEs per paging occasion) while incurring minimal energy cost at the UE side.


What Makes a Scientific Paper be Accepted for Publication?. Despite peer reviewing being an essential component of academia since the 1600s, it has repeatedly received criticisms for lack of transparency and consistency. We posit that recent work in machine learning and explainable AI provide tools that enable insights into the decisions from a given peer review process. We start by extracting global explanations in the form of linguistic features that affect the acceptance of a scientific paper for publication on an open peer review dataset. Second, since such global explanations do not justify causal interpretations, we provide a methodology for detecting confounding effects in natural language in order to generate causal explanations, under assumptions, in the form of lexicons. Our proposed linguistic explanation methodology indicates the following on a case dataset of ICLR submissions a) the organising committee follows, for the most part, the recommendations of reviewers, and, b) the paper's main characteristics that led to reviewers recommending acceptance for publication are originality, clarity and substance.


Material separating regularizer for multi energy X ray tomography. Dual energy X ray tomography is considered in a context where the target under imaging consists of two distinct materials. The materials are assumed to be possibly intertwined in space, but at any given location there is only one material present. Further, two X ray energies are chosen so that there is a clear difference in the spectral dependence of the attenuation coefficients of the two materials. A novel regularizer is presented for the inverse problem of reconstructing separate tomographic images for the two materials. A combination of two things, (a) non negativity constraint, and (b) penalty term containing the inner product between the two material images, promotes the presence of at most one material in a given pixel. A preconditioned interior point method is derived for the minimization of the regularization functional. Numerical tests with digital phantoms suggest that the new algorithm outperforms the baseline method, Joint Total Variation regularization, in terms of correctly material characterized pixels. While the method is tested only in a two dimensional setting with two materials and two energies, the approach readily generalizes to three dimensions and more materials. The number of materials just needs to match the number of energies used in imaging.


Face reduction and the immobile indices approaches to regularization of linear Copositive Programming problems. The paper is devoted to the regularization of linear Copositive Programming problems which consists of transforming a problem to an equivalent form, where the Slater condition is satisfied and the strong duality holds. We describe here two regularization algorithms based on the concept of immobile indices and an understanding of the important role these indices play in the feasible sets' characterization. These algorithms are compared to some regularization procedures developed for a more general case of convex problems and based on a facial reduction approach. We show that the immobile index based approach combined with the specifics of copositive problems allows us to construct more explicit and detailed regularization algorithms for linear Copositive Programming problems than those already available.


Geometry Aware Hierarchical Bayesian Learning on Manifolds. Bayesian learning with Gaussian processes demonstrates encouraging regression and classification performances in solving computer vision tasks. However, Bayesian methods on 3D manifold valued vision data, such as meshes and point clouds, are seldom studied. One of the primary challenges is how to effectively and efficiently aggregate geometric features from the irregular inputs. In this paper, we propose a hierarchical Bayesian learning model to address this challenge. We initially introduce a kernel with the properties of geometry awareness and intra kernel convolution. This enables geometrically reasonable inferences on manifolds without using any specific hand crafted feature descriptors. Then, we use a Gaussian process regression to organize the inputs and finally implement a hierarchical Bayesian network for the feature aggregation. Furthermore, we incorporate the feature learning of neural networks with the feature aggregation of Bayesian models to investigate the feasibility of jointly learning on manifolds. Experimental results not only show that our method outperforms existing Bayesian methods on manifolds but also demonstrate the prospect of coupling neural networks with Bayesian networks.


Optical bistable SOI micro ring resonators for memory applications. The present work focuses on experimental investigations of a bistabile silicon on insulator (SOI) micro ring resonator (MRR). The resonator exploits a continuous wave operation of the carrier induced bistability demonstrating a stable hysteresis response at the through and drop ports when the input power exceeds the threshold value. Flipping the optical input power provides a convenient mechanism for a switching of the MRR output characteristics between two steady states having a long holding time. The transition of the resonator output between these states is experimentally investigated. It is shown that the switching speed is limited by a low to high transition of 188 ns. Obtained results shows an application of the passive SOI MRR as an all optical memory cell with two complementary outputs.


Distributed Swarm Collision Avoidance Based on Angular Calculations. Collision avoidance is one of the most important topics in the robotics field. The goal is to move the robots from initial locations to target locations such that they follow shortest non colliding paths in the shortest time and with the least amount of energy. In this paper, a distributed and real time algorithm for dense and complex 2D and 3D environments is proposed. This algorithm uses angular calculations to select the optimal direction for the movement of each robot and it has been shown that these separate calculations lead to a form of cooperative behavior among agents. We evaluated the proposed approach on various simulation and experimental scenarios and compared the results with FMP and ORCA, two important algorithms in this field. The results show that the proposed approach is at least 25 faster than ORCA and at least 7 faster than FMP and also more reliable than both methods. The proposed method is shown to enable fully autonomous navigation of a swarm of crazyflies.


Adaptively Multi view and Temporal Fusing Transformer for 3D Human Pose Estimation. In practical application, 3D Human Pose Estimation (HPE) is facing with several variable elements, involving the number of views, the length of the video sequence, and whether using camera calibration. To this end, we propose a unified framework named Multi view and Temporal Fusing Transformer (MTF Transformer) to adaptively handle varying view numbers and video length without calibration. MTF Transformer consists of Feature Extractor, Multi view Fusing Transformer (MFT), and Temporal Fusing Transformer (TFT). Feature Extractor estimates the 2D pose from each image and encodes the predicted coordinates and confidence into feature embedding for further 3D pose inference. It discards the image features and focuses on lifting the 2D pose into the 3D pose, making the subsequent modules computationally lightweight enough to handle videos. MFT fuses the features of a varying number of views with a relative attention block. It adaptively measures the implicit relationship between each pair of views and reconstructs the features. TFT aggregates the features of the whole sequence and predicts 3D pose via a transformer, which is adaptive to the length of the video and takes full advantage of the temporal information. With these modules, MTF Transformer handles different application scenes, varying from a monocular single image to multi view video, and the camera calibration is avoidable. We demonstrate quantitative and qualitative results on the Human3.6M, TotalCapture, and KTH Multiview Football II. Compared with state of the art methods with camera parameters, experiments show that MTF Transformer not only obtains comparable results but also generalizes well to dynamic capture with an arbitrary number of unseen views. Code is available in https github.com lelexx MTF Transformer.


Welfare implications of noise traders. We prove the existence of incomplete Radner equilibria in two models with exponential investors and different types of noise traders an exogenous noise trader and an endogenous noise tracker. In each model, we analyze a coupled system of ODEs and reduce it to a system of two coupled ODEs in order to establish equilibrium existence. As an application, we study the impact of the noise trader types on welfare. We show that the aggregate welfare comparison depends in a non trivial manner on every equilibrium parameter, and there is no ordering in general. Our models suggest that care should be used when drawing conclusions about welfare effects when noise traders are used.


A non commutative generalization BL rings. The purpose of this work is to extend the study of the commutative rings whose lattice of ideals can be a structure of BL algebra as carry out by Heubo et al in 2018, to non commutative rings appointed in the work as pseudo BL rings. We study and characterize rings whose ideals form a pseudo BL algebra, we describe them in terms of their subdirectly irreductible factors. We obtain that these are (up to isomorphism) to a subring of a direct sums of unitary special primary rings and discrete valuation ring.


Discovery of Nonlinear Dynamical Systems using a Runge Kutta Inspired Dictionary based Sparse Regression Approach. Discovering dynamical models to describe underlying dynamical behavior is essential to draw decisive conclusions and engineering studies, e.g., optimizing a process. Experimental data availability notwithstanding has increased significantly, but interpretable and explainable models in science and engineering yet remain incomprehensible. In this work, we blend machine learning and dictionary based learning with numerical analysis tools to discover governing differential equations from noisy and sparsely sampled measurement data. We utilize the fact that given a dictionary containing huge candidate nonlinear functions, dynamical models can often be described by a few appropriately chosen candidates. As a result, we obtain interpretable and parsimonious models which are prone to generalize better beyond the sampling regime. Additionally, we integrate a numerical integration framework with dictionary learning that yields differential equations without requiring or approximating derivative information at any stage. Hence, it is utterly effective in corrupted and sparsely sampled data. We discuss its extension to governing equations, containing rational nonlinearities that typically appear in biological networks. Moreover, we generalized the method to governing equations that are subject to parameter variations and externally controlled inputs. We demonstrate the efficiency of the method to discover a number of diverse differential equations using noisy measurements, including a model describing neural dynamics, chaotic Lorenz model, Michaelis Menten Kinetics, and a parameterized Hopf normal form.


Learning from Multiple Annotators by Incorporating Instance Features. Learning from multiple annotators aims to induce a high quality classifier from training instances, where each of them is associated with a set of possibly noisy labels provided by multiple annotators under the influence of their varying abilities and own biases. In modeling the probability transition process from latent true labels to observed labels, most existing methods adopt class level confusion matrices of annotators that observed labels do not depend on the instance features, just determined by the true labels. It may limit the performance that the classifier can achieve. In this work, we propose the noise transition matrix, which incorporates the influence of instance features on annotators' performance based on confusion matrices. Furthermore, we propose a simple yet effective learning framework, which consists of a classifier module and a noise transition matrix module in a unified neural network architecture. Experimental results demonstrate the superiority of our method in comparison with state of the art methods.


Globally Minimizing Geodesics in Jet Space. The space J k of k jets of a real function of one real variable x admits a natural sub Riemannian structure of Carnot group type. Like any Carnot group, J k has a submetry ( subRiemannian submersion) onto the Euclidean plane. Horizontal lifts of Euclidean lines yield globally minimizing geodesics on J k . What are the rest of the globally minimizing geodesics? Theorems A and B provide a partial answer in the language of the Meneses Monroy polynomials, real polynomials F(x) of degree k out of which all geodesics on J k can be constructed. Our methods for proving these theorems include solving Hamilton Jacobi (eikonal) equations, constructing an intermediate three dimensional magnetic'' sub Riemannian structure lying between J k and the plane, and analyzing the period asymptotics for a pair of cycles on a family of hyperelliptic'' Riemann surfaces associated to the deformation a b F(x) of F(x) . Along the way, we conjecture the equi optimality'' of J k geodesics a claim of the independence of the cut time from the starting location along the geodesic.


Customizing Graph500 for Tianhe Pre exacale system. BFS (Breadth First Search) is a typical graph algorithm used as a key component of many graph applications. However, current distributed parallel BFS implementations suffer from irregular data communication with large volumes of transfers across nodes, leading to inefficiency in performance. In this paper, we present a set of optimization techniques to improve the Graph500 performance for Pre exacale system, including BFS accelerating with SVE (Scalable Vector extension) in matrix2000 , sorting with buffering for heavy vertices, and group based monitor communication based on proprietary interconnection built in Tianhe Pre exacale system. Performance evaluation on the customized Graph500 testing on the Tianhe Pre exacale system achieves 2131.98 Giga TEPS on 512 node with 96608 cores, which surpasses the ranking of Tianhe 2 with about 16X fewer nodes in the June 2018 Graph500 list, and shows our customized Graph500 is 3.15 times faster on 512 nodes than the base version using the state of the art techniques.


Looking Outside the Window Wide Context Transformer for the Semantic Segmentation of High Resolution Remote Sensing Images. Long range contextual information is crucial for the semantic segmentation of High Resolution (HR) Remote Sensing Images (RSIs). However, image cropping operations, commonly used for training neural networks, limit the perception of long range contexts in large RSIs. To overcome this limitation, we propose a Wide Context Network (WiCoNet) for the semantic segmentation of HR RSIs. Apart from extracting local features with a conventional CNN, the WiCoNet has an extra context branch to aggregate information from a larger image area. Moreover, we introduce a Context Transformer to embed contextual information from the context branch and selectively project it onto the local features. The Context Transformer extends the Vision Transformer, an emerging kind of neural network, to model the dual branch semantic correlations. It overcomes the locality limitation of CNNs and enables the WiCoNet to see the bigger picture before segmenting the land cover land use (LCLU) classes. Ablation studies and comparative experiments conducted on several benchmark datasets demonstrate the effectiveness of the proposed method. In addition, we present a new Beijing Land Use (BLU) dataset. This is a large scale HR satellite dataset with high quality and fine grained reference labels, which can facilitate future studies in this field.


Effect of radiation reaction on charged particle dynamics in a focused electromagnetic wave. Effect of radiation reaction force on the dynamics of a charged particle in an intense focused light wave is investigated using the physically appealing Hartemann Luhmann equation of motion. It is found that, irrespective of the choice of initial conditions, radiation reaction force causes the charge particle to cross the focal region, thereby enhancing the forward energy gained by the particle from the intense light wave. This result is in sharp contrast to the well known result, derived in the absence of radiation reaction forces, where for certain initial conditions the particle reflects from the high intensity region of the focused light wave, thereby losing forward energy. These results, which are of relevance to the present day direct laser acceleration schemes of charge particle, also agrees with that obtained using the well known Landau Lifshitz equation of motion.


Long Horizon Manipulation of Unknown Objects via Task and Motion Planning with Estimated Affordances. We present a strategy for designing and building very general robot manipulation systems involving the integration of a general purpose task and motion planner with engineered and learned perception modules that estimate properties and affordances of unknown objects. Such systems are closed loop policies that map from RGB images, depth images, and robot joint encoder measurements to robot joint position commands. We show that following this strategy a task and motion planner can be used to plan intelligent behaviors even in the absence of a priori knowledge regarding the set of manipulable objects, their geometries, and their affordances. We explore several different ways of implementing such perceptual modules for segmentation, property detection, shape estimation, and grasp generation. We show how these modules are integrated within the PDDLStream task and motion planning framework. Finally, we demonstrate that this strategy can enable a single system to perform a wide variety of real world multi step manipulation tasks, generalizing over a broad class of objects, object arrangements, and goals, without any prior knowledge of the environment and without re training.


The delta unlinking number of algebraically split links. It is known that algebraically split links (links with vanishing pairwise linking number) can be transformed into the trivial link by a series of local moves on the link diagram called delta moves we define the delta unlinking number to be the minimum number of such moves needed. This generalizes the notion of delta unknotting number, defined to be the minimum number of delta moves needed to move a knot into the unknot. While the delta unknotting number has been well studied and calculated for prime knots, no prior such analysis has been conducted for the delta unlinking number. We prove a number of lower and upper bounds on the delta unlinking number, relating it to classical link invariants including unlinking number, 4 genus, and Arf invariant. This allows us to determine the precise value of the delta unlinking number for algebraically split prime links with up to 9 crossings as well as determine the 4 genus for most of these links.


A Medical Pre Diagnosis System for Histopathological Image of Breast Cancer. This paper constructs a novel intelligent medical diagnosis system, which can realize automatic communication and breast cancer pathological image recognition. This system contains two main parts, including a pre training chatbot called M Chatbot and an improved neural network model of EfficientNetV2 S named EfficientNetV2 SA, in which the activation function in top layers is replaced by ACON C. Using information retrieval mechanism, M Chatbot instructs patients to send breast pathological image to EfficientNetV2 SA network, and then the classifier trained by transfer learning will return the diagnosis results. We verify the performance of our chatbot and classification on the extrinsic metrics and BreaKHis dataset, respectively. The task completion rate of M Chatbot reached 63.33 . For the BreaKHis dataset, the highest accuracy of EfficientNetV2 SA network have achieved 84.71 . All these experimental results illustrate that the proposed model can improve the accuracy performance of image recognition and our new intelligent medical diagnosis system is successful and efficient in providing automatic diagnosis of breast cancer.


L ojasiewicz inequalities for mean convex self shrinkers. We prove L ojasiewicz inequalities for round cylinders and cylinders over Abresch Langer curves, using perturbative analysis of a quantity introduced by Colding Minicozzi. A feature is that this auxiliary quantity allows us to work essentially at first order. This new method interpolates between the higher order perturbative analysis used by the author for certain shrinking cylinders, and the differential geometric method used by Colding Minicozzi for the round case.


Improving Coherence and Consistency in Neural Sequence Models with Dual System, Neuro Symbolic Reasoning. Human reasoning can often be understood as an interplay between two systems the intuitive and associative ("System 1") and the deliberative and logical ("System 2"). Neural sequence models which have been increasingly successful at performing complex, structured tasks exhibit the advantages and failure modes of System 1 they are fast and learn patterns from data, but are often inconsistent and incoherent. In this work, we seek a lightweight, training free means of improving existing System 1 like sequence models by adding System 2 inspired logical reasoning. We explore several variations on this theme in which candidate generations from a neural sequence model are examined for logical consistency by a symbolic reasoning module, which can either accept or reject the generations. Our approach uses neural inference to mediate between the neural System 1 and the logical System 2. Results in robust story generation and grounded instruction following show that this approach can increase the coherence and accuracy of neurally based generations.


Regularity of integral closure of powers of edge ideals. In this article, we study the regularity of integral closure of powers of edge ideals. We obtain a lower bound for the regularity of integral closure of powers of edge ideals in terms of induced matching number of graphs. We prove that the regularity of integral closure of powers of edge ideals of graphs with at most two odd cycles is the same as the regularity of their powers.


DeepWORD A GCN based Approach for Owner Member Relationship Detection in Autonomous Driving. It's worth noting that the owner member relationship between wheels and vehicles has an significant contribution to the 3D perception of vehicles, especially in the embedded environment. However, there are currently two main challenges about the above relationship prediction i) The traditional heuristic methods based on IoU can hardly deal with the traffic jam scenarios for the occlusion. ii) It is difficult to establish an efficient applicable solution for the vehicle mounted system. To address these issues, we propose an innovative relationship prediction method, namely DeepWORD, by designing a graph convolution network (GCN). Specifically, we utilize the feature maps with local correlation as the input of nodes to improve the information richness. Besides, we introduce the graph attention network (GAT) to dynamically amend the prior estimation deviation. Furthermore, we establish an annotated owner member relationship dataset called WORD as a large scale benchmark, which will be available soon. The experiments demonstrate that our solution achieves state of the art accuracy and real time in practice.


BEANNA A Binary Enabled Architecture for Neural Network Acceleration. Modern hardware design trends have shifted towards specialized hardware acceleration for computationally intensive tasks like machine learning and computer vision. While these complex workloads can be accelerated by commercial GPUs, domain specific hardware is far more optimal when needing to meet the stringent memory, throughput, and power constraints of mobile and embedded devices. This paper proposes and evaluates a Binary Enabled Architecture for Neural Network Acceleration (BEANNA), a neural network hardware accelerator capable of processing both floating point and binary network layers. Through the use of a novel 16x16 systolic array based matrix multiplier with processing elements that compute both floating point and binary multiply adds, BEANNA seamlessly switches between high precision floating point and binary neural network layers. Running at a clock speed of 100MHz, BEANNA achieves a peak throughput of 52.8 GigaOps second when operating in high precision mode, and 820 GigaOps second when operating in binary mode. Evaluation of BEANNA was performed by comparing a hybrid network with floating point outer layers and binary hidden layers to a network with only floating point layers. The hybrid network accelerated using BEANNA achieved a 194 throughput increase, a 68 memory usage decrease, and a 66 energy consumption decrease per inference, all this at the cost of a mere 0.23 classification accuracy decrease on the MNIST dataset.