Generalized Conflict directed Search for Optimal Ordering Problems. Solving planning and scheduling problems for multiple tasks with highly coupled state and temporal constraints is notoriously challenging. An appealing approach to effectively decouple the problem is to judiciously order the events such that decisions can be made over sequences of tasks. As many problems encountered in practice are over constrained, we must instead find relaxed solutions in which certain requirements are dropped. This motivates a formulation of optimality with respect to the costs of relaxing constraints and the problem of finding an optimal ordering under which this relaxing cost is minimum. In this paper, we present Generalized Conflict directed Ordering (GCDO), a branch and bound ordering method that generates an optimal total order of events by leveraging the generalized conflicts of both inconsistency and suboptimality from sub solvers for cost estimation and solution space pruning. Due to its ability to reason over generalized conflicts, GCDO is much more efficient in finding high quality total orders than the previous conflict directed approach CDITO. We demonstrate this by benchmarking on temporal network configuration problems, which involves managing networks over time and makes necessary tradeoffs between network flows against CDITO and Mixed Integer Linear Programing (MILP). Our algorithm is able to solve two orders of magnitude more benchmark problems to optimality and twice the problems compared to CDITO and MILP within a runtime limit, respectively.


FANCA In Silico deleterious mutation analysis for early prediction of leukemia. As a novel biomarker from the Fanconi anemia complementation group (FANC) family, FANCA is antigens to Leukemia cancer. The overexpression of FANCA has predicted the second most common cancer in the world that is responsible for cancer related deaths. Non synonymous SNPs are an essential group of SNPs that lead to alterations in encoded polypeptides. Changes in the amino acid sequences of gene products lead to Leukemia. First, we study individual SNPs in the coding region of FANCA and computational tools like PROVEAN, PolyPhen2, MuPro, and PANTHER to compute deleterious mutation scores. The three dimensional structural and functional prediction conducted using I TASSER. Further, the predicted structure refined using the GlaxyWeb tool. In the study, the proteomic data has been retrieved from the UniProtKB. The coding region of the dataset contains 100 non synonymous single nucleotide polymorphisms (nsSNPs), and 24 missense SNPs have been determined as deleterious by all analyses. In this work, six well known computational tools were employed to study Leukemia associated nsSNPs. It is inferred that these nsSNPs could play their role in the up regulation of FANCA, which further leads to provoke leukemia advancement. The current research would benefit researchers and practitioners in handling cancer associated diseases related to FANCA. The proposed study would also help to develop precision medicine in the field of drug discovery.


RuleBert Teaching Soft Rules to Pre trained Language Models. While pre trained language models (PLMs) are the go to solution to tackle many natural language processing problems, they are still very limited in their ability to capture and to use common sense knowledge. In fact, even if information is available in the form of approximate (soft) logical rules, it is not clear how to transfer it to a PLM in order to improve its performance for deductive reasoning tasks. Here, we aim to bridge this gap by teaching PLMs how to reason with soft Horn rules. We introduce a classification task where, given facts and soft rules, the PLM should return a prediction with a probability for a given hypothesis. We release the first dataset for this task, and we propose a revised loss function that enables the PLM to learn how to predict precise probabilities for the task. Our evaluation results show that the resulting fine tuned models achieve very high performance, even on logical rules that were unseen at training. Moreover, we demonstrate that logical notions expressed by the rules are transferred to the fine tuned model, yielding state of the art results on external datasets.


Wireless Information and Power Transfer for IoT Pulse Position Modulation, Integrated Receiver, and Experimental Validation. Simultaneous wireless information and power transfer (SWIPT) has emerged as a viable technique to energize and connect low power autonomous devices and enable future Internet of Things (IoT). A major challenge of SWIPT is the energy consumption of the receiver of such low power devices. An attractive low power solution consists in an integrated information decoder (ID) and energy harvester (EH) architecture for SWIPT receiver (IntRx) where the received RF signal is first rectified before being used for information decoding. Such architecture eliminates the need for energy consuming RF components such as local oscillators and mixers. This paper proposes a novel modulation and demodulation method for the IntRx SWIPT architecture based on pulse position modulation (PPM) where information is encoded in the position of the pulse. The new method transmits high amplitude pulses to increase the Peak to Average Power Ratio (PAPR) of the transmit signal and exploits the EH's nonlinearity so as to boost the harvested DC power. Simultaneously, the information can be decoded from the rectifier signal by simply finding the position of the pulse in a certain symbol duration. We have analyzed both the information and the power transfer performance of the newly proposed PPM for IntRx SWIPT theoretically, numerically, and experimentally. To that end, we have established a SWIPT system testbed in an indoor environment by prototyping a base station to transfer information power signal and the IntRx SWIPT receiver including ID and EH blocks. The performance evaluation of the PPM was carried out in various conditions, and the results have been compared and contrasted to conventional signals. Theoretical, numerical, and experimental results highlight the significant benefits of the proposed PPM scheme to enhance the power transfer performance and operate information decoding with low power consumption.


Secure Distributed Training at Scale. Some of the hardest problems in deep learning can be solved via pooling together computational resources of many independent parties, as is the case for scientific collaborations and volunteer computing. Unfortunately, any single participant in such systems can jeopardize the entire training run by sending incorrect updates, whether deliberately or by mistake. Training in presence of such peers requires specialized distributed training algorithms with Byzantine tolerance. These algorithms often sacrifice efficiency by introducing redundant communication or passing all updates through a trusted server. As a result, it can be infeasible to apply such algorithms to large scale distributed deep learning, where models can have billions of parameters. In this work, we propose a novel protocol for secure (Byzantine tolerant) decentralized training that emphasizes communication efficiency. We rigorously analyze this protocol in particular, we provide theoretical bounds for its resistance against Byzantine and Sybil attacks and show that it has a marginal communication overhead. To demonstrate its practical effectiveness, we conduct large scale experiments on image classification and language modeling in presence of Byzantine attackers.


UMPNet Universal Manipulation Policy Network for Articulated Objects. We introduce the Universal Manipulation Policy Network (UMPNet) a single image based policy network that infers closed loop action sequences for manipulating arbitrary articulated objects. To infer a wide range of action trajectories, the policy supports 6DoF action representation and varying trajectory length. To handle a diverse set of objects, the policy learns from objects with different articulation structures and generalizes to unseen objects or categories. The policy is trained with self guided exploration without any human demonstrations, scripted policy, or pre defined goal conditions. To support effective multi step interaction, we introduce a novel Arrow of Time action attribute that indicates whether an action will change the object state back to the past or forward into the future. With the Arrow of Time inference at each interaction step, the learned policy is able to select actions that consistently lead towards or away from a given state, thereby, enabling both effective state exploration and goal conditioned manipulation. Video is available at https youtu.be KqlvcL9RqKM


Monge Amp e re type equations on almost Hermitian manifolds. In this paper, we consider the Monge Amp e re type equations on compact almost Hermitian manifolds. We derive C infty a priori estimates under the existence of an admissible mathcal C subsolution. Finally, we obtain an existence result if there exists an admissible supersolution.


120 fs single pulse generation from stretched pulse fiber Kerr resonators. Fiber Kerr resonators are simple driven resonators with desirable wavelength and repetition rate flexibility for generating ultrashort pulses for applications including telecommunications, biomedicine, and materials processing. However, fiber Kerr resonators to date often generate longer pulses and require more complicated techniques for generating single pulses than would be desirable for applications. Here we address these limits by demonstrating robust single pulse performance with 120 fs pulse durations in fiber Kerr resonators based on stretched pulse solitons. Through matching numerical and experimental studies, stretched pulse soliton performance is found to strongly depend on the total cavity length, and the optimum length is found to depend on the drive, Raman scattering, and the total pulse stretching. By designing the cavity for this optimum with the described setup, stable stretched pulse solitons with 120 fs duration are experimentally observed. In addition, soliton trapping is demonstrated with a pulsed drive source despite large intracavity breathing and single pulse performance is observed. Robust with high performance single pulse generation is a critical step toward useful femtosecond pulse generation.


Approximate Privacy Preserving Neighbourhood Estimations. Anonymous social networks present a number of new and challenging problems for existing Social Network Analysis techniques. Traditionally, existing methods for analysing graph structure, such as community detection, required global knowledge of the graph structure. That implies that a centralised entity must be given access to the edge list of each node in the graph. This is impossible for anonymous social networks and other settings where privacy is valued by its participants. In addition, using their graph structure inputs for learning tasks defeats the purpose of anonymity. In this work, we hypothesise that one can re purpose the use of the HyperANF a.k.a HyperBall algorithm intended for approximate diameter estimation to the task of privacy preserving community detection for friend recommending systems that learn from an anonymous representation of the social network graph structure with limited privacy impact. This is possible because the core data structure maintained by HyperBall is a HyperLogLog with a counter of the number of reachable neighbours from a given node. Exchanging this data structure in future decentralised learning deployments gives away no information about the neighbours of the node and therefore does preserve the privacy of the graph structure.


A Metric Tensor Approach to Data Assimilation with Adaptive Moving Meshes. Adaptive moving spatial meshes are useful for solving physical models given by time dependent partial differentialequations. However, special consideration must be given when combining adaptive meshing procedures with ensemble based data assimilation (DA) techniques. In particular, we focus on the case where each ensemble member evolvesindependently upon its own mesh and is interpolated to a common mesh for the DA update. This paper outlines aframework to develop time dependent reference meshes using locations of observations and the metric tensors (MTs)or monitor functions that define the spatial meshes of the ensemble members. We develop a time dependent spatiallocalization scheme based on the metric tensor (MT localization). We also explore how adaptive moving mesh tech niques can control and inform the placement of mesh points to concentrate near the location of observations, reducingthe error of observation interpolation. This is especially beneficial when we have observations in locations that wouldotherwise have a sparse spatial discretization. We illustrate the utility of our results using discontinuous Galerkin(DG) approximations of 1D and 2D inviscid Burgers equations. The numerical results show that the MT localizationscheme compares favorably with standard Gaspari Cohn localization techniques. In problems where the observationsare sparse, the choice of common mesh has a direct impact on DA performance. The numerical results also demonstratethe advantage of DG based interpolation over linear interpolation for the 2D inviscid Burgers equation.


Photo acoustic inversion using plasmonic contrast agents The full Maxwell model. We analyze the inversion of the photo acoustic imaging modality using electromagnetic plasmonic nano particles as contrast agents. We prove that the generated pressure, before and after injecting the plasmonic nano particles, measured at a single point, located away from the targeted inhomogeneity to image, and at a given band of incident frequencies is enough to reconstruct the (eventually complex valued) permittivity. Indeed, from these measurements, we define an indicator function which depends on the used incident frequency and the time of measurement. This indicator function has differentiating behaviors in terms of both time and frequency. First, from the behavior in terms of time, we can estimate the arrival time of the pressure from which we can localize the injected nano particle. Second, we show that this indicator function has maximum picks at incident frequencies close to the plasmonic resonances. This allows us to estimate these resonances from which we construct the permittivity. To justify these properties, we derive the dominant electric field created by the injected nano particle when the incident frequency is close to plasmonic resonances. This is done for the full Maxwell system. To this end, we use a natural spectral decomposition of the vector space (L 2(D)) 3 based on the spectra of the Newtonian and the Magnetization operators. As another key argument, we provide the singularity analysis of the Green's tensor of the Maxwell problem with varying permittivity. Such singularity is unusual if compared to the ones of the elliptic case (as the acoustic or elastic models). In addition, we show how the derived approximation of the electric fields propagates, as a source, in the induced pressure with the time.


Sketch Guided Equality Saturation Scaling Equality Saturation to Complex Optimizations in Languages with Bindings. Equality saturation is a technique for implementing rewrite driven compiler optimizations by efficiently representing many equivalent programs in so called e graphs. To improve performance, the set of equivalent programs is grown by applying rewrites in a purely additive way until a fixed point is reached (saturation), or the search times out. In practice, two issues limit the application of equality saturation in programming language compilers. First, equality saturation is not efficient for the name bindings (variables) that appear in almost all programming languages. Second, equality saturation does not scale to complex optimizations with long rewrite sequences such as loop blocking. This paper addresses both issues, thereby enabling equality saturation to be applied to more realistic programs and compiler optimizations. First, we demonstrate how to drastically improve the efficiency of equality saturation for a functional language based on the typed lambda calculus. Second, we introduce sketch guided equality saturation, a semi automatic technique that allows programmers to provide sketches guiding rewriting when performing complex optimizations. We evaluate sketch guided equality saturation by performing a series of realistic optimizations of matrix multiplication expressed in the Rise functional language. The optimizations include loop blocking, vectorization, and parallelization. We demonstrate that naive equality saturation does not scale to these optimizations, even with hours of exploration time. Previous work on orchestrating rewrite sequences shows that these optimizations can be expressed as rewrites, at the cost of weeks of programmer effort. Our guided equality saturation combines the advantages of both techniques minimal programmer guidance enables complex compiler optimizations to be applied in seconds.


Generic Stability Implication from Full Information Estimation to Moving Horizon Estimation. Optimization based state estimation is useful for handling of constrained linear or nonlinear dynamical systems. It has an ideal form, known as full information estimation (FIE) which uses all past measurements to perform state estimation, and also a practical counterpart, known as moving horizon estimation (MHE) which uses most recent measurements of a limited length to perform the estimation. Due to the theoretical ideal, conditions for robust stability of FIE are relatively easier to establish than those for MHE, and various sufficient conditions have been developed in literature. This work reveals a generic link from robust stability of FIE to that of MHE, showing that the former implies at least a weaker robust stability of MHE which implements a long enough horizon. The implication strengthens to strict robust stability of MHE if the corresponding FIE satisfies a mild Lipschitz continuity condition. The revealed implications are then applied to derive new sufficient conditions for robust stability of MHE, which further reveal an intrinsic relation between the existence of a robustly stable FIE MHE and the system being incrementally input output to state stable.


Magnetic field induced asymmetric splitting of the output signal. In this paper we have investigated the dynamics of a damped harmonic oscillator in the presence of an electromagnetic field. The transients for the two dimensional harmonic oscillator imply about the modulation of the frequency of the oscillator by the velocity dependent non conservative force from an applied magnetic field. Except a special condition, the motion is in general quasi periodic nature even in the absence of damping. Another interesting finding is that the magnetic field may induce an asymmetric splitting of the spectrum of the output signal with two peaks in the case of a driven damped two dimensional harmonic oscillator. One more additional peak may appear for the three dimensional case. In some cases the spectrum may have similarity with the Normal Zeeman Effect. At the same time one may observe to appear the anti resonance phenomenon even for the driven damped cyclotron motion where the system with the purely non conservative force fields is driven by an electric field. Finally, our calculation exhibits how the magnetic field can modulate the phase difference (between input and output signals) and the efficiency like quantity of the energy storing process. Thus the present study might be applicable in the areas related to the refractive index, the barrier crossing dynamics and autonomous stochastic resonance, respectively.


MRC LSTM A Hybrid Approach of Multi scale Residual CNN and LSTM to Predict Bitcoin Price. Bitcoin, one of the major cryptocurrencies, presents great opportunities and challenges with its tremendous potential returns accompanying high risks. The high volatility of Bitcoin and the complex factors affecting them make the study of effective price forecasting methods of great practical importance to financial investors and researchers worldwide. In this paper, we propose a novel approach called MRC LSTM, which combines a Multi scale Residual Convolutional neural network (MRC) and a Long Short Term Memory (LSTM) to implement Bitcoin closing price prediction. Specifically, the Multi scale residual module is based on one dimensional convolution, which is not only capable of adaptive detecting features of different time scales in multivariate time series, but also enables the fusion of these features. LSTM has the ability to learn long term dependencies in series, which is widely used in financial time series forecasting. By mixing these two methods, the model is able to obtain highly expressive features and efficiently learn trends and interactions of multivariate time series. In the study, the impact of external factors such as macroeconomic variables and investor attention on the Bitcoin price is considered in addition to the trading information of the Bitcoin market. We performed experiments to predict the daily closing price of Bitcoin (USD), and the experimental results show that MRC LSTM significantly outperforms a variety of other network structures. Furthermore, we conduct additional experiments on two other cryptocurrencies, Ethereum and Litecoin, to further confirm the effectiveness of the MRC LSTM in short term forecasting for multivariate time series of cryptocurrencies.


Existence of solutions for first order Hamiltonian stochastic impulsive differential equations with Dirichlet boundary conditions. In this paper, we study the sufficient conditions for the existence of solutions of first order Hamiltonian stochastic impulsive differential equations under Dirichlet boundary value conditions. By using the variational method, we first obtain the corresponding energy functional. And by using Legendre transformation, we obtain the conjugation of the functional. Then the existence of critical point is obtained by mountain pass lemma. Finally, we assert that the critical point of the energy functional is the mild solution of the first order Hamiltonian stochastic impulsive differential equation.Finally, an example are presented to illustrate the feasibility and effectiveness of our results.


Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers. Detection transformers have recently shown promising object detection results and attracted increasing attention. However, how to develop effective domain adaptation techniques to improve its cross domain performance remains unexplored and unclear. In this paper, we delve into this topic and empirically find that direct feature distribution alignment on the CNN backbone only brings limited improvements, as it does not guarantee domain invariant sequence features in the transformer for prediction. To address this issue, we propose a novel Sequence Feature Alignment (SFA) method that is specially designed for the adaptation of detection transformers. Technically, SFA consists of a domain query based feature alignment (DQFA) module and a token wise feature alignment (TDA) module. In DQFA, a novel domain query is used to aggregate and align global context from the token sequence of both domains. DQFA reduces the domain discrepancy in global feature representations and object relations when deploying in the transformer encoder and decoder, respectively. Meanwhile, TDA aligns token features in the sequence from both domains, which reduces the domain gaps in local and instance level feature representations in the transformer encoder and decoder, respectively. Besides, a novel bipartite matching consistency loss is proposed to enhance the feature discriminability for robust object detection. Experiments on three challenging benchmarks show that SFA outperforms state of the art domain adaptive object detection methods. Code has been made available at https github.com encounter1997 SFA.


Rational activation functions in neural networks with uniform based loss functions and its application in classification. In this paper, we demonstrate the application of generalised rational uniform (Chebyshev) approximation in neural networks. In particular, our activation functions are one degree rational functions and the loss function is based on the uniform norm. In this setting, when the coefficients of the rational activation function are fixed, the overall optimisation problem of the neural network forms a generalised rational uniform approximation problem where the weights and the bias of the network are the decision variables. To optimise the decision variables, we suggest using two prominent methods the bisection method and the differential correction algorithm. We perform numerical experiments on classification problems with two classes and report the classification accuracy obtained by the network using the bisection method, differential correction algorithm along with the standard MATLAB toolbox which uses the least square loss function. We show that the choice of the uniform norm based loss function with rational activation function and the bisection method lead to better classification accuracy when the training dataset is either very small or if the classes are imbalanced.


Low Light Image Enhancement via Global and Local Context Modeling. Images captured under low light conditions manifest poor visibility, lack contrast and color vividness. Compared to conventional approaches, deep convolutional neural networks (CNNs) perform well in enhancing images. However, being solely reliant on confined fixed primitives to model dependencies, existing data driven deep models do not exploit the contexts at various spatial scales to address low light image enhancement. These contexts can be crucial towards inferring several image enhancement tasks, e.g., local and global contrast, brightness and color corrections which requires cues from both local and global spatial extent. To this end, we introduce a context aware deep network for low light image enhancement. First, it features a global context module that models spatial correlations to find complementary cues over full spatial domain. Second, it introduces a dense residual block that captures local context with a relatively large receptive field. We evaluate the proposed approach using three challenging datasets MIT Adobe FiveK, LoL, and SID. On all these datasets, our method performs favorably against the state of the arts in terms of standard image fidelity metrics. In particular, compared to the best performing method on the MIT Adobe FiveK dataset, our algorithm improves PSNR from 23.04 dB to 24.45 dB.


Unipotent Ideals for Spin and Exceptional Groups. In the monograph arXiv 2108.03453, we define the notion of a unipotent representation of a complex reductive group. The representations we define include, as a proper subset, all special unipotent representations in the sense of Barbasch Vogan and form the (conjectural) building blocks of the unitary dual. In arXiv 2108.03453 we provide combinatorial formulas for the infinitesimal characters of all unipotent representations of linear classical groups. In this paper, we establish analogous formulas for spin and exceptional groups, thus completing the determination of the infinitesimal characters of all unipotent ideals. Using these formulas, we prove an old conjecture of Vogan all unipotent ideals are maximal. For G a real reductive Lie group (not necessarily complex), we introduce the notion of a unipotent representation attached to a rigid nilpotent orbit (in the complexified Lie algebra of G ). Like their complex group counterparts, these representations form the (conjectural) building blocks of the unitary dual. Using the atlas software (and the work of Adams Miller van Leeuwen Vogan) we show that if G is a real form of a simple group of exceptional type, all such representations are unitary.


Skew power series rings over a prime base ring. In this paper, we investigate the structure of skew power series rings of the form S R x sigma, delta , where R is a complete filtered ring and ( sigma, delta) is a skew derivation respecting the filtration. Our main focus is on the case in which sigma delta delta sigma , and we aim to use techniques in non commutative valuation theory to address the long standing open question if P is an invariant prime ideal of R , is PS a prime ideal of S ? When R has characteristic p , our results reduce this to a finite index problem. We also give preliminary results in the "Iwasawa algebra" case delta sigma mathrm id R in arbitrary characteristic. A key step in our argument will be to show that for a large class of Noetherian algebras, the nilradical is "almost" ( sigma, delta) invariant in a certain sense.


Pluriclosed manifolds with constant holomorphic sectional curvature. A long standing conjecture in complex geometry says that a compact Hermitian manifold with constant holomorphic sectional curvature must be K "ahler when the constant is non zero and must be Chern flat when the constant is zero. The conjecture is known in complex dimension 2 by the work of Balas Gauduchon in 1985 (when the constant is zero or negative) and by Apostolov Davidov Muskarov in 1996 (when the constant is positive). For higher dimensions, the conjecture is still largely unknown. In this article, we restrict ourselves to pluriclosed manifolds, and confirm the conjecture for the special case of Strominger K "ahler like manifolds, namely, for Hermitian manifolds whose Strominger connection (also known as Bismut connection) obeys all the K "ahler symmetries.


Transient Performance Modelling of 5G Slicing with Mixed Numerologies for Smart Grid Traffic. Network slicing enabled by fifth generation (5G) systems has the potential to satisfy diversified service requirements from different vertical industries. As a typical vertical industry, smart distribution grid poses new challenges to communication networks. This paper investigates the behavior of network slicing for smart grid applications in 5G radio access networks with heterogeneous traffic. To facilitate network slicing in such a network, we employ different 5G radio access numerologies for two traffic classes which have distinct radio resource and quality of service requirements. Three multi dimensional Markov models are developed to assess the transient performance of network slicing for resource allocation with and without traffic priority. Through analysis and simulations, we investigate the effects of smart grid protection and control traffic on other types of parallel traffic sessions as well as on radio resource utilization.


Levels of Automation for a Mobile Robot Teleoperated by a Caregiver. Caregivers in eldercare can benefit from telepresence robots that allow them to perform a variety of tasks remotely. In order for such robots to be operated effectively and efficiently by non technical users, it is important to examine if and how the robotic system's level of automation (LOA) impacts their performance. The objective of this work was to develop suitable LOA modes for a mobile robotic telepresence (MRP) system for eldercare and assess their influence on users' performance, workload, awareness of the environment and usability at two different levels of task complexity. For this purpose, two LOA modes were implemented on the MRP platform assisted teleoperation (low LOA mode) and autonomous navigation (high LOA mode). The system was evaluated in a user study with 20 participants, who, in the role of the caregiver, navigated the robot through a home like environment to perform control and perception tasks. Results revealed that performance improved in the high LOA when task complexity was low. However, when task complexity increased, lower LOA improved performance. This opposite trend was also observed in the results for workload and situation awareness. We discuss the results in terms of the LOAs' impact on users' attitude towards automation and implications on usability.


Learning to Communicate with Reinforcement Learning for an Adaptive Traffic Control System. Recent work in multi agent reinforcement learning has investigated inter agent communication which is learned simultaneously with the action policy in order to improve the team reward. In this paper, we investigate independent Q learning (IQL) without communication and differentiable inter agent learning (DIAL) with learned communication on an adaptive traffic control system (ATCS). In real world ATCS, it is impossible to present the full state of the environment to every agent so in our simulation, the individual agents will only have a limited observation of the full state of the environment. The ATCS will be simulated using the Simulation of Urban MObility (SUMO) traffic simulator in which two connected intersections are simulated. Every intersection is controlled by an agent which has the ability to change the direction of the traffic flow. Our results show that a DIAL agent outperforms an independent Q learner on both training time and on maximum achieved reward as it is able to share relevant information with the other agents.


Benchmarking Processor Performance by Multi Threaded Machine Learning Algorithms. Machine learning algorithms have enabled computers to predict things by learning from previous data. The data storage and processing power are increasing rapidly, thus increasing machine learning and Artificial intelligence applications. Much of the work is done to improve the accuracy of the models built in the past, with little research done to determine the computational costs of machine learning acquisitions. In this paper, I will proceed with this later research work and will make a performance comparison of multi threaded machine learning clustering algorithms. I will be working on Linear Regression, Random Forest, and K Nearest Neighbors to determine the performance characteristics of the algorithms as well as the computation costs to the obtained results. I will be benchmarking system hardware performance by running these multi threaded algorithms to train and test the models on a dataset to note the differences in performance matrices of the algorithms. In the end, I will state the best performing algorithms concerning the performance efficiency of these algorithms on my system.


On the correspondence between path algebras and generalized path algebras. The concept of generalized path algebras was introduced in (Coelho and Liu, 2000). It was shown in (Ib 'a nez Cobos et al., 2008) how to obtain the Gabriel quiver of a given generalized path algebra. In this article, we generalize the concept of generalized path algebra to allow them to have relations, and we extend the result in (Ib 'a nez Cobos et al., 2008) to this new setting. Moreover, we use the extended result mentioned above to address the inverse problem that is, the problem of determining when a given algebra is isomorphic to a generalized path algebra in a non trivial way.


Equivariant Burnside groups and representation theory. We apply the equivariant Burnside group formalism to distinguish linear actions of finite groups, up to equivariant birationality. Our approach is based on De Concini Procesi models of subspace arrangements.


Understanding Chinese Video and Language via Contrastive Multimodal Pre Training. The pre trained neural models have recently achieved impressive performances in understanding multimodal content. However, it is still very challenging to pre train neural models for video and language understanding, especially for Chinese video language data, due to the following reasons. Firstly, existing video language pre training algorithms mainly focus on the co occurrence of words and video frames, but ignore other valuable semantic and structure information of video language content, e.g., sequential order and spatiotemporal relationships. Secondly, there exist conflicts between video sentence alignment and other proxy tasks. Thirdly, there is a lack of large scale and high quality Chinese video language datasets (e.g., including 10 million unique videos), which are the fundamental success conditions for pre training techniques. In this work, we propose a novel video language understanding framework named VICTOR, which stands for VIdeo language understanding via Contrastive mulTimOdal pRe training. Besides general proxy tasks such as masked language modeling, VICTOR constructs several novel proxy tasks under the contrastive learning paradigm, making the model be more robust and able to capture more complex multimodal semantic and structural relationships from different perspectives. VICTOR is trained on a large scale Chinese video language dataset, including over 10 million complete videos with corresponding high quality textual descriptions. We apply the pre trained VICTOR model to a series of downstream applications and demonstrate its superior performances, comparing against the state of the art pre training methods such as VideoBERT and UniVL. The codes and trained checkpoints will be publicly available to nourish further developments of the research community.


Self adversarial attack as an augmentation method for immunohistochemical stainings. It has been shown that unpaired image to image translation methods constrained by cycle consistency hide the information necessary for accurate input reconstruction as imperceptible noise. We demonstrate that, when applied to histopathology data, this hidden noise appears to be related to stain specific features and show that this is the case with two immunohistochemical stainings during translation to Periodic acid Schiff (PAS), a histochemical staining method commonly applied in renal pathology. Moreover, by perturbing this hidden information, the translation models produce different, plausible outputs. We demonstrate that this property can be used as an augmentation method which, in a case of supervised glomeruli segmentation, leads to improved performance.


Vapor flux on bumpy surfaces condensation and transpiration on leaves. Drop condensation and evaportation as a result of the gradient in vapor concentration are important in both engineering and natural systems. One of the interesting natural examples is transpiration on plant leaves. Most of water in the inner space of the leaves escapes through stomata, whose rate depends on the surface topography and a difference in vapor concentrations inside and just outside of the leaves. Previous research on the vapor flux on various surfaces has focused on numerically solving the vapor diffusion equation or using scaling arguments based on a simple solution with a flat surface. In this present work, we present and discuss simple analytical solutions on various 2D surface shapes (e.g., semicylinder, semi ellipse, hair). The method of solving the diffusion equation is to use the complex potential theory, which provides analytical solutions for vapor concentration and flux. We find that a high mass flux of vapor is formed near the top of the microstructures while a low mass flux is developed near the stomata at the leaf surface. Such a low vapor flux near the stomata may affect transpiration in two ways. First, condensed droplets on the stomata will not grow due to a low mass flux of vapor, which will not inhibit the gas exchange through the stomatal opening. Second, the low mass flux from the atmosphere will facilitate the release of high concentrated vapor from the substomatal space.


A case study on parametric verification of failure detectors. Partial synchrony is a model of computation in many distributed algorithms and modern blockchains. These algorithms are typically parameterized in the number of participants, and their correctness requires the existence of bounds on message delays and on the relative speed of processes after reaching Global Stabilization Time. These characteristics make partially synchronous algorithms parameterized in the number of processes, and parametric in time bounds, which render automated verification of partially synchronous algorithms challenging. In this paper, we present a case study on formal verification of both safety and liveness of the Chandra and Toueg failure detector that is based on partial synchrony. To this end, we first introduce and formalize the class of symmetric point to point algorithms that contains the failure detector. Second, we show that these symmetric point to point algorithms have a cutoff, and the cutoff results hold in three models of computation synchrony, asynchrony, and partial synchrony. As a result, one can verify them by model checking small instances, but the verification problem stays parametric in time. Next, we specify the failure detector and the partial synchrony assumptions in three frameworks TLA , IVy, and counter automata. Importantly, we tune our modeling to use the strength of each method (1) We are using counters to encode message buffers with counter automata, (2) we are using first order relations to encode message buffers in IVy, and (3) we are using both approaches in TLA . By running the tools for TLA and counter automata, we demonstrate safety for fixed time bounds. By running IVy, we prove safety for arbitrary time bounds. Moreover, we show how to verify liveness of the failure detector by reducing the verification problem to safety verification. Thus, both properties are verified by developing inductive invariants with IVy.


3d sequential image mosaicing for underwater navigation and mapping. Although fully autonomous mapping methods are becoming more and more common and reliable, still the human operator is regularly employed in many 3D surveying missions. In a number of underwater applications, divers or pilots of remotely operated vehicles (ROVs) are still considered irreplaceable, and tools for real time visualization of the mapped scene are essential to support and maximize the navigation and surveying efforts. For underwater exploration, image mosaicing has proved to be a valid and effective approach to visualize large mapped areas, often employed in conjunction with autonomous underwater vehicles (AUVs) and ROVs. In this work, we propose the use of a modified image mosaicing algorithm that coupled with image based real time navigation and mapping algorithms provides two visual navigation aids. The first is a classic image mosaic, where the recorded and processed images are incrementally added, named 2D sequential image mosaicing (2DSIM). The second one geometrically transform the images so that they are projected as planar point clouds in the 3D space providing an incremental point cloud mosaicing, named 3D sequential image plane projection (3DSIP). In the paper, the implemented procedure is detailed, and experiments in different underwater scenarios presented and discussed. Technical considerations about computational efforts, frame rate capabilities and scalability to different and more compact architectures (i.e. embedded systems) is also provided.


N2 H2 capacitively coupled radio frequency discharges at low pressure. Part I. Experimental results effect of the H2 amount on electrons, positive ions and ammonia formation. The mixing of N2 with H2 leads to very different plasmas from pure N2 and H2 plasma discharges. Numerous issues are therefore raised involving the processes leading to ammonia (NH3) formation. The aim of this work is to better characterize capacitively coupled radiofrequency plasma discharges in N2 with few percents of H2 (up to 5 pct), at low pressure (0.3 to 1 mbar) and low coupled power (3 to 13 W). Both experimental measurements and numerical simulations are performed. For clarity, we separated the results in two complementary parts. The actual one (first part), presents the details on the experimental measurements, while the second focuses on the simulation, a hybrid model combining a 2D fluid module and a 0D kinetic module. Electron density is measured by a resonant cavity method. It varies from 0.4 to 5e9 cm 3, corresponding to ionization degrees from 2e 8 to 4e 7. Ammonia density is quantified by combining IR absorption and mass spectrometry. It increases linearly with the amount of H2 (up to 3e13 cm 3 at 5 pct H2). On the contrary, it is constant with pressure, which suggests the dominance of surface processes on the formation of ammonia. Positive ions are measured by mass spectrometry. Nitrogen bearing ions are hydrogenated by the injection of H2, N2H being the major ion as soon as the amount of H2 is larger than 1 pct. The increase of pressure leads to an increase of secondary ions formed by ion (or radical) neutral collisions (ex N2H , NH4 , H3 ), while an increase of the coupled power favours ions formed by direct ionization (ex N2 , NH3 , H2 ).


Preproduction Deploys Cloud Native Integration Testing. The microservice architecture for cloud based systems is extended to not only require each loosely coupled component to be independently deployable, but also to provide independent routing for each component. This supports canary deployments, green blue deployments and roll back. Both ad hoc and system integration test traffic can be directed to components before they are released to production traffic. Front end code is included in this architecture by using server side rendering of JS bundles. Environments for integration testing are created with preproduction deploys side by side with production deploys using appropriate levels of isolation. After a successful integration test run, preproduction components are known to work with production precisely as it is. For isolation, test traffic uses staging databases that are copied daily from the production databases, omitting sensitive data. Safety and security concerns are dealt with in a targeted fashion, not monolithically. This architecture scales well with organization size is more effective for integration testing and is better aligned with agile business practices than traditional approaches.


Grounding Natural Language Instructions Can Large Language Models Capture Spatial Information?. Models designed for intelligent process automation are required to be capable of grounding user interface elements. This task of interface element grounding is centred on linking instructions in natural language to their target referents. Even though BERT and similar pre trained language models have excelled in several NLP tasks, their use has not been widely explored for the UI grounding domain. This work concentrates on testing and probing the grounding abilities of three different transformer based models BERT, RoBERTa and LayoutLM. Our primary focus is on these models' spatial reasoning skills, given their importance in this domain. We observe that LayoutLM has a promising advantage for applications in this domain, even though it was created for a different original purpose (representing scanned documents) the learned spatial features appear to be transferable to the UI grounding setting, especially as they demonstrate the ability to discriminate between target directions in natural language instructions.


Conditional propagation of chaos in a spatial stochastic epidemic model with common noise. We study a stochastic spatial epidemic model where the N individuals carry two features a position and an infection state, interact and move in R d . In this Markovian model, the evolution of the infection states are described with the help of the Poisson Point Processes , whereas the displacement of the individuals are driven by mean field advection, a (state dependence) diffusion and also a common noise, so that the spatial dynamic is a random process. We prove that when the number N of individual goes to infinity, the conditional propagation of chaos holds conditionnally to the common noise, the individuals are asymptotically independent and the stochastic dynamic converges to a "random" nonlinear McKean Vlasov process. As a consequence, the associated empirical measure converges to a measure, which is solution of a stochastic mean field PDE driven by the common noise.


Efficient passive membership inference attack in federated learning. In cross device federated learning (FL) setting, clients such as mobiles cooperate with the server to train a global machine learning model, while maintaining their data locally. However, recent work shows that client's private information can still be disclosed to an adversary who just eavesdrops the messages exchanged between the client and the server. For example, the adversary can infer whether the client owns a specific data instance, which is called a passive membership inference attack. In this paper, we propose a new passive inference attack that requires much less computation power and memory than existing methods. Our empirical results show that our attack achieves a higher accuracy on CIFAR100 dataset (more than 4 percentage points) with three orders of magnitude less memory space and five orders of magnitude less calculations.


Investigating the Relationship Between Dropout Regularization and Model Complexity in Neural Networks. Dropout Regularization, serving to reduce variance, is nearly ubiquitous in Deep Learning models. We explore the relationship between the dropout rate and model complexity by training 2,000 neural networks configured with random combinations of the dropout rate and the number of hidden units in each dense layer, on each of the three data sets we selected. The generated figures, with binary cross entropy loss and binary accuracy on the z axis, question the common assumption that adding depth to a dense layer while increasing the dropout rate will certainly enhance performance. We also discover a complex correlation between the two hyperparameters that we proceed to quantify by building additional machine learning and Deep Learning models which predict the optimal dropout rate given some hidden units in each dense layer. Linear regression and polynomial logistic regression require the use of arbitrary thresholds to select the cost data points included in the regression and to assign the cost data points a binary classification, respectively. These machine learning models have mediocre performance because their naive nature prevented the modeling of complex decision boundaries. Turning to Deep Learning models, we build neural networks that predict the optimal dropout rate given the number of hidden units in each dense layer, the desired cost, and the desired accuracy of the model. Though, this attempt encounters a mathematical error that can be attributed to the failure of the vertical line test. The ultimate Deep Learning model is a neural network whose decision boundary represents the 2,000 previously generated data points. This final model leads us to devise a promising method for tuning hyperparameters to minimize computational expense yet maximize performance. The strategy can be applied to any model hyperparameters, with the prospect of more efficient tuning in industrial models.


Diseases on complex networks. Modeling from a database and a protection strategy proposal. Among the diverse and important applications that networks currently have is the modeling of infectious diseases. Immunization, or the process of protecting nodes in the network, plays a key role in stopping diseases from spreading. Hence the importance of having tools or strategies that allow the solving of this challenge. In this work, we evaluate the effectiveness of the DIL W alpha ranking in immunizing nodes in an edge weighted network. The network is obtained from a real database and the spread of COVID 19 was modeled with the classic SIR model. We apply the protection to the network, according to the importance ranking list produced by DIL W alpha .


Square root cancellation for sums of factorization functions over squarefree progressions in mathbb F q t . We prove estimates for the level of distribution of the M "obius function, von Mangoldt function, and divisor functions in squarefree progressions in the ring of polynomials over a finite field. Each level of distribution converges to 1 as q goes to infty , and the power savings converges to square root cancellation as q goes to infty . These results in fact apply to a more general class of functions, the factorization functions, that includes these three. The divisor estimates have applications to the moments of L functions, and the von Mangoldt estimate to one level densities.


A generalization of higher rank graphs. We introduce what we call generalized higher rank k graphs' as a class of categories equipped with a notion of size. They extend not only the higher rank k graphs, but also the Levi categories introduced by the first author as a categorical setting for graphs of groups. We prove that examples of generalized higher rank k graphs can be constructed using Zappa Sz 'ep products of groupoids and higher rank graphs.


Textual Data Distributions Kullback Leibler Textual Distributions Contrasts on GPT 2 Generated Texts, with Supervised, Unsupervised Learning on Vaccine Market Topics Sentiment. Efficient textual data distributions (TDD) alignment and generation are open research problems in textual analytics and NLP. It is presently difficult to parsimoniously and methodologically confirm that two or more natural language datasets belong to similar distributions, and to identify the extent to which textual data possess alignment. This study focuses on addressing a segment of the broader problem described above by applying multiple supervised and unsupervised machine learning (ML) methods to explore the behavior of TDD by (i) topical alignment, and (ii) by sentiment alignment. Furthermore we use multiple text generation methods including fine tuned GPT 2, to generate text by topic and by sentiment. Finally we develop a unique process driven variation of Kullback Leibler divergence (KLD) application to TDD, named KL Textual Distributions Contrasts(KL TDC) to identify the alignment of machine generated textual corpora with naturally occurring textual corpora. This study thus identifies a unique approach for generating and validating TDD by topic and sentiment, which can be used to help address sparse data problems and other research, practice and classroom situations in need of artificially generated topic or sentiment aligned textual data.


Chern Weil theory for Haefliger singular foliations. We give a Chern Weil map for the Gel'fand Fuks characteristic classes of Haefliger singular foliations, those foliations defined by smooth Haefliger structures with dense regular set. Our characteristic map constructs, out of singular geometric structures adapted to singularities, explicit forms representing characteristic classes in de Rham cohomology. The forms are functorial under foliation morphisms. We prove that the theory applies, up to homotopy, to general smooth Haefliger structures subject only to obvious necessary dimension constraints, every smooth Haefliger structure is homotopic to a Haefliger singular foliation, and any morphism of Haefliger structures is homotopic to a morphism of Haefliger singular foliations. As an application, we provide a generalisation to the singular setting of the classical construction of forms representing the Godbillon Vey invariant.


"How Does It Detect A Malicious App?" Explaining the Predictions of AI based Android Malware Detector. AI methods have been proven to yield impressive performance on Android malware detection. However, most AI based methods make predictions of suspicious samples in a black box manner without transparency on models' inference. The expectation on models' explainability and transparency by cyber security and AI practitioners to assure the trustworthiness increases. In this article, we present a novel model agnostic explanation method for AI models applied for Android malware detection. Our proposed method identifies and quantifies the data features relevance to the predictions by two steps i) data perturbation that generates the synthetic data by manipulating features' values and ii) optimization of features attribution values to seek significant changes of prediction scores on the perturbed data with minimal feature values changes. The proposed method is validated by three experiments. We firstly demonstrate that our proposed model explanation method can aid in discovering how AI models are evaded by adversarial samples quantitatively. In the following experiments, we compare the explainability and fidelity of our proposed method with state of the arts, respectively.


Group Free 3D Object Detection via Transformers. Recently, directly detecting 3D objects from 3D point clouds has received increasing attention. To extract object representation from an irregular point cloud, existing methods usually take a point grouping step to assign the points to an object candidate so that a PointNet like network could be used to derive object features from the grouped points. However, the inaccurate point assignments caused by the hand crafted grouping scheme decrease the performance of 3D object detection. In this paper, we present a simple yet effective method for directly detecting 3D objects from the 3D point cloud. Instead of grouping local points to each object candidate, our method computes the feature of an object from all the points in the point cloud with the help of an attention mechanism in the Transformers cite vaswani2017attention , where the contribution of each point is automatically learned in the network training. With an improved attention stacking scheme, our method fuses object features in different stages and generates more accurate object detection results. With few bells and whistles, the proposed method achieves state of the art 3D object detection performance on two widely used benchmarks, ScanNet V2 and SUN RGB D. The code and models are publicly available at url https github.com zeliu98 Group Free 3D


Knowledge Graph informed Fake News Classification via Heterogeneous Representation Ensembles. Increasing amounts of freely available data both in textual and relational form offers exploration of richer document representations, potentially improving the model performance and robustness. An emerging problem in the modern era is fake news detection many easily available pieces of information are not necessarily factually correct, and can lead to wrong conclusions or are used for manipulation. In this work we explore how different document representations, ranging from simple symbolic bag of words, to contextual, neural language model based ones can be used for efficient fake news identification. One of the key contributions is a set of novel document representation learning methods based solely on knowledge graphs, i.e. extensive collections of (grounded) subject predicate object triplets. We demonstrate that knowledge graph based representations already achieve competitive performance to conventionally accepted representation learners. Furthermore, when combined with existing, contextual representations, knowledge graph based document representations can achieve state of the art performance. To our knowledge this is the first larger scale evaluation of how knowledge graph based representations can be systematically incorporated into the process of fake news classification.


Polynomial Anonymous Dynamic Distributed Computing without a Unique Leader. Counting the number of nodes in Anonymous Dynamic Networks is enticing from an algorithmic perspective an important computation in a restricted platform with promising applications. Starting with Michail, Chatzigiannakis, and Spirakis 19 , a flurry of papers sped up the running time guarantees from doubly exponential to polynomial 16 . There is a common theme across all those works a distinguished node is assumed to be present, because Counting cannot be solved deterministically without at least one. In the present work we study challenging questions that naturally follow how to efficiently count with more than one distinguished node, or how to count without any distinguished node. More importantly, what is the minimal information needed about these distinguished nodes and what is the best we can aim for (count precision, stochastic guarantees, etc.) without any. We present negative and positive results to answer these questions. To the best of our knowledge, this is the first work that addresses them.


SpikeDyn A Framework for Energy Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments. Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their energy efficient design for resource constrained scenarios (like embedded systems, IoT Edge, etc.). We propose SpikeDyn, a comprehensive framework for energy efficient SNNs with continual and unsupervised learning capabilities in dynamic environments, for both the training and inference phases. It is achieved through the following multiple diverse mechanisms 1) reduction of neuronal operations, by replacing the inhibitory neurons with direct lateral inhibitions 2) a memory and energy constrained SNN model search algorithm that employs analytical models to estimate the memory footprint and energy consumption of different candidate SNN models and selects a Pareto optimal SNN model and 3) a lightweight continual and unsupervised learning algorithm that employs adaptive learning rates, adaptive membrane threshold potential, weight decay, and reduction of spurious updates. Our experimental results show that, for a network with 400 excitatory neurons, our SpikeDyn reduces the energy consumption on average by 51 for training and by 37 for inference, as compared to the state of the art. Due to the improved learning algorithm, SpikeDyn provides on avg. 21 accuracy improvement over the state of the art, for classifying the most recently learned task, and by 8 on average for the previously learned tasks.


Spectra of strongly Deza graphs. A Deza graph G with parameters (n,k,b,a) is a k regular graph with n vertices such that any two distinct vertices have b or a common neighbours. The children G A and G B of a Deza graph G are defined on the vertex set of G such that every two distinct vertices are adjacent in G A or G B if and only if they have a or b common neighbours, respectively. A strongly Deza graph is a Deza graph with strongly regular children. In this paper we give a spectral characterisation of strongly Deza graphs, show relationships between eigenvalues, and study strongly Deza graphs which are distance regular.


Faster First Order Primal Dual Methods for Linear Programming using Restarts and Sharpness. First order primal dual methods are appealing for their low memory overhead, fast iterations, and effective parallelization. However, they are often slow at finding high accuracy solutions, which creates a barrier to their use in traditional linear programming (LP) applications. This paper exploits the sharpness of primal dual formulations of LP instances to achieve linear convergence using restarts in a general setting that applies to ADMM (alternating direction method of multipliers), PDHG (primal dual hybrid gradient method) and EGM (extragradient method). In the special case of PDHG, without restarts we show a lower bound of Omega( kappa 2 log(1 epsilon)) , while with restarts we show an upper bound of O( kappa log(1 epsilon)) , where kappa is a condition number and epsilon is the desired accuracy. Moreover, the upper bound is optimal for a wide class of primal dual methods, and applies to the strictly more general class of sharp primal dual problems. We develop an adaptive restart scheme and verify that restarts significantly improve the ability of PDHG to find high accuracy solutions to LP problems.


Probing the helium dimer by relativistic highly charged projectiles. We study the fragmentation of He 2 dimers into He ions by relativistic highly charged projectiles. It is demonstrated that the interaction between an ultrafast projectile with an extremely extended object the helium dimer possesses interesting features which are absent in collisions with "normal" molecules. It is also shown that such projectiles, due to their enormous interaction range, can accurately probe the ground state of the dimer and even be used for a precise determination of its binding energy.


Nonlinear dynamic fracture problems with polynomial and strain limiting constitutive relations. We extend the framework of dynamic fracture problems with a phase field approximation to the case of a nonlinear constitutive relation between the Cauchy stress tensor mathbb T , linearised strain boldsymbol epsilon ( mathbf u ) and strain rate boldsymbol epsilon ( mathbf u t ) . The relationship takes the form boldsymbol epsilon ( mathbf u t) alpha boldsymbol epsilon ( mathbf u ) F( mathbb T ) where F satisfies certain p growth conditions. We take particular care to study the case p 1 of a strain limiting' solid, that is, one in which the strain is bounded it a priori . We prove the existence of long time, large data weak solutions of a balance law coupled with a minimisation problem for the phase field function and an energy dissipation inequality, in any number d of spatial dimensions. In the case of Dirichlet boundary conditions, we also prove the satisfaction of an energy dissipation equality.


Modeling the Second Player in Distributionally Robust Optimization. Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the "uncertainty set"). This is done by solving a min max game the model is trained to minimize its maximum expected loss among all distributions in the uncertainty set. While careful design of the uncertainty set is critical to the success of the DRO procedure, previous work has been limited to relatively simple alternatives that keep the min max optimization problem exactly tractable, such as f divergence balls. In this paper, we argue instead for the use of neural generative models to characterize the worst case distribution, allowing for more flexible and problem specific selection of the uncertainty set. However, while simple conceptually, this approach poses a number of implementation and optimization challenges. To circumvent these issues, we propose a relaxation of the KL constrained inner maximization objective that makes the DRO problem more amenable to gradient based optimization of large scale generative models, and develop model selection heuristics to guide hyper parameter search. On both toy settings and realistic NLP tasks, we find that the proposed approach yields models that are more robust than comparable baselines.


ePose Let's Make EfficientPose More Generally Applicable. EfficientPose is an impressive 3D object detection model. It has been demonstrated to be quick, scalable, and accurate, especially when considering that it uses only RGB inputs. In this paper we try to improve on EfficientPose by giving it the ability to infer an object's size, and by simplifying both the data collection and loss calculations. We evaluated ePose using the Linemod dataset and a new subset of it called "Occlusion 1 class". We also outline our current progress and thoughts about using ePose with the NuScenes and the 2017 KITTI 3D Object Detection datasets. The source code is available at https github.com tbd clip EfficientPose.


Geometric Value Iteration Dynamic Error Aware KL Regularization for Reinforcement Learning. The recent boom in the literature on entropy regularized reinforcement learning (RL) approaches reveals that Kullback Leibler (KL) regularization brings advantages to RL algorithms by canceling out errors under mild assumptions. However, existing analyses focus on fixed regularization with a constant weighting coefficient and do not consider cases where the coefficient is allowed to change dynamically. In this paper, we study the dynamic coefficient scheme and present the first asymptotic error bound. Based on the dynamic coefficient error bound, we propose an effective scheme to tune the coefficient according to the magnitude of error in favor of more robust learning. Complementing this development, we propose a novel algorithm, Geometric Value Iteration (GVI), that features a dynamic error aware KL coefficient design with the aim of mitigating the impact of errors on performance. Our experiments demonstrate that GVI can effectively exploit the trade off between learning speed and robustness over uniform averaging of a constant KL coefficient. The combination of GVI and deep networks shows stable learning behavior even in the absence of a target network, where algorithms with a constant KL coefficient would greatly oscillate or even fail to converge.


Excitation energies through Becke's exciton model within a Cartesian grid KS DFT. Photon induced electronic excitations are ubiquitously observed in organic chromophore. In this context, we present a simple, alternative time independent DFT procedure, for computation of single particle excitation energies, in particular, the lower bound excited singlet states, which are of primary interest in photochemistry. This takes inspiration from recently developed Becke's exciton model, where a key step constitutes the accurate evaluation of correlated singlet triplet splitting energy. It introduces a non empirical model, both from "adiabatic connection theorem" and "virial theorem" to analyze the role of 2e integral in such calculations. The latter quantity is efficiently mapped onto a real grid and computed accurately using a purely numerical strategy. Illustrative calculations are performed on 10 pi electron organic chromophores within a Cartesian grid implementation of pseudopotential Kohn Sham (KS) DFT, developed in our laboratory, taking SBKJC type basis functions within B3LYP approximation. The triplet and singlet excitation energies corresponding to first singly excited configuration, are found to be in excellent agreement with TD B3LYP calculations. Further, we perform the same for a set of larger molecular systems using the asymptotically corrected LC BLYP, in addition to B3LYP. A systematic comparison with theoretical best estimates demonstrates the viability and suitability of current approach in determining optical gaps, combining predictive accuracy with moderate computational cost.


Stretchable optical diffraction grating from poly(acrylic acid) polyethylene oxide stereocomplex. Optical gratings are a key component in many spectroscopy, communications, and imaging systems. While initially static elements, advances in optical materials have enabled dynamically tunable gratings to be designed. One common tuning strategy is relying on mechanical deformation of the grating pitch to modify the diffraction pattern. To date, most mechanically adaptive optical gratings consist of a hybrid system where rigid moieties are patterned on an elastomeric substrate. In the present work, we demonstrate an all polymer tunable grating that is fabricated using replica molding from the poly(acrylic acid) (PAA) polyethylene oxide (PEO) polymer stereocomplex. PAA PEO pristine films exhibit excellent optical transmittance at or above 80 from 500 nm to 1400 nm and stretchability over 800 strain. The experimental studies on the changes of diffraction mode distances with respect to the applied strains agree well with the finite difference time domain (FDTD) theoretical modeling.


Distributed Sparse Regression via Penalization. We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic penalty of the consensus constraint the latter being instrumental to obtain distributed solution methods. While penalty based consensus methods have been extensively studied in the optimization literature, their statistical and computational guarantees in the high dimensional setting remain unclear. This work provides an answer to this open problem. Our contribution is two fold. First, we establish statistical consistency of the estimator under a suitable choice of the penalty parameter, the optimal solution of the penalized problem achieves near optimal minimax rate mathcal O (s log d N) in ell 2 loss, where s is the sparsity value, d is the ambient dimension, and N is the total sample size in the network this matches centralized sample rates. Second, we show that the proximal gradient algorithm applied to the penalized problem, which naturally leads to distributed implementations, converges linearly up to a tolerance of the order of the centralized statistical error the rate scales as mathcal O (d) , revealing an unavoidable speed accuracy dilemma.Numerical results demonstrate the tightness of the derived sample rate and convergence rate scalings.


Communication Efficient Separable Neural Network for Distributed Inference on Edge Devices. The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the computing power of many devices to enable the machine learning models. In this paper, we proposed a novel method of exploiting model parallelism to separate a neural network for distributed inferences. To achieve a better balance between communication latency, computation latency, and performance, we adopt neural architecture search (NAS) to search for the best transmission policy and reduce the amount of communication. The best model we found decreases by 86.6 of the amount of data transmission compared to the baseline and does not impact performance much. Under proper specifications of devices and configurations of models, our experiments show that the inference of large neural networks on edge clusters can be distributed and accelerated, which provides a new solution for the deployment of intelligent applications in the internet of things (IoT).


Fast solution of fully implicit Runge Kutta and discontinuous Galerkin in time for numerical PDEs, Part II nonlinearities and DAEs. Fully implicit Runge Kutta (IRK) methods have many desirable accuracy and stability properties as time integration schemes, but high order IRK methods are not commonly used in practice with large scale numerical PDEs because of the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic framework for solving the nonlinear equations that arise from IRK methods (and discontinuous Galerkin discretizations in time) applied to nonlinear numerical PDEs, including PDEs with algebraic constraints. Several new linearizations of the nonlinear IRK equations are developed, offering faster and more robust convergence than the often considered simplified Newton, as well as an effective preconditioner for the true Jacobian if exact Newton iterations are desired. Inverting these linearizations requires solving a set of block 2x2 systems. Under quite general assumptions, it is proven that the preconditioned 2x2 operator's condition number is bounded by a small constant close to one, independent of the spatial discretization, spatial mesh, and time step, and with only weak dependence on the number of stages or integration accuracy. Moreover, the new method is built using the same preconditioners needed for backward Euler type time stepping schemes, so can be readily added to existing codes. The new methods are applied to several challenging fluid flow problems, including the compressible Euler and Navier Stokes equations, and the vorticity streamfunction formulation of the incompressible Euler and Navier Stokes equations. Up to 10th order accuracy is demonstrated using Gauss IRK, while in all cases 4th order Gauss IRK requires roughly half the number of preconditioner applications as required by standard SDIRK methods.


Open Domain Question Answering over Tables via Dense Retrieval. Recent advances in open domain QA have led to strong models based on dense retrieval, but only focused on retrieving textual passages. In this work, we tackle open domain QA over tables for the first time, and show that retrieval can be improved by a retriever designed to handle tabular context. We present an effective pre training procedure for our retriever and improve retrieval quality with mined hard negatives. As relevant datasets are missing, we extract a subset of Natural Questions (Kwiatkowski et al., 2019) into a Table QA dataset. We find that our retriever improves retrieval results from 72.0 to 81.1 recall 10 and end to end QA results from 33.8 to 37.7 exact match, over a BERT based retriever.


Fair and Truthful Mechanism with Limited Subsidy. The notion of emph envy freeness is a natural and intuitive fairness requirement in resource allocation. With indivisible goods, such fair allocations are unfortunately not guaranteed to exist. Classical works have avoided this issue by introducing an additional divisible resource, i.e., money, to subsidize envious agents. In this paper, we aim to design a truthful allocation mechanism of indivisible goods to achieve both fairness and efficiency criteria with a limited amount of subsidy. Following the work of Halpern and Shah, our central question is as follows to what extent do we need to rely on the power of money to accomplish these objectives? For general valuations, the impossibility theorem of combinatorial auction translates to our setting even if an arbitrarily large amount of money is available for use, no mechanism can achieve truthfulness, envy freeness, and utilitarian optimality simultaneously when agents have general monotone submodular valuations. By contrast, we show that, when agents have matroidal valuations, there is a truthful allocation mechanism that achieves envy freeness and utilitarian optimality by subsidizing each agent with at most 1 , the maximum marginal contribution of each item for each agent. The design of the mechanism rests crucially on the underlying matroidal M convexity of the Lorenz dominating allocations.


Not engaging with problems in the lab Students' navigation of conflicting data and models. With the adoption of instructional laboratories (labs) that require students to make their own decisions, there is a need to better understand students' activities as they make sense of their data and decide how to proceed. In particular, understanding when students do not engage productively with unexpected data may provide insights into how to better support students in more open ended labs. We examine video and audio data from groups within a lab session where students were expected to find data inconsistent with the predictions of two models. In prior work, we examined the actions of the four groups that productively grapple with this designed problem. Here, we analyze the engagement of the three groups that do not. We conducted three phases of analysis 1) documenting large scale behaviors and time spent in on topic discussion, 2) analyzing interactions with the teaching assistant, and 3) identifying students' framing their expectations for what is taking place when they were discussing their data. Our Phase 1 and 2 analysis show only minor differences between the groups that engaged with the problem and those that did not. Our Phase 3 analysis demonstrated that the groups that did not engage with the problem framed the lab activity as about confirming a known result or as a series of hoops to jump through to fulfill assignment requirements. Implications for instruction include supporting teaching assistants to attend to students' framing and agency within laboratory classrooms.


Finding Small Multi Demand Set Covers with Ubiquitous Elements and Large Sets is Fixed Parameter Tractable. We study a variant of Set Cover where each element of the universe has some demand that determines how many times the element needs to be covered. Moreover, we examine two generalizations of this problem when a set can be included multiple times and when sets have different prices. We prove that all three problems are fixed parameter tractable with respect to the combined parameter budget, the maximum number of elements missing in one of the sets, and the maximum number of sets in which one of the elements does not occur. Lastly, we point out how our fixed parameter tractability algorithm can be applied in the context of bribery for the (collective decision) group identification problem.


Contrastive Document Representation Learning with Graph Attention Networks. Recent progress in pretrained Transformer based language models has shown great success in learning contextual representation of text. However, due to the quadratic self attention complexity, most of the pretrained Transformers models can only handle relatively short text. It is still a challenge when it comes to modeling very long documents. In this work, we propose to use a graph attention network on top of the available pretrained Transformers model to learn document embeddings. This graph attention network allows us to leverage the high level semantic structure of the document. In addition, based on our graph document model, we design a simple contrastive learning strategy to pretrain our models on a large amount of unlabeled corpus. Empirically, we demonstrate the effectiveness of our approaches in document classification and document retrieval tasks.


Neural Latents Benchmark '21 Evaluating latent variable models of neural population activity. Advances in neural recording present increasing opportunities to study neural activity in unprecedented detail. Latent variable models (LVMs) are promising tools for analyzing this rich activity across diverse neural systems and behaviors, as LVMs do not depend on known relationships between the activity and external experimental variables. However, progress with LVMs for neuronal population activity is currently impeded by a lack of standardization, resulting in methods being developed and compared in an ad hoc manner. To coordinate these modeling efforts, we introduce a benchmark suite for latent variable modeling of neural population activity. We curate four datasets of neural spiking activity from cognitive, sensory, and motor areas to promote models that apply to the wide variety of activity seen across these areas. We identify unsupervised evaluation as a common framework for evaluating models across datasets, and apply several baselines that demonstrate benchmark diversity. We release this benchmark through EvalAI. http neurallatents.github.io


V2V Based Task Offloading and Resource Allocation in Vehicular Edge Computing Networks. In the research and application of vehicle ad hoc networks (VANETs), it is often assumed that vehicles obtain cloud computing services by accessing to roadside units (RSUs). However, due to the problems of insufficient construction quantity, limited communication range and overload of calculation load of roadside units, the calculation mode relying only on vehicle to roadside units is difficult to deal with complex and changeable calculation tasks. In this paper, when the roadside unit is missing, the vehicle mobile unit is regarded as a natural edge computing node to make full use of the excess computing power of mobile vehicles and perform the offloading task of surrounding mobile vehicles in time. In this paper, the OPFTO framework is designed, an improved task allocation algorithm HGSA is proposed, and the pre filtering process is designed with full consideration of the moving characteristics of vehicles. In addition, vehicle simulation experiments show that the proposed strategy has the advantages of low delay and high accuracy compared with other task scheduling strategies, which provides a reference scheme for the construction of Urban Intelligent Transportation in the future.


REANN A PyTorch based End to End Multi functional Deep Neural Network Package for Molecular, Reactive and Periodic Systems. In this work, we present a general purpose deep neural network package for representing energies, forces, dipole moments, and polarizabilities of atomistic systems. This so called recursively embedded atom neural network model takes both advantages of the physically inspired atomic descriptor based neural networks and the message passing based neural networks. Implemented in the PyTorch framework, the training process is parallelized on both CPU and GPU with high efficiency and low memory, in which all hyperparameters can be optimized automatically. We demonstrate the state of the art accuracy, high efficiency, scalability, and universality of this package by learning not only energies (with or without forces), but also dipole moment vectors and polarizability tensors, in various molecular, reactive, and periodic systems. An interface between a trained model and LAMMPs is provided for large scale molecular dynamics simulations. We hope that this open source toolbox will allow future method development and applications of machine learned potential energy surfaces and quantum chemical properties of molecules, reactions, and materials.


Spaces of stability conditions via exceptional collection length 4 case. In this paper, we study the space of stability conditions on triangulated categories generated by an exceptional collection. We give an exact description of subspace of stability conditions generated by length 4 complete exceptional collection.


Design of a Flying Humanoid Robot Based on Thrust Vector Control. Achieving short distance flight helps improve the efficiency of humanoid robots moving in complex environments (e.g., crossing large obstacles or reaching high places) for rapid emergency missions. This study proposes a design of a flying humanoid robot named Jet HR2. The robot has 10 joints driven by brushless motors and harmonic drives for locomotion. To overcome the challenge of the stable attitude takeoff in small thrust to weight conditions, the robot was designed based on the concept of thrust vectoring. The propulsion system consists of four ducted fans, that is, two fixed on the waist of the robot and the other two mounted on the feet, for thrust vector control. The thrust vector is controlled by adjusting the attitude of the foot during the flight. A simplified model and control strategies are proposed to solve the problem of attitude instability caused by mass errors and joint position errors during takeoff. The experimental results show that the robot's spin and dive behaviors during takeoff were effectively suppressed by controlling the thrust vector of the ducted fan on the foot. The robot successfully achieved takeoff at a thrust to weight ratio of 1.17 (17 kg 20 kg) and maintained a stable attitude, reaching a takeoff height of over 1000 mm.


Cross Model Pseudo Labeling for Semi Supervised Action Recognition. Semi supervised action recognition is a challenging but important task due to the high cost of data annotation. A common approach to this problem is to assign unlabeled data with pseudo labels, which are then used as additional supervision in training. Typically in recent work, the pseudo labels are obtained by training a model on the labeled data, and then using confident predictions from the model to teach itself. In this work, we propose a more effective pseudo labeling scheme, called Cross Model Pseudo Labeling (CMPL). Concretely, we introduce a lightweight auxiliary network in addition to the primary backbone, and ask them to predict pseudo labels for each other. We observe that, due to their different structural biases, these two models tend to learn complementary representations from the same video clips. Each model can thus benefit from its counterpart by utilizing cross model predictions as supervision. Experiments on different data partition protocols demonstrate the significant improvement of our framework over existing alternatives. For example, CMPL achieves 17.6 and 25.1 Top 1 accuracy on Kinetics 400 and UCF 101 using only the RGB modality and 1 labeled data, outperforming our baseline model, FixMatch, by 9.0 and 10.3 , respectively.


Branch cuts writing, editing, and ramified complexities. As I was preparing my tenure application, the University of Wisconsin Board of Regents voted to redefine tenure, removing many of the institution's historical protections. Reevaluating my career priorities in light of these changes and a resurgent two body problem, I recognized that my fundamental goal was communicating mathematical ideas. I found a new role as an editor at Mathematical Reviews, part of the American Mathematical Society. To my surprise, thinking more about my identity as a writer and editor also changed my perspective on my own sexuality and gender identity, inspiring new approaches to leadership.


Malware Sight Seeing Accelerating Reverse Engineering via Point of Interest Beacons. New types of malware are emerging at concerning rates. However, analyzing malware via reverse engineering is still a time consuming and mostly manual task. For this reason, it is necessary to develop techniques that automate parts of the reverse engineering process and that can evade the built in countermeasures of modern malware. The main contribution of this paper is a novel method to automatically find so called Points of Interest (POIs) in executed programs. POIs are instructions that interact with data that is known to an analyst. They can be used as beacons in the analysis of malware and can help to guide the analyst to the interesting parts of the malware. Furthermore, we propose a metric for POIs , the so called confidence score that estimates how exclusively a POI will process data relevant to the malware. With the goal of automatically extract peers in P2P botnet malware, we demonstrate and evaluate our approach by applying it on four botnets (ZeroAccess, Sality, Nugache, and Kelihos). We looked into the identified POIs for known IPs and ports and, by using this information, leverage it to successfully monitor the botnets. Furthermore, using our scoring system, we show that we can extract peers for each botnet with high accuracy.


Modeling Communication to Coordinate Perspectives in Cooperation. Communication is highly overloaded. Despite this, even young children are good at leveraging context to understand ambiguous signals. We propose a computational account of overloaded signaling from a shared agency perspective which we call the Imagined We for Communication. Under this framework, communication helps cooperators coordinate their perspectives, allowing them to act together to achieve shared goals. We assume agents are rational cooperators, which puts constraints on how signals can be sent and interpreted. We implement this model in a set of simulations demonstrating this model's success under increasing ambiguity as well as increasing layers of reasoning. Our model is capable of improving performance with deeper recursive reasoning however, it outperforms comparison baselines at even the shallowest level, highlighting how shared knowledge and cooperative logic can do much of the heavy lifting in language.


On rate of convergence estimates for homogeneous discrete time nonlinear Markov chains. The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the current probability distributions of the process apart from being dependent on the current state. Such processes often act as limits for large scale systems of dependent Markov chains with interaction. The paper generalizes the convergence results by taking the estimate over two steps. Such an approach keeps the existence and uniqueness results under assumptions that are analogical to the one step result. It is shown that such an approach may lead to a better rate of convergence. Several examples provided illustrating the fact that the suggested estimate may have a better rate of convergence than the original one. Also, it is shown that the new estimate may even be applicable in some cases when the conditions of the result on one step cannot guarantee any convergence. Finally, these examples depict that the original conditions may not be an obstacle for the convergence of nonlinear Markov chains.


SD QA Spoken Dialectal Question Answering for the Real World. Question answering (QA) systems are now available through numerous commercial applications for a wide variety of domains, serving millions of users that interact with them via speech interfaces. However, current benchmarks in QA research do not account for the errors that speech recognition models might introduce, nor do they consider the language variations (dialects) of the users. To address this gap, we augment an existing QA dataset to construct a multi dialect, spoken QA benchmark on five languages (Arabic, Bengali, English, Kiswahili, Korean) with more than 68k audio prompts in 24 dialects from 255 speakers. We provide baseline results showcasing the real world performance of QA systems and analyze the effect of language variety and other sensitive speaker attributes on downstream performance. Last, we study the fairness of the ASR and QA models with respect to the underlying user populations. The dataset, model outputs, and code for reproducing all our experiments are available https github.com ffaisal93 SD QA.


Quasi simple modules and Loewy lengths in modular representations of reductive Lie algebras. Let frak g be a reductive Lie algebra over an algebraically closed field of characteristic p 0 . In this paper, we study the representations of frak g with a p character chi of standard Levi form associated with a given subset I of the simple root system Pi of frak g . Let U chi( frak g ) be the reduced enveloping algebra of frak g . A notion "quasi simple module" (denoted by mathcal L chi( lambda) ) is introduced. The properties of such a module turn out to be better than those of the corresponding simple module widehat L chi( lambda) . It enables us to investigate the U chi( frak g ) modules from a new point of view, and correspondingly gives rise new consequences. First, we show that the first self extension of mathcal L chi( lambda) is zero, and the projective dimension of mathcal L chi( lambda) is finite when lambda is p regular. These properties make it significant to rewrite the formula of Lusztig's Hope (Lusztig's conjecture on the irreducible characters in the category of U chi( frak g ) modules) by replacing widehat L chi( lambda) by mathcal L chi( lambda) . Second, with the aid of quasi simple modules, we get a formula on the Loewy lengths of standard modules and proper standard modules over U chi( frak g ) . And by studying some examples, we formulate some conjectures on the Loewy lengths of indecomposable projective frak g modules, standard modules and proper standard modules.


Constrained Language Models Yield Few Shot Semantic Parsers. We explore the use of large pretrained language models as few shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language models are trained to generate natural language. To bridge the gap, we use language models to paraphrase inputs into a controlled sublanguage resembling English that can be automatically mapped to a target meaning representation. Our results demonstrate that with only a small amount of data and very little code to convert into English like representations, our blueprint for rapidly bootstrapping semantic parsers leads to surprisingly effective performance on multiple community tasks, greatly exceeding baseline methods also trained on the same limited data.


Lost in Zero Space An Empirical Comparison of 0.y.z Releases in Software Package Distributions. Distributions of open source software packages dedicated to specific programming languages facilitate software development by allowing software projects to depend on the functionality provided by such reusable packages. The health of a software project can be affected by the maturity of the packages on which it depends. The version numbers of the used package releases provide an indication of their maturity. Packages with a 0.y.z version number are commonly assumed to be under initial development, suggesting that they are likely to be less stable, and depending on them may be considered as less healthy. In this paper, we empirically study, for four open source package distributions (Cargo, npm, Packagist and RubyGems) to which extent 0.y.z package releases and 1.0.0 package releases behave differently. We quantify the prevalence of 0.y.z releases, we explore how long packages remain in the initial development stage, we compare the update frequency of 0.y.z and 1.0.0 package releases, we study how often 0.y.z releases are required by other packages, we assess whether semantic versioning is respected for dependencies towards them, and we compare some characteristics of 0.y.z and 1.0.0 package repositories hosted on GitHub. Among others, we observe that package distributions are more permissive than what semantic versioning dictates for 0.y.z releases, and that many of the 0.y.z releases can actually be regarded as mature packages. As a consequence, the version number does not provide a good indication of the maturity of a package release.