Zero shot Generalization in Dialog State Tracking through Generative Question Answering. Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task oriented dialogs. In real world settings with constantly changing services, DST systems must generalize to new domains and unseen slot types. Existing methods for DST do not generalize well to new slot names and many require known ontologies of slot types and values for inference. We introduce a novel ontology free framework that supports natural language queries for unseen constraints and slots in multi domain task oriented dialogs. Our approach is based on generative question answering using a conditional language model pre trained on substantive English sentences. Our model improves joint goal accuracy in zero shot domain adaptation settings by up to 9 (absolute) over the previous state of the art on the MultiWOZ 2.1 dataset.


Re rank Coarse Classification with Local Region Enhanced Features for Fine Grained Image Recognition. Fine grained image recognition is very challenging due to the difficulty of capturing both semantic global features and discriminative local features. Meanwhile, these two features are not easy to be integrated, which are even conflicting when used simultaneously. In this paper, a retrieval based coarse to fine framework is proposed, where we re rank the TopN classification results by using the local region enhanced embedding features to improve the Top1 accuracy (based on the observation that the correct category usually resides in TopN results). To obtain the discriminative regions for distinguishing the fine grained images, we introduce a weakly supervised method to train a box generating branch with only image level labels. In addition, to learn more effective semantic global features, we design a multi level loss over an automatically constructed hierarchical category structure. Experimental results show that our method achieves state of the art performance on three benchmarks CUB 200 2011, Stanford Cars, and FGVC Aircraft. Also, visualizations and analysis are provided for better understanding.


Assisted Learning for Organizations with Limited Data. We develop an assisted learning framework for assisting organization level learners to improve their learning performance with limited and imbalanced data. In particular, learners at the organization level usually have sufficient computation resource, but are subject to stringent collaboration policy and information privacy. Their limited imbalanced data often cause biased inference and sub optimal decision making. In our assisted learning framework, an organizational learner purchases assistance service from a service provider and aims to enhance its model performance within a few assistance rounds. We develop effective stochastic training algorithms for assisted deep learning and assisted reinforcement learning. Different from existing distributed algorithms that need to frequently transmit gradients or models, our framework allows the learner to only occasionally share information with the service provider, and still achieve a near oracle model as if all the data were centralized.


Imbalanced Sample Generation and Evaluation for Power System Transient Stability Using CTGAN. Although deep learning has achieved impressive advances in transient stability assessment of power systems, the insufficient and imbalanced samples still trap the training effect of the data driven methods. This paper proposes a controllable sample generation framework based on Conditional Tabular Generative Adversarial Network (CTGAN) to generate specified transient stability samples. To fit the complex feature distribution of the transient stability samples, the proposed framework firstly models the samples as tabular data and uses Gaussian mixture models to normalize the tabular data. Then we transform multiple conditions into a single conditional vector to enable multi conditional generation. Furthermore, this paper introduces three evaluation metrics to verify the quality of generated samples based on the proposed framework. Experimental results on the IEEE 39 bus system show that the proposed framework effectively balances the transient stability samples and significantly improves the performance of transient stability assessment models.


On convergence of numerical solutions for the compressible MHD system with weakly divergence free magnetic field. We study a general convergence theory for the analysis of numerical solutions to the magnetohydrodynamic system describing the time evolution of compressible, viscous, electrically conducting fluids in space dimension d ( 2 3). First, we introduce the concept of dissipative weak solutions and prove the weak strong uniqueness property for dissipative weak solutions, meaning a dissipative weak solution coincides with a classical solution emanating from the same initial data on the lifespan of the latter. Next, we introduce the concept of consistent approximations and prove the convergence of consistent approximations towards the dissipative weak solution as well as the classical solution. Interpreting the consistent approximation as the energy stability and consistency of numerical solutions, we have built a nonlinear variant of the celebrated Lax equivalence theorem. Finally, as an application of this theory, we show the convergence analysis for two numerical methods.


RaidaR A Rich Annotated Image Dataset of Rainy Street Scenes. We introduce RaidaR, a rich annotated image dataset of rainy street scenes, to support autonomous driving research. The new dataset contains the largest number of rainy images (58,542) to date, 5,000 of which provide semantic segmentations and 3,658 provide object instance segmentations. The RaidaR images cover a wide range of realistic rain induced artifacts, including fog, droplets, and road reflections, which can effectively augment existing street scene datasets to improve data driven machine perception during rainy weather. To facilitate efficient annotation of a large volume of images, we develop a semi automatic scheme combining manual segmentation and an automated processing akin to cross validation, resulting in 10 20 fold reduction on annotation time. We demonstrate the utility of our new dataset by showing how data augmentation with RaidaR can elevate the accuracy of existing segmentation algorithms. We also present a novel unpaired image to image translation algorithm for adding removing rain artifacts, which directly benefits from RaidaR.


A relative approach to opinion formation. Formal models of opinion formation commonly represent an individual's opinion by a value on a fixed opinion interval. We propose an alternative modeling method wherein interpretation is only provided to the relative positions of opinions vis a vis each other. This method is then considered in a similar setting as the discrete time Altafini model (an extension of the well known DeGroot model), but with more general influence weights. Even in a linear framework, the model can describe, in the long run, polarization, dynamics with a periodic pattern, and (modulus) consensus formation. In addition, in our alternative approach key characteristics of the opinion dynamic can be derived from real valued square matrices of influence weights, which immediately allows one to transfer matrix theory insights to the field of opinion formation dynamics under more relaxed conditions than in the DeGroot or discrete time Altafini models. A few specific themes are covered (i) We demonstrate how stable patterns in relative opinion dynamics are identified which are hidden when opinions are considered in an absolute opinion framework. (ii) For the two agent case, we provide an exhaustive closed form description of the relative opinion model's dynamic in the long run. (iii) We explore group dynamics analytically, in particular providing a non trivial condition under which a subgroup's asymptotic behavior carries over to the entire population.


On Cropped versus Uncropped Training Sets in Tabular Structure Detection. Automated document processing for tabular information extraction is highly desired in many organizations, from industry to government. Prior works have addressed this problem under table detection and table structure detection tasks. Proposed solutions leveraging deep learning approaches have been giving promising results in these tasks. However, the impact of dataset structures on table structure detection has not been investigated. In this study, we provide a comparison of table structure detection performance with cropped and uncropped datasets. The cropped set consists of only table images that are cropped from documents assuming tables are detected perfectly. The uncropped set consists of regular document images. Experiments show that deep learning models can improve the detection performance by up to 9 in average precision and average recall on the cropped versions. Furthermore, the impact of cropped images is negligible under the Intersection over Union (IoU) values of 50 70 when compared to the uncropped versions. However, beyond 70 IoU thresholds, cropped datasets provide significantly higher detection performance.


Rational numbers represented by sign variable Cantor series. The present article is devoted to representations of rational numbers in terms sign variable Cantor expansions. The main attention is given to one of the discussions given by J. Galambos in 4 .


Effects of Rotation on Vorticity Dynamics on a Sphere with Discrete Exterior Calculus. We investigate incompressible, inviscid vorticity dynamics on a rotating unit sphere using a Discrete Exterior Calculus (DEC) scheme. For a prescribed initial vorticity distribution, we vary the rate of rotation of the sphere from zero (non rotating case, which corresponds to infinite Rossby number (Ro)) to 320 (which corresponds to Ro 1.30 times 10 3 ), and investigate the evolution with time of the vorticity field. For the non rotating case, the vortices evolve into thin filaments due to so called forward direct enstrophy cascade. At late times an oscillating quadrupolar vortical field emerges as a result of the inverse energy cascade. Rotation diminishes the forward cascade of enstrophy (and hence the inverse cascade of energy) and tend to align the vortical structures in the azimuthal zonal direction. Our investigation reveals that, for the initial vorticity field comprising of intermediate wavenumber spherical harmonics, the zonalization of the vortical structures is not monotonic with ever decreasing Rossby numbers and the structures revert back to a non zonal state below a certain Rossby number. On the other hand, for the initial vorticity field comprising of intermediate to large wavenumber spherical harmonics, the zonalization is monotonic with decreasing Rossby number. Although, rotation diminishes the forward cascade of enstrophy, it does not completely cease arrest the cascade.


Low Cost Algorithmic Recourse for Users With Uncertain Cost Functions. People affected by machine learning model decisions may benefit greatly from access to recourses, i.e. suggestions about what features they could change to receive a more favorable decision from the model. Current approaches try to optimize for the cost incurred by users when adopting a recourse, but they assume that all users share the same cost function. This is an unrealistic assumption because users might have diverse preferences about their willingness to change certain features. In this work, we introduce a new method for identifying recourse sets for users which does not assume that users' preferences are known in advance. We propose an objective function, Expected Minimum Cost (EMC), based on two key ideas (1) when presenting a set of options to a user, there only needs to be one low cost solution that the user could adopt (2) when we do not know the user's true cost function, we can approximately optimize for user satisfaction by first sampling plausible cost functions from a distribution, then finding a recourse set that achieves a good cost for these samples. We optimize EMC with a novel discrete optimization algorithm, Cost Optimized Local Search (COLS), which is guaranteed to improve the recourse set quality over iterations. Experimental evaluation on popular real world datasets with simulated users demonstrates that our method satisfies up to 25.89 percentage points more users compared to strong baseline methods, while, the human evaluation shows that our recourses are preferred more than twice as often as the strongest baseline recourses. Finally, using standard fairness metrics we show that our method can provide more fair solutions across demographic groups than baselines. We provide our source code at https github.com prateeky2806 EMC COLS recourse


Fault Tolerant Max Cut. In this work, we initiate the study of fault tolerant Max Cut, where given an edge weighted undirected graph G (V,E) , the goal is to find a cut S subseteq V that maximizes the total weight of edges that cross S even after an adversary removes k vertices from G . We consider two types of adversaries an adaptive adversary that sees the outcome of the random coin tosses used by the algorithm, and an oblivious adversary that does not. For any constant number of failures k we present an approximation of (0.878 epsilon) against an adaptive adversary and of alpha GW approx 0.8786 against an oblivious adversary (here alpha GW is the approximation achieved by the random hyperplane algorithm of Goemans Williamson J. ACM 95 ). Additionally, we present a hardness of approximation of alpha GW against both types of adversaries, rendering our results (virtually) tight. The non linear nature of the fault tolerant objective makes the design and analysis of algorithms harder when compared to the classic Max Cut. Hence, we employ approaches ranging from multi objective optimization to LP duality and the ellipsoid algorithm to obtain our results.


Accuracy of spectral element method for wave, parabolic and Schr " o dinger equations. The spectral element method constructed by the Q k ( k geq 2 ) continuous finite element method with (k 1) point Gauss Lobatto quadrature on rectangular meshes is a popular high order scheme for solving wave equations in various applications. It can also be regarded as a finite difference scheme on all Gauss Lobatto points. We prove that this finite difference scheme is (k 2) order accurate in discrete 2 norm for smooth solutions. The same proof can be extended to the spectral element method solving linear parabolic and Schr "odinger equations. The main result also applies to the spectral element method on curvilinear meshes that can be smoothly mapped to rectangular meshes on the unit square.


1st Place Solution to ECCV TAO 2020 Detect and Represent Any Object for Tracking. We extend the classical tracking by detection paradigm to this tracking any object task. Solid detection results are first extracted from TAO dataset. Some state of the art techniques like textbf BA lanced textbf G roup textbf S oftmax ( textbf BAGS cite li2020overcoming ) and DetectoRS cite qiao2020detectors are integrated during detection. Then we learned appearance features to represent any object by training feature learning networks. We ensemble several models for improving detection and feature representation. Simple linking strategies with most similar appearance features and tracklet level post association module are finally applied to generate final tracking results. Our method is submitted as textbf AOA on the challenge website. Code is available at https github.com feiaxyt Winner ECCV20 TAO.


Session based Social and Dependency aware Software Recommendation. With the increase of complexity of modern software, social collaborative coding and reuse of open source software packages become more and more popular, which thus greatly enhances the development efficiency and software quality. However, the explosive growth of open source software packages exposes developers to the challenge of information overload. While this can be addressed by conventional recommender systems, they usually do not consider particular constraints of social coding such as social influence among developers and dependency relations among software packages. In this paper, we aim to model the dynamic interests of developers with both social influence and dependency constraints, and propose the Session based Social and Dependency aware software Recommendation (SSDRec) model. This model integrates recurrent neural network (RNN) and graph attention network (GAT) into a unified framework. An RNN is employed to model the short term dynamic interests of developers in each session and two GATs are utilized to capture social influence from friends and dependency constraints from dependent software packages, respectively. Extensive experiments are conducted on real world datasets and the results demonstrate that our model significantly outperforms the competitive baselines.


Revisiting the origin to bridge a gap between topology and topography optimisation of fluid flow problems. This paper revisits the origin of topology optimisation for fluid flow problems, namely the Poiseuille based frictional resistance term used to parametrise regions of solid and fluid. The traditional model only works for true topology optimisation, where it is used to approximate solid regions as areas with very small channel height and, thus, very high frictional resistance. It will be shown that if the channel height is allowed to vary continuously and or the minimum channel height is relatively large and or meaning is attributed to intermediate design field values, then the predictions of the traditional model are wrong. To remedy this problem, this work introduces an augmentation of the mass conservation equation to allow for continuously varying channel heights. The proposed planar model accurately describes fully developed flow between two plates of varying channel height. It allows for a significant reduction in the number of degrees of freedom, while generally ensuring a high accuracy for low to moderate Reynolds numbers in the laminar regime. The accuracy and limitations of both the traditional and proposed models are explored using in depth parametric studies. The proposed model is used to optimise the height of the fluid channel between two parallel plates and, thus, the topography of the plates for a flow distribution problem. Lastly, it is observed that the proposed model actually produces better topological designs than the traditional model when applied to the topology optimisation of a flow manifold.


Polarisation optics for biomedical and clinical applications a review. Many polarisation techniques have been harnessed for decades in biological and clinical research, each based upon measurement of the vectorial properties of light or the vectorial transformations imposed on light by objects. Various advanced vector measurement sensing techniques, physical interpretation methods, and approaches to analyse biomedically relevant information have been developed and harnessed. In this review, we focus mainly on summarizing methodologies and applications related to tissue polarimetry, with an emphasis on the adoption of the Stokes Mueller formalism. Several recent breakthroughs, development trends, and potential multi modal uses in conjunction with other techniques are also presented. The primary goal of the review is to give the reader a general overview in the use of vectorial information that can be obtained by polarisation optics for applications in biomedical and clinical research.


AffectiveNet Affective Motion Feature Learningfor Micro Expression Recognition. Micro expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective motion imaging that cumulates rapid and short lived variational information of micro expressions into a single response. Moreover, we have proposed an AffectiveNet affective motion feature learning network that can perceive subtle changes and learns the most discriminative dynamic features to describe the emotion classes. The AffectiveNet holds two blocks MICRoFeat and MFL block. MICRoFeat block conserves the scale invariant features, which allows network to capture both coarse and tiny edge variations. While MFL block learns micro level dynamic variations from two different intermediate convolutional layers. Effectiveness of the proposed network is tested over four datasets by using two experimental setups person independent (PI) and cross dataset (CD) validation. The experimental results of the proposed network outperforms the state of the art approaches with significant margin for MER approaches.


log Set Formulas as Programs. log is a programming language at the intersection of Constraint Logic Programming, set programming and declarative programming. But log is also a satisfiability solver for a theory of finite sets and finite binary relations. With log programmers can write abstract programs using all the power of set theory and binary relations. These programs are not very efficient but they are very close to specifications. Then, their correctness is more evident. Furthermore, log programs are also set formulas. Hence, programmers can use log again to automatically prove their programs verify non trivial properties. In this paper we show this development methodology by means of several examples.


Calibration free wavelength modulation spectroscopy based on even order harmonics. This paper proposes a novel and rapid calibration free wavelength modulation spectroscopy algorithm based on even order harmonics. The proposed algorithm, analytically deduced from Voigt line shape function, only involves simple algebraic operations to describe the actual gas absorption spectra, thus eliminating the time consuming simulations and line shape fitting procedures adopted in traditional algorithms. Instead of acquiring the entirely scanned absorption line shape, the proposed technique only requires extraction of the peak values of the harmonics. This characteristic significantly benefits gas diagnosis at elevated pressure and or temperature, in which the entirely scanned absorption is very difficult to be obtained due to the broadened line shapes. The proposed algorithm is validated by both numerical simulation and condition controlled experiment, indicating millisecond level calculation of gas parameters with the relative error less than 4 in the experiments.


How statistical model development can obscure inequities in STEM student outcomes. Researchers often frame quantitative research as objective, but every step in data collection and analysis can bias findings in often unexamined ways. In this investigation, we examined how the process of selecting variables to include in regression models (model specification) can bias findings about inequities in science and math student outcomes. We identified the four most used methods for model specification in discipline based education research about equity a priori, statistical significance, variance explained, and information criterion. Using a quantitative critical perspective that blends statistical theory with critical theory, we reanalyzed the data from a prior publication using each of the four methods and compared the findings from each. We concluded that using information criterion produced models that best aligned with our quantitative critical perspective's emphasis on intersectionality and models with more accurate coefficients and uncertainties. Based on these findings, we recommend researchers use information criterion for specifying models about inequities in STEM student outcomes.


An answer to a question of Bonnaf 'e. We give a negative answer to a question of Bonnaf 'e on the Loewy length of a character ring of a finite group.


ParDen Surrogate Assisted Hyper Parameter Optimisation for Portfolio Selection. Portfolio optimisation is a multi objective optimisation problem (MOP), where an investor aims to optimise the conflicting criteria of maximising a portfolio's expected return whilst minimising its risk and other costs. However, selecting a portfolio is a computationally expensive problem because of the cost associated with performing multiple evaluations on test data ("backtesting") rather than solving the convex optimisation problem itself. In this research, we present ParDen, an algorithm for the inclusion of any discriminative or generative machine learning model as a surrogate to mitigate the computationally expensive backtest procedure. In addition, we compare the performance of alternative metaheuristic algorithms NSGA II, R NSGA II, NSGA III, R NSGA III, U NSGA III, MO CMA ES, and COMO CMA ES. We measure performance using multi objective performance indicators, including Generational Distance Plus, Inverted Generational Distance Plus and Hypervolume. We also consider meta indicators, Success Rate and Average Executions to Success Rate, of the Hypervolume to provide more insight into the quality of solutions. Our results show that ParDen can reduce the number of evaluations required by almost a third while obtaining an improved Pareto front over the state of the art for the problem of portfolio selection.


Subgraph aware Few Shot Inductive Link Prediction via Meta Learning. Link prediction for knowledge graphs aims to predict missing connections between entities. Prevailing methods are limited to a transductive setting and hard to process unseen entities. The recent proposed subgraph based models provided alternatives to predict links from the subgraph structure surrounding a candidate triplet. However, these methods require abundant known facts of training triplets and perform poorly on relationships that only have a few triplets. In this paper, we propose Meta iKG, a novel subgraph based meta learner for few shot inductive relation reasoning. Meta iKG utilizes local subgraphs to transfer subgraph specific information and learn transferable patterns faster via meta gradients. In this way, we find the model can quickly adapt to few shot relationships using only a handful of known facts with inductive settings. Moreover, we introduce a large shot relation update procedure to traditional meta learning to ensure that our model can generalize well both on few shot and large shot relations. We evaluate Meta iKG on inductive benchmarks sampled from NELL and Freebase, and the results show that Meta iKG outperforms the current state of the art methods both in few shot scenarios and standard inductive settings.


On support tau tilting graphs of gentle algebras. Let A be a finite dimensional gentle algebra over an algebraically closed field. We investigate the combinatorial properties of support tau tilting graph of A . In particular, it is proved that the support tau tilting graph of A is connected and has the so called reachable in face property. This property was conjectured by Fomin and Zelevinsky for exchange graphs of cluster algebras which was recently confirmed by Cao and Li.


Shared memories driven by the intrinsic memorability of items. When we experience an event, it feels like our previous experiences, our interpretations of that event (e.g., aesthetics, emotions), and our current state will determine how we will remember it. However, recent work has revealed a strong sway of the visual world itself in influencing what we remember and forget. Certain items including certain faces, words, images, and movements are intrinsically memorable or forgettable across observers, regardless of individual differences. Further, neuroimaging research has revealed that the brain is sensitive to memorability both rapidly and automatically during late perception. These strong consistencies in memory across people may reflect the broad organizational principles of our sensory environment, and may reveal how the brain prioritizes information before encoding items into memory. In this chapter, I will discuss our current state of the art understanding of memorability for visual information, and what these findings imply about how we perceive and remember visual events.


Faithful and Plausible Explanations of Medical Code Predictions. Machine learning models that offer excellent predictive performance often lack the interpretability necessary to support integrated human machine decision making. In clinical medicine and other high risk settings, domain experts may be unwilling to trust model predictions without explanations. Work in explainable AI must balance competing objectives along two different axes 1) Explanations must balance faithfulness to the model's decision making with their plausibility to a domain expert. 2) Domain experts desire local explanations of individual predictions and global explanations of behavior in aggregate. We propose to train a proxy model that mimics the behavior of the trained model and provides fine grained control over these trade offs. We evaluate our approach on the task of assigning ICD codes to clinical notes to demonstrate that explanations from the proxy model are faithful and replicate the trained model behavior.


Are conditional GANs explicitly conditional?. This paper proposes two important contributions for conditional Generative Adversarial Networks (cGANs) to improve the wide variety of applications that exploit this architecture. The first main contribution is an analysis of cGANs to show that they are not explicitly conditional. In particular, it will be shown that the discriminator and subsequently the cGAN does not automatically learn the conditionality between inputs. The second contribution is a new method, called a contrario cGAN, that explicitly models conditionality for both parts of the adversarial architecture via a novel a contrario loss that involves training the discriminator to learn unconditional (adverse) examples. This leads to a novel type of data augmentation approach for GANs (a contrario learning) which allows to restrict the search space of the generator to conditional outputs using adverse examples. Extensive experimentation is carried out to evaluate the conditionality of the discriminator by proposing a probability distribution analysis. Comparisons with the cGAN architecture for different applications show significant improvements in performance on well known datasets including, semantic image synthesis, image segmentation, monocular depth prediction and "single label" to image using different metrics including Fr 'echet Inception Distance (FID), mean Intersection over Union (mIoU), Root Mean Square Error log (RMSE log) and Number of statistically Different Bins (NDB).


The strong truncated Hamburger moment problem with and without gaps. The strong truncated Hamburger moment problem (STHMP) of degree ( 2k 1,2k 2) asks to find necessary and sufficient conditions for the existence of a positive Borel measure, supported on mathbb R setminus 0 , such that beta i int x id mu ( 2k 1 leq i leq 2k 2) . Using the solution of the truncated Hamburger moment problem and the properties of Hankel matrices we solve the STHMP. Then, using the equivalence with the STHMP of degree ( 2k,2k) , we obtain the solution of the 2 dimensional truncated moment problem (TMP) of degree 2k with variety xy 1 , first solved by Curto and Fialkow. Our addition to their result is the fact previously known only for k 2 , that the existence of a measure is equivalent to the existence of a flat extension of the moment matrix. Further on, we solve the STHMP of degree ( 2k 1,2k 2) with one missing moment in the sequence, i.e., beta 2k 1 1 or beta 2k 2 1 , which also gives the solution of the TMP with variety x 2y 1 as a special case, first studied by Fialkow.


SuSketch Surrogate Models of Gameplay as a Design Assistant. This paper introduces SuSketch, a design tool for first person shooter levels. SuSketch provides the designer with gameplay predictions for two competing players of specific character classes. The interface allows the designer to work side by side with an artificially intelligent creator and to receive varied types of feedback such as path information, predicted balance between players in a complete playthrough, or a predicted heatmap of the locations of player deaths. The system also proactively designs alternatives to the level and class pairing, and presents them to the designer as suggestions that improve the predicted balance of the game. SuSketch offers a new way of integrating machine learning into mixed initiative co creation tools, as a surrogate of human play trained on a large corpus of artificial playtraces. A user study with 16 game developers indicated that the tool was easy to use, but also highlighted a need to make SuSketch more accessible and more explainable.


Controllable Semantic Parsing via Retrieval Augmentation. In practical applications of semantic parsing, we often want to rapidly change the behavior of the parser, such as enabling it to handle queries in a new domain, or changing its predictions on certain targeted queries. While we can introduce new training examples exhibiting the target behavior, a mechanism for enacting such behavior changes without expensive model re training would be preferable. To this end, we propose ControllAble Semantic Parser via Exemplar Retrieval (CASPER). Given an input query, the parser retrieves related exemplars from a retrieval index, augments them to the query, and then applies a generative seq2seq model to produce an output parse. The exemplars act as a control mechanism over the generic generative model by manipulating the retrieval index or how the augmented query is constructed, we can manipulate the behavior of the parser. On the MTOP dataset, in addition to achieving state of the art on the standard setup, we show that CASPER can parse queries in a new domain, adapt the prediction toward the specified patterns, or adapt to new semantic schemas without having to further re train the model.


MD Simulation of Hundred Billion Metal Atom Cascade Collision on Sunway Taihulight. Radiation damage to the steel material of reactor pressure vessels is a major threat to the nuclear reactor safety. It is caused by the metal atom cascade collision, initialized when the atoms are struck by a high energy neutron. The paper presents MISA MD, a new implementation of molecular dynamics, to simulate such cascade collision with EAM potential. MISA MD realizes (1) a hash based data structure to efficiently store an atom and find its neighbors, and (2) several acceleration and optimization strategies based on SW26010 processor of Sunway Taihulight supercomputer, including an efficient potential table storage and interpolation method, a coloring method to avoid write conflicts, and double buffer and data reuse strategies. The experimental results demonstrated that MISA MD has good accuracy and scalability, and obtains a parallel efficiency of over 79 in an 655 billion atom system. Compared with a state of the art MD program LAMMPS, MISA MD requires less memory usage and achieves better computational performance.


Uncertainty in Criminal Justice Algorithms simulation studies of the Pennsylvania Additive Classification Tool. Much attention has been paid to algorithms related to sentencing, the setting of bail, parole decisions and recidivism while less attention has been paid to carceral algorithms, those algorithms used to determine an incarcerated individual's lived experience. In this paper we study one such algorithm, the Pennsylvania Additive Classification Tool (PACT) that assigns custody levels to incarcerated individuals. We analyze the PACT in ways that criminal justice algorithms are often analyzed namely, we train an accurate machine learning model for the PACT we study its fairness across sex, age and race and we determine which features are most important. In addition to these conventional computations, we propose and carry out some new ways to study such algorithms. Instead of focusing on the outcomes themselves, we propose shifting our attention to the variability in the outcomes, especially because many carceral algorithms are used repeatedly and there can be a propagation of uncertainty. By carrying out several simulations of assigning custody levels, we shine light on problematic aspects of tools like the PACT.


Levenberg Marquardt method and partial exact penalty parameter selection in bilevel optimization. We consider the optimistic bilevel optimization problem, known to have a wide range of applications in engineering, that we transform into a single level optimization problem by means of the lower level optimal value function reformulation. Subsequently, based on the partial calmness concept, we build an equation system, which is parameterized by the corresponding partial exact penalization parameter. We then design and analyze a Levenberg Marquardt method to solve this parametric system of equations. Considering the fact that the selection of the partial exact penalization parameter is a critical issue when numerically solving a bilevel optimization problem, we conduct a careful experimental study to this effect, in the context the Levenberg Marquardt method, while using the Bilevel Optimization LIBrary (BOLIB) series of test problems.


Ergodic Deviations of Degenerate Multidimensional Actions Symmetric Convex Bodies. We prove that the ergodic deviation of a degenerate mathbb Z 2 action on the torus mathbb T 2 relative to a symmetric, strictly convex body can be decomposed into two parts, and that each part admits a limit distribution after choosing a suitable normalizer. Specifically, the first part is similar to an ergodic sum of smooth observables after being normalized by N , and the second part is similar to the case of a random toral translation, i.e., the mathbb Z action, but with a normalizer of N frac 1 2 . The key difference is that we employ the product flow on the product space of mathbb Z 2 lattices for the multidimensional action.


Spatio Temporal Economic Properties of Multi Product Supply Chains. In this work, we analyze the spatio temporal economic properties of multi product supply chains. Specifically, we interpret the supply chain as a coordinated market in which stakeholders (suppliers, consumers, and providers of transportation, storage, and transformation services) bid into a market that is cleared by an independent entity to obtain allocations and prices. The proposed model provides a general graph representation of spatio temporal product transport that helps capture geographical transport, time delays, and storage (temporal transport) in a unified and compact manner. This representation allows us to establish fundamental economic properties for the supply chain (revenue adequacy, cost recovery, and competitiveness) and to establish bounds for space time prices. To illustrate the concepts, we consider a case study in which organic waste is used for producing biogas and electricity. Our market model shows that incentives for waste storage emerge from electricity demand dynamics and illustrates how space time price dynamics for waste and derived products emerge from geographical transport and storage.


Mining Idioms in the Wild. Existing code repositories contain numerous instances of code patterns that are idiomatic ways of accomplishing a particular programming task. Sometimes, the programming language in use supports specific operators or APIs that can express the same idiomatic imperative code much more succinctly. However, those code patterns linger in repositories because the developers may be unaware of the new APIs or have not gotten around to them. Detection of idiomatic code can also point to the need for new APIs. We share our experiences in mine idiomatic patterns from the Hack repo at Facebook. We found that existing techniques either cannot identify meaningful patterns from syntax trees or require test suite based dynamic analysis to incorporate semantic properties to mine useful patterns. The key insight of the approach proposed in this paper emph Jezero is that semantic idioms from a large codebase can be learned from emph canonicalized dataflow trees. We propose a scalable, lightweight static analysis based approach to construct such a tree that is well suited to mine semantic idioms using nonparametric Bayesian methods. Our experiments with Jezero on Hack code shows a clear advantage of adding canonicalized dataflow information to ASTs emph Jezero was significantly more effective than a baseline that did not have the dataflow augmentation in being able to effectively find refactoring opportunities from unannotated legacy code.


SiamReID Confuser Aware Siamese Tracker with Re identification Feature. Siamese deep network trackers have received significant attention in recent years due to their real time speed and state of the art performance. However, Siamese trackers suffer from similar looking confusers, that are prevalent in aerial imagery and create challenging conditions due to prolonged occlusions where the tracker object re appears under different pose and illumination. Our work proposes SiamReID, a novel re identification framework for Siamese trackers, that incorporates confuser rejection during prolonged occlusions and is well suited for aerial tracking. The re identification feature is trained using both triplet loss and a class balanced loss. Our approach achieves state of the art performance in the UAVDT single object tracking benchmark.


DeepTag A General Framework for Fiducial Marker Design and Detection. A fiducial marker system usually consists of markers, a detection algorithm, and a coding system. The appearance of markers and the detection robustness are generally limited by the existing detection algorithms, which are hand crafted with traditional low level image processing techniques. Furthermore, a sophisticatedly designed coding system is required to overcome the shortcomings of both markers and detection algorithms. To improve the flexibility and robustness in various applications, we propose a general deep learning based framework, DeepTag, for fiducial marker design and detection. DeepTag not only supports detection of a wide variety of existing marker families, but also makes it possible to design new marker families with customized local patterns. Moreover, we propose an effective procedure to synthesize training data on the fly without manual annotations. Thus, DeepTag can easily adapt to existing and newly designed marker families. To validate DeepTag and existing methods, beside existing datasets, we further collect a new large and challenging dataset where markers are placed in different view distances and angles. Experiments show that DeepTag well supports different marker families and greatly outperforms the existing methods in terms of both detection robustness and pose accuracy. Both code and dataset are available at url https herohuyongtao.github.io research publications deep tag .


Trace theorem and non zero boundary value problem for parabolic equations in weighted Sobolev spaces. We present weighted Sobolev spaces and prove a trace theorem for the spaces. As an application, we discuss non zero boundary value problems for parabolic equations. The weighted parabolic Sobolev spaces we consider are designed, in particular, for the regularity theory of stochastic partial differential equations on bounded domains.


Language Lexicons for Hindi English Multilingual Text Processing. Language Identification in textual documents is the process of automatically detecting the language contained in a document based on its content. The present Language Identification techniques presume that a document contains text in one of the fixed set of languages, however, this presumption is incorrect when dealing with multilingual document which includes content in more than one possible language. Due to the unavailability of large standard corpora for Hindi English mixed lingual language processing tasks we propose the language lexicons, a novel kind of lexical database that supports several multilingual language processing tasks. These lexicons are built by learning classifiers over transliterated Hindi and English vocabulary. The designed lexicons possess richer quantitative characteristic than its primary source of collection which is revealed using the visualization techniques.


Levenshtein Graphs Resolvability, Automorphisms Determining Sets. We introduce the notion of Levenshtein graphs, an analog to Hamming graphs but using the edit distance instead of the Hamming distance in particular, Levenshtein graphs allow for underlying strings (nodes) of different lengths. We characterize various properties of these graphs, including a necessary and sufficient condition for their geodesic distance to be identical to the edit distance, their automorphism group and determining number, and an upper bound on their metric dimension. Regarding the latter, we construct a resolving set composed of two run strings and an algorithm that computes the edit distance between a string of length k and any single run or two run string in O(k) operations.


The Representation Jensen R 'enyi Divergence. We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram matrices that are obtained by evaluating the kernel over pairs of data points. The new measure shares similar properties to Jensen Shannon divergence. Convergence of the proposed estimators follows from concentration results based on the difference between the ordered spectrum of the Gram matrices and the integral operators associated with the population quantities. The proposed measure of divergence avoids the estimation of the probability distribution underlying the data. Numerical experiments involving comparing distributions and applications to sampling unbalanced data for classification show that the proposed divergence can achieve state of the art results.


DRINet A Dual Representation Iterative Learning Network for Point Cloud Segmentation. We present a novel and flexible architecture for point cloud segmentation with dual representation iterative learning. In point cloud processing, different representations have their own pros and cons. Thus, finding suitable ways to represent point cloud data structure while keeping its own internal physical property such as permutation and scale invariant is a fundamental problem. Therefore, we propose our work, DRINet, which serves as the basic network structure for dual representation learning with great flexibility at feature transferring and less computation cost, especially for large scale point clouds. DRINet mainly consists of two modules called Sparse Point Voxel Feature Extraction and Sparse Voxel Point Feature Extraction. By utilizing these two modules iteratively, features can be propagated between two different representations. We further propose a novel multi scale pooling layer for pointwise locality learning to improve context information propagation. Our network achieves state of the art results for point cloud classification and segmentation tasks on several datasets while maintaining high runtime efficiency. For large scale outdoor scenarios, our method outperforms state of the art methods with a real time inference speed of 62ms per frame.


A Nested Multi Scale Model for COVID 19 Viral Infection. In this study, we develop and analyze a nested multi scale model for COVID 19 disease that integrates within host scale and between host scale sub models. First, the well posedness of the multi scale model is discussed, followed by the stability analysis of the equilibrium points. The disease free equilibrium point is shown to be globally asymptotically stable for R 0 1 . When R 0 exceeds unity, a unique infected equilibrium exists, and the system is found to undergo a forward (trans critical) bifurcation at R 0 1 . Two parameter heat plots are also done to find the parameter combinations for which the equilibrium points are stable. The parameters beta, pi and Lambda are found to be most sensitive to R 0 . The influence of within host sub model parameter on the between host sub model variables is numerically illustrated. The spread of infection in a community is shown to be influenced by within host level sub model parameters, such as the production of viral particles by infected cells ( alpha) , the clearance rate of infected cells by the immune system (x) , and the clearance rate of viral particles by the immune system (y) . The comparative effectiveness of the three health interventions (antiviral drugs, immunomodulators, and generalized social distancing) for COVID 19 infection was examined using the effective reproductive number R E as an indicator of the effectiveness of the interventions. The results suggest that a combined strategy of antiviral drugs, immunomodulators and generalized social distancing would be the best strategy to implement to contain the spread of infection in the community.


Bio inspired visual attention for silicon retinas based on spiking neural networks applied to pattern classification. Visual attention can be defined as the behavioral and cognitive process of selectively focusing on a discrete aspect of sensory cues while disregarding other perceivable information. This biological mechanism, more specifically saliency detection, has long been used in multimedia indexing to drive the analysis only on relevant parts of images or videos for further processing. The recent advent of silicon retinas (or event cameras sensors that measure pixel wise changes in brightness and output asynchronous events accordingly) raises the question of how to adapt attention and saliency to the unconventional type of such sensors' output. Silicon retina aims to reproduce the biological retina behaviour. In that respect, they produce punctual events in time that can be construed as neural spikes and interpreted as such by a neural network. In particular, Spiking Neural Networks (SNNs) represent an asynchronous type of artificial neural network closer to biology than traditional artificial networks, mainly because they seek to mimic the dynamics of neural membrane and action potentials over time. SNNs receive and process information in the form of spike trains. Therefore, they make for a suitable candidate for the efficient processing and classification of incoming event patterns measured by silicon retinas. In this paper, we review the biological background behind the attentional mechanism, and introduce a case study of event videos classification with SNNs, using a biology grounded low level computational attention mechanism, with interesting preliminary results.


On radio k chromatic number of powers of paths having small diameter. The radio k coloring is an assignment l of non negative integers to the vertices of a graph in such a way that for two vertices u,v which are d distance apart, we must have l(u) l(v) geq k 1 d . The difference between the greatest and the least image of l is its span and our objective is to minimize the span. That is, the radio k chromatic number rc k(G) is the minimum lambda such that it is a span of some radio k coloring of G . In this article, we find exact values of rc k(P n m ) when k diam(P n m ) epsilon , where P n m denotes the m th power of a path on (n 1) vertices, and diam(P n m ) denotes its diameter.


The Power of the Weisfeiler Leman Algorithm for Machine Learning with Graphs. In recent years, algorithms and neural architectures based on the Weisfeiler Leman algorithm, a well known heuristic for the graph isomorphism problem, emerged as a powerful tool for (supervised) machine learning with graphs and relational data. Here, we give a comprehensive overview of the algorithm's use in a machine learning setting. We discuss the theoretical background, show how to use it for supervised graph and node classification, discuss recent extensions, and its connection to neural architectures. Moreover, we give an overview of current applications and future directions to stimulate research.


Tailoring Broadband Kerr Soliton Microcombs via Post Fabrication Tuning of the Geometric Dispersion. Geometric dispersion in integrated microresonators plays a major role in nonlinear optics applications, especially at short wavelengths, to compensate the natural material normal dispersion. Tailoring of geometric confinement allows for anomalous dispersion, which in particular enables the formation of microcombs which can be tuned into the dissipative Kerr soliton (DKS) regime. Due to processes like soliton induced dispersive wave generation, broadband DKS combs are particularly sensitive to higher order dispersion, which in turn is sensitive to the ring dimensions at the nanometer level. For microrings exhibiting a rectangular cross section, the ring width and thickness are the two main control parameters to achieve the targeted dispersion. The former can be easily varied through parameter variation within the lithography mask, yet the latter is defined by the film thickness during growth of the starting material stack, and can show a significant variation (few percent of the total thickness) over a single wafer. In this letter, we demonstrate that controlled dry etching allows for fine tuning of the device layer (silicon nitride) thickness at the wafer level, allowing multi project wafers targeting different wavelength bands, and post fabrication trimming in air clad ring devices. We demonstrate that such dry etching does not significantly affect either the silicon nitride surface roughness or the optical quality of the devices, thereby enabling fine tuning of the dispersion and the spectral shape of the resulting DKS states.


A Batch Normalization Classifier for Domain Adaptation. Adapting a model to perform well on unforeseen data outside its training set is a common problem that continues to motivate new approaches. We demonstrate that application of batch normalization in the output layer, prior to softmax activation, results in improved generalization across visual data domains in a refined ResNet model. The approach adds negligible computational complexity yet outperforms many domain adaptation methods that explicitly learn to align data domains. We benchmark this technique on the Office Home dataset and show that batch normalization is competitive with other leading methods. We show that this method is not sensitive to presence of source data during adaptation and further present the impact on trained tensor distributions tends toward sparsity. Code is available at https github.com matthewbehrend BNC


Linear maps preserving the Lorentz spectrum of 2 times 2 matrices. In this paper we give a complete description of the linear maps phi W n rightarrow W n that preserve the Lorentz spectrum, when n 2 and W n is the space M n of n times n real matrices or the subspace S n of M n formed by the symmetric matrices. In both cases, we have shown that phi(A) PAP 1 for all A in W 2 , where P is a matrix with a certain structure. The results in this paper extend to n 2 those for n geq 3 obtained by Bueno, Furtado, and Sivakumar (2021). The case n 2 has some specificities, when compared to the case n geq3, due to the fact that the Lorentz cone in mathbb R 2 is polyedral, contrary to what happens when it is contained in mathbb R n with n geq3.


Meromorphic functions and differences of subharmonic functions in integrals and the difference characteristic of Nevanlinna. III. Estimates of integrals over fractal sets in terms of the Hausdorff measure and content. Let U not equiv pm infty be a delta subharmonic function on a closed disc of radius R centered at zero. In the previous two parts of our paper, we obtained general and explicit estimates of the integral of the positive part of the radial maximum growth characteristic mathsf M U(t) sup bigl U(z) bigm z r bigr over the increasing integration function m on the segment 0, r subset 0,R) through the difference characteristic of Nevanlinna and the quantities associated with the integration function m . The third part of our paper contains estimates of these quantities in terms of the Hausdorff h measure and h content of compact subset S subset 0, r such that the integration function m is constant on each open component of the connectivity of the complement 0, r setminus S . The case of the d dimensional Hausdorff measure is highlighted separately.


On the Fourier transform of a quantitative trait Implications for compressive sensing. This paper explores the genotype phenotype relationship. It outlines conditions under which the dependence of a quantitative trait on the genome might be predictable, based on measurement of a limited subset of genotypes. It uses the theory of real valued Boolean functions in a systematic way to translate trait data into the Fourier domain. Important trait features, such as the roughness of the trait landscape or the modularity of a trait have a simple Fourier interpretation. Ruggedness at a gene location corresponds to high sensitivity to mutation, while a modular organization of gene activity reduces such sensitivity. Traits where rugged loci are rare will naturally compress gene data in the Fourier domain, leading to a sparse representation of trait data, concentrated in identifiable, low level coefficients. This Fourier representation of a trait organizes epistasis in a form which is isometric to the trait data. As Fourier matrices are known to be maximally incoherent with the standard basis, this permits employing compressive sensing techniques to work from data sets that are relatively small sometimes even of polynomial size compared to the exponentially large sets of possible genomes. This theory provides a theoretical underpinning for systematic use of Boolean function machinery to dissect the dependency of a trait on the genome and environment.


Accelerating Federated Learning with a Global Biased Optimiser. Federated Learning (FL) is a recent development in the field of machine learning that collaboratively trains models without the training data leaving client devices, to preserve data privacy. In realistic FL settings, the training set is distributed over clients in a highly non Independent and Identically Distributed (non IID) fashion, which has been shown extensively to harm FL convergence speed and final model performance. To address this challenge, we propose a novel, generalised approach for incorporating adaptive optimisation techniques into FL with the Federated Global Biased Optimiser (FedGBO) algorithm. FedGBO accelerates FL by employing a set of global biased optimiser values during the client training phase, which helps to reduce client drift' from non IID data, whilst also benefiting from adaptive optimisation. We show that the FedGBO update with a generic optimiser can be reformulated as centralised training using biased gradients and optimiser updates, and apply this theoretical framework to prove the convergence of FedGBO using momentum Stochastic Gradient Descent (SGDm). We also conduct extensive experiments using 4 realistic FL benchmark datasets (CIFAR100, Sent140, FEMNIST, Shakespeare) and 3 popular adaptive optimisers (RMSProp, SGDm, Adam) to compare the performance of state of the art adaptive FL algorithms. The results demonstrate that FedGBO has highly competitive performance whilst achieving lower communication and computation costs, and provide practical insights into the trade offs associated with the different adaptive FL algorithms and optimisers for real world FL deployments.


Gym mu RTS Toward Affordable Full Game Real time Strategy Games Research with Deep Reinforcement Learning. In recent years, researchers have achieved great success in applying Deep Reinforcement Learning (DRL) algorithms to Real time Strategy (RTS) games, creating strong autonomous agents that could defeat professional players in StarCraft II. However, existing approaches to tackle full games have high computational costs, usually requiring the use of thousands of GPUs and CPUs for weeks. This paper has two main contributions to address this issue 1) We introduce Gym mu RTS (pronounced "gym micro RTS") as a fast to run RL environment for full game RTS research and 2) we present a collection of techniques to scale DRL to play full game mu RTS as well as ablation studies to demonstrate their empirical importance. Our best trained bot can defeat every mu RTS bot we tested from the past mu RTS competitions when working in a single map setting, resulting in a state of the art DRL agent while only taking about 60 hours of training using a single machine (one GPU, three vCPU, 16GB RAM). See the blog post at https wandb.ai vwxyzjn gym microrts paper reports Gym RTS Toward Affordable Deep Reinforcement Learning Research in Real Time Strategy Games Vmlldzo2MDIzMTg and the source code at https github.com vwxyzjn gym microrts paper


Ampere class Bright Field Emission Cathode Operated at 100 MV m. High current bright sources are needed to power the next generation of compact rf and microwave systems. A major requirement is that such a source could be sustainably operated at high frequencies, well above 1 GHz, and high gradients, well above 100 MV m. Field emission sources offer simplicity and scalability in a high frequency era of the injector design, but the output rf cycle charge and high gradient operation remain a great and largely unaddressed challenge. Here, a field emission cathode based on ultra nano crystalline diamond or UNCD, an efficient planar field emission material, was tested at 100 MV m in an L band injector. A very high charge of 38 pC per rf cycle (300 nC per rf pulse corresponding to rf pulse current of 120 mA) was demonstrated. This operating condition revealed a space charge dominated emission from the cathode and revealed a condition under which the 1D Child Langmuir limit was surpassed. Finally, a beam brightness of sim 10 14 10 15 A m 2 times rad 2 was estimated.


Active Reconfigurable Intelligent Surface Aided Secure Transmission. Reconfigurable Intelligent Surface (RIS) draws great attentions in academic and industry due to its passive and low power consumption nature, and has currently been used in physical layer security to enhance the secure transmission. However, due to the existence of double fading effect on the reflecting channel link between transmitter and user, RIS helps achieve limited secrecy performance gain compared with the case without RIS. In this correspondence, we propose a novel active RIS design to enhance the secure wireless transmission, where the reflecting elements in RIS not only adjust the phase shift but also amplify the amplitude of signals. To solve the non convex secrecy rate optimization based on this design, an efficient alternating optimization algorithm is proposed to jointly optimize the beamformer at transmitter and reflecting coefficient matrix at RIS. Simulation results show that with the aid of active RIS design, the impact of double fading effect can be effectively relieved, resulting in a significantly higher secrecy performance gain compared with existing solutions with passive RIS and without RIS design.


Neural Graph Matching based Collaborative Filtering. User and item attributes are essential side information their interactions (i.e., their co occurrence in the sample data) can significantly enhance prediction accuracy in various recommender systems. We identify two different types of attribute interactions, inner interactions and cross interactions inner interactions are those between only user attributes or those between only item attributes cross interactions are those between user attributes and item attributes. Existing models do not distinguish these two types of attribute interactions, which may not be the most effective way to exploit the information carried by the interactions. To address this drawback, we propose a neural Graph Matching based Collaborative Filtering model (GMCF), which effectively captures the two types of attribute interactions through modeling and aggregating attribute interactions in a graph matching structure for recommendation. In our model, the two essential recommendation procedures, characteristic learning and preference matching, are explicitly conducted through graph learning (based on inner interactions) and node matching (based on cross interactions), respectively. Experimental results show that our model outperforms state of the art models. Further studies verify the effectiveness of GMCF in improving the accuracy of recommendation.


Gated3D Monocular 3D Object Detection From Temporal Illumination Cues. Today's state of the art methods for 3D object detection are based on lidar, stereo, or monocular cameras. Lidar based methods achieve the best accuracy, but have a large footprint, high cost, and mechanically limited angular sampling rates, resulting in low spatial resolution at long ranges. Recent approaches based on low cost monocular or stereo cameras promise to overcome these limitations but struggle in low light or low contrast regions as they rely on passive CMOS sensors. In this work, we propose a novel 3D object detection modality that exploits temporal illumination cues from a low cost monocular gated imager. We propose a novel deep detector architecture, Gated3D, that is tailored to temporal illumination cues from three gated images. Gated images allow us to exploit mature 2D object feature extractors that guide the 3D predictions through a frustum segment estimation. We assess the proposed method on a novel 3D detection dataset that includes gated imagery captured in over 10,000 km of driving data. We validate that our method outperforms state of the art monocular and stereo approaches at long distances. We will release our code and dataset, opening up a new sensor modality as an avenue to replace lidar in autonomous driving.


Optimal Delay Outage Analysis for Noise Limited Wireless Networks with Caching, Computing, and Communications Derivations and Proofs. Performance assessment and optimization for networks jointly performing caching, computing, and communication (3C) has recently drawn significant attention because many emerging applications require 3C functionality. However, studies in the literature mostly focus on the particular algorithms and setups of such networks, while their theoretical understanding and characterization has been less explored. To fill this gap, this paper conducts the asymptotic (scaling law) analysis for the delay outage tradeoff of noise limited wireless edge networks with joint 3C. In particular, assuming the user requests for different tasks following a Zipf distribution, we derive the analytical expression for the optimal caching policy. Based on this, we next derive the closed form expression for the optimum outage probability as a function of delay and other network parameters for the case that the Zipf parameter is smaller than 1. Then, for the case that the Zipf parameter is larger than 1, we derive the closed form expressions for upper and lower bounds of the optimum outage probability. We provide insights and interpretations based on the derived expressions. Computer simulations validate our analytical results and insights.


Characterizations of some groups in terms of centralizers. A group G is said to be n centralizer if its number of element centralizers mid Cent(G) mid n , an F group if every non central element centralizer contains no other element centralizer and a CA group if all non central element centralizers are abelian. For any n 11 , we prove that if G is an n centralizer group, then mid frac G Z(G) mid leq 2(n 4) log 2 (n 4) , which improves an earlier result (it is known that mid frac G Z(G) mid leq (n 2) 2 for n leq 11 ). We also prove that if G is an arbitrary n centralizer F group, then gcd (n 2, mid frac G Z(G) mid) neq 1 . For a finite F group G , we show that mid Cent(G) mid geq frac mid G mid 2 iff G cong A 4, D 2n (where n is odd) or an extraspecial 2 group. Among other results, for a finite group G with non trivial center, it is proved that mid Cent(G) mid frac mid G mid 2 iff G is an extraspecial 2 group. We give a family of F groups which are not CA groups and extend an earlier result.


On subdirect products of type FP n of limit groups over Droms RAAGs. We generalize some known results for limit groups over free groups and residually free groups to limit groups over Droms RAAGs and residually Droms RAAGs, respectively. We show that limit groups over Droms RAAGs are free by (torsion free nilpotent). We prove that if S is a full subdirect product of type FP s( mathbb Q ) of limit groups over Droms RAAGs with trivial center, then the projection of S to the direct product of any s of the limit groups over Droms RAAGs has finite index. Moreover, we compute the growth of homology groups and the volume gradients for limit groups over Droms RAAGs in any dimension and for finitely presented residually Droms RAAGs of type FP m in dimensions up to m . In particular, this gives the values of the analytic L 2 Betti numbers of these groups in the respective dimensions.


Continuous mean distance of a weighted graph. We study the concept of the continuous mean distance of a weighted graph. For connected unweighted graphs, the mean distance can be defined as the arithmetic mean of the distances between all pairs of vertices. This parameter provides a natural measure of the compactness of the graph, and has been intensively studied, together with several variants, including its version for weighted graphs. The continuous analog of the (discrete) mean distance is the mean of the distances between all pairs of points on the edges of the graph. Despite being a very natural generalization, to the best of our knowledge this concept has been barely studied, since the jump from discrete to continuous implies having to deal with an infinite number of distances, something that increases the difficulty of the parameter. In this paper we show that the continuous mean distance of a weighted graph can be computed in time quadratic in the number of edges, by two different methods that apply fundamental concepts in discrete algorithms and computational geometry. We also present structural results that allow a faster computation of this continuous parameter for several classes of weighted graphs. Finally, we study the relation between the (discrete) mean distance and its continuous counterpart, mainly focusing on the relevant question of the convergence when iteratively subdividing the edges of the weighted graph.


Local well posedness of skew mean curvature flow for small data in d geq 4 dimensions. The skew mean curvature flow is an evolution equation for d dimensional manifolds embedded in mathbb R d 2 (or more generally, in a Riemannian manifold). It can be viewed as a Schr "odinger analogue of the mean curvature flow, or alternatively as a quasilinear version of the Schr "odinger Map equation. In this article, we prove small data local well posedness in low regularity Sobolev spaces for the skew mean curvature flow in dimension d geq 4 .


Quasitriangular structures on abelian extensions of mathbb Z 2 . The aim of this paper is to give all quasitriangular structures on a class of semisimple Hopf algebras constructed through abelian extensions of Bbbk mathbb Z 2 by Bbbk G for an abelian group G . We first introduce the concept of symmetry of quasitriangular structures of Hopf algebras and obtain some related propositions which can be used to simplify our calculations of quasitriangular structures. Secondly, we find that quasitriangular structures of these semisimple Hopf algebras can do division like operations. Using such operations we transform the problem of solving the quasitriangular structures into solving general solutions and giving a special solution. Then we give all general solutions and get a necessary and sufficient condition for the existence of a special solution.


Committor functions via tensor networks. We propose a novel approach for computing committor functions, which describe transitions of a stochastic process between metastable states. The committor function satisfies a backward Kolmogorov equation, and in typical high dimensional settings of interest, it is intractable to compute and store the solution with traditional numerical methods. By parametrizing the committor function in a matrix product state tensor train format and using a similar representation for the equilibrium probability density, we solve the variational formulation of the backward Kolmogorov equation with linear time and memory complexity in the number of dimensions. This approach bypasses the need for sampling the equilibrium distribution, which can be difficult when the distribution has multiple modes. Numerical results demonstrate the effectiveness of the proposed method for high dimensional problems.


What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methods. There is a rapidly growing literature on dark patterns, user interface designs typically related to shopping or privacy that researchers deem problematic. Recent work has been predominantly descriptive, documenting and categorizing objectionable user interfaces. These contributions have been invaluable in highlighting specific designs for researchers and policymakers. But the current literature lacks a conceptual foundation What makes a user interface a dark pattern? Why are certain designs problematic for users or society? We review recent work on dark patterns and demonstrate that the literature does not reflect a singular concern or consistent definition, but rather, a set of thematically related considerations. Drawing from scholarship in psychology, economics, ethics, philosophy, and law, we articulate a set of normative perspectives for analyzing dark patterns and their effects on individuals and society. We then show how future research on dark patterns can go beyond subjective criticism of user interface designs and apply empirical methods grounded in normative perspectives.


Scale Consistent Fusion from Heterogeneous Local Sampling to Global Immersive Rendering. Image based geometric modeling and novel view synthesis based on sparse, large baseline samplings are challenging but important tasks for emerging multimedia applications such as virtual reality and immersive telepresence. Existing methods fail to produce satisfactory results due to the limitation on inferring reliable depth information over such challenging reference conditions. With the popularization of commercial light field (LF) cameras, capturing LF images (LFIs) is as convenient as taking regular photos, and geometry information can be reliably inferred. This inspires us to use a sparse set of LF captures to render high quality novel views globally. However, fusion of LF captures from multiple angles is challenging due to the scale inconsistency caused by various capture settings. To overcome this challenge, we propose a novel scale consistent volume rescaling algorithm that robustly aligns the disparity probability volumes (DPV) among different captures for scale consistent global geometry fusion. Based on the fused DPV projected to the target camera frustum, novel learning based modules have been proposed (i.e., the attention guided multi scale residual fusion module, and the disparity field guided deep re regularization module) which comprehensively regularize noisy observations from heterogeneous captures for high quality rendering of novel LFIs. Both quantitative and qualitative experiments over the Stanford Lytro Multi view LF dataset show that the proposed method outperforms state of the art methods significantly under different experiment settings for disparity inference and LF synthesis.


The Landau and Non cutoff Boltzmann Equation in Union of Cubes. The existence and stability of collisional kinetic equation, especially non cutoff Boltzmann equation, in bounded domain with physical boundary condition is longstanding open problem. This work proves the global stability of the Landau equation and non cutoff Boltzmann equation in union of cubes with the specular reflection boundary condition when an initial datum is near Maxwellian. Moreover, the solution enjoys exponential large time decay in bounded domain. Our method is based on that fact that normal derivatives in cubes is also derivatives along axis, which allows us to obtain high order derivative estimates.


A survey on Variational Autoencoders from a GreenAI perspective. Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional data. The key insight of VAEs is to learn the latent distribution of data in such a way that new meaningful samples can be generated from it. This approach led to tremendous research and variations in the architectural design of VAEs, nourishing the recent field of research known as unsupervised representation learning. In this article, we provide a comparative evaluation of some of the most successful, recent variations of VAEs. We particularly focus the analysis on the energetic efficiency of the different models, in the spirit of the so called Green AI, aiming both to reduce the carbon footprint and the financial cost of generative techniques. For each architecture we provide its mathematical formulation, the ideas underlying its design, a detailed model description, a running implementation and quantitative results.


Master Equation for Cournot Mean Field Games of Control with Absorption. We establish the existence and uniqueness of a solution to the master equation for a mean field game of controls with absorption. The mean field game arises as a continuum limit of a dynamic game of exhaustible resources modeling Cournot competition between producers. The proof relies on an analysis of a forward backward system of nonlocal Hamilton Jacobi Fokker Planck equations with Dirichlet boundary conditions. In particular, we establish new a priori estimates to prove that solutions are differentiable with respect to the initial measure.


Neural Circuit Synthesis from Specification Patterns. We train hierarchical Transformers on the task of synthesizing hardware circuits directly out of high level logical specifications in linear time temporal logic (LTL). The LTL synthesis problem is a well known algorithmic challenge with a long history and an annual competition is organized to track the improvement of algorithms and tooling over time. New approaches using machine learning might open a lot of possibilities in this area, but suffer from the lack of sufficient amounts of training data. In this paper, we consider a method to generate large amounts of additional training data, i.e., pairs of specifications and circuits implementing them. We ensure that this synthetic data is sufficiently close to human written specifications by mining common patterns from the specifications used in the synthesis competitions. We show that hierarchical Transformers trained on this synthetic data solve a significant portion of problems from the synthesis competitions, and even out of distribution examples from a recent case study.


Knowledge Guided Object Discovery with Acquired Deep Impressions. We present a framework called Acquired Deep Impressions (ADI) which continuously learns knowledge of objects as "impressions" for compositional scene understanding. In this framework, the model first acquires knowledge from scene images containing a single object in a supervised manner, and then continues to learn from novel multi object scene images which may contain objects that have not been seen before without any further supervision, under the guidance of the learned knowledge as humans do. By memorizing impressions of objects into parameters of neural networks and applying the generative replay strategy, the learned knowledge can be reused to generate images with pseudo annotations and in turn assist the learning of novel scenes. The proposed ADI framework focuses on the acquisition and utilization of knowledge, and is complementary to existing deep generative models proposed for compositional scene representation. We adapt a base model to make it fall within the ADI framework and conduct experiments on two types of datasets. Empirical results suggest that the proposed framework is able to effectively utilize the acquired impressions and improve the scene decomposition performance.


Training Neural Networks with Fixed Sparse Masks. During typical gradient based training of deep neural networks, all of the model's parameters are updated at each iteration. Recent work has shown that it is possible to update only a small subset of the model's parameters during training, which can alleviate storage and communication requirements. In this paper, we show that it is possible to induce a fixed sparse mask on the model's parameters that selects a subset to update over many iterations. Our method constructs the mask out of the k parameters with the largest Fisher information as a simple approximation as to which parameters are most important for the task at hand. In experiments on parameter efficient transfer learning and distributed training, we show that our approach matches or exceeds the performance of other methods for training with sparse updates while being more efficient in terms of memory usage and communication costs. We release our code publicly to promote further applications of our approach.


Predicting trajectory behaviour via machine learned invariant manifolds. In this paper, we use support vector machines (SVM) to develop a machine learning framework to discover phase space structures that distinguish between distinct reaction pathways. The SVM model is trained using data from trajectories of Hamilton's equations and works well even with relatively few trajectories. Moreover, this framework is specifically designed to require minimal a priori knowledge of the dynamics in a system. This makes our approach computationally better suited than existing methods for high dimensional systems and systems where integrating trajectories is expensive. We benchmark our approach on Chesnavich's CH 4 Hamiltonian.


GearV A Two Gear Hypervisor for Mixed Criticality IoT Systems. This paper presents GearV, a two gear lightweight hypervisor architecture to address the some known challenges. By dividing hypervisor into some partitions, and dividing scheduling policies into Gear1 and Gear2 respectively, GearV creates a consolidated platform to run best effort system and safety critical system simultaneously with managed engineering effort. The two gears architecture also simplifies retrofitting the virtualization systems. We believe that GearV can serves as a reasonable hypervisor architecture for the mix critical IoT systems.


"Weak AI" is Likely to Never Become "Strong AI", So What is its Greatest Value for us?. AI has surpassed humans across a variety of tasks such as image classification, playing games (e.g., go, "Starcraft" and poker), and protein structure prediction. However, at the same time, AI is also bearing serious controversies. Many researchers argue that little substantial progress has been made for AI in recent decades. In this paper, the author (1) explains why controversies about AI exist (2) discriminates two paradigms of AI research, termed "weak AI" and "strong AI" (a.k.a. artificial general intelligence) (3) clarifies how to judge which paradigm a research work should be classified into (4) discusses what is the greatest value of "weak AI" if it has no chance to develop into "strong AI".


UniT Multimodal Multitask Learning with a Unified Transformer. We propose UniT, a Unified Transformer model to simultaneously learn the most prominent tasks across different domains, ranging from object detection to natural language understanding and multimodal reasoning. Based on the transformer encoder decoder architecture, our UniT model encodes each input modality with an encoder and makes predictions on each task with a shared decoder over the encoded input representations, followed by task specific output heads. The entire model is jointly trained end to end with losses from each task. Compared to previous efforts on multi task learning with transformers, we share the same model parameters across all tasks instead of separately fine tuning task specific models and handle a much higher variety of tasks across different domains. In our experiments, we learn 7 tasks jointly over 8 datasets, achieving strong performance on each task with significantly fewer parameters. Our code is available in MMF at https mmf.sh.


Autonomous Head to Head Racing in the Indy Autonomous Challenge Simulation Race. This paper describes Ariel Team's autonomous racing controller for the Indy Autonomous Challenge (IAC) simulation race cite INDY . IAC is the first multi vehicle autonomous head to head competition, reaching speeds of 300 km h along an oval track, modeled after the Indianapolis Motor Speedway (IMS). Our racing controller attempts to maximize progress along the track while avoiding collisions with opponent vehicles and obeying the race rules. To this end, the racing controller first computes a race line offline. Then, it repeatedly computes online a small set of dynamically feasible maneuver candidates, each tested for collision with the opponent vehicles. Finally, it selects the maneuver that maximizes progress along the track, taking into account the race line. The maneuver candidates, as well as the predicted trajectories of the opponent vehicles, are approximated using a point mass model. Despite the simplicity of this racing controller, it managed to drive competitively and with no collision with any of the opponent vehicles in the IAC final simulation race.


LiDAR Cluster First and Camera Inference Later A New Perspective Towards Autonomous Driving. Object detection in state of the art Autonomous Vehicles (AV) framework relies heavily on deep neural networks. Typically, these networks perform object detection uniformly on the entire camera LiDAR frames. However, this uniformity jeopardizes the safety of the AV by giving the same priority to all objects in the scenes regardless of their risk of collision to the AV. In this paper, we present a new end to end pipeline for AV that introduces the concept of LiDAR cluster first and camera inference later to detect and classify objects. The benefits of our proposed framework are twofold. First, our pipeline prioritizes detecting objects that pose a higher risk of collision to the AV, giving more time for the AV to react to unsafe conditions. Second, it also provides, on average, faster inference speeds compared to popular deep neural network pipelines. We design our framework using the real world datasets, the Waymo Open Dataset, solving challenges arising from the limitations of LiDAR sensors and object detection algorithms. We show that our novel object detection pipeline prioritizes the detection of higher risk objects while simultaneously achieving comparable accuracy and a 25 higher average speed compared to camera inference only.


Anti parity time topologically undefined state. We constructed an anti parity time symmetric photonic lattice by using perturbations. The results show the topological state will appear when the waveguide coupling constants kappa 1 kappa 2 Interestingly, a state with undefined winding numbers occurs when kappa 1 kappa 2 , in which the light distributes only in the wide waveguides with equal magnitude distribution. Further studies show that the edge state will be strengthened by introducing defect for the topologically non trivial case, while it will not affect the equal intensity transmission for the topologically undefined state. Our work provides a new way to realize the topological state and equally divided light transmission and might be applicable in optical circuits and optical interconnect.


Complexity and algorithms for injective edge coloring in graphs. An injective k edge coloring of a graph G is an assignment of colors, i.e. integers in 1, ldots , k , to the edges of G such that any two edges each incident with one distinct endpoint of a third edge, receive distinct colors. The problem of determining whether such a k coloring exists is called k INJECTIVE EDGE COLORING. We show that 3 INJECTIVE EDGE COLORING is NP complete, even for triangle free cubic graphs, planar subcubic graphs of arbitrarily large girth, and planar bipartite subcubic graphs of girth 6. 4 INJECTIVE EDGE COLORING remains NP complete for cubic graphs. For any k geq 45 , we show that k INJECTIVE EDGE COLORING remains NP complete even for graphs of maximum degree at most 5 sqrt 3k . In contrast with these negative results, we show that InjPbName k is linear time solvable on graphs of bounded treewidth. Moreover, we show that all planar bipartite subcubic graphs of girth at least 16 are injectively 3 edge colorable. In addition, any graph of maximum degree at most sqrt k 2 is injectively k edge colorable.


A Conceptual Framework for Establishing Trust in Real World Intelligent Systems. Intelligent information systems that contain emergent elements often encounter trust problems because results do not get sufficiently explained and the procedure itself can not be fully retraced. This is caused by a control flow depending either on stochastic elements or on the structure and relevance of the input data. Trust in such algorithms can be established by letting users interact with the system so that they can explore results and find patterns that can be compared with their expected solution. Reflecting features and patterns of human understanding of a domain against algorithmic results can create awareness of such patterns and may increase the trust that a user has in the solution. If expectations are not met, close inspection can be used to decide whether a solution conforms to the expectations or whether it goes beyond the expected. By either accepting or rejecting a solution, the user's set of expectations evolves and a learning process for the users is established. In this paper we present a conceptual framework that reflects and supports this process. The framework is the result of an analysis of two exemplary case studies from two different disciplines with information systems that assist experts in their complex tasks.


An open debate on SARS CoV 2's proximal origin is long overdue. There is a near consensus view that SARS CoV 2 has a natural zoonotic origin however, several characteristics of SARS CoV 2 taken together are not easily explained by a natural zoonotic origin hypothesis. These include a low rate of evolution in the early phase of transmission the lack of evidence of recombination events a high pre existing binding to human ACE2 a novel furin cleavage site insert a flat glycan binding domain of the spike protein which conflicts with host evasion survival patterns exhibited by other coronaviruses, and high human and mouse peptide mimicry. Initial assumptions against a laboratory origin, by contrast, have remained unsubstantiated. Furthermore, over a year after the initial outbreak in Wuhan, there is still no clear evidence of zoonotic transfer from a bat or intermediate species. Given the immense social and economic impact of this pandemic, identifying the true origin of SARS CoV 2 is fundamental to preventing future outbreaks. The search for SARS CoV 2's origin should include an open and unbiased inquiry into a possible laboratory origin.


A Multilevel Approach to Stochastic Trace Estimation. This article presents a randomized matrix free method for approximating the trace of f( bf A ) , where bf A is a large symmetric matrix and f is a function analytic in a closed interval containing the eigenvalues of bf A . Our method uses a combination of stochastic trace estimation (i.e., Hutchinson's method), Chebyshev approximation, and multilevel Monte Carlo techniques. We establish general bounds on the approximation error of this method by extending an existing error bound for Hutchinson's method to multilevel trace estimators. Numerical experiments are conducted for common applications such as estimating the log determinant, nuclear norm, and Estrada index, and triangle counting in graphs. We find that using multilevel techniques can substantially reduce the variance of existing single level estimators.


Numerical Solution of Stiff ODEs with Physics Informed RPNNs. We propose a numerical method based on physics informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme Learning Machine with a single hidden layer with radial basis functions having as widths uniformly distributed random variables, while the values of the weights between the input and the hidden layer are set equal to one. The numerical solution of the IVPs is obtained by constructing a system of nonlinear algebraic equations, which is solved with respect to the output weights by the Gauss Newton method, using a simple adaptive scheme for adjusting the time interval of integration. To assess its performance, we apply the proposed method for the solution of four benchmark stiff IVPs, namely the Prothero Robinson, van der Pol, ROBER and HIRES problems. Our method is compared with an adaptive Runge Kutta method based on the Dormand Prince pair, and a variable step variable order multistep solver based on numerical differentiation formulas, as implemented in the texttt ode45 and texttt ode15s MATLAB functions, respectively. We show that the proposed scheme yields good approximation accuracy, thus outperforming texttt ode45 and texttt ode15s , especially in the cases where steep gradients arise. Furthermore, the computational times of our approach are comparable with those of the two MATLAB solvers for practical purposes.


Upper limit on efficiency of electron deflection in bent crystals. Basing on experiments at SLAC, MAMI, CERN, and on Monte Carlo simulations, we assess the physical limits on efficiency and reachable angles of electron deflection in bent crystals in the energy range from sub GeV to sub TeV. We find that applications of electron channeling for beam deflection are possible, limited by maximal deflection angle of 2 3 mrad at sub GeV, 1 2 mrad at multi GeV, and 0.5 1 mrad at sub TeV energy. This opens opportunities for crystal assisted electron beam extraction from accelerator rings.


Don't Disturb Me Challenges of Interacting with SoftwareBots on Open Source Software Projects. Software bots are used to streamline tasks in Open Source Software (OSS) projects' pull requests, saving development cost, time, and effort. However, their presence can be disruptive to the community. We identified several challenges caused by bots in pull request interactions by interviewing 21 practitioners, including project maintainers, contributors, and bot developers. In particular, our findings indicate noise as a recurrent and central problem. Noise affects both human communication and development workflow by overwhelming and distracting developers. Our main contribution is a theory of how human developers perceive annoying bot behaviors as noise on social coding platforms. This contribution may help practitioners understand the effects of adopting a bot, and researchers and tool designers may leverage our results to better support human bot interaction on social coding platforms.


Quadratic Chabauty for Atkin Lehner Quotients of Modular Curves of Prime Level and Genus 4, 5, 6. We use the method of quadratic Chabauty on the quotients X 0 (N) of modular curves X 0(N) by their Fricke involutions to provably compute all the rational points of these curves for prime levels N of genus four, five, and six. We find that the only such curves with exceptional rational points are of levels 137 and 311 . In particular there are no exceptional rational points on those curves of genus five and six. More precisely, we determine the rational points on the curves X 0 (N) for N 137,173,199,251,311,157,181,227,263,163,197,211,223,269,271,359 .


On fractional Schr "odinger equations with Hartree type nonlinearities. Goal of this paper is to study the following doubly nonlocal equation begin equation label eq abstract ( Delta) s u mu u (I alpha F(u))F'(u) quad hbox in mathbb R N tag P end equation in the case of general nonlinearities F in C 1( mathbb R ) of Berestycki Lions type, when N geq 2 and mu 0 is fixed. Here ( Delta) s , s in (0,1) , denotes the fractional Laplacian, while the Hartree type term is given by convolution with the Riesz potential I alpha , alpha in (0,N) . We prove existence of ground states of eqref eq abstract . Furthermore we obtain regularity and asymptotic decay of general solutions, extending some results contained in 25, 65 .


Java Card Virtual Machine Memory Organization a Design Proposal. The Java Card Virtual Machine (JCVM) platform is widely deployed on security oriented components. JCVM implementations are mainly evaluated under security schemes. However, existing implementation are close source without detail. We believe studying how to design JCVM will improve them and it can be reused by the community to improve Java Card security. In 2018, Bouffard et al. 6 introduced an Operating System (OS) which aims at running JCVM compatible implementation. This OS is compatible with several Commercially available Off The Shelf (COTS) components. This is a first step to design a secure JCVM platform. However, some important details are missing to design a secure oriented Java Card platform. In this article, we focus on the JCVM memory. This memory contains everything required to run JCVM and applets. Currently, JCVM memory is out of the Java Card specification and each JCVM developer use his own approach. Based on the existing tools and documentation, we explain how to extract from the Java Card toolchain every data required by applets and JCVM. When data to store in memory are identified, this article introduces how to organize required data onto JCVM memory.