Ab Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions. Solving the Schr "odinger equation is key to many quantum mechanical properties. However, an analytical solution is only tractable for single electron systems. Recently, neural networks succeeded at modeling wave functions of many electron systems. Together with the variational Monte Carlo (VMC) framework, this led to solutions on par with the best known classical methods. Still, these neural methods require tremendous amounts of computational resources as one has to train a separate model for each molecular geometry. In this work, we combine a Graph Neural Network (GNN) with a neural wave function to simultaneously solve the Schr "odinger equation for multiple geometries via VMC. This enables us to model continuous subsets of the potential energy surface with a single training pass. Compared to existing state of the art networks, our Potential Energy Surface Network PESNet speeds up training for multiple geometries by up to 40 times while matching or surpassing their accuracy. This may open the path to accurate and orders of magnitude cheaper quantum mechanical calculations.


Around plane waves solutions of the Schr "o dinger Langevin equation. We consider the logarithmic Schr "o dinger equations with damping, also called Schr "o dinger Langevin equation. On a periodic domain, this equation possesses plane wave solutions that are explicit. We prove that these solutions are asymptotically stable in Sobolev regularity. In the case without damping, we prove that for almost all value of the nonlinear parameter, these solutions are stable in high Sobolev regularity for arbitrary long times when the solution is close to a plane wave. We also show and discuss numerical experiments illustrating our results.


Lifting couplings in Wasserstein spaces. This paper makes mathematically precise the idea that conditional probabilities are analogous to path liftings in geometry. The idea of lifting is modelled in terms of the category theoretic concept of a lens, which can be interpreted as a consistent choice of arrow liftings. The category we study is the one of probability measures over a given standard Borel space, with morphisms given by the couplings, or transport plans. The geometrical picture is even more apparent once we equip the arrows of the category with weights, which one can interpret as "lengths" or "costs", forming a so called weighted category, which unifies several concepts of category theory and metric geometry. Indeed, we show that the weighted version of a lens is tightly connected to the notion of submetry in geometry. Every weighted category gives rise to a pseudo quasimetric space via optimization over the arrows. In particular, Wasserstein spaces can be obtained from the weighted categories of probability measures and their couplings, with the weight of a coupling given by its cost. In this case, conditionals allow one to form weighted lenses, which one can interpret as "lifting transport plans, while preserving their cost".


Equivalence between module categories over quiver Hecke algebras and Hernandez Leclerc's categories in general types. We prove in full generality that the generalized quantum affine Schur Weyl duality functor, introduced by Kang Kashiwara Kim, gives an equivalence between the category of finite dimensional modules over a quiver Hecke algebra and a certain full subcategory of finite dimensional modules over a quantum affine algebra which is a generalization of the Hernandez Leclerc's category mathcal C Q . This was previously proved in untwisted ADE types by Fujita using the geometry of quiver varieties, which is not applicable in general. Our proof is purely algebraic, and so can be extended uniformly to general types.


Fluctuations in Salem Zygmund almost sure central limit theorem. Let us consider i.i.d. random variables a k,b k k geq 1 defined on a common probability space ( Omega, mathcal F, mathbb P) , following a symmetric Rademacher distribution and the associated random trigonometric polynomials S n( theta) frac 1 sqrt n sum k 1 n a k cos(k theta) b k sin(k theta) . A seminal result by Salem and Zygmund ensures that mathbb P almost surely, forall t in mathbb R lim n to infty frac 1 2 pi int 0 2 pi e i t S n( theta) d theta e t 2 2 . This result was then further generalized in various directions regarding the coefficients distribution, their dependency structure or else the dimension and the nature of the ambient manifold. To the best of our knowledge, the natural question of the fluctuations in the above limit has not been tackled so far and is precisely the object of this article. Namely, for general i.i.d. symmetric random coefficients having a finite sixth moment and for a large class of continuous test functions phi we prove that sqrt n left( frac 1 2 pi int 0 2 pi phi(S n( theta))d theta int mathbb R phi(t) frac e frac t 2 2 dt sqrt 2 pi right) xrightarrow n to infty text Law mathcal N left(0, sigma phi 2 frac c 2( phi) 2 2 left( mathbb E (a 1 4) 3 right) right). Here, the constant sigma phi 2 is explicit and corresponds to the limit variance in the case of Gaussian coefficients and c 2( phi) is the coefficient of order 2 in the decomposition of phi in the Hermite polynomial basis. Surprisingly, it thus turns out that the fluctuations are not universal since they both involve the kurtosis of the coefficients and the second coefficient of phi in the Hermite basis.


Masked Face Recognition using ResNet 50. Over the last twenty years, there have seen several outbreaks of different coronavirus diseases across the world. These outbreaks often led to respiratory tract diseases and have proved to be fatal sometimes. Currently, we are facing an elusive health crisis with the emergence of COVID 19 disease of the coronavirus family. One of the modes of transmission of COVID 19 is airborne transmission. This transmission occurs as humans breathe in the droplets released by an infected person through breathing, speaking, singing, coughing, or sneezing. Hence, public health officials have mandated the use of face masks which can reduce disease transmission by 65 . For face recognition programs, commonly used for security verification purposes, the use of face mask presents an arduous challenge since these programs were typically trained with human faces devoid of masks but now due to the onset of Covid 19 pandemic, they are forced to identify faces with masks. Hence, this paper investigates the same problem by developing a deep learning based model capable of accurately identifying people with face masks. In this paper, the authors train a ResNet 50 based architecture that performs well at recognizing masked faces. The outcome of this study could be seamlessly integrated into existing face recognition programs that are designed to detect faces for security verification purposes.


Theory of vibrators with variable order fractional forces. In this paper, we present a theory of six classes of vibrators with variable order fractional forces of inertia, damping, and restoration. The novelty and contributions of the present theory are reflected in six aspects. 1) Equivalent motion equations of those variable order fractional vibrators are proposed. 2) The analytical expressions of the effective mass, damping, and stiffness of those variable order fractional vibrators are presented. 3) The asymptotic properties of the effective mass, damping, and stiffness of a class of variable order fractional vibrators are given. 4) The restricted effective parameters (damping ratio, damping free natural frequency, damped natural frequency, frequency ratio) of the variable order fractional vibrators are put forward. 5) We bring forward the analytical representations of the free responses, the impulse responses, and the frequency transfer functions of those variable order fractional vibrators. 6) We propose a solution to an open problem of how to mathematically explain the Rayleigh damping assumption based on the present theory of variable order fractional vibrations.


Primitive divisors of sequences associated to elliptic curves over function fields. We study the existence of a Zsigmondy bound for a sequence of divisors associated to points on an elliptic curve over a function field. More precisely, let k be an algebraically closed field, let mathcal C be a nonsingular projective curve over k , and let K denote the function field of mathcal C . Suppose E is an ordinary elliptic curve over K and suppose there does not exist an elliptic curve E 0 defined over k that is isomorphic to E over K . Suppose P in E(K) is a non torsion point and Q in E(K) is a torsion point of order r . The sequence of points nP Q subset E(K) induces a sequence of effective divisors D nP Q on mathcal C . We provide conditions on r and the characteristic of k for there to exist a bound N such that D nP Q has a primitive divisor for all n geq N . This extends the analogous result of Verzobio in the case where K is a number field.


CpT Convolutional Point Transformer for 3D Point Cloud Processing. We present CpT Convolutional point Transformer a novel deep learning architecture for dealing with the unstructured nature of 3D point cloud data. CpT is an improvement over existing attention based Convolutions Neural Networks as well as previous 3D point cloud processing transformers. It achieves this feat due to its effectiveness in creating a novel and robust attention based point set embedding through a convolutional projection layer crafted for processing dynamically local point set neighbourhoods. The resultant point set embedding is robust to the permutations of the input points. Our novel CpT block builds over local neighbourhoods of points obtained via a dynamic graph computation at each layer of the networks' structure. It is fully differentiable and can be stacked just like convolutional layers to learn global properties of the points. We evaluate our model on standard benchmark datasets such as ModelNet40, ShapeNet Part Segmentation, and the S3DIS 3D indoor scene semantic segmentation dataset to show that our model can serve as an effective backbone for various point cloud processing tasks when compared to the existing state of the art approaches.


Self Repairing Neural Networks Provable Safety for Deep Networks via Dynamic Repair. Neural networks are increasingly being deployed in contexts where safety is a critical concern. In this work, we propose a way to construct neural network classifiers that dynamically repair violations of non relational safety constraints called safe ordering properties. Safe ordering properties relate requirements on the ordering of a network's output indices to conditions on their input, and are sufficient to express most useful notions of non relational safety for classifiers. Our approach is based on a novel self repairing layer, which provably yields safe outputs regardless of the characteristics of its input. We compose this layer with an existing network to construct a self repairing network (SR Net), and show that in addition to providing safe outputs, the SR Net is guaranteed to preserve the accuracy of the original network. Notably, our approach is independent of the size and architecture of the network being repaired, depending only on the specified property and the dimension of the network's output thus it is scalable to large state of the art networks. We show that our approach can be implemented using vectorized computations that execute efficiently on a GPU, introducing run time overhead of less than one millisecond on current hardware even on large, widely used networks containing hundreds of thousands of neurons and millions of parameters.


Asymptotic stability of solutions to the Navier Stokes Fourier system driven by inhomogeneous Dirichlet boundary conditions. We consider global in time solutions of the Navier Stokes Fourier system describing the motion of a general compressible, viscous and heat conducting fluid far from equilibirum. Using a new concept of weak solution suitable to accommodate the inhomogeneous Dirichlet time dependent data we find sufficient conditions for the global in time weak solutions to be ultimately bounded.


Determinantal formulas with major indices. We give a simple proof of a major index determinant formula in the symmetric group discovered by Krattenthaler and first proved by Thibon using noncommutative symmetric functions. We do so by proving a factorization of an element in the group ring of the symmetric group. By applying similar methods to the groups of signed permutations and colored permutations, we prove determinant formulas in these groups as conjectured by Krattenthaler.


Twistors, Self Duality, and Spin c Structures. The fact that every compact oriented 4 manifold admits spin c structures was proved long ago by Hirzebruch and Hopf. However, the usual proof is neither direct nor transparent. This article gives a new proof using twistor spaces that is simpler and more geometric. After using these ideas to clarify various aspects of four dimensional geometry, we then explain how related ideas can be used to understand both spin and spin c structures in any dimension.


A Graph based Method for Session based Recommendations. We present a graph based approach for the data management tasks and the efficient operation of a system for session based next item recommendations. The proposed method can collect data continuously and incrementally from an ecommerce web site, thus seemingly prepare the necessary data infrastructure for the recommendation algorithm to operate without any excessive training phase. Our work aims at developing a recommender method that represents a balance between data processing and management efficiency requirements and the effectiveness of the recommendations produced. We use the Neo4j graph database to implement a prototype of such a system. Furthermore, we use an industry dataset corresponding to a typical e commerce session based scenario, and we report on experiments using our graph based approach and other state of the art machine learning and deep learning methods.


Decentralized Federated Learning with Unreliable Communications. Decentralized federated learning, inherited from decentralized learning, enables the edge devices to collaborate on model training in a peer to peer manner without the assistance of a server. However, existing decentralized learning frameworks usually assume perfect communication among devices, where they can reliably exchange messages, e.g., gradients or parameters. But the real world communication networks are prone to packet loss and transmission errors. Transmission reliability comes with a price. The commonly used solution is to adopt a reliable transportation layer protocol, e.g., transmission control protocol (TCP), which however leads to significant communication overhead and reduces connectivity among devices that can be supported. For a communication network with a lightweight and unreliable communication protocol, user datagram protocol (UDP), we propose a robust decentralized stochastic gradient descent (SGD) approach, called Soft DSGD, to address the unreliability issue. Soft DSGD updates the model parameters with partially received messages and optimizes the mixing weights according to the link reliability matrix of communication links. We prove that the proposed decentralized training system, even with unreliable communications, can still achieve the same asymptotic convergence rate as vanilla decentralized SGD with perfect communications. Moreover, numerical results confirm the proposed approach can leverage all available unreliable communication links to speed up convergence.


CONFAIR Configurable and Interpretable Algorithmic Fairness. The rapid growth of data in the recent years has led to the development of complex learning algorithms that are often used to make decisions in real world. While the positive impact of the algorithms has been tremendous, there is a need to mitigate any bias arising from either training samples or implicit assumptions made about the data samples. This need becomes critical when algorithms are used in automated decision making systems that can hugely impact people's lives. Many approaches have been proposed to make learning algorithms fair by detecting and mitigating bias in different stages of optimization. However, due to a lack of a universal definition of fairness, these algorithms optimize for a particular interpretation of fairness which makes them limited for real world use. Moreover, an underlying assumption that is common to all algorithms is the apparent equivalence of achieving fairness and removing bias. In other words, there is no user defined criteria that can be incorporated into the optimization procedure for producing a fair algorithm. Motivated by these shortcomings of existing methods, we propose the CONFAIR procedure that produces a fair algorithm by incorporating user constraints into the optimization procedure. Furthermore, we make the process interpretable by estimating the most predictive features from data. We demonstrate the efficacy of our approach on several real world datasets using different fairness criteria.


Distributed coloring and the local structure of unit disk graphs. Coloring unit disk graphs efficiently is an important problem in the global and distributed setting, with applications in radio channel assignment problems when the communication relies on omni directional antennas of the same power. In this context it is important to bound not only the complexity of the coloring algorithms, but also the number of colors used. In this paper, we consider two natural distributed settings. In the location aware setting (when nodes know their coordinates in the plane), we give a constant time distributed algorithm coloring any unit disk graph G with at most 4 omega(G) colors, where omega(G) is the clique number of G . This improves upon a classical 3 approximation algorithm for this problem, for all unit disk graphs whose chromatic number significantly exceeds their clique number. When nodes do not know their coordinates in the plane, we give a distributed algorithm in the LOCAL model that colors every unit disk graph G with at most 5.68 omega(G) colors in O( log 3 log n) rounds. Moreover, when omega(G) O(1) , the algorithm runs in O( log n) rounds. This algorithm is based on a study of the local structure of unit disk graphs, which is of independent interest. We conjecture that every unit disk graph G has average degree at most 4 omega(G) , which would imply the existence of a O( log n) round algorithm coloring any unit disk graph G with (approximately) 4 omega(G) colors in the LOCAL model.


AutoNLU Detecting, root causing, and fixing NLU model errors. Improving the quality of Natural Language Understanding (NLU) models, and more specifically, task oriented semantic parsing models, in production is a cumbersome task. In this work, we present a system called AutoNLU, which we designed to scale the NLU quality improvement process. It adds automation to three key steps detection, attribution, and correction of model errors, i.e., bugs. We detected four times more failed tasks than with random sampling, finding that even a simple active learning sampling method on an uncalibrated model is surprisingly effective for this purpose. The AutoNLU tool empowered linguists to fix ten times more semantic parsing bugs than with prior manual processes, auto correcting 65 of all identified bugs.


Submodular Maximization via Taylor Series Approximation. We study submodular maximization problems with matroid constraints, in particular, problems where the objective can be expressed via compositions of analytic and multilinear functions. We show that for functions of this form, the so called continuous greedy algorithm attains a ratio arbitrarily close to (1 1 e) approx 0.63 using a deterministic estimation via Taylor series approximation. This drastically reduces execution time over prior art that uses sampling.


Deep Reinforcement Learning for the Control of Robotic Manipulation A Focussed Mini Review. Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial intelligence. Another subfield of machine learning named reinforcement learning, tries to find an optimal behavior strategy through interactions with the environment. Combining deep learning and reinforcement learning permits resolving critical issues relative to the dimensionality and scalability of data in tasks with sparse reward signals, such as robotic manipulation and control tasks, that neither method permits resolving when applied on its own. In this paper, we present recent significant progress of deep reinforcement learning algorithms, which try to tackle the problems for the application in the domain of robotic manipulation control, such as sample efficiency and generalization. Despite these continuous improvements, currently, the challenges of learning robust and versatile manipulation skills for robots with deep reinforcement learning are still far from being resolved for real world applications.


Generalised rigid body motions in non Euclidean planes with applications to global rigidity. A bar joint framework (G,p) in a (non Euclidean) real normed plane X is the combination of a finite, simple graph G and a placement p of the vertices in X . A framework (G,p) is globally rigid in X if every other framework (G,q) in X with the same edge lengths as (G,p) arises from an isometry of X . The weaker property of local rigidity in normed planes (where only (G,q) within a neighbourhood of (G,p) are considered) has been studied by several researchers over the last 5 years after being introduced by Kitson and Power for ell p norms. However global rigidity is an unexplored area for general normed spaces, despite being intensely studied in the Euclidean context by many groups over the last 40 years. In order to understand global rigidity in X , we introduce new generalised rigid body motions in normed planes where the norm is determined by an analytic function. This theory allows us to deduce several geometric and combinatorial results concerning the global rigidity of bar joint frameworks in X .


Modelling uncertainty in financial tail risk a forecast combination and weighted quantile approach. A novel forecast combination and weighted quantile based tail risk forecasting framework is proposed, aiming to reduce the impact of modelling uncertainty in tail risk forecasting. The proposed approach is based on a two step estimation procedure. The first step involves the combination of Value at Risk (VaR) forecasts at a grid of quantile levels. A range of parametric and semi parametric models is selected as the model universe in the forecast combination procedure. The quantile forecast combination weights are estimated by optimizing the quantile loss. In the second step, the Expected Shortfall (ES) is computed as a weighted average of combined quantiles. The quantiles weighting structure for ES forecasting is determined by minimizing a strictly consistent joint VaR and ES loss function of the Fissler Ziegel class. The proposed framework is applied to six stock market indices and its forecasting performance is compared to each individual model in the universe, a simple average approach and a weighted quantile approach. The forecasting results support the proposed framework.


Some constructive variants of S4 with the finite model property. The logics CS4 and IS4 are intuitionistic variants of the modal logic S4. Whether the finite model property holds for each of these logics has been a long standing open problem. In this paper we introduce two logics closely related to IS4 GS4, obtained by adding the Godel Dummett axiom to IS4, and S4I, obtained by reversing the roles of the modal and intuitionistic relations. We then prove that CS4, GS4, and S4I all enjoy the finite model property.


Pseudo links in handlebodies. In this paper we introduce and study the theory of pseudo links in the genus g handlebody, H g . Pseudo links are links with some missing crossing information that naturally generalize the notion of knot diagrams. The motivation for studying these relatively new knotted objects lies in the fact that pseudo links may be used to model DNA knots, since it is not uncommon for biologists to obtain DNA knots for which it is not possible to tell a positive from a negative crossing. We consider pseudo links in H g as mixed pseudo links in S 3 and we generalize the Kauffman bracket polynomial for the category of pseudo links in H g . We then pass on the category of mixed pseudo braids, that is, pseudo braids whose closures are pseudo links in H g , and we formulate the analogue of the Alexander theorem. It is worth mentioning that the theory of pseudo links is close related to the theory of singular links and that all results in this paper may be used for studying singular links in H g .


A level set based space time finite element approach to the modelling of solidification and melting processes. We present a strategy for the numerical solution of convection coupled phase transition problems, with focus on solidification and melting. We solve for the temperature and flow fields over time. The position of the phase change interface is tracked with a level set method, which requires knowledge of the heat flux discontinuity at the interface. In order to compute the heat flux jump, we build upon the ghost cell approach and extend it to the space time finite element method. This technique does not require a local enrichment of the basis functions, such as methods like extended finite elements, and it can be easily implemented in already existing finite element codes. Verification cases for the 1D Stefan problem and the lid driven cavity melting problem are provided. Furthermore, we show a more elaborate 2D case in view of complex applications.


OntoEA Ontology guided Entity Alignment via Joint Knowledge Graph Embedding. Semantic embedding has been widely investigated for aligning knowledge graph (KG) entities. Current methods have explored and utilized the graph structure, the entity names and attributes, but ignore the ontology (or ontological schema) which contains critical meta information such as classes and their membership relationships with entities. In this paper, we propose an ontology guided entity alignment method named OntoEA, where both KGs and their ontologies are jointly embedded, and the class hierarchy and the class disjointness are utilized to avoid false mappings. Extensive experiments on seven public and industrial benchmarks have demonstrated the state of the art performance of OntoEA and the effectiveness of the ontologies.


Generalised homomorphisms, measuring coalgebras and extended symmetries. Three categories of algebras with morphisms generalising the usual set of algebra homomorphisms are described. The Sweedler product provides a hom tensor equivalence relating these three categories, and a tool enabling the universal measuring coalgebra to be calculated in small cases. A parallel theory for modules is presented.


Online Continual Learning with Natural Distribution Shifts An Empirical Study with Visual Data. Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks classes are added at discrete time intervals. Such an "offline" setting does not evaluate the ability of agents to learn effectively and efficiently, since an agent can perform multiple learning epochs without any time limitation when a task is added. We argue that "online" continual learning, where data is a single continuous stream without task boundaries, enables evaluating both information retention and online learning efficacy. In online continual learning, each incoming small batch of data is first used for testing and then added to the training set, making the problem truly online. Trained models are later evaluated on historical data to assess information retention. We introduce a new benchmark for online continual visual learning that exhibits large scale and natural distribution shifts. Through a large scale analysis, we identify critical and previously unobserved phenomena of gradient based optimization in continual learning, and propose effective strategies for improving gradient based online continual learning with real data. The source code and dataset are available in https github.com IntelLabs continuallearning.


An Abstract View of Big Data Processing Programs. This paper proposes a model for specifying data flow based parallel data processing programs agnostic of target Big Data processing frameworks. The paper focuses on the formal abstract specification of non iterative and iterative programs, generalizing the strategies adopted by data flow Big Data processing frameworks. The proposed model relies on monoid AlgebraandPetri Netstoabstract Big Data processing programs in two levels a high level representing the program data flow and a lower level representing data transformation operations (e.g., filtering, aggregation, join). We extend the model for data processing programs proposed in 1 , to enable the use of iterative programs. The general specification of iterative data processing programs implemented by data flow based parallel programming models is essential given the democratization of iterative and greedy Big Data analytics algorithms. Indeed, these algorithms call for revisiting parallel programming models to express iterations. The paper gives a comparative analysis of the iteration strategies proposed byApache Spark, DryadLINQ, Apache Beam and Apache Flink. It discusses how the model achieves to generalize these strategies.


Network Support for High performance Distributed Machine Learning. The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach, i.e., to define the logical network topology em around the learning task to perform, so as to meet the desired learning performance. In this paper, we propose a system model that captures such aspects in the context of supervised machine learning, accounting for both learning nodes (that perform computations) and information nodes (that provide data). We then formulate the problem of selecting (i) which learning and information nodes should cooperate to complete the learning task, and (ii) the number of iterations to perform, in order to minimize the learning cost while meeting the target prediction error and execution time. After proving important properties of the above problem, we devise an algorithm, named DoubleClimb, that can find a 1 1 I competitive solution (with I being the set of information nodes), with cubic worst case complexity. Our performance evaluation, leveraging a real world network topology and considering both classification and regression tasks, also shows that DoubleClimb closely matches the optimum, outperforming state of the art alternatives.


Learning MDPs from Features Predict Then Optimize for Sequential Decision Problems by Reinforcement Learning. In the predict then optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes decision quality when the optimization is subsequently solved. Recent work on decision focused learning shows that embedding the optimization problem in the training pipeline can improve decision quality and help generalize better to unseen tasks compared to relying on an intermediate loss function for evaluating prediction quality. We study the predict then optimize framework in the context of sequential decision problems (formulated as MDPs) that are solved via reinforcement learning. In particular, we are given environment features and a set of trajectories from training MDPs, which we use to train a predictive model that generalizes to unseen test MDPs without trajectories. Two significant computational challenges arise in applying decision focused learning to MDPs (i) large state and action spaces make it infeasible for existing techniques to differentiate through MDP problems, and (ii) the high dimensional policy space, as parameterized by a neural network, makes differentiating through a policy expensive. We resolve the first challenge by sampling provably unbiased derivatives to approximate and differentiate through optimality conditions, and the second challenge by using a low rank approximation to the high dimensional sample based derivatives. We implement both Bellman based and policy gradient based decision focused learning on three different MDP problems with missing parameters, and show that decision focused learning performs better in generalization to unseen tasks.


Does transitioning to online classes mid semester affect conceptual understanding?. The Force Concept Inventory (FCI) can be used as an assessment tool to measure conceptual gains in a cohort of students. The FCI uses a conceptions "misconceptions" lens rather than a context dependent perspective, such as "knowledge in pieces". In this study it was given to first year students ( N 256 students) pre and post mechanics lectures, at the University of Johannesburg. From these results we examine the effect of switching mid semester from traditional classes to online classes, as imposed by the COVID 19 lockdown in South Africa. Overall results indicate no appreciable difference of gain, when bench marked against previous studies using this assessment tool. When compared with 2019 grades, the 2020 semester grades do not appear to be greatly affected. Furthermore, statistical analyses also indicate a gender difference in mean gains in favour of females at the 95 significance level (for paired data, N 48 ).


Learning from Miscellaneous Other Class Words for Few shot Named Entity Recognition. Few shot Named Entity Recognition (NER) exploits only a handful of annotations to identify and classify named entity mentions. Prototypical network shows superior performance on few shot NER. However, existing prototypical methods fail to differentiate rich semantics in other class words, which will aggravate overfitting under few shot scenario. To address the issue, we propose a novel model, Mining Undefined Classes from Other class (MUCO), that can automatically induce different undefined classes from the other class to improve few shot NER. With these extra labeled undefined classes, our method will improve the discriminative ability of NER classifier and enhance the understanding of predefined classes with stand by semantic knowledge. Experimental results demonstrate that our model outperforms five state of the art models in both 1 shot and 5 shots settings on four NER benchmarks. We will release the code upon acceptance. The source code is released on https github.com shuaiwa16 OtherClassNER.git.


Learning to Generate Novel Scene Compositions from Single Images and Videos. Training GANs in low data regimes remains a challenge, as overfitting often leads to memorization or training divergence. In this work, we introduce One Shot GAN that can learn to generate samples from a training set as little as one image or one video. We propose a two branch discriminator, with content and layout branches designed to judge the internal content separately from the scene layout realism. This allows synthesis of visually plausible, novel compositions of a scene, with varying content and layout, while preserving the context of the original sample. Compared to previous single image GAN models, One Shot GAN achieves higher diversity and quality of synthesis. It is also not restricted to the single image setting, successfully learning in the introduced setting of a single video.


Switch Point biased Self Training Re purposing Pretrained Models for Code Switching. Code switching (CS), a ubiquitous phenomenon due to the ease of communication it offers in multilingual communities still remains an understudied problem in language processing. The primary reasons behind this are (1) minimal efforts in leveraging large pretrained multilingual models, and (2) the lack of annotated data. The distinguishing case of low performance of multilingual models in CS is the intra sentence mixing of languages leading to switch points. We first benchmark two sequence labeling tasks POS and NER on 4 different language pairs with a suite of pretrained models to identify the problems and select the best performing model, char BERT, among them (addressing (1)). We then propose a self training method to repurpose the existing pretrained models using a switch point bias by leveraging unannotated data (addressing (2)). We finally demonstrate that our approach performs well on both tasks by reducing the gap between the switch point performance while retaining the overall performance on two distinct language pairs in both the tasks. Our code is available here https github.com PC09 EMNLP2021 Switch Point biased Self Training.


About plane periodic waves of the nonlinear Schr "odinger equations. The present contribution contains a quite extensive theory for the stability analysis of plane periodic waves of general Schr "o dinger equations. On one hand, we put the one dimensional theory, or in other words the stability theory for longitudinal perturbations, on a par with the one available for systems of Korteweg type, including results on co periodic spectral instability, nonlinear co periodic orbital stability, side band spectral instability and linearized large time dynamics in relation with modulation theory, and resolutions of all the involved assumptions in both the small amplitude and large period regimes. On the other hand, we provide extensions of the spectral part of the latter to the multi dimensional context. Notably, we provide suitable multi dimensional modulation formal asymptotics, validate those at the spectral level and use them to prove that waves are always spectrally unstable in both the small amplitude and the large period regimes.


HierMUD Hierarchical Multi task Unsupervised Domain Adaptation between Bridges for Drive by Damage Diagnosis. Monitoring bridge health using vibrations of drive by vehicles has various benefits, such as no need for directly installing and maintaining sensors on the bridge. However, many of the existing drive by monitoring approaches are based on supervised learning models that require labeled data from every bridge of interest, which is expensive and time consuming, if not impossible, to obtain. To this end, we introduce a new framework that transfers the model learned from one bridge to diagnose damage in another bridge without any labels from the target bridge. Our framework trains a hierarchical neural network model in an adversarial way to extract task shared and task specific features that are informative to multiple diagnostic tasks and invariant across multiple bridges. We evaluate our framework on experimental data collected from 2 bridges and 3 vehicles. We achieve accuracies of 95 for damage detection, 93 for localization, and up to 72 for quantification, which are 2 times improvements from baseline methods.


Parallel Refinements for Lexically Constrained Text Generation with BART. Lexically constrained text generation aims to control the generated text by incorporating some pre specified keywords into the output. Previous work injects lexical constraints into the output by controlling the decoding process or refining the candidate output iteratively, which tends to generate generic or ungrammatical sentences, and has high computational complexity. To address these challenges, we propose Constrained BART (CBART) for lexically constrained text generation. CBART leverages the pre trained model BART and transfers part of the generation burden from the decoder to the encoder by decomposing this task into two sub tasks, thereby improving the sentence quality. Concretely, we extend BART by adding a token level classifier over the encoder, aiming at instructing the decoder where to replace and insert. Guided by the encoder, the decoder refines multiple tokens of the input in one step by inserting tokens before specific positions and re predicting tokens with low confidence. To further reduce the inference latency, the decoder predicts all tokens in parallel. Experiment results on One Billion Word and Yelp show that CBART can generate plausible text with high quality and diversity while significantly accelerating inference.


Toric geometry and integral affine structures in non archimedean mirror symmetry. We study integral dlt models of a proper C((t)) variety X along a toric stratum of the special fiber. We prove that the associated Berkovich retraction from the non archimedean analytification of X onto the dual complex of the model is an affinoid torus fibration around the simplex corresponding to the toric stratum, which extends results from Nicaise Xu Yu. This allows us to construct new types of non archimedean retractions for maximally degenerate families of quartic K3 surfaces and quintic 3 folds, by gluing several non archimedean SYZ fibrations, each one toric along a codimension one stratum. We then show that the new retractions induce the same singular integral affine structures that arise on the dual complex of toric degenerations in the Gross Siebert program, as well as on the Gromov Hausdorff limit of the family.


Universal Multilayer Network Exploration by Random Walk with Restart. The amount and variety of data is increasing drastically for several years. These data are often represented as networks, which are then explored with approaches arising from network theory. Recent years have witnessed the extension of network exploration methods to leverage more complex and richer network frameworks. Random walks, for instance, have been extended to explore multilayer networks. However, current random walk approaches are limited in the combination and heterogeneity of network layers they can handle. New analytical and numerical random walk methods are needed to cope with the increasing diversity and complexity of multilayer networks. We propose here MultiXrank, a Python package that enables Random Walk with Restart (RWR) on any kind of multilayer network with an optimized implementation. This package is supported by a universal mathematical formulation of the RWR. We evaluated MultiXrank with leave one out cross validation and link prediction, and introduced protocols to measure the impact of the addition or removal of multilayer network data on prediction performances. We further measured the sensitivity of MultiXrank to input parameters by in depth exploration of the parameter space. Finally, we illustrate the versatility of MultiXrank with different use cases of unsupervised node prioritization and supervised classification in the context of human genetic diseases.


Fine grained Domain Adaptive Crowd Counting via Point derived Segmentation. Existing domain adaptation methods for crowd counting view each crowd image as a whole and reduce domain discrepancies on crowds and backgrounds simultaneously. However, we argue that these methods are suboptimal, as crowds and backgrounds have quite different characteristics and backgrounds may vary dramatically in different crowd scenes (see Fig. ref teaser ). This makes crowds not well aligned across domains together with backgrounds in a holistic manner. To this end, we propose to untangle crowds and backgrounds from crowd images and design fine grained domain adaption methods for crowd counting. Different from other tasks which possess region based fine grained annotations (e.g., segments or bounding boxes), crowd counting only annotates one point on each human head, which impedes the implementation of fine grained adaptation methods. To tackle this issue, we propose a novel and effective schema to learn crowd segmentation from point level crowd counting annotations in the context of Multiple Instance Learning. We further leverage the derived segments to propose a crowd aware fine grained domain adaptation framework for crowd counting, which consists of two novel adaptation modules, i.e., Crowd Region Transfer (CRT) and Crowd Density Alignment (CDA). Specifically, the CRT module is designed to guide crowd features transfer across domains beyond background distractions, and the CDA module dedicates to constraining the target domain crowd density distributions. Extensive experiments on multiple cross domain settings (i.e., Synthetic rightarrow Real, Fixed rightarrow Fickle, Normal rightarrow BadWeather) demonstrate the superiority of the proposed method compared with state of the art methods.


Reading from External Memory. Modern external memory is represented by several device classes. At present, HDD, SATA SSD and NVMe SSD are widely used. Recently ultra low latency SSD such as Intel Optane became available on the market. Each of these types exhibits it's own pattern for throughput, latency and parallelism. To achieve the highest performance one has to pick an appropriate I O interface provided by the operating system. In this work we present a detailed overview and evaluation of modern storage reading performance with regard to available Linux synchronous and asynchronous interfaces. While throughout this work we aim for the highest throughput we also measure latency and CPU usage. We provide this report in hope the detailed results could be interesting to both researchers and practitioners.


Sign regularized Multi task Learning. Multi task learning is a framework that enforces different learning tasks to share their knowledge to improve their generalization performance. It is a hot and active domain that strives to handle several core issues particularly, which tasks are correlated and similar, and how to share the knowledge among correlated tasks. Existing works usually do not distinguish the polarity and magnitude of feature weights and commonly rely on linear correlation, due to three major technical challenges in 1) optimizing the models that regularize feature weight polarity, 2) deciding whether to regularize sign or magnitude, 3) identifying which tasks should share their sign and or magnitude patterns. To address them, this paper proposes a new multi task learning framework that can regularize feature weight signs across tasks. We innovatively formulate it as a biconvex inequality constrained optimization with slacks and propose a new efficient algorithm for the optimization with theoretical guarantees on generalization performance and convergence. Extensive experiments on multiple datasets demonstrate the proposed methods' effectiveness, efficiency, and reasonableness of the regularized feature weighted patterns.


The curve shrinking flow, compactness and its relation to scale manifolds. This master thesis looks at the gradient flow of the length functional on embedded loops. The space of embedded loops is endowed with a scale structure so that the length functional becomes scale smooth. For certain underlying manifolds, using the fact that the gradient flow of the length is the same as the curvature flow, a weak compactness property for the gradient flow lines between fixed critical points (geodesics) is proven. Also Floer Gromov convergence of certain gradient flow lines is achieved. These convergence properties are very similar to those in Morse theory. Figures visualizing the gradient curvature flow on several manifolds are included.


Sharing in a Trustless World Privacy Preserving Data Analytics with Potentially Cheating Participants. Lack of trust between organisations and privacy concerns about their data are impediments to an otherwise potentially symbiotic joint data analysis. We propose DataRing, a data sharing system that allows mutually mistrusting participants to query each others' datasets in a privacy preserving manner while ensuring the correctness of input datasets and query answers even in the presence of (cheating) participants deviating from their true datasets. By relying on the assumption that if only a small subset of rows of the true dataset are known, participants cannot submit answers to queries deviating significantly from their true datasets. We employ differential privacy and a suite of cryptographic tools to ensure individual privacy for each participant's dataset and data confidentiality from the system. Our results show that the evaluation of 10 queries on a dataset with 10 attributes and 500,000 records is achieved in 90.63 seconds. DataRing could detect cheating participant that deviates from its true dataset in few queries with high accuracy.


On the connection between angular and partial waves time delays in electron scattering. Within the framework of a Dirac bubble potential model for the C60 fullerene shell we investigated the angular time delay in slow electron elastic scattering by C60 as well as average time delay of electrons in this process. It is demonstrated how the angular time delay is connected to the Eisenbud Wigner Smith (EWS) time delay. The angular and energy dependences of these times are investigated. The studies conducted shed light to some extent on the specific features of these dependencies.


Theoretical proposal for the experimental realisation of a monochromatic electromagnetic knot. We propose an antenna designed to generate monochromatic electromagnetic knots and other "unusual electromagnetic disturbances" in the microwave domain. Our antenna is a spherical array of radiating dipolar elements configured to approximate the desired electromagnetic field near its centre. We show numerically that a specific embodiment of the antenna with a radius of 61.2 cm and only 20 element pairs driven at a frequency of 2.45 GHz can yield linked and torus knotted electric and magnetic field lines approximating those of an "electromagnetic tangle" a monochromatic electromagnetic knot closely related to the well known Ra nada Hopf type electromagnetic knots but simpler in its construction. The antenna could be used to locally excite plasmas.


Asymptotics of the radiation field for the massless Dirac Coulomb system. We consider the long time behavior of the massless Dirac equation coupled to a Coulomb potential. For nice enough initial data, we find a joint asymptotic expansion for solutions near the null and future infinities and characterize explicitly the decay rates seen in the expansion.


Contrastive Learning of Generalized Game Representations. Representing games through their pixels offers a promising approach for building general purpose and versatile game models. While games are not merely images, neural network models trained on game pixels often capture differences of the visual style of the image rather than the content of the game. As a result, such models cannot generalize well even within similar games of the same genre. In this paper we build on recent advances in contrastive learning and showcase its benefits for representation learning in games. Learning to contrast images of games not only classifies games in a more efficient manner it also yields models that separate games in a more meaningful fashion by ignoring the visual style and focusing, instead, on their content. Our results in a large dataset of sports video games containing 100k images across 175 games and 10 game genres suggest that contrastive learning is better suited for learning generalized game representations compared to conventional supervised learning. The findings of this study bring us closer to universal visual encoders for games that can be reused across previously unseen games without requiring retraining or fine tuning.


Shimura subvarieties via endomorphisms. We show the existence of two new Shimura subvarieties of mathcal A 2, mathcal A 3 generically contained in the Torelli locus. They provide the first examples of Shimura subvarieties obtained by means of Jacobians carrying non trivial endomorphisms not directly induced by the automorphisms of the curves. We also obtain a new example of a Shimura subvariety of mathcal A 4 generically contained in the Prym locus.


Desperately seeking the impact of learning analytics in education at scale Marrying data analysis with teaching and learning. Learning analytics (LA) is argued to be able to improve learning outcomes, learner support and teaching. However, despite an increasingly expanding amount of student (digital) data accessible from various online education and learning platforms and the growing interest in LA worldwide as well as considerable research efforts already made, there is still little empirical evidence of impact on practice that shows the effectiveness of LA in education settings. Based on a selection of theoretical and empirical research, this chapter provides a critical discussion about the possibilities of collecting and using student data as well as barriers and challenges to overcome in providing data informed support to educators' everyday teaching practices. We argue that in order to increase the impact of data driven decision making aimed at students' improved learning in education at scale, we need to better understand educators' needs, their teaching practices and the context in which these practices occur, and how to support them in developing relevant knowledge, strategies and skills to facilitate the data informed process of digitalization of education.


A Communication Efficient and Privacy Aware Distributed Algorithm for Sparse PCA. As a prominent variant of principal component analysis (PCA), sparse PCA attempts to find sparse loading vectors when conducting dimension reduction. This paper aims to calculate sparse PCA through solving an optimization problem pursuing orthogonality and sparsity simultaneously. We propose a splitting and alternating approach, leading to an efficient distributed algorithm, called DAL1, for solving this nonconvex and nonsmooth optimization problem. Convergence of DAL1 to stationary points has been rigorously established. Computational experiments demonstrate that, due to its fast convergence in terms of iteration count, DAL1 requires far fewer rounds of communications to reach the prescribed accuracy than those required by existing peer methods. Unlike existing algorithms, there is a relatively small possibility of data leakage for DAL1.


Constructing Regression Dataset from Code Evolution History. Bug datasets consisting of real world bugs are important artifacts for researchers and programmers, which lay empirical and experimental foundation for various SE PL research such as fault localization, software testing, and program repair. All known state of the art datasets are constructed manually, which inevitably limits their scalability, representativeness, and the support for the emerging data driven research. In this work, we propose an approach to automate the process of harvesting replicable regression bugs from the code evolutionary history. We focus on regression bug dataset, as they (1) manifest how a bug is introduced and fixed (as normal bugs), (2) support regression bug analysis, and (3) incorporate a much stronger specification (i.e., the original passing version) for general bug analysis. Technically, we address an information retrieval problem on code evolution history. Given a code repository, we search for regressions where a test can pass a regression fixing commit, fail a regressioninducing commit, and pass a working commit. In this work, we address the challenges of (1) identifying potential regression fixing commits from the code evolution history, (2) migrating the test and its code dependencies over the history, and (3) minimizing the compilation overhead during the regression search. We build our tool, RegMiner, which harvested 537 regressions over 66 projects for 3 weeks, created the largest replicable regression dataset within shortest period, to the best of our knowledge. Moreover, our empirical study on our regression dataset shows a gap between the popular regression fault localization techniques (e.g, delta debugging) and the real fix, revealing new data driven research opportunities.


Some inequalities and applications of Simons' type formulas in Riemannian, affine and statistical geometry. A few formulas and theorems for statistical structures are proved. They deal with various curvatures as well as with metric properties of the cubic form or its covariant derivative. Some of them generalize formulas and theorems known in the case of Lagrangian submanifolds or affine hypersurfaces.


Weakly Supervised Methods for Suicide Risk Assessment Role of Related Domains. Social media has become a valuable resource for the study of suicidal ideation and the assessment of suicide risk. Among social media platforms, Reddit has emerged as the most promising one due to its anonymity and its focus on topic based communities (subreddits) that can be indicative of someone's state of mind or interest regarding mental health disorders such as r SuicideWatch, r Anxiety, r depression. A challenge for previous work on suicide risk assessment has been the small amount of labeled data. We propose an empirical investigation into several classes of weakly supervised approaches, and show that using pseudo labeling based on related issues around mental health (e.g., anxiety, depression) helps improve model performance for suicide risk assessment.


Bragg's Additivity Rule and Core and Bond model studied by real time TDDFT electronic stopping simulations the case of water vapor. The electronic stopping power ( S e ) of water vapor (H 2 O), hydrogen (H 2 ) and oxygen (O 2 ) gases for protons in a broad range of energies, centered in the Bragg peak, was calculated using real time time dependent density functional theory (rt TDDFT) simulations with Gaussian basis sets. This was done for a kinetic energy of incident protons ( E k ) ranging from 1.56 keV amu to 1.6 MeV amu. S e was calculated as the average over geometrically pre sampled short ion trajectories. The average S e(E k) values were found to rapidly converge with 25 30 pre sampled, 2 nm long ion trajectories. The rt TDDFT S e(E k) curves were compared to experimental and SRIM data, and used to validate the Bragg's Additivity Rule (BAR). Discrepancies were analyzed in terms of basis set effects and omitted nuclear stopping at low energies. At variance with SRIM, we found that BAR is applicable to our rt TDDFT simulations of mathrm 2H 2 O 2 mathrm rightarrow 2H 2O without scaling for E k 40 keV amu. The hydrogen and oxygen Core and Bond (CAB) contributions to electronic stopping were calculated and found to be slightly smaller than SRIM values as a result of a red shift in our rt TDDFT S e(E k) curves and a re distribution of weights due to some bond contributions being neglected in SRIM.


Geometry adaptation of protrusion and polarity dynamics in confined cell migration. Cell migration in confining physiological environments relies on the concerted dynamics of several cellular components, including protrusions, adhesions with the environment, and the cell nucleus. However, it remains poorly understood how the dynamic interplay of these components and the cell polarity determine the emergent migration behavior at the cellular scale. Here, we employ a data driven theoretical approach to develop a mechanistic model for confined cell migration, revealing how the cellular dynamics adapt to confining geometries. Specifically, we use experimental data of joint protrusion nucleus migration trajectories of cells on confining micropatterns to systematically determine a model linking the stochastic dynamics of cell polarity, protrusions, and nucleus. Our model indicates that the cellular dynamics adapt to confining constrictions through a switch in the polarity dynamics from a negative to a positive, self reinforcing feedback loop. This feedback loop leads to stereotypical cycles of protrusion nucleus dynamics that drive the migration of the cell through constrictions. Our data driven theoretical approach therefore identifies polarity feedback adaptation as a key mechanism in confined cell migration.


ExClus Explainable Clustering on Low dimensional Data Representations. Dimensionality reduction and clustering techniques are frequently used to analyze complex data sets, but their results are often not easy to interpret. We consider how to support users in interpreting apparent cluster structure on scatter plots where the axes are not directly interpretable, such as when the data is projected onto a two dimensional space using a dimensionality reduction method. Specifically, we propose a new method to compute an interpretable clustering automatically, where the explanation is in the original high dimensional space and the clustering is coherent in the low dimensional projection. It provides a tunable balance between the complexity and the amount of information provided, through the use of information theory. We study the computational complexity of this problem and introduce restrictions on the search space of solutions to arrive at an efficient, tunable, greedy optimization algorithm. This algorithm is furthermore implemented in an interactive tool called ExClus. Experiments on several data sets highlight that ExClus can provide informative and easy to understand patterns, and they expose where the algorithm is efficient and where there is room for improvement considering tunability and scalability.


Harmonic Analysis on the Affine Group of the Plane. For any natural number n , the group G n of all invertible affine transformations of n dimensional Euclidean space has, up to equivalence, just one square integrable representation and the left regular representation of G n is a multiple of this square integrable representation. We provide a concrete realization sigma 2 of this square integrable representation of G 2 acting on the Hilbert space L 2 big( widehat mathbb R 2 times widehat mathbb R big) . We explicitly decompose the Hilbert space L 2(G 2) as a direct sum of left invariant closed subspaces on each of which the left regular representation acts as a representation equivalent to sigma 2 .


Brain Modelling as a Service The Virtual Brain on EBRAINS. The Virtual Brain (TVB) is now available as open source cloud ecosystem on EBRAINS, a shared digital research platform for brain science. It offers services for constructing, simulating and analysing brain network models (BNMs) including the TVB network simulator magnetic resonance imaging (MRI) processing pipelines to extract structural and functional connectomes multiscale co simulation of spiking and large scale networks a domain specific language for automatic high performance code generation from user specified models simulation ready BNMs of patients and healthy volunteers Bayesian inference of epilepsy spread data and code for mouse brain simulation and extensive educational material. TVB cloud services facilitate reproducible online collaboration and discovery of data assets, models, and software embedded in scalable and secure workflows, a precondition for research on large cohort data sets, better generalizability and clinical translation.


Distributionally Robust Recurrent Decoders with Random Network Distillation. Neural machine learning models can successfully model language that is similar to their training distribution, but they are highly susceptible to degradation under distribution shift, which occurs in many practical applications when processing out of domain (OOD) text. This has been attributed to "shortcut learning" relying on weak correlations over arbitrary large contexts. We propose a method based on OOD detection with Random Network Distillation to allow an autoregressive language model to automatically disregard OOD context during inference, smoothly transitioning towards a less expressive but more robust model as the data becomes more OOD while retaining its full context capability when operating in distribution. We apply our method to a GRU architecture, demonstrating improvements on multiple language modeling (LM) datasets.


Strategy Complexity of Mean Payoff, Total Payoff and Point Payoff Objectives in Countable MDPs. We study countably infinite Markov decision processes (MDPs) with real valued transition rewards. Every infinite run induces the following sequences of payoffs 1. Point payoff (the sequence of directly seen transition rewards), 2. Total payoff (the sequence of the sums of all rewards so far), and 3. Mean payoff. For each payoff type, the objective is to maximize the probability that the liminf is non negative. We establish the complete picture of the strategy complexity of these objectives, i.e., how much memory is necessary and sufficient for varepsilon optimal (resp. optimal) strategies. Some cases can be won with memoryless deterministic strategies, while others require a step counter, a reward counter, or both.


Does The Monge Theorem Apply To Some Non Euclidean Geometries ?. In geometry, Monge's theorem states that for any three nonoverlapping circles of distinct radii in the two dimensional analytical plane equipped with the Euclidean metric, none of which is completely inside one of the others, the intersection points of each of the three pairs of external tangent lines are collinear. So, it is clearly observed that Monge's theorem is an application of Desargues' theorem. Our main motivation in this study is to show whether Monge theorem is still valid even if the plane is equipped with the metrics alpha and Lp.


alpha approximate Reductions a Novel Source of Heuristics for Better Approximation Algorithms. Lokshtanov et al. STOC 2017 introduced emph lossy kernelization as a mathematical framework for quantifying the effectiveness of preprocessing algorithms in preserving approximation ratios. emph alpha approximate reduction rules are a central notion of this framework. We propose that carefully crafted alpha approximate reduction rules can yield improved approximation ratios in practice, while being easy to implement as well. This is distinctly different from the (theoretical) purpose for which Lokshtanov et al. designed alpha approximate Reduction Rules. As evidence in support of this proposal we present a new 2 approximate reduction rule for the textsc Dominating Set problem. This rule, when combined with an approximation algorithm for textsc Dominating Set , yields significantly better approximation ratios on a variety of benchmark instances as compared to the latter algorithm alone. The central thesis of this work is that alpha approximate reduction rules can be used as a tool for designing approximation algorithms which perform better in practice. To the best of our knowledge, ours is the first exploration of the use of alpha approximate reduction rules as a design technique for practical approximation algorithms. We believe that this technique could be useful in coming up with improved approximation algorithms for other optimization problems as well.


Span Pointer Networks for Non Autoregressive Task Oriented Semantic Parsing. An effective recipe for building seq2seq, non autoregressive, task oriented parsers to map utterances to semantic frames proceeds in three steps encoding an utterance x , predicting a frame's length y , and decoding a y sized frame with utterance and ontology tokens. Though empirically strong, these models are typically bottlenecked by length prediction, as even small inaccuracies change the syntactic and semantic characteristics of resulting frames. In our work, we propose span pointer networks, non autoregressive parsers which shift the decoding task from text generation to span prediction that is, when imputing utterance spans into frame slots, our model produces endpoints (e.g., i, j ) as opposed to text (e.g., "6pm"). This natural quantization of the output space reduces the variability of gold frames, therefore improving length prediction and, ultimately, exact match. Furthermore, length prediction is now responsible for frame syntax and the decoder is responsible for frame semantics, resulting in a coarse to fine model. We evaluate our approach on several task oriented semantic parsing datasets. Notably, we bridge the quality gap between non autogressive and autoregressive parsers, achieving 87 EM on TOPv2 (Chen et al. 2020). Furthermore, due to our more consistent gold frames, we show strong improvements in model generalization in both cross domain and cross lingual transfer in low resource settings. Finally, due to our diminished output vocabulary, we observe 70 reduction in latency and 83 reduction in memory at beam size 5 compared to prior non autoregressive parsers.


Metadata Analysis of Open Educational Resources. Open Educational Resources (OERs) are openly licensed educational materials that are widely used for learning. Nowadays, many online learning repositories provide millions of OERs. Therefore, it is exceedingly difficult for learners to find the most appropriate OER among these resources. Subsequently, the precise OER metadata is critical for providing high quality services such as search and recommendation. Moreover, metadata facilitates the process of automatic OER quality control as the continuously increasing number of OERs makes manual quality control extremely difficult. This work uses the metadata of 8,887 OERs to perform an exploratory data analysis on OER metadata. Accordingly, this work proposes metadata based scoring and prediction models to anticipate the quality of OERs. Based on the results, our analysis demonstrated that OER metadata and OER content qualities are closely related, as we could detect high quality OERs with an accuracy of 94.6 . Our model was also evaluated on 884 educational videos from Youtube to show its applicability on other educational repositories.


Reidemeister Franz Torsion of Compact Orientable Surfaces via Pants Decomposition. Let Sigma g,n denote the compact orientable surface with genus g geq 2 and boundary disjoint union of n circles. By using a particular pants decomposition of Sigma g,n , we obtain a formula that computes the Reidemeister torsion of Sigma g,n in terms of Reidemeister torsions of pairs of pants.


Singleton type bounds for list decoding and list recovery, and related results. List decoding and list recovery are important generalizations of unique decoding that received considerable attention over the years. However, the optimal trade off among list decoding (resp. list recovery) radius, list size, and the code rate are not fully understood in both problems. This paper takes a step towards this direction when the list size is a given constant and the alphabet size is large (as a function of the code length). We prove a new Singleton type upper bound for list decodable codes, which improves upon the previously known bound by roughly a factor of 1 L , where L is the list size. We also prove a Singleton type upper bound for list recoverable codes, which is to the best of our knowledge, the first such bound for list recovery. We apply these results to obtain new lower bounds that are optimal up to a multiplicative constant on the list size for list decodable and list recoverable codes with rates approaching capacity. Moreover, we show that list decodable emph nonlinear codes can strictly outperform list decodable linear codes. More precisely, we show that there is a gap for a wide range of parameters, which grows fast with the alphabet size, between the size of the largest list decodable nonlinear code and the size of the largest list decodable linear codes. This is achieved by a novel connection between list decoding and the notion of sparse hypergraphs in extremal combinatorics. We remark that such a gap is not known to exist in the problem of unique decoding. Lastly, we show that list decodability or recoverability of codes implies in some sense good unique decodability.


Multiplierless MP Kernel Machine For Energy efficient Edge Devices. We present a novel framework for designing multiplierless kernel machines that can be used on resource constrained platforms like intelligent edge devices. The framework uses a piecewise linear (PWL) approximation based on a margin propagation (MP) technique and uses only addition subtraction, shift, comparison, and register underflow overflow operations. We propose a hardware friendly MP based inference and online training algorithm that has been optimized for a Field Programmable Gate Array (FPGA) platform. Our FPGA implementation eliminates the need for DSP units and reduces the number of LUTs. By reusing the same hardware for inference and training, we show that the platform can overcome classification errors and local minima artifacts that result from the MP approximation. Using the FPGA platform, we also show that the proposed multiplierless MP kernel machine demonstrates superior performance in terms of power, performance, and area compared to other comparable implementations.


Plasmon resonances of nanorods in transverse electromagnetic scattering. Plasmon resonance is the resonant oscillation of conduction electrons at the interface between negative and positive permittivity material stimulated by incident light, which forms the fundamental basis of many cutting edge industrial applications. We are concerned with the quantitative theoretical understanding of this peculiar resonance phenomenon. It is known that the occurrence of plasmon resonance as well as its quantitative behaviours critically depend on the geometry of the material structure, the corresponding material parameters and the operating wave frequency, which are delicately coupled together. In this paper, we study the plasmon resonance for a 2D nanorod structure, which presents an anisotropic geometry and arises in the transverse electromagnetic scattering. We present delicate spectral and asymptotic analysis to establish the accurate resonant conditions as well as sharply characterize the quantitative behaviours of the resonant field.


Partially Averaged Navier Stokes Closure Modeling for Variable Density Turbulent Flow. This work extends the framework of the partially averaged Navier Stokes (PANS) equations to variable density flow, text i.e. , multi material and or compressible mixing problems with density variations and production of turbulence kinetic energy by both shear and buoyancy mechanisms. The proposed methodology is utilized to derive the PANS BHR LEVM closure. This includes textit a priori testing to analyze and develop guidelines toward the efficient selection of the parameters controlling the physical resolution and, consequently, the range of resolved scales of PANS. Two archetypal test cases involving transient turbulence, hydrodynamic instabilities, and coherent structures are used to illustrate the accuracy and potential of the method the Taylor Green vortex (TGV) at Reynolds number mathrm Re 3000 , and the Rayleigh Taylor (RT) flow at Atwood number 0.5 and ( mathrm Re ) max approx 500 . These representative problems, for which turbulence is generated by shear and buoyancy processes, constitute the initial validation space of the new model, and their results are comprehensively discussed in two subsequent studies. The computations indicate that PANS can accurately predict the selected flow problems, resolving only a fraction of the scales of large eddy simulation and direct numerical simulation strategies. The results also reiterate that the physical resolution of the PANS model must guarantee that the key instabilities and coherent structures of the flow are resolved. The remaining scales can be modeled through an adequate turbulence scale dependent closure.


Analysis of Relation between Motor Activity and Imaginary EEG Records. Electroencephalography (EEG) signals signals are often used to learn about brain structure and to learn what thinking. EEG signals can be easily affected by external factors. For this reason, they should be applied various pre process during their analysis. In this study, it is used the EEG signals received from 109 subjects when opening and closing their right or left fists and performing hand and foot movements and imagining the same movements. The relationship between motor activities and imaginary of that motor activities were investigated. Algorithms with high performance rates have been used for feature extraction , selection and classification using the nearest neighbour algorithm.


Boundary path groupoids of generalized Boolean dynamical systems and their C algebras. In this paper, we provide two types of boundary path groupoids from a generalized Boolean dynamical system ( mathcal B , mathcal L , theta, mathcal I alpha ) . For the first groupoid, we associate an inverse semigroup to a generalized Boolean dynamical system and use the tight spectrum mathsf T as the unit space of a groupoid Gamma( mathcal B , mathcal L , theta, mathcal I alpha ) that is isomorphic to the tight groupoid mathcal G tight . The other one is defined as the Renault Deaconu groupoid Gamma( partial E, sigma E) arising from a topological correspondence E associated with a generalized Boolean dynamical system. We then prove that the tight spectrum mathsf T is homeomorphic to the boundary path space partial E obtained from the topological correspondence. Using this result, we prove that the groupoid Gamma( mathcal B , mathcal L , theta, mathcal I alpha ) equipped with the topology induced from the topology on mathcal G tight is isomorphic to Gamma( partial E, sigma E) as a topological groupoid. Finally, we show that their C algebras are isomorphic to the C algebra of the generalized Boolean dynamical system.


On unique tensor rank decomposition of 3 tensors. We answer to a question posed recently by B. Lovitz and F. Petrov, proving the conjectured sufficient minimality and uniqueness condition of the 3 tensor decomposition.


Stochastic solutions of generalized time fractional evolution equations. We consider a general class of integro differential evolution equations which includes the governing equation of the generalized grey Brownian motion and the time and space fractional heat equation. We present a general relation between the parameters of the equation and the distribution of the underlying stochastic processes, as well as discuss different classes of processes providing stochastic solutions of these equations. For a subclass of evolution equations, containing Saigo Maeda generalized time fractional operators, we determine the parameters of the corresponding processes explicitly. Moreover, we explain how self similar stochastic solutions with stationary increments can be obtained via linear fractional L 'evy motion for suitable pseudo differential operators in space.


Optimal investment in illiquid market with search frictions and transaction costs. We consider an optimal investment problem to maximize expected utility of the terminal wealth, in an illiquid market with search frictions and transaction costs. In the market model, an investor's attempt of transaction is successful only at arrival times of a Poisson process, and the investor pays proportional transaction costs when the transaction is successful. We characterize the no trade region describing the optimal trading strategy. We provide asymptotic expansions of the boundaries of the no trade region and the value function, for small transaction costs. The asymptotic analysis implies that the effects of the transaction costs are more pronounced.


Spectrum of the Neumann Poincar 'e operator and optimal estimates for transmission problems in presence of two circular inclusions. We consider the field concentration for the transmission problems of the homogeneous and inhomogeneous conductivity equations in the presence of closely located circular inclusions. We revisit these well studied problems by exploiting the spectral nature residing behind the phenomenon of the field concentration. The spectral approach enables us not only to recover the existing results with new insights but also to produce significant new results. We show that when relative conductivities of inclusions have different signs, then the gradient of the solution is bounded regardless of the distance between inclusions, but the second and higher derivatives may blow up as the distance tends to zero if one of conductivities is 0 and the other infty . This result holds for both homogenous and inhomogeneous problems. We prove these results by precise quantitative estimates of the derivatives of the solution. We also show by examples that the estimates are optimal.


Fault Localization in Cloud using Centrality Measures. Fault localization is an imperative method in fault tolerance in a distributed environment that designs a blueprint for continuing the ongoing process even when one or many modules are non functional. Visualizing a distributed environment as a graph, whose nodes represent faults (fault graph), allows us to introduce probabilistic weights to both edges and nodes that cause the faults. With multiple modules like databases, run time cloud, etc. making up a distributed environment and extensively, a cloud environment, we aim to address the problem of optimally and accurately performing fault localization in a distributed environment by modifying the Graph optimization approach to localization and centrality, specific to fault graphs.


Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out of Scope Intent Detection. Pre trained Transformer based models were reported to be robust in intent classification. In this work, we first point out the importance of in domain out of scope detection in few shot intent recognition tasks and then illustrate the vulnerability of pre trained Transformer based models against samples that are in domain but out of scope (ID OOS). We construct two new datasets, and empirically show that pre trained models do not perform well on both ID OOS examples and general out of scope examples, especially on fine grained few shot intent detection tasks. To figure out how the models mistakenly classify ID OOS intents as in scope intents, we further conduct analysis on confidence scores and the overlapping keywords, as well as point out several prospective directions for future work. Resources are available on https github.com jianguoz Few Shot Intent Detection.


Preference Discovery in Large Product Lines. When AI tools can generate many solutions, some human preference must be applied to determine which solution is relevant to the current project. One way to find those preferences is interactive search based software engineering (iSBSE) where humans can influence the search process. Current iSBSE methods can lead to cognitive fatigue (when they overwhelm humans with too many overly elaborate questions). WHUN is an iSBSE algorithm that avoids that problem. Due to its recursive clustering procedure, WHUN only pesters humans for O(log 2 N ) interactions. Further, each interaction is mediated via a feature selection procedure that reduces the number of asked questions. When compared to prior state of the art iSBSE systems, WHUN runs faster, asks fewer questions, and achieves better solutions that are within 0.1 of the best solutions seen in our sample space. More importantly, WHUN scales to large problems (in our experiments, models with 1000 variables can be explored with half a dozen interactions where, each time, we ask only four questions). Accordingly, we recommend WHUN as a baseline against which future iSBSE work should be compared. To facilitate that, all our scripts are online at https github.com ai se whun.


On the Hodge conjecture for quasi smooth intersections in toric varieties. We establish the Hodge conjecture for some subvarieties of a class of toric varieties. First we study quasi smooth intersections in a projective simplicial toric variety, which is a suitable notion to generalize smooth complete intersection subvarieties in the toric environment, and in particular quasi smooth hypersurfaces. We show that under appropriate conditions, the Hodge Conjecture holds for a very general quasi smooth intersection subvariety, generalizing the work on quasi smooth hypersurfaces of the first author and Grassi in 3 . We also show that the Hodge Conjecture holds asymptotically for suitable quasi smooth hypersurface in the Noether Lefschetz locus, where "asymptotically" means that the degree of the hypersurface is big enough. This extendes to toric varieties Otwinowska's result in 15 .


Reduction of Brauer classes on K3 surfaces, rationality and derived equivalence. We consider the reduction of Brauer classes on surfaces over number fields, with a view toward applications to rationality and derived equivalence. We show that a Brauer class on a very general polarized K3 surface over a number field becomes trivial upon reduction for a set of places of positive natural density. As a consequence, there are cubic fourfolds which become rational upon reduction for a positive proportion of places, and there are twisted derived equivalent K3 surfaces which become derived equivalent upon reduction for a positive proportion of places.


A generalization of T 'oth identity in the ring of algebraic integers involving a Dirichlet Character. The k dimensional generalized Euler function varphi k(n) is defined to be the number of ordered k tuples (a 1,a 2, ldots, a k) in mathbb N k with 1 leq a 1,a 2, ldots, a k leq n such that both the product a 1a 2 cdots a k and the sum a 1 a 2 cdots a k are co prime to n . T 'oth proved that the identity begin equation sum substack a 1,a 2, ldots, a k 1 gcd(a 1a 2 cdots a k,n) 1 gcd(a 1 a 2 cdots a k,n) 1 n gcd(a 1 a 2 cdots a k 1,n) varphi k(n) sigma 0(n), text where sigma s(n) sum d mid n d s text holds. end equation This identity can also be viewed as a generalization of Menon's identity. In this article, we generalize this identity to the ring of algebraic integers involving arithmetical functions and Dirichlet characters.


Document Domain Randomization for Deep Learning Document Layout Extraction. We present document domain randomization (DDR), the first successful transfer of convolutional neural networks (CNNs) trained only on graphically rendered pseudo paper pages to real world document segmentation. DDR renders pseudo document pages by modeling randomized textual and non textual contents of interest, with user defined layout and font styles to support joint learning of fine grained classes. We demonstrate competitive results using our DDR approach to extract nine document classes from the benchmark CS 150 and papers published in two domains, namely annual meetings of Association for Computational Linguistics (ACL) and IEEE Visualization (VIS). We compare DDR to conditions of style mismatch, fewer or more noisy samples that are more easily obtained in the real world. We show that high fidelity semantic information is not necessary to label semantic classes but style mismatch between train and test can lower model accuracy. Using smaller training samples had a slightly detrimental effect. Finally, network models still achieved high test accuracy when correct labels are diluted towards confusing labels this behavior hold across several classes.


The bundle of KMS state spaces for flows on a unital C algebra. It is shown that any bundle of KMS state spaces which can occur for a flow on a unital separable C algebra with a trace state can also be realized by a flow on any given unital infinite dimensional simple AF algebra with a tracial state space affinely homeomorphic to the fiber in the bundle over 0.


Rigidity results for geodesically reversible Finsler metrics. A Finsler metric is geodesically reversible if geodesics remain geodesics after a change of orientation. Asymmetric norms on vector spaces and Funk metrics in the interior of convex bodies are examples of geodesically reversible metrics that are not necessarily sums of reversible metrics and closed 1 forms. However, there seem to be few such examples in closed manifolds. In this paper the theory of volumes and areas on Finsler spaces is applied to establish a number of rigidity theorems which partially explain this paucity of examples. These rigidity results settle some hitherto unsolved cases of Hilbert's fourth problem for asymmetric metrics.


Moments of Sunlight Pathlength in Water and Aerosol Clouds from O 2 Spectroscopy Exploitable Parameter Sensitivities. The last IPCC assessment states that clouds and aerosols remain a challenge in climate prediction with Global Climate Models. Therefore, NASA's 2017 Decadal Survey has made them, along with convection and precipitation, a priority target for future missions under the ACCP banner, now Atmospheric Observing System. Atmospheric science is now more than ever driving renewal in remote sensing to probe clouds and aerosols more accurately and with improved sampling. Here, we bring new results that support Differential Optical Absorption Spectroscopy (DOAS) using oxygen absorption features in the visible near IR spectrum. With known concentration and cross section, the remaining unknown in O 2 DOAS is the path the light followed through the absorbing gas. In presence of scattering by cloud or aerosol particles, that path is broken at each interaction. Cumulative pathlength through the gas is a random variable, and its probability distribution function (PDF) will contain desirable information about the clouds or aerosols. Here, we compute statistical moments of the that PDF, showing that mean and variance convey different pieces of information, namely, size and opacity of the medium. We also extend the connection between geometric thickness and mean pathlength in presence of absorption by the scattering particles. We view pathlength moments as intermediate products that can be obtained from O 2 spectroscopy, and describe an algorithm to do that. In turn, these moments yield cloud or aerosol profile parameters of interest layer geometric and optical thicknesses. One normally thinks about active sensors, radars and lidars, for such atmospheric profiling. Here, the profile is parameterized and representative of a horizontal average determined by multiple scattering. However, there are advantages in passive vs active instrumentation, starting with the possibility of imaging over a large swath.


The Manhattan curve, ergodic theory of topological flows and rigidity. For every non elementary hyperbolic group, we introduce the Manhattan curve associated to any pair of left invariant hyperbolic metrics which are quasi isometric to a word metric. It is convex we show that it is continuously differentiable and moreover is a straight line if and only if the corresponding two metrics are roughly similar, i.e., they are within bounded distance after multiplying by a positive constant. Further, we prove that the Manhattan curve associated to two strongly hyperbolic metrics is twice continuously differentiable. The proof is based on the ergodic theory of topological flows associated to general hyperbolic groups and analyzing the multifractal structure of Patterson Sullivan measures. We exhibit some explicit examples including a hyperbolic triangle group and compute the exact value of the mean distortion for pairs of word metrics.


Semantic Bounds and Strong Call by Value Normalization. This paper explores two topics at once the use of denotational semantics to bound the evaluation length of functional programs, and the semantics of strong (that is, possibly under abstractions) call by value evaluation. About the first, we analyze de Carvalho's seminal use of relational semantics for bounding the evaluation length of lambda terms, starting from the presentation of the semantics as an intersection types system. We focus on the part of his work which is usually neglected in its many recent adaptations, despite being probably the conceptually deeper one how to transfer the bounding power from the type system to the relational semantics itself. We dissect this result and re understand it via the isolation of a simpler size representation property. About the second, we use relational semantics to develop a semantical study of strong call by value evaluation, which is both a delicate and neglected topic. We give a semantic characterization of terms normalizable with respect to strong evaluation, providing in particular the first result of adequacy with respect to strong call by value. Moreover, we extract bounds about strong evaluation from both the type systems and the relational semantics. Essentially, we use strong call by value to revisit de Carvalho's semantic bounds, and de Carvalho's technique to provide semantical foundations for strong call by value.


On Fast Sampling of Diffusion Probabilistic Models. In this work, we propose FastDPM, a unified framework for fast sampling in diffusion probabilistic models. FastDPM generalizes previous methods and gives rise to new algorithms with improved sample quality. We systematically investigate the fast sampling methods under this framework across different domains, on different datasets, and with different amount of conditional information provided for generation. We find the performance of a particular method depends on data domains (e.g., image or audio), the trade off between sampling speed and sample quality, and the amount of conditional information. We further provide insights and recipes on the choice of methods for practitioners.


CANINE Pre training an Efficient Tokenization Free Encoder for Language Representation. Pipelined NLP systems have largely been superseded by end to end neural modeling, yet nearly all commonly used models still require an explicit tokenization step. While recent tokenization approaches based on data derived subword lexicons are less brittle than manually engineered tokenizers, these techniques are not equally suited to all languages, and the use of any fixed vocabulary may limit a model's ability to adapt. In this paper, we present CANINE, a neural encoder that operates directly on character sequences, without explicit tokenization or vocabulary, and a pre training strategy that operates either directly on characters or optionally uses subwords as a soft inductive bias. To use its finer grained input effectively and efficiently, CANINE combines downsampling, which reduces the input sequence length, with a deep transformer stack, which encodes context. CANINE outperforms a comparable mBERT model by 2.8 F1 on TyDi QA, a challenging multilingual benchmark, despite having 28 fewer model parameters.


Design and behaviour of the Large Hadron Collider external beam dumps capable of receiving 539 MJ dump. Two 6 t beam dumps, made of a graphite core encapsulated in a stainless steel vessel, are used to absorb the energy of the two Large Hadron Collider (LHC) intense proton beams during operation of the accelerator. Operational issues started to appear in 2015 during LHC Run 2 (2014 2018) as a consequence of the progressive increase of the LHC beam kinetic energy, necessitating technical interventions in the highly radioactive areas around the dumps. Nitrogen gas leaks appeared after highly energetic beam impacts and instrumentation measurements indicated an initially unforeseen movement of the dumps. A computer modelling analysis campaign was launched to understand the origin of these issues, including both Monte Carlo simulations to model the proton beam interaction as well as advanced thermo mechanical analyses. The main findings were that the amount of instantaneous energy deposited in the dump vessel leads to a strong dynamic response of the whole dump and high accelerations (above 2000g). Based on these findings, an upgraded design, including a new support system and beam windows, was implemented to ensure the dumps' compatibility with the more intense beams foreseen during LHC Run 3 (2022 2025) of 539 MJ per beam. In this paper an integral overview of the operational behaviour of the dumps and the upgraded configurations are discussed.


On the Strategyproofness of the Geometric Median. The geometric median of a tuple of vectors is the vector that minimizes the sum of Euclidean distances to the vectors of the tuple. Classically called the Fermat Weber problem and applied to facility location, it has become a major component of the robust learning toolbox. It is typically used to aggregate the (processed) inputs of different data providers, whose motivations may diverge, especially in applications like content moderation. Interestingly, as a voting system, the geometric median has well known desirable properties it is a provably good average approximation, it is robust to a minority of malicious voters, and it satisfies the "one voter, one unit force" fairness principle. However, what was not known is the extent to which the geometric median is strategyproof. Namely, can a strategic voter significantly gain by misreporting their preferred vector? We prove in this paper that, perhaps surprisingly, the geometric median is not even alpha strategyproof, where alpha bounds what a voter can gain by deviating from truthfulness. But we also prove that, in the limit of a large number of voters with i.i.d. preferred vectors, the geometric median is asymptotically alpha strategyproof. We show how to compute this bound alpha . We then generalize our results to voters who care more about some dimensions. Roughly, we show that, if some dimensions are more polarized and regarded as more important, then the geometric median becomes less strategyproof. Interestingly, we also show how the skewed geometric medians can improve strategyproofness. Nevertheless, if voters care differently about different dimensions, we prove that no skewed geometric median can achieve strategyproofness for all. Overall, our results constitute a coherent set of insights into the extent to which the geometric median is suitable to aggregate high dimensional disagreements.