The distance backbone of complex networks. Redundancy needs more precise characterization as it is a major factor in the evolution and robustness of networks of multivariate interactions. We investigate the complexity of such interactions by inferring a connection transitivity that includes all possible measures of path length for weighted graphs. The result, without breaking the graph into smaller components, is a distance backbone subgraph sufficient to compute all shortest paths. This is important for understanding the dynamics of spread and communication phenomena in real world networks. The general methodology we formally derive yields a principled graph reduction technique and provides a finer characterization of the triangular geometry of all edges those that contribute to shortest paths and those that do not but are involved in other network phenomena. We demonstrate that the distance backbone is very small in large networks across domains ranging from air traffic to the human brain connectome, revealing that network robustness to attacks and failures seems to stem from surprisingly vast amounts of redundancy.


Equilibrium of an Arbitrary Bunch Train with Cavity Resonators and Short Range Wake Enhanced Iterative Solution with Anderson Acceleration. This paper continues the work of two previous treatments of bunch lengthening by a passive harmonic cavity in an electron storage ring. Such cavities, intended to reduce the effect of Touschek scattering, are a feature of fourth generation synchrotron light sources. The charge densities in the equilibrium state are given by solutions of coupled Ha "issinski equations, which are nonlinear integral equations. If the only wake fields are from cavity resonators, the unknowns can be the Fourier transforms of bunch densities at the resonator frequencies. The solution scheme based on this choice of unknowns proved to be deficient at the design current when multiple resonators were included. Here we return to the conventional formulation of Ha "issinski equations in coordinate space, the unknowns being charge densities at mesh points on a fine grid. This system would be awkward to solve by the Newton method used previously, because the Jacobian matrix is very large. Here a new solution is described, which is both Jacobian free and much simpler. It is based on an elementary fixed point iteration, accelerated by Anderson's method. The scheme is notably fast and robust, accommodating even the case of extreme over stretching at current far beyond the design value. The Anderson method is promising for many problems in accelerator theory and beyond, since it is quite simple and can be used to attack all kinds of nonlinear and linear integral and differential equations. Results are presented for ALS U, with updated design parameters. The model includes harmonic and main r.f. cavities, compensation of beam loading of the main cavity by adjustment of the generator voltage, and a realistic short range wake field (rather than the broad band resonator wake invoked previously).


Neural Hierarchical Factorization Machines for User's Event Sequence Analysis. Many prediction tasks of real world applications need to model multi order feature interactions in user's event sequence for better detection performance. However, existing popular solutions usually suffer two key issues 1) only focusing on feature interactions and failing to capture the sequence influence 2) only focusing on sequence information, but ignoring internal feature relations of each event, thus failing to extract a better event representation. In this paper, we consider a two level structure for capturing the hierarchical information over user's event sequence 1) learning effective feature interactions based event representation 2) modeling the sequence representation of user's historical events. Experimental results on both industrial and public datasets clearly demonstrate that our model achieves significantly better performance compared with state of the art baselines.


Explainable Machine Learning using Real, Synthetic and Augmented Fire Tests to Predict Fire Resistance and Spalling of RC Columns. This paper presents the development of systematic machine learning (ML) approach to enable explainable and rapid assessment of fire resistance and fire induced spalling of reinforced concrete (RC) columns. The developed approach comprises of an ensemble of three novel ML algorithms namely random forest (RF), extreme gradient boosted trees (ExGBT), and deep learning (DL). These algorithms are trained to account for a wide collection of geometric characteristics and material properties, as well as loading conditions to examine fire performance of normal and high strength RC columns by analyzing a comprehensive database of fire tests comprising of over 494 observations. The developed ensemble is also capable of presenting quantifiable insights to ML predictions thus, breaking free from the notion of 'blackbox' ML and establishing a solid step towards transparent and explainable ML. Most importantly, this work tackles the scarcity of available fire tests by proposing new techniques to leverage the use of real, synthetic and augmented fire test observations. The developed ML ensemble has been calibrated and validated for standard and design fire exposures and for one, two, three and four sided fire exposures thus covering a wide range of practical scenarios present during fire incidents. When fully deployed, the developed ensemble can analyze over 5,000 RC columns in under 60 seconds thus, providing an attractive solution for researchers and practitioners. The presented approach can also be easily extended for evaluating fire resistance and spalling of other structural members and under varying fire scenarios and loading conditions and hence paves the way to modernize the state of this research area and practice.


Learning to Cooperate with Unseen Agent via Meta Reinforcement Learning. Ad hoc teamwork problem describes situations where an agent has to cooperate with previously unseen agents to achieve a common goal. For an agent to be successful in these scenarios, it has to have a suitable cooperative skill. One could implement cooperative skills into an agent by using domain knowledge to design the agent's behavior. However, in complex domains, domain knowledge might not be available. Therefore, it is worthwhile to explore how to directly learn cooperative skills from data. In this work, we apply meta reinforcement learning (meta RL) formulation in the context of the ad hoc teamwork problem. Our empirical results show that such a method could produce robust cooperative agents in two cooperative environments with different cooperative circumstances social compliance and language interpretation. (This is a full paper of the extended abstract version.)


Nonlocal reaction traffic flow model with on off ramps. We present a non local version of a scalar balance law modeling traffic flow with on ramps and off ramps. The source term is used to describe the traffic flow over the on ramp and off ramps. We approximate the problem using an upwind type numerical scheme and we provide L infty and BV estimates for the sequence of approximate solutions. Together with a discrete entropy inequality, we also show the well posedness of the considered class of scalar balance laws. Some numerical simulations illustrate the behaviour of solutions in sample cases.


Precision determination of isotope shifts in ytterbium and implications for new physics. We report measurements of isotope shifts for the five spinless Yb isotopes on the 6s 2 , 1 textrm S 0 rightarrow 5d6s , 1 textrm D 2 transition using Doppler free two photon spectroscopy. We combine these data with existing measurements on two transitions in Yb Phys. Rev. Lett. 125, 123002 (2020) , where deviation from King plot linearity showed hints of a new bosonic force carrier at the 3 sigma level. The combined data strongly reduces the significance of the new physics signal. We show that the observed nonlinearity in the joint Yb Yb King plot analysis can be accounted for by the deformation of the Yb nuclei.


Make Bipedal Robots Learn How to Imitate. Bipedal robots do not perform well as humans since they do not learn to walk like we do. In this paper we propose a method to train a bipedal robot to perform some basic movements with the help of imitation learning (IL) in which an instructor will perform the movement and the robot will try to mimic the instructor movement. To the best of our knowledge, this is the first time we train the robot to perform movements with a single video of the instructor and as the training is done based on joint angles the robot will keep its joint angles always in physical limits which in return help in faster training. The joints of the robot are identified by OpenPose architecture and then joint angle data is extracted with the help of angle between three points resulting in a noisy solution. We smooth the data using Savitzky Golay filter and preserve the Simulatore data anatomy. An ingeniously written Deep Q Network (DQN) is trained with experience replay to make the robot learn to perform the movements as similar as the instructor. The implementation of the paper is made publicly available.


Experimental and quantum chemical characterization of heavy carbon subchalcogenides Infrared detection of SeC 3 Se. High resolution infrared studies of laser ablation products from carbon selenium targets have revealed a new vibrational band at 2057 cm 1 that is identified as the vibrational fundamental of the SeC 3 Se cluster. Because of the rich isotopic composition of selenium and the heavy nuclear masses involved, the vibrational band shows a relatively compact and complex structure despite the simple linear geometric arrangement. Overall, rotational vibrational lines of six isotopologues could be assigned and fitted permitting the derivation of an accurate selenium carbon bond length. Spectroscopic analysis has been greatly supported by high level quantum chemical calculations of the molecular structure and the harmonic and anharmonic force fields performed at the CCSD(T) level of theory. Scalar relativistic effects on the molecular structure were also considered but found of little importance.


Behavioral Experiments for Understanding Catastrophic Forgetting. In this paper we explore whether the fundamental tool of experimental psychology, the behavioral experiment, has the power to generate insight not only into humans and animals, but artificial systems too. We apply the techniques of experimental psychology to investigating catastrophic forgetting in neural networks. We present a series of controlled experiments with two layer ReLU networks, and exploratory results revealing a new understanding of the behavior of catastrophic forgetting. Alongside our empirical findings, we demonstrate an alternative, behavior first approach to investigating neural network phenomena.


Existence of global solution to a 2 D Riemann problem for Euler equations with general equation of state. In this article, we study the gas expansion problem by turning a sharp corner into vacuum for the two dimensional pseudo steady compressible Euler equations with a convex equation of state. This problem can be considered as interaction of a centered simple wave with a planar rarefaction wave. In order to obtain the global existence of solution up to vacuum boundary of the corresponding two dimensional Riemann problem, we consider several Goursat type boundary value problems for 2 D self similar Euler equations and use the ideas of characteristic decomposition and bootstrap method. Further, we formulate two dimensional modified shallow water equations newly and solve a dam break type problem for them as an application of this work. Moreover, we also recover the results from the available literature for certain equation of states which provide a check that the results obtained in this article are actually correct.


Entropy Based Evolutionary Diversity Optimisation for the Traveling Salesperson Problem. Computing diverse sets of high quality solutions has gained increasing attention among the evolutionary computation community in recent years. It allows practitioners to choose from a set of high quality alternatives. In this paper, we employ a population diversity measure, called the high order entropy measure, in an evolutionary algorithm to compute a diverse set of high quality solutions for the Traveling Salesperson Problem. In contrast to previous studies, our approach allows diversifying segments of tours containing several edges based on the entropy measure. We examine the resulting evolutionary diversity optimisation approach precisely in terms of the final set of solutions and theoretical properties. Experimental results show significant improvements compared to a recently proposed edge based diversity optimisation approach when working with a large population of solutions or long segments.


Theory and modeling of nonperturbative effects at high acoustic energy densities in thermoviscous acoustofluidics. A theoretical model of thermal boundary layers and acoustic heating in microscale acoustofluidic devices is presented. It includes effective boundary conditions allowing for simulations in three dimensions. The model is extended by an iterative scheme to incorporate nonlinear thermoviscous effects not captured by standard perturbation theory. The model predicts that the dominant nonperturbative effects in these devices are due to the dependency of thermoacoustic streaming on gradients in the steady temperature induced by a combination of internal frictional heating, external heating, and thermal convection. The model enables simulations in a nonperturbative regime relevant for design and fabrication of high throughput acoustofluidic devices.


Large scale holographic particle 3D imaging with the beam propagation model. We develop a novel algorithm for large scale holographic reconstruction of 3D particle fields. Our method is based on a multiple scattering beam propagation method (BPM) combined with sparse regularization that enables recovering dense 3D particles of high refractive index contrast from a single hologram. We show that the BPM computed hologram generates intensity statistics closely matching with the experimental measurements and provides up to 9 times higher accuracy than the single scattering model. To solve the inverse problem, we devise a computationally efficient algorithm, which reduces the computation time by two orders of magnitude as compared to the state of the art multiple scattering based technique. We demonstrate superior reconstruction accuracy in both simulations and experiments under different scattering strengths. We show that the BPM reconstruction significantly outperforms the single scattering method in particular for deep imaging depths and high particle densities.


Decentralized Global Connectivity Maintenance for Multi Robot Navigation A Reinforcement Learning Approach. The problem of multi robot navigation of connectivity maintenance is challenging in multi robot applications. This work investigates how to navigate a multi robot team in unknown environments while maintaining connectivity. We propose a reinforcement learning (RL) approach to develop a decentralized policy, which is shared among multiple robots. Given range sensor measurements and the positions of other robots, the policy aims to generate control commands for navigation and preserve the global connectivity of the robot team. We incorporate connectivity concerns into the RL framework as constraints and introduce behavior cloning to reduce the exploration complexity of policy optimization. The policy is optimized with all transition data collected by multiple robots in random simulated scenarios. We validate the effectiveness of the proposed approach by comparing different combinations of connectivity constraints and behavior cloning. We also show that our policy can generalize to unseen scenarios in both simulation and holonomic robots experiments.


Pagurus Eliminating Cold Startup in Serverless Computing with Inter Action Container Sharing. Serverless computing provides fine grain resource sharing between Cloud tenants through containers. Each function invocation (action) runs in an individual container. When there is not an already started container for a user function, a new container has to be created for it. However, the long cold startup time of a container results in the long response latency of the action. Our investigation shows that the containers for some user actions share most of the software packages. If an action that requires a new container can borrow'' a similar warm container from other actions, the long cold startup can be eliminated. Based on the above finding, we propose Pagurus, a runtime container management system for eliminating the cold startup in serverless computing. Pagurus is comprised of an inter action container scheduler and an intra action container scheduler for each action. The inter action container scheduler schedules shared containers among actions. The intra action container scheduler deals with the management of the container lifecycle. Our experimental results show that Pagurus effectively eliminates the time consuming container cold startup. An action may start to run in 10ms with Pagurus, even if there is not warm container for it.


MiB Asynchronous BFT with More Replicas. State of the art asynchronous Byzantine fault tolerant (BFT) protocols, such as HoneyBadgerBFT, BEAT, and Dumbo, have shown a performance comparable to partially synchronous BFT protocols. This paper studies two practical directions in asynchronous BFT. First, while all these asynchronous BFT protocols assume optimal resilience with 3f 1 replicas (where f is an upper bound on the number of Byzantine replicas), it is interesting to ask whether more efficient protocols are possible if relaxing the resilience level. Second, these recent BFT protocols evaluate their performance under failure free scenarios. It is unclear if these protocols indeed perform well during failures and attacks. This work first studies asynchronous BFT with suboptimal resilience using 5f 1 and 7f 1 replicas. We present MiB, a novel and efficient asynchronous BFT framework using new distributed system constructions as building blocks. MiB consists of two main BFT instances and five other variants. As another contribution, we systematically design experiments for asynchronous BFT protocols with failures and evaluate their performance in various failure scenarios. We report interesting findings, showing asynchronous BFT indeed performs consistently well during various failure scenarios. In particular, via a five continent deployment on Amazon EC2 using 140 replicas, we show the MiB instances have lower latency and much higher throughput than their asynchronous BFT counterparts.


Classification of a Class of Solvable Real Lie Algebras by using Techniques in Matrix Theory. We give a complete classification of the class of Lie algebras of simply connected real Lie groups whose nontrivial coadjoint orbits are of codimension 1. Such a Lie group belongs to a well known class, called the class of MD groups. The Lie algebra of an MD group is called an MD algebra. Some interest properties of MD algebras will be investigated as well. The techniques used in this paper is elementary techniques in matrix theory and available to apply to more general cases.


Fast solution of fully implicit Runge Kutta and discontinuous Galerkin in time for numerical PDEs, Part I the linear setting. Fully implicit Runge Kutta (IRK) methods have many desirable properties as time integration schemes in terms of accuracy and stability, but high order IRK methods are not commonly used in practice with numerical PDEs due to the difficulty of solving the stage equations. This paper introduces a theoretical and algorithmic preconditioning framework for solving the systems of equations that arise from IRK methods applied to linear numerical PDEs (without algebraic constraints). This framework also naturally applies to discontinuous Galerkin discretizations in time. Under quite general assumptions on the spatial discretization that yield stable time integration, the preconditioned operator is proven to have condition number bounded by a small, order one constant, independent of the spatial mesh and time step size, and with only weak dependence on number of stages polynomial order for example, the preconditioned operator for 10th order Gauss IRK has condition number less than two, independent of the spatial discretization and time step. The new method can be used with arbitrary existing preconditioners for backward Euler type time stepping schemes, and is amenable to the use of three term recursion Krylov methods when the underlying spatial discretization is symmetric. The new method is demonstrated to be effective on various high order finite difference and finite element discretizations of linear parabolic and hyperbolic problems, demonstrating fast, scalable solution of up to 10th order accuracy. The new method consistently outperforms existing block preconditioning approaches, and in several cases, the new method can achieve 4th order accuracy using Gauss integration with roughly half the number of preconditioner applications and wallclock time as required using standard diagonally implicit RK methods.


ell 2 decoupling for certain surfaces of finite type in mathbb R 3 . In this article, we establish an ell 2 decoupling inequality for the surface F 4 2 Big ( xi 1, xi 2, xi 1 4 xi 2 4) ( xi 1, xi 2) in 0,1 2 Big associated with the decomposition adapted to finite type geometry from our previous work. The key ingredients of the proof include the so called generalized rescaling technique, an ell 2 decoupling inequality for the surfaces Big ( xi 1, xi 2, phi 1( xi 1) xi 2 4) ( xi 1, xi 2) in 0,1 2 Big with phi 1 being non degenerate, reduction of dimension arguments and induction on scales.


Weakly multiplicative distributions and weighted Dirichlet spaces. We show that if u is a compactly supported distribution on the complex plane such that, for every pair of entire functions f,g , langle u,f overline g rangle langle u,f rangle langle u, overline g rangle, then u is supported at a single point. As an application, we complete the classification of all weighted Dirichlet spaces on the unit disk that are de Branges Rovnyak spaces by showing that, for such spaces, the weight is necessarily a superharmonic function.


Well posedness of Hibler's dynamical sea ice model. This paper establishes the local in time well posedness of solutions to an approximating system constructed by mildly regularizing the dynamical sea ice model of it W.D. Hibler, Journal of Physical Oceanography, 1979 . Our choice of regularization has been carefully designed, prompted by physical considerations, to retain the original coupled hyperbolic parabolic character of Hibler's model. Various regularized versions of this model have been used widely for the numerical simulation of the circulation and thickness of the Arctic ice cover. However, due to the singularity in the ice rheology, the notion of solutions to the original model is unclear. Instead, an approximating system, which captures current numerical study, is proposed. The well posedness theory of such a system provides a first step groundwork in both numerical study and future analytical study.


Improving Web API Usage Logging. A Web API (WAPI) is a type of API whose interaction with its consumers is done through the Internet. While being accessed through the Internet can be challenging, mostly when WAPIs evolve, it gives providers the possibility to monitor their usage, and understand and analyze consumers' behavior. Currently, WAPI usage is mostly logged for traffic monitoring and troubleshooting. Even though they contain invaluable information regarding consumers' behavior they are not sufficiently used by providers. In this paper, we first consider two phases of the application development lifecycle, and based on them we distinguish two different types of usage logs, namely development logs and production logs. For each of them we show the potential analyses (e.g., WAPI usability evaluation, consumers' needs identification) that can be performed, as well as the main impediments, that may be caused by the unsuitable log format. We then conduct a case study using logs of the same WAPI from different deployments and different formats, to demonstrate the occurrence of these impediments and at the same time the importance of a proper log format. Next, based on the case study results, we present the main quality issues of WAPI log data and explain their impact on data analyses. For each of them, we give some practical suggestions on how to deal with them, as well as mitigating their root cause.


Learning Hierarchical Integration of Foveal and Peripheral Vision for Vergence Control by Active Efficient Coding. The active efficient coding (AEC) framework parsimoniously explains the joint development of visual processing and eye movements, e.g., the emergence of binocular disparity selective neurons and fusional vergence, the disjunctive eye movements that align left and right eye images. Vergence can be driven by information in both the fovea and periphery, which play complementary roles. The high resolution fovea can drive precise short range movements. The lower resolution periphery supports coarser long range movements. The fovea and periphery may also contain conflicting information, e.g. due to objects at different depths. While past AEC models did integrate peripheral and foveal information, they did not explicitly take into account these characteristics. We propose here a two level hierarchical approach that does. The bottom level generates different vergence actions from foveal and peripheral regions. The top level selects one. We demonstrate that the hierarchical approach performs better than prior approaches in realistic environments, exhibiting better alignment and less oscillation.


Characterizing and contrasting structural proton transport mechanisms in azole hydrogen bond networks using ab initio molecular dynamics. Imidazole and 1,2,3 triazole are promising hydrogen bonded heterocycles that conduct protons via a structural mechanism and whose derivatives are present in systems ranging from biological proton channels to proton exchange membrane fuel cells. Here, we leverage multiple time stepping to perform ab initio molecular dynamics of imidazole and 1,2,3 triazole at the nanosecond timescale. We show that despite the close structural similarities of these compounds, their proton diffusion constants vary by over an order of magnitude. Our simulations reveal the reasons for these differences in diffusion constants, which range from the degree of hydrogen bonded chain linearity to the effect of the central nitrogen atom in 1,2,3 triazole on proton transport. In particular, we uncover evidence of two "blocking" mechanisms in 1,2,3 triazole, where covalent and hydrogen bonds formed by the central nitrogen atom limit the mobility of protons. Our simulations thus provide insights into the origins of the experimentally observed 10 fold difference in proton conductivity.


Deep Transformer Networks for Time Series Classification The NPP Safety Case. A challenging part of dynamic probabilistic risk assessment for nuclear power plants is the need for large amounts of temporal simulations given various initiating events and branching conditions from which representative feature extraction becomes complicated for subsequent applications. Artificial Intelligence techniques have been shown to be powerful tools in time dependent sequential data processing to automatically extract and yield complex features from large data. An advanced temporal neural network referred to as the Transformer is used within a supervised learning fashion to model the time dependent NPP simulation data and to infer whether a given sequence of events leads to core damage or not. The training and testing datasets for the Transformer are obtained by running 10,000 RELAP5 3D NPP blackout simulations with the list of variables obtained from the RAVEN software. Each simulation is classified as "OK" or "CORE DAMAGE" based on the consequence. The results show that the Transformer can learn the characteristics of the sequential data and yield promising performance with approximately 99 classification accuracy on the testing dataset.


Zero Aware Configurable Data Encoding by Skipping Transfer for Error Resilient Applications. In this paper, we propose Zero Aware Configurable Data Encoding by Skipping Transfer (ZAC DEST), a data encoding scheme to reduce the energy consumption of DRAM channels, specifically targeted towards approximate computing and error resilient applications. ZAC DEST exploits the similarity between recent data transfers across channels and information about the error resilience behavior of applications to reduce on die termination and switching energy by reducing the number of 1's transmitted over the channels. ZAC DEST also provides a number of knobs for trading off the application's accuracy for energy savings, and vice versa, and can be applied to both training and inference. We apply ZAC DEST to five machine learning applications. On average, across all applications and configurations, we observed a reduction of 40 in termination energy and 37 in switching energy as compared to the state of the art data encoding technique BD Coder with an average output quality loss of 10 . We show that if both training and testing are done assuming the presence of ZAC DEST, the output quality of the applications can be improved upto 9 times as compared to when ZAC DEST is only applied during testing leading to energy savings during training and inference with increased output quality.


Adaptive Multi Goal Exploration. We introduce a generic strategy for provably efficient multi goal exploration. It relies on AdaGoal, a novel goal selection scheme that leverages a measure of uncertainty in reaching states to adaptively target goals that are neither too difficult nor too easy. We show how AdaGoal can be used to tackle the objective of learning an epsilon optimal goal conditioned policy for the (initially unknown) set of goal states that are reachable within L steps in expectation from a reference state s 0 in a reward free Markov decision process. In the tabular case with S states and A actions, our algorithm requires tilde O (L 3 S A epsilon 2 ) exploration steps, which is nearly minimax optimal. We also readily instantiate AdaGoal in linear mixture Markov decision processes, yielding the first goal oriented PAC guarantee with linear function approximation. Beyond its strong theoretical guarantees, we anchor AdaGoal in goal conditioned deep reinforcement learning, both conceptually and empirically, by connecting its idea of selecting "uncertain" goals to maximizing value ensemble disagreement.


On Riemannian Optimization over Positive Definite Matrices with the Bures Wasserstein Geometry. In this paper, we comparatively analyze the Bures Wasserstein (BW) geometry with the popular Affine Invariant (AI) geometry for Riemannian optimization on the symmetric positive definite (SPD) matrix manifold. Our study begins with an observation that the BW metric has a linear dependence on SPD matrices in contrast to the quadratic dependence of the AI metric. We build on this to show that the BW metric is a more suitable and robust choice for several Riemannian optimization problems over ill conditioned SPD matrices. We show that the BW geometry has a non negative curvature, which further improves convergence rates of algorithms over the non positively curved AI geometry. Finally, we verify that several popular cost functions, which are known to be geodesic convex under the AI geometry, are also geodesic convex under the BW geometry. Extensive experiments on various applications support our findings.


Data Type Inference for Logic Programming. In this paper we present a new static data type inference algorithm for logic programming. Without the need of declaring types for predicates, our algorithm is able to automatically assign types to predicates which, in most cases, correspond to the data types processed by their intended meaning. The algorithm is also able to infer types given data type definitions similar to data definitions in Haskell and, in this case, the inferred types are more informative in general. We present the type inference algorithm, prove some properties and finally, we evaluate our approach on example programs that deal with different data structures.


TRACE A Differentiable Approach to Line level Stroke Recovery for Offline Handwritten Text. Stroke order and velocity are helpful features in the fields of signature verification, handwriting recognition, and handwriting synthesis. Recovering these features from offline handwritten text is a challenging and well studied problem. We propose a new model called TRACE (Trajectory Recovery by an Adaptively trained Convolutional Encoder). TRACE is a differentiable approach that uses a convolutional recurrent neural network (CRNN) to infer temporal stroke information from long lines of offline handwritten text with many characters and dynamic time warping (DTW) to align predictions and ground truth points. TRACE is perhaps the first system to be trained end to end on entire lines of text of arbitrary width and does not require the use of dynamic exemplars. Moreover, the system does not require images to undergo any pre processing, nor do the predictions require any post processing. Consequently, the recovered trajectory is differentiable and can be used as a loss function for other tasks, including synthesizing offline handwritten text. We demonstrate that temporal stroke information recovered by TRACE from offline data can be used for handwriting synthesis and establish the first benchmarks for a stroke trajectory recovery system trained on the IAM online handwriting dataset.


Concerted Rolling and Membrane Penetration Revealed by Atomistic Simulations of Antimicrobial Peptides. Short peptides with antimicrobial activity have therapeutic potential for treating bacterial infections. Mechanisms of actions for antimicrobial peptides require binding the biological membrane of their target, which often represents a key mechanistic step. A multitude of data driven approaches have been developed to predict potential antimicrobial peptide sequences however, these methods are usually agnostic to the physical interactions between the peptide and the membrane. Towards developing higher throughput screening methodologies, here we use Markov State Modeling and all atom molecular dynamics simulations to quantify the membrane binding and insertion kinetics of three prototypical and antimicrobial peptides (alpha helical magainin 2 and PGLa and beta hairpin tachyplesin 1). By leveraging a set of collective variables that capture the essential physics of the amphiphilic and cationic peptide membrane interactions we reveal how the slowest kinetic process of membrane insertion is the dynamic rolling of the peptide from a prebound to fully inserted state. These results add critical details to how antimicrobial peptides insert into bacterial membranes.


Coarse grained Stochastic Model of Myosin Driven Vesicles into Dendritic Spines. We study the dynamics of membrane vesicle motor transport into dendritic spines, which are bulbous intracellular compartments in neurons that play a key role in transmitting signals between neurons. We consider the stochastic analog of the vesicle transport model in Park and Fai, The Dynamics of Vesicles Driven Into Closed Constrictions by Molecular Motors. Bull. Math. Biol. 82, 141 (2020) . The stochastic version, which may be considered as an agent based model, relies mostly on the action of individual myosin motors to produce vesicle motion. To aid in our analysis, we coarse grain this agent based model using a master equation combined with a partial differential equation describing the probability of local motor positions. We confirm through convergence studies that the coarse graining captures the essential features of bistability in velocity (observed in experiments) and waiting time distributions to switch between steady state velocities. Interestingly, these results allow us to reformulate the translocation problem in terms of the mean first passage time for a run and tumble particle moving on a finite domain with absorbing boundaries at the two ends. We conclude by presenting numerical and analytical calculations of vesicle translocation.


Analytical theory of frequency modulated combs generalized mean field theory, complex cavities, and harmonic states. Frequency modulated (FM) combs with a linearly chirped frequency and nearly constant intensity occur naturally in certain laser systems they can be most succinctly described by a nonlinear Schr "odinger equation with a phase potential. In this work, we perform a comprehensive analytical study of FM combs in order to calculate their salient properties. We develop a general procedure that allows mean field theories to be constructed for arbitrary sets of master equations, and as an example consider the case of reflective defects. We derive an expression for the FM chirp of arbitrary Fabry Perot cavities important for most realistic lasers and use perturbation theory to show how they are affected by gain curvature. Lastly, we show that an eigenvalue formulation of the laser's dynamics can be useful for characterizing all of the stable states of the laser the fundamental comb, the continuous wave solution, and the harmonic states.


Autonomous Vehicles Drive into Shared Spaces eHMI Design Concept Focusing on Vulnerable Road Users. In comparison to conventional traffic designs, shared spaces promote a more pleasant urban environment with slower motorized movement, smoother traffic, and less congestion. In the foreseeable future, shared spaces will be populated with a mixture of autonomous vehicles (AVs) and vulnerable road users (VRUs) like pedestrians and cyclists. However, a driver less AV lacks a way to communicate with the VRUs when they have to reach an agreement of a negotiation, which brings new challenges to the safety and smoothness of the traffic. To find a feasible solution to integrating AVs seamlessly into shared space traffic, we first identified the possible issues that the shared space designs have not considered for the role of AVs. Then an online questionnaire was used to ask participants about how they would like a driver of the manually driving vehicle to communicate with VRUs in a shared space. We found that when the driver wanted to give some suggestions to the VRUs in a negotiation, participants thought that the communications via the driver's body behaviors were necessary. Besides, when the driver conveyed information about her his intentions and cautions to the VRUs, participants selected different communication methods with respect to their transport modes (as a driver, pedestrian, or cyclist). These results suggest that novel eHMIs might be useful for AV VRU communication when the original drivers are not present. Hence, a potential eHMI design concept was proposed for different VRUs to meet their various expectations. In the end, we further discussed the effects of the eHMIs on improving the sociality in shared spaces and the autonomous driving systems.


DRILL Deep Reinforcement Learning for Refinement Operators in mathcal ALC . Approaches based on refinement operators have been successfully applied to class expression learning on RDF knowledge graphs. These approaches often need to explore a large number of concepts to find adequate hypotheses. This need arguably stems from current approaches relying on myopic heuristic functions to guide their search through an infinite concept space. In turn, deep reinforcement learning provides effective means to address myopia by estimating how much discounted cumulated future reward states promise. In this work, we leverage deep reinforcement learning to accelerate the learning of concepts in mathcal ALC by proposing DRILL a novel class expression learning approach that uses a convolutional deep Q learning model to steer its search. By virtue of its architecture, DRILL is able to compute the expected discounted cumulated future reward of more than 10 3 class expressions in a second on standard hardware. We evaluate DRILL on four benchmark datasets against state of the art approaches. Our results suggest that DRILL converges to goal states at least 2.7 times faster than state of the art models on all benchmark datasets. We provide an open source implementation of our approach, including training and evaluation scripts as well as pre trained models.


Dual Progressive Prototype Network for Generalized Zero Shot Learning. Generalized Zero Shot Learning (GZSL) aims to recognize new categories with auxiliary semantic information,e.g., category attributes. In this paper, we handle the critical issue of domain shift problem, i.e., confusion between seen and unseen categories, by progressively improving cross domain transferability and category discriminability of visual representations. Our approach, named Dual Progressive Prototype Network (DPPN), constructs two types of prototypes that record prototypical visual patterns for attributes and categories, respectively. With attribute prototypes, DPPN alternately searches attribute related local regions and updates corresponding attribute prototypes to progressively explore accurate attribute region correspondence. This enables DPPN to produce visual representations with accurate attribute localization ability, which benefits the semantic visual alignment and representation transferability. Besides, along with progressive attribute localization, DPPN further projects category prototypes into multiple spaces to progressively repel visual representations from different categories, which boosts category discriminability. Both attribute and category prototypes are collaboratively learned in a unified framework, which makes visual representations of DPPN transferable and distinctive. Experiments on four benchmarks prove that DPPN effectively alleviates the domain shift problem in GZSL.


Stable free lattices in residually reducible Galois deformations and control theorem of Selmer groups. In this paper, we study the graph of homothety classes of stable free lattices in a two dimensional representation over a local UFD. This generalizes a classical result of the case where the base ring is a discrete valuation ring due to Serre. As applications, we consider the case when the representation comes from a residually reducible Hida family and we study the control theorem of Selmer groups. These results enable us to know the precise statement of the main conjecture in residually reducible case as we will remark in section 4.


A Matrix free Multigrid Preconditioner for Jacobian free Newton Krylov Methods. In this work, we propose a multigrid preconditioner for Jacobian free Newton Krylov (JFNK) methods. Our multigrid method does not require to store any representation of the Jacobian at any level of the multigrid hierarchy. As it is common in standard multigrid methods, the proposed method also relies on three building blocks transfer operators, smoothers, and a coarse level solver. In addition to the restriction and prolongation operator, we also use a projection operator to transfer the current Newton iterate to a coarser level. The three level Chebyshev semi iterative method is employed as a smoother, as it has good smoothing properties and does not require the representation of the Jacobian matrix. We replace the direct solver on the coarsest level with a matrix free Krylov subspace method, thus giving rise to a truly Jacobian free multigrid preconditioner. We will discuss all building blocks of our multigrid preconditioner in detail and demonstrate the robustness and the efficiency of the proposed method using several numerical examples.


Netmarble AI Center's WMT21 Automatic Post Editing Shared Task Submission. This paper describes Netmarble's submission to WMT21 Automatic Post Editing (APE) Shared Task for the English German language pair. First, we propose a Curriculum Training Strategy in training stages. Facebook Fair's WMT19 news translation model was chosen to engage the large and powerful pre trained neural networks. Then, we post train the translation model with different levels of data at each training stages. As the training stages go on, we make the system learn to solve multiple tasks by adding extra information at different training stages gradually. We also show a way to utilize the additional data in large volume for APE tasks. For further improvement, we apply Multi Task Learning Strategy with the Dynamic Weight Average during the fine tuning stage. To fine tune the APE corpus with limited data, we add some related subtasks to learn a unified representation. Finally, for better performance, we leverage external translations as augmented machine translation (MT) during the post training and fine tuning. As experimental results show, our APE system significantly improves the translations of provided MT results by 2.848 and 3.74 on the development dataset in terms of TER and BLEU, respectively. It also demonstrates its effectiveness on the test dataset with higher quality than the development dataset.


CEREC A Corpus for Entity Resolution in Email Conversations. We present the first large scale corpus for entity resolution in email conversations (CEREC). The corpus consists of 6001 email threads from the Enron Email Corpus containing 36,448 email messages and 60,383 entity coreference chains. The annotation is carried out as a two step process with minimal manual effort. Experiments are carried out for evaluating different features and performance of four baselines on the created corpus. For the task of mention identification and coreference resolution, a best performance of 59.2 F1 is reported, highlighting the room for improvement. An in depth qualitative and quantitative error analysis is presented to understand the limitations of the baselines considered.


Kuttler Sigillito's Inequalities and Rellich Christianson Identity. This article has two main objectives. The first one is to show Kuttler Sigillito's type inequalities involving the mixed Neumann Dirichlet, mixed Steklov Dirichlet, and mixed Robin Dirichlet eigenvalue problems. We will provide examples on e.g. squares and balls for the inequalities presented. Next we will show a Rellich identity for the mixed Neumann Dirichlet problem. This identity will be used to prove a Rellich Christianson identity for the Neumann Dirichlet problem.


Parallel Independence in Attributed Graph Rewriting. In order to define graph transformations by the simultaneous application of concurrent rules, we have adopted in previous work a structure of attributed graphs stable by unions. We analyze the consequences on parallel independence, a property that characterizes the possibility to resort to sequential rewriting. This property turns out to depend not only on the left hand side of rules, as in algebraic approaches to graph rewriting, but also on their right hand side. It is then shown that, of three possible definitions of parallel rewriting, only one is convenient in the light of parallel independence.


Preliminary Steps Towards Federated Sentiment Classification. Automatically mining sentiment tendency contained in natural language is a fundamental research to some artificial intelligent applications, where solutions alternate with challenges. Transfer learning and multi task learning techniques have been leveraged to mitigate the supervision sparsity and collaborate multiple heterogeneous domains correspondingly. Recent years, the sensitive nature of users' private data raises another challenge for sentiment classification, i.e., data privacy protection. In this paper, we resort to federated learning for multiple domain sentiment classification under the constraint that the corpora must be stored on decentralized devices. In view of the heterogeneous semantics across multiple parties and the peculiarities of word embedding, we pertinently provide corresponding solutions. First, we propose a Knowledge Transfer Enhanced Private Shared (KTEPS) framework for better model aggregation and personalization in federated sentiment classification. Second, we propose KTEPS star with the consideration of the rich semantic and huge embedding size properties of word vectors, utilizing Projection based Dimension Reduction (PDR) methods for privacy protection and efficient transmission simultaneously. We propose two federated sentiment classification scenes based on public benchmarks, and verify the superiorities of our proposed methods with abundant experimental investigations.


A tool to support the investigation and visualization of cyber and or physical incidents. Investigating efficiently the data collected from a system's activity can help to detect malicious attempts and better understand the context behind past incident occurrences. Nowadays, several solutions can be used to monitor system activities to detect probable abnormalities and malfunctions. However, most of these systems overwhelm their users with vast amounts of information, making it harder for them to perceive incident occurrences and their context. Our approach combines a dynamic and intuitive user interface with Machine Learning forecasts to provide an intelligent investigation tool that facilitates the security operator's work. Our system can also act as an enhanced and fully automated decision support mechanism that provides suggestions about possible incident occurrences.


Annealed Stein Variational Gradient Descent. Particle based optimization algorithms have recently been developed as sampling methods that iteratively update a set of particles to approximate a target distribution. In particular Stein variational gradient descent has gained attention in the approximate inference literature for its flexibility and accuracy. We empirically explore the ability of this method to sample from multi modal distributions and focus on two important issues (i) the inability of the particles to escape from local modes and (ii) the inefficacy in reproducing the density of the different regions. We propose an annealing schedule to solve these issues and show, through various experiments, how this simple solution leads to significant improvements in mode coverage, without invalidating any theoretical properties of the original algorithm.


Analytic Continuation of Generalized Trigonometric Functions. Via a unified geometric approach, a class of generalized trigonometric functions with two parameters are analytically extended to maximal domains on which they are univalent. Some consequences are deduced concerning radius of convergence for the Maclaurin series, commutation with rotation, continuation beyond the domain of univalence, and periodicity.


The MIT Humanoid Robot Design, Motion Planning, and Control For Acrobatic Behaviors. Demonstrating acrobatic behavior of a humanoid robot such as flips and spinning jumps requires systematic approaches across hardware design, motion planning, and control. In this paper, we present a new humanoid robot design, an actuator aware kino dynamic motion planner, and a landing controller as part of a practical system design for highly dynamic motion control of the humanoid robot. To achieve the impulsive motions, we develop two new proprioceptive actuators and experimentally evaluate their performance using our custom designed dynamometer. The actuator's torque, velocity, and power limits are reflected in our kino dynamic motion planner by approximating the configuration dependent reaction force limits and in our dynamics simulator by including actuator dynamics along with the robot's full body dynamics. For the landing control, we effectively integrate model predictive control and whole body impulse control by connecting them in a dynamically consistent way to accomplish both the long time horizon optimal control and high bandwidth full body dynamics based feedback. Actuators' torque output over the entire motion are validated based on the velocity torque model including battery voltage droop and back EMF voltage. With the carefully designed hardware and control framework, we successfully demonstrate dynamic behaviors such as back flips, front flips, and spinning jumps in our realistic dynamics simulation.


Exact CutFEM Polynomial Integration. The implementation of discontinuous functions occurs in many of today's state of the art partial differential equation solvers. In finite element methods this poses an inherent difficulty there are no quadrature rules readily available, when integrating functions whose discontinuity falls in the interior of the element. Many approaches to this issue have been developed in recent years, among them is the equivalent polynomial technique. This method replaces the discontinuous function with a polynomial, potentially allowing for the integration to occur over the entire domain, rather than integrating over complex subdomains. Although, eliminating the issues involved with discontinuous function integration, the equivalent polynomial tactic introduces its own set of problems. In particular, either adaptivity is required to capture the discontinuity or error is introduced when regularization of the discontinuous function is implemented. In the current work we eliminate both of these issues. The results of this work provide exact algebraic expressions for subdomain and interface polynomial integration, where the interface represents the boundary of the cut domain. We also provide algorithms for the implementation of these expressions for standard finite element shapes in one, two, and three dimensions, along with a hypercube of arbitrary dimension .


Does Parking Matter? The Impact of Search Time for Parking on Last Mile Delivery Optimization. Parking is a necessary component of traditional last mile delivery practices, but finding parking can be difficult. Yet, the routing literature largely does not account for the need to find parking. In this paper, we address this challenge of finding parking through the Capacitated Delivery Problem with Parking (CDPP). Unlike other models in the literature, the CDPP accounts for the search time for parking in the objective and minimizes the completion time of the delivery tour. When we restrict the customer geography to a complete grid, we identify conditions for when a Traveling Salesman Problem (TSP) solution that parks at each customer is an optimal solution to the CDPP. We then determine when the search time for parking is large enough for the CDPP optimal solution to differ from this TSP solution. We also identify model improvements that allow reasonably sized instances of the CDPP to be solved exactly. We introduce a heuristic for the CDPP that quickly finds high quality solutions to large instances. Computational experiments show that parking matters in last mile delivery optimization. The CDPP outperforms industry practice and models in the literature showing the greatest advantage when the search time for parking is high. This analysis provides immediate ways to improve routing in last mile delivery.


Analysis of a discretization of a distributed control problem with a stochastic evolution equation. This paper analyzes a discretization of a stochastic parabolic optimal control problem, where the diffusion term contains the control variable. With rough data, the convergence of the discretization is derived. In addition, a Monte Carlo method is presented.


Better Algorithms for Individually Fair k Clustering. We study data clustering problems with ell p norm objectives (e.g. k Median and k Means) in the context of individual fairness. The dataset consists of n points, and we want to find k centers such that (a) the objective is minimized, while (b) respecting the individual fairness constraint that every point v has a center within a distance at most r(v) , where r(v) is v 's distance to its (n k) th nearest point. Jung, Kannan, and Lutz FORC 2020 introduced this concept and designed a clustering algorithm with provable (approximate) fairness and objective guarantees for the ell infty or k Center objective. Mahabadi and Vakilian ICML 2020 revisited this problem to give a local search algorithm for all ell p norms. Empirically, their algorithms outperform Jung et. al.'s by a large margin in terms of cost (for k Median and k Means), but they incur a reasonable loss in fairness. In this paper, our main contribution is to use Linear Programming (LP) techniques to obtain better algorithms for this problem, both in theory and in practice. We prove that by modifying known LP rounding techniques, one gets a worst case guarantee on the objective which is much better than in MV20, and empirically, this objective is extremely close to the optimal. Furthermore, our theoretical fairness guarantees are comparable with MV20 in theory, and empirically, we obtain noticeably fairer solutions. Although solving the LP em exactly might be prohibitive, we demonstrate that in practice, a simple sparsification technique drastically improves the run time of our algorithm.


Orthogonal Attention A Cloze Style Approach to Negation Scope Resolution. Negation Scope Resolution is an extensively researched problem, which is used to locate the words affected by a negation cue in a sentence. Recent works have shown that simply finetuning transformer based architectures yield state of the art results on this task. In this work, we look at Negation Scope Resolution as a Cloze Style task, with the sentence as the Context and the cue words as the Query. We also introduce a novel Cloze Style Attention mechanism called Orthogonal Attention, which is inspired by Self Attention. First, we propose a framework for developing Orthogonal Attention variants, and then propose 4 Orthogonal Attention variants OA C, OA CA, OA EM, and OA EMB. Using these Orthogonal Attention layers on top of an XLNet backbone, we outperform the finetuned XLNet state of the art for Negation Scope Resolution, achieving the best results to date on all 4 datasets we experiment with BioScope Abstracts, BioScope Full Papers, SFU Review Corpus and the sem 2012 Dataset (Sherlock).


A Formal Proof of the Independence of the Continuum Hypothesis. We describe a formal proof of the independence of the continuum hypothesis ( mathsf CH ) in the Lean theorem prover. We use Boolean valued models to give forcing arguments for both directions, using Cohen forcing for the consistency of neg mathsf CH and a sigma closed forcing for the consistency of mathsf CH .


Regular origamis with totally non congruence groups as Veech groups. Veech groups are an important tool to examine translation surfaces and related mathematical objects. Origamis, also known as square tiled surfaces, form an interesting class of translation surfaces with finite index subgroups of SL(2,Z) as Veech groups. We study when Veech groups of origamis with maximal symmetry group are totally non congruence groups, i.e., when they surject onto SL(2, Z nZ) for each natural number n. For this, we use a result of Schlage Puchta and Weitze Schmith "usen to deduce sufficient conditions on the deck transformation group of the origami. More precisely, we show that origamis with certain quotients of triangle groups as deck transformation groups satisfy this condition. All Hurwitz groups are such quotients.


Equilibrium Refinements for Multi Agent Influence Diagrams Theory and Practice. Multi agent influence diagrams (MAIDs) are a popular form of graphical model that, for certain classes of games, have been shown to offer key complexity and explainability advantages over traditional extensive form game (EFG) representations. In this paper, we extend previous work on MAIDs by introducing the concept of a MAID subgame, as well as subgame perfect and trembling hand perfect equilibrium refinements. We then prove several equivalence results between MAIDs and EFGs. Finally, we describe an open source implementation for reasoning about MAIDs and computing their equilibria.


The algebra of Feistel Toffoli schemes. The process of replacing an arbitrary Boolean function by a bijective one, a fundamental tool in reversible computing and in cryptography, is interpreted algebraically as a particular instance of a certain group homomorphism from the X fold cartesian power of a group G into the automorphism group of the free G set over the set X. It is shown that this construction not only can be generalized from groups to monoids but, more generally, to internal categories in arbitrary finitely complete categories where it becomes a cartesian isomorphism between certain discrete fibrations.


A Study on the Efficient Product Search Service for the Damaged Image Information. With the development of Information and Communication Technologies and the dissemination of smartphones, especially now that image search is possible through the internet, e commerce markets are more activating purchasing services for a wide variety of products. However, it often happens that the image of the desired product is impaired and that the search engine does not recognize it properly. The idea of this study is to help search for products through image restoration using an image pre processing and image inpainting algorithm for damaged images. It helps users easily purchase the items they want by providing a more accurate image search system. Besides, the system has the advantage of efficiently showing information by category, so that enables efficient sales of registered information.


Tameness and the power of programs over monoids in DA. The program over monoid model of computation originates with Barrington's proof that the model captures the complexity class mathsf NC 1 . Here we make progress in understanding the subtleties of the model. First, we identify a new tameness condition on a class of monoids that entails a natural characterization of the regular languages recognizable by programs over monoids from the class. Second, we prove that the class known as mathbf DA satisfies tameness and hence that the regular languages recognized by programs over monoids in mathbf DA are precisely those recognizable in the classical sense by morphisms from mathbf QDA . Third, we show by contrast that the well studied class of monoids called mathbf J is not tame. Finally, we exhibit a program length based hierarchy within the class of languages recognized by programs over monoids from mathbf DA .


Asymptotic behavior of fronts and pulses of the bidomain model. The bidomain model is the standard model for cardiac electrophysiology. In this paper, we investigate the instability and asymptotic behavior of planar fronts and planar pulses of the bidomain Allen Cahn equation and the bidomain FitzHugh Nagumo equation in two spatial dimension. In previous work, it was shown that planar fronts of the bidomain Allen Cahn equation can become unstable in contrast to the classical Allen Cahn equation. We find that, after the planar front is destabilized, a rotating zigzag front develops whose shape can be explained by simple geometric arguments using a suitable Frank diagram. We also show that the Hopf bifurcation through which the front becomes unstable can be either supercritical or subcritical, by demonstrating a parameter regime in which a stable planar front and zigzag front can coexist. In our computational studies of the bidomain FitzHugh Nagumo pulse solution, we show that the pulses can also become unstable much like the bidomain Allen Cahn fronts. However, unlike the bidomain Allen Cahn case, the destabilized pulse does not necessarily develop into a zigzag pulse. For certain choice of parameters, the destabilized pulse can disintegrate entirely. These studies are made possible by the development of a numerical scheme that allows for the accurate computation of the bidomain equation in a two dimensional strip domain of infinite extent.


Two Coupled Rejection Metrics Can Tell Adversarial Examples Apart. Correctly classifying adversarial examples is an essential but challenging requirement for safely deploying machine learning models. As reported in RobustBench, even the state of the art adversarially trained models struggle to exceed 67 robust test accuracy on CIFAR 10, which is far from practical. A complementary way towards robustness is to introduce a rejection option, allowing the model to not return predictions on uncertain inputs, where confidence is a commonly used certainty proxy. Along with this routine, we find that confidence and a rectified confidence (R Con) can form two coupled rejection metrics, which could provably distinguish wrongly classified inputs from correctly classified ones. This intriguing property sheds light on using coupling strategies to better detect and reject adversarial examples. We evaluate our rectified rejection (RR) module on CIFAR 10, CIFAR 10 C, and CIFAR 100 under several attacks including adaptive ones, and demonstrate that the RR module is compatible with different adversarial training frameworks on improving robustness, with little extra computation. The code is available at https github.com P2333 Rectified Rejection.


On The Ingredients of an Effective Zero shot Semantic Parser. Semantic parsers map natural language utterances into meaning representations (e.g., programs). Such models are typically bottlenecked by the paucity of training data due to the required laborious annotation efforts. Recent studies have performed zero shot learning by synthesizing training examples of canonical utterances and programs from a grammar, and further paraphrasing these utterances to improve linguistic diversity. However, such synthetic examples cannot fully capture patterns in real data. In this paper we analyze zero shot parsers through the lenses of the language and logical gaps (Herzig and Berant, 2019), which quantify the discrepancy of language and programmatic patterns between the canonical examples and real world user issued ones. We propose bridging these gaps using improved grammars, stronger paraphrasers, and efficient learning methods using canonical examples that most likely reflect real user intents. Our model achieves strong performance on two semantic parsing benchmarks (Scholar, Geo) with zero labeled data.


Supervised Contrastive Learning for Interpretable Long Document Comparison. Recent advancements in deep learning techniques have transformed the area of semantic text matching. However, most of the state of the art models are designed to operate with short documents such as tweets, user reviews, comments, etc., and have fundamental limitations when applied to long form documents such as scientific papers, legal documents, and patents. When handling such long documents, there are three primary challenges (i) The presence of different contexts for the same word throughout the document, (ii) Small sections of contextually similar text between two documents, but dissimilar text in the remaining parts this defies the basic understanding of "similarity", and (iii) The coarse nature of a single global similarity measure which fails to capture the heterogeneity of the document content. In this paper, we describe CoLDE Contrastive Long Document Encoder a transformer based framework that addresses these challenges and allows for interpretable comparisons of long documents. CoLDE uses unique positional embeddings and a multi headed chunkwise attention layer in conjunction with a contrastive learning framework to capture similarity at three different levels (i) high level similarity scores between a pair of documents, (ii) similarity scores between different sections within and across documents, and (iii) similarity scores between different chunks in the same document and also other documents. These fine grained similarity scores aid in better interpretability. We evaluate CoLDE on three long document datasets namely, ACL Anthology publications, Wikipedia articles, and USPTO patents. Besides outperforming the state of the art methods on the document comparison task, CoLDE also proves interpretable and robust to changes in document length and text perturbations.


Relationships Between the Maximum Principle and Dynamic Programming for Infinite Dimensional Stochastic Control Systems. Pontryagin type maximum principle and Bellman's dynamic programming principle serve as two of the most important tools in solving optimal control problems. There is a huge literature on the study of relationship between them. The main purpose of this paper is to investigate the relationships between Pontryagin type maximum principle and dynamic programming principle for control systems governed by stochastic evolution equations in infinite dimensional space, with the control variables appearing into both the drift and the diffusion terms. To do so, we first establish dynamic programming principle for those systems without employing the martingale solutions. Then we establish the desired relationships in both cases that value function associated is smooth and nonsmooth. For the nonsmooth case, in particular, by employing the relaxed transposition solution, we discover the connection between the superdifferentials and subdifferentials of value function and the first order and second order adjoint equations.


Codimension 2 embeddings and finite localization of spaces. In order to classify concordance classes of codimension 2 embeddings in a manifold M, we need to determine the complement of such an embedding. These complements are spaces over M well defined up to some homology equivalence. We construct a localization functor corresponding to this class of homology equivalences and we give a characterization of local objects in terms of homotopy groups.


Freeness of Sch "utzenberger groups of primitive substitutions. Our main goal is to study the freeness of Sch "utzenberger groups defined by primitive substitutions. Our findings include a simple freeness test for these groups, which is applied to exhibit a primitive invertible substitution with corresponding non free Sch "utzenberger group. This constitutes a counterexample to a result of Almeida dating back to 2005. We also give some early results concerning relative freeness of Sch "utzenberger groups, a question which remains largely unexplored.


Eigenvalues of stochastic Hamiltonian systems with boundary conditions and its application. In this paper we solve the eigenvalue problem of stochastic Hamiltonian system with boundary conditions. Firstly, we extend the results in S. Peng cite peng from time invariant case to time dependent case, proving the existence of a series of eigenvalues lambda m and construct corresponding eigenfunctions. Moreover, the order of growth for these lambda m are obtained lambda m sim m 2 , as m rightarrow infty . As applications, we give an explicit estimation formula about the statistic period of solutions of Forward Backward SDEs. Besides, by a meticulous example we show the subtle situation in time dependent case that some eigenvalues appear when the solution of the associated Riccati equation does not blow up, which does not happen in time invariant case.


Smoothed Multi View Subspace Clustering. In recent years, multi view subspace clustering has achieved impressive performance due to the exploitation of complementary imformation across multiple views. However, multi view data can be very complicated and are not easy to cluster in real world applications. Most existing methods operate on raw data and may not obtain the optimal solution. In this work, we propose a novel multi view clustering method named smoothed multi view subspace clustering (SMVSC) by employing a novel technique, i.e., graph filtering, to obtain a smooth representation for each view, in which similar data points have similar feature values. Specifically, it retains the graph geometric features through applying a low pass filter. Consequently, it produces a clustering friendly" representation and greatly facilitates the downstream clustering task. Extensive experiments on benchmark datasets validate the superiority of our approach. Analysis shows that graph filtering increases the separability of classes.


Insights into Data through Model Behaviour An Explainability driven Strategy for Data Auditing for Responsible Computer Vision Applications. In this study, we take a departure and explore an explainability driven strategy to data auditing, where actionable insights into the data at hand are discovered through the eyes of quantitative explainability on the behaviour of a dummy model prototype when exposed to data. We demonstrate this strategy by auditing two popular medical benchmark datasets, and discover hidden data quality issues that lead deep learning models to make predictions for the wrong reasons. The actionable insights gained from this explainability driven data auditing strategy is then leveraged to address the discovered issues to enable the creation of high performing deep learning models with appropriate prediction behaviour. The hope is that such an explainability driven strategy can be complimentary to data driven strategies to facilitate for more responsible development of machine learning algorithms for computer vision applications.


Variable order fractional calculus a change of perspective. Several approaches to the formulation of a fractional theory of calculus of "variable order" have appeared in the literature over the years. Unfortunately, most of these proposals lack a rigorous mathematical framework. We consider an alternative view on the problem, originally proposed by G. Scarpi in the early seventies, based on a naive modification of the representation in the Laplace domain of standard kernels functions involved in (constant order) fractional calculus. We frame Scarpi's ideas within recent theory of General Fractional Derivatives and Integrals, that mostly rely on the Sonine condition, and investigate the main properties of the emerging variable order operators. Then, taking advantage of powerful and easy to use numerical methods for the inversion of Laplace transforms of functions defined in the Laplace domain, we discuss some practical applications of the variable order Scarpi integral and derivative.


Touchless Palmprint Recognition based on 3D Gabor Template and Block Feature Refinement. With the growing demand for hand hygiene and convenience of use, palmprint recognition with touchless manner made a great development recently, providing an effective solution for person identification. Despite many efforts that have been devoted to this area, it is still uncertain about the discriminative ability of the contactless palmprint, especially for large scale datasets. To tackle the problem, in this paper, we build a large scale touchless palmprint dataset containing 2334 palms from 1167 individuals. To our best knowledge, it is the largest contactless palmprint image benchmark ever collected with regard to the number of individuals and palms. Besides, we propose a novel deep learning framework for touchless palmprint recognition named 3DCPN (3D Convolution Palmprint recognition Network) which leverages 3D convolution to dynamically integrate multiple Gabor features. In 3DCPN, a novel variant of Gabor filter is embedded into the first layer for enhancement of curve feature extraction. With a well designed ensemble scheme,low level 3D features are then convolved to extract high level features. Finally on the top, we set a region based loss function to strengthen the discriminative ability of both global and local descriptors. To demonstrate the superiority of our method, extensive experiments are conducted on our dataset and other popular databases TongJi and IITD, where the results show the proposed 3DCPN achieves state of the art or comparable performances.


Learning Knowledge Graph based World Models of Textual Environments. World models improve a learning agent's ability to efficiently operate in interactive and situated environments. This work focuses on the task of building world models of text based game environments. Text based games, or interactive narratives, are reinforcement learning environments in which agents perceive and interact with the world using textual natural language. These environments contain long, multi step puzzles or quests woven through a world that is filled with hundreds of characters, locations, and objects. Our world model learns to simultaneously (1) predict changes in the world caused by an agent's actions when representing the world as a knowledge graph and (2) generate the set of contextually relevant natural language actions required to operate in the world. We frame this task as a Set of Sequences generation problem by exploiting the inherent structure of knowledge graphs and actions and introduce both a transformer based multi task architecture and a loss function to train it. A zero shot ablation study on never before seen textual worlds shows that our methodology significantly outperforms existing textual world modeling techniques as well as the importance of each of our contributions.


Towards Self Supervision for Video Identification of Individual Holstein Friesian Cattle The Cows2021 Dataset. In this paper we publish the largest identity annotated Holstein Friesian cattle dataset Cows2021 and a first self supervision framework for video identification of individual animals. The dataset contains 10,402 RGB images with labels for localisation and identity as well as 301 videos from the same herd. The data shows top down in barn imagery, which captures the breed's individually distinctive black and white coat pattern. Motivated by the labelling burden involved in constructing visual cattle identification systems, we propose exploiting the temporal coat pattern appearance across videos as a self supervision signal for animal identity learning. Using an individual agnostic cattle detector that yields oriented bounding boxes, rotation normalised tracklets of individuals are formed via tracking by detection and enriched via augmentations. This produces a positive' sample set per tracklet, which is paired against a negative' set sampled from random cattle of other videos. Frame triplet contrastive learning is then employed to construct a metric latent space. The fitting of a Gaussian Mixture Model to this space yields a cattle identity classifier. Results show an accuracy of Top 1 57.0 and Top 4 76.9 and an Adjusted Rand Index 0.53 compared to the ground truth. Whilst supervised training surpasses this benchmark by a large margin, we conclude that self supervision can nevertheless play a highly effective role in speeding up labelling efforts when initially constructing supervision information. We provide all data and full source code alongside an analysis and evaluation of the system.


Effect of block medium parameters on energy dissipation. This paper describes energy distribution in a block medium simulated by a one dimensional chain of masses joined by springs and dampers. Equations describing the motion of masses are solved by the methods of the theory of ordinary differential equations. The effect of the block medium parameters on energy dissipation is investigated. An approximate analytical solution is obtained that describes the total energy of a block medium at large values of time.


A massively parallel Eulerian Lagrangian method for advection dominated transport in viscous fluids. Motivated by challenges in Earth mantle convection, we present a massively parallel implementation of an Eulerian Lagrangian method for the advection diffusion equation in the advection dominated regime. The advection term is treated by a particle based, characteristics method coupled to a block structured finite element framework. Its numerical and computational performance is evaluated in multiple, two and three dimensional benchmarks, including curved geometries, discontinuous solutions, pure advection, and it is applied to a coupled non linear system modeling buoyancy driven convection in Stokes flow. We demonstrate the parallel performance in a strong and weak scaling experiment, with scalability to up to 147,456 parallel processes, solving for more than 5.2 times 10 10 (52 billion) degrees of freedom per time step.


Whispering gallery modes promote enhanced optical backflow in a perforated dielectric microsphere. Optical energy flow inside a dielectric microsphere is usually codirected with the optical wavevector. At the same time, if the optical field in a microsphere is in resonance with one of the high quality spatial eigenmodes (whispering gallery modes WGMs), a region of reverse energy flow emerges in the shadow hemisphere. This area is of considerable practical interest due to increased optical trapping potential. In this Letter, we consider a perforated microsphere with an air filled single pinhole fabricated along the particle diameter and numerically analyze the peculiarities of WGM excitation in a nanostructured microsphere. A pinhole isolates the energy backflow region of a resonant mode and changes a perforated microsphere into an efficient optical tweezer. For the first time to our knowledge, we reveal the multiple enhancement of backflow intensity in the pinhole at a WGM resonance and discuss the way for its manipulation.


A new version of Toom's proof. There are several proofs now for the stability of Toom's example of a two dimensional stable cellular automaton and its application to fault tolerant computation. Simon and Berman simplified and strengthened Toom's original proof the present report is a simplified exposition of their proof.


Electromagnetic formulations for GTC simulation. A set of electromagnetic formulations with gyrokinetic ions and drift kinetic electrons for global gyrokinetic simulations is presented. Low freuqncy electromagnetic modes like drift waves, AEs and MHD modes can be simulated using this framework. In the long wavelength and low frequency limit, ideal MHD equations and dispersion relation are found. Especially, the magnetic compressional term and the equilibrium current are carefully kept in this model. This model is successfully used to simulate the internal kink modes in DIII D tokamaks.


Detecting Extraneous Content in Podcasts. Podcast episodes often contain material extraneous to the main content, such as advertisements, interleaved within the audio and the written descriptions. We present classifiers that leverage both textual and listening patterns in order to detect such content in podcast descriptions and audio transcripts. We demonstrate that our models are effective by evaluating them on the downstream task of podcast summarization and show that we can substantively improve ROUGE scores and reduce the extraneous content generated in the summaries.


Language Models for Lexical Inference in Context. Lexical inference in context (LIiC) is the task of recognizing textual entailment between two very similar sentences, i.e., sentences that only differ in one expression. It can therefore be seen as a variant of the natural language inference task that is focused on lexical semantics. We formulate and evaluate the first approaches based on pretrained language models (LMs) for this task (i) a few shot NLI classifier, (ii) a relation induction approach based on handcrafted patterns expressing the semantics of lexical inference, and (iii) a variant of (ii) with patterns that were automatically extracted from a corpus. All our approaches outperform the previous state of the art, showing the potential of pretrained LMs for LIiC. In an extensive analysis, we investigate factors of success and failure of our three approaches.


Homotopical presentations of braid groups via reduced lifts. In 1997, Deligne showed that the reduced lift presentation of a finite type generalized braid group remains correct if it is (suitably) interpreted as a presentation of a topological monoid. In this expository paper, we point out that Deligne's argument does not require the 'finite type' hypothesis, so it gives a different proof of a theorem proved by Dobrinskaya in 2006. We also review how to use this result to construct an action of the braid group on the finite or affine Hecke infty category via intertwining functors.


Guiding Topic Flows in the Generative Chatbot by Enhancing the ConceptNet with the Conversation Corpora. Human conversations consist of reasonable and natural topic flows, which are observed as the shifts of the mentioned concepts across utterances. Previous chatbots that incorporate the external commonsense knowledge graph prove that modeling the concept shifts can effectively alleviate the dull and uninformative response dilemma. However, there still exists a gap between the concept relations in the natural conversation and those in the external commonsense knowledge graph, which is an issue to solve. Specifically, the concept relations in the external commonsense knowledge graph are not intuitively built from the conversational scenario but the world knowledge, which makes them insufficient for the chatbot construction. To bridge the above gap, we propose the method to supply more concept relations extracted from the conversational corpora and reconstruct an enhanced concept graph for the chatbot construction. In addition, we present a novel, powerful, and fast graph encoding architecture named the Edge Transformer to replace the traditional GNN architecture. Experimental results on the Reddit conversation dataset indicate our proposed method significantly outperforms strong baseline systems and achieves new SOTA results. Further analysis individually proves the effectiveness of the enhanced concept graph and the Edge Transformer architecture.


Learning to Transfer for Traffic Forecasting via Multi task Learning. Deep neural networks have demonstrated superior performance in short term traffic forecasting. However, most existing traffic forecasting systems assume that the training and testing data are drawn from the same underlying distribution, which limits their practical applicability. The NeurIPS 2021 Traffic4cast challenge is the first of its kind dedicated to benchmarking the robustness of traffic forecasting models towards domain shifts in space and time. This technical report describes our solution to this challenge. In particular, we present a multi task learning framework for temporal and spatio temporal domain adaptation of traffic forecasting models. Experimental results demonstrate that our multi task learning approach achieves strong empirical performance, outperforming a number of baseline domain adaptation methods, while remaining highly efficient. The source code for this technical report is available at https github.com YichaoLu Traffic4cast2021.


Joint Identification through Hybrid Models Improved by Correlations. In mechanical systems coupled with joints, accurate prediction of the joint characteristics is extremely important. Despite years of research, a lot is yet to be learnt about the joints' interface dynamics. The problem becomes even more difficult when the interface Degrees of Freedom (DoF) are inaccessible for Frequency Response Function (FRF) measurements. This is, for example, the case of bladed disk systems with dove tail or fir tree type joints. Therefore, an FRF based expansion method called System Equivalent Model Mixing (SEMM) is used to obtain expanded interface dynamics. The method uses numerical and experimental sub models of each component and their assembly to produce the respective expanded or hybrid sub models. By applying substructure decoupling to these sub models, the joint can be identified. However, the joint can be noisy due to expansion and measurement errors which propagate to the hybrid sub models. In this paper, a correlation based approach is proposed in the SEMM method wherein the quality of the expanded sub models is improved. In this new approach, several expanded models are generated systematically using different combinations of the experimental FRFs and computing a parameter, Frequency Response Assurance Criteria (FRAC), to evaluate quality of the contribution of the different measurements. The lowest correlated channels or FRFs can be filtered out based on a certain threshold value of FRAC. Using the improved hybrid sub models, the joint identification also shows a remarkable improvement. The test object for the method is an assembly of disk and one blade with a dove tail joint.


Isotropic random spin weighted functions on S 2 vs isotropic random fields on S 3 . We show that an isotropic random field on SU(2) is not necessarily isotropic as a random field on S 3 , although the two spaces can be identified. The ambiguity is due to the fact that the notion of isotropy on a group and on a sphere are different, the latter being much stronger. We show that any isotropic random field on S 3 is necessarily a superposition of uncorrelated random harmonic homogeneous polynomials, such that the one of degree d is necessarily a superposition of uncorrelated random spin weighted functions of every possible spin weight in the range frac d 2 , dots, frac d 2 , each of which is isotropic in the sense of SU(2) . Moreover, for a random field of fixed degree, each spin weight appears with the same magnitude, in a sense to be specified. In addition we will give an overview of the theory of spin weighted functions and Wigner D matrices, with the purpose of gathering together many different points of view and adding ours. As a byproduct of this survey we will prove some new properties of the Wigner matrices and a formula relating the operators eth overline eth and the horizontal Laplacian of the Hopf fibration S 3 to S 2 .


A Review of Location Encoding for GeoAI Methods and Applications. A common need for artificial intelligence models in the broader geoscience is to represent and encode various types of spatial data, such as points (e.g., points of interest), polylines (e.g., trajectories), polygons (e.g., administrative regions), graphs (e.g., transportation networks), or rasters (e.g., remote sensing images), in a hidden embedding space so that they can be readily incorporated into deep learning models. One fundamental step is to encode a single point location into an embedding space, such that this embedding is learning friendly for downstream machine learning models such as support vector machines and neural networks. We call this process location encoding. However, there lacks a systematic review on the concept of location encoding, its potential applications, and key challenges that need to be addressed. This paper aims to fill this gap. We first provide a formal definition of location encoding, and discuss the necessity of location encoding for GeoAI research from a machine learning perspective. Next, we provide a comprehensive survey and discussion about the current landscape of location encoding research. We classify location encoding models into different categories based on their inputs and encoding methods, and compare them based on whether they are parametric, multi scale, distance preserving, and direction aware. We demonstrate that existing location encoding models can be unified under a shared formulation framework. We also discuss the application of location encoding for different types of spatial data. Finally, we point out several challenges in location encoding research that need to be solved in the future.


On Queries Determined by a Constant Number of Homomorphism Counts. It is well known Lov ' a sz, 1967 that up to isomorphism a graph G is determined by the homomorphism counts hom(F, G) , i.e., the number of homomorphisms from F to G , where F ranges over all graphs. Moreover, it suffices that F ranges over the graphs with at most as many vertices as G . Thus in principle we can answer any query concerning G with only accessing the hom( cdot,G) 's instead of G itself. In this paper, we zoom in on those queries that can be answered using a constant number of hom( cdot,G) for every graph G . We observe that if a query varphi is expressible as a Boolean combination of universal sentences in first order logic, then whether a graph G satisfies varphi can be determined by the vector overrightarrow mathrm hom F 1, ldots, F k (G) big( mathrm hom (F 1, G), ldots, mathrm hom (F k, G) big), where the graphs F 1, ldots,F k only depend on varphi . This leads to a query algorithm for varphi that is non adaptive in the sense that those F i are independent of the input G . On the other hand, we prove that the existence of an isolated vertex, which is not definable by such a varphi but in first order logic, cannot be determined by any overrightarrow mathrm hom F 1, ldots, F k ( cdot) . These results provide a clear delineation of the power of non adaptive query algorithms with access to a constant number of hom( cdot, G) 's. For adaptive query algorithms, i.e., algorithms that might access some hom(F i 1 , G) with F i 1 depending on hom(F 1, G), ldots, hom(F i, G) , we show that three homomorphism counts hom( cdot,G) are both sufficient and in general necessary to determine the graph G . In particular, by three adaptive queries we can answer any question on G . Moreover, adaptively accessing two hom( cdot, G) 's is already enough to detect an isolated vertex.


Extreme Rotation Estimation using Dense Correlation Volumes. We present a technique for estimating the relative 3D rotation of an RGB image pair in an extreme setting, where the images have little or no overlap. We observe that, even when images do not overlap, there may be rich hidden cues as to their geometric relationship, such as light source directions, vanishing points, and symmetries present in the scene. We propose a network design that can automatically learn such implicit cues by comparing all pairs of points between the two input images. Our method therefore constructs dense feature correlation volumes and processes these to predict relative 3D rotations. Our predictions are formed over a fine grained discretization of rotations, bypassing difficulties associated with regressing 3D rotations. We demonstrate our approach on a large variety of extreme RGB image pairs, including indoor and outdoor images captured under different lighting conditions and geographic locations. Our evaluation shows that our model can successfully estimate relative rotations among non overlapping images without compromising performance over overlapping image pairs.


Bridging the gap between learning and heuristic based pushing policies. Non prehensile pushing actions have the potential to singulate a target object from its surrounding clutter in order to facilitate the robotic grasping of the target. To address this problem we utilize a heuristic rule that moves the target object towards the workspace's empty space and demonstrate that this simple heuristic rule achieves singulation. Furthermore, we incorporate this heuristic rule to the reward in order to train more efficiently reinforcement learning (RL) agents for singulation. Simulation experiments demonstrate that this insight increases performance. Finally, our results show that the RL based policy implicitly learns something similar to one of the used heuristics in terms of decision making.


Optimizing the Rydberg EIT spectrum in a thermal vapor. We present Rydberg state electromagnetically induced transparency (EIT) measurements examining the effects of laser polarization, magnetic fields, laser intensities, and the optical density of the thermal 87 Rb medium. Two counter propagating laser beams with wavelengths of 480 nm and 780 nm were employed to sweep the spectrum across the Rydberg states 33D 3 2 rangle and 33D 5 2 rangle . An analytic transmission expression well fits the Rydberg EIT spectra with multiple transitions under different magnetic fields and laser polarization after accounting for the relevant Clebsch Gordan coefficients, Zeeman splittings, and Doppler shifts. In addition, the high contrast Rydberg EIT can be optimized with the probe laser intensity and optical density. Rydberg EIT peak height was achieved at 13 , which is more than twice as high as the maximum peak height at room temperature. A quantitative theoretical model is employed to represent the spectra properties and to predict well the optimization conditions. A Rydberg EIT spectrum with high contrast in real time can be served as a quantum sensor to detect the electromagnetic field within an environment.


GPU backed Data Mining on Android Devices. Choosing an appropriate programming paradigm for high performance computing on low power devices can be useful to speed up calculations. Many Android devices have an integrated GPU and although not officially supported the OpenCL framework can be used on Android devices for addressing these GPUs. OpenCL supports thread and data parallelism. Applications that use the GPU must account for the fact that they can be suspended by the user or the Android operating system at any moment. We have created a wrapper library that allows to use OpenCL on Android devices. Already written OpenCL programs can be executed with almost no modification. We have used this library to compare the performance of the DBSCAN and Kmeans algorithms on an integrated GPU of an Arm v7 tablet with other single and multithreaded implementations on the same device. We have investigated which programming paradigm and language allows the best tradeoff between execution speed and energy consumption. Using the GPU for HPC on Android devices can help to carry out computationally intensive machine learning or data mining tasks in remote areas, under harsh environmental conditions and in areas where energy supply is an issue.


Unsupervised Motion Representation Learning with Capsule Autoencoders. We propose the Motion Capsule Autoencoder (MCAE), which addresses a key challenge in the unsupervised learning of motion representations transformation invariance. MCAE models motion in a two level hierarchy. In the lower level, a spatio temporal motion signal is divided into short, local, and semantic agnostic snippets. In the higher level, the snippets are aggregated to form full length semantic aware segments. For both levels, we represent motion with a set of learned transformation invariant templates and the corresponding geometric transformations by using capsule autoencoders of a novel design. This leads to a robust and efficient encoding of viewpoint changes. MCAE is evaluated on a novel Trajectory20 motion dataset and various real world skeleton based human action datasets. Notably, it achieves better results than baselines on Trajectory20 with considerably fewer parameters and state of the art performance on the unsupervised skeleton based action recognition task.