Sensitive detection of metastable NO and ce N2 by reactive collisions with laser excited Li. In a proof of principle experiment, we demonstrate that metastable nitric oxide molecules, NO(a 4 Pi i ), generated inside a pulsed, supersonic beam, can be detected by reactive gas phase collisions with electronically excited Li atoms in the 2 2 P 3 2 state. Since the internal energy of NO(a 4 Pi i , v leq 4 ) is lower than the ionization potential of Li in the 2 2 S 1 2 electronic ground state, we observe that the product ion yield arising from autoionizing NO(a 4 Pi i ) Li( 2 2 S 1 2 ) collisions is a factor of 21 lower than the ion yield from NO(a 4 Pi i ) Li( 2 2 P 3 2 ) collisions. We also compare our findings with measurements of relative rates for collisions of metastable ce N2 Li( 2 2 S 1 2 ) and metastable ce N2 Li( 2 2 P 3 2 ) reactive collisions. Using this detection method, we infer densities of approx 600 NO(a 4 Pi i ) molecules cm 3 and approx 6 cdot 10 4 metastable ce N2 molecules cm 3 in the interaction region. Our results also allow for an estimate of the fractional population of NO(a 4 Pi i , v geq 5 ) prior to the collision process. The production of NO(a 4 Pi i ) in selected vibrational states using laser excitation from the X 2 Pi r ground state will open possibilities for the detailed study of vibrational state selected NO(a 4 Pi i ) Li( 2 2 P 3 2 ) collisions.


Machine learning moment closure models for the radiative transfer equation I directly learning a gradient based closure. In this paper, we take a data driven approach and apply machine learning to the moment closure problem for radiative transfer equation in slab geometry. Instead of learning the unclosed high order moment, we propose to directly learn the gradient of the high order moment using neural networks. This new approach is consistent with the exact closure we derive for the free streaming limit and also provides a natural output normalization. A variety of benchmark tests, including the variable scattering problem, the Gaussian source problem with both periodic and reflecting boundaries, and the two material problem, show both good accuracy and generalizability of our machine learning closure model.


Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy Iterative Design and Evaluation with Therapists and Post Stroke Survivors. Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction. While previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, the deployment of these systems remains a challenge. Previous work described the lack of involving stakeholders to design such functionalities as one of the major causes. In this paper, we present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient's exercises in an effective and acceptable way with four therapists and five post stroke survivors. Through iterative questionnaires and interviews, we found that both post stroke survivors and therapists appreciated the potential benefits of AI and robotic coaches to achieve more systematic management and improve their self efficacy and motivation on rehabilitation therapy. In addition, our evaluation sheds light on several practical concerns (e.g. a possible difficulty with the interaction for people with cognitive impairment, system failures, etc.). We discuss the value of early involvement of stakeholders and interactive techniques that complement system failures, but also support a personalized therapy session for the better deployment of AI and robotic exercise coaches.


Characterizing soot in TEM images using a convolutional neural network. Soot is an important material with impacts that depend on particle morphology. Transmission electron microscopy (TEM) represents one of the most direct routes to qualitatively assess particle characteristics. However, producing quantitative information requires robust image processing tools, which is complicated by the low image contrast and complex aggregated morphologies characteristic of soot. The current work presents a new convolutional neural network explicitly trained to characterize soot, using pre classified images of particles from a natural gas engine a laboratory gas flare and a marine engine. The results are compared against other existing classifiers before considering the effect that the classifiers have on automated primary particle size methods. Estimates of the overall uncertainties between fully automated approaches of aggregate characterization range from 25 in d p,100 to 85 in D TEM . A consistent correlation is observed between projected area equivalent diameter and primary particle size across all of the techniques.


The structure of a perturbed magnetic reconnection electron diffusion region. We report in situ observations of an electron diffusion region (EDR) and adjacent separatrix region. We observe significant magnetic field oscillations near the lower hybrid frequency which propagate perpendicularly to the reconnection plane. We also find that the strong electron scale gradients close to the EDR exhibit significant oscillations at a similar frequency. Such oscillations are not expected for a crossing of a steady 2D EDR, and can be explained by a complex motion of the reconnection plane induced by current sheet kinking propagating in the out of reconnection plane direction. Thus all three spatial dimensions have to be taken into account to explain the observed perturbed EDR crossing.


Length functions on groups and rigidity. Let G be a group. A function l G rightarrow lbrack 0, infty ) is called a length function if (1) l(g n ) n l(g) for any g in G and n in mathbb Z (2) l(hgh 1 ) l(g) for any h,g in G and (3) l(ab) leq l(a) l(b) for commuting elements a,b. Such length functions exist in many branches of mathematics, mainly as stable word lengths, stable norms, smooth measure theoretic entropy, translation lengths on mathrm CAT (0) spaces and Gromov delta hyperbolic spaces, stable norms of quasi cocycles, rotation numbers of circle homeomorphisms, dynamical degrees of birational maps and so on. We study length functions on Lie groups, Gromov hyperbolic groups, arithmetic subgroups, matrix groups over rings and Cremona groups. As applications, we prove that every group homomorphism from an arithmetic subgroup of a simple algebraic mathbb Q group of mathbb Q rank at least 2, or a finite index subgroup of the elementary group E n (R) (n geq 3) over an associative ring, or the Cremona group mathrm Bir (P mathbb C 2 ) to any group G having a purely positive length function must have its image finite. Here G can be outer automorphism group mathrm Out (F n ) of free groups, mapping classes group mathrm MCG ( Sigma g ) , mathrm CAT (0) groups or Gromov hyperbolic groups, or the group mathrm Diff ( Sigma , omega ) of diffeomorphisms of a hyperbolic closed surface preserving an area form omega .


On fine Selmer groups and signed Selmer groups of elliptic modular forms. Let f be an elliptic modular form and p an odd prime that is coprime to the level of f . We study the link between divisors of the characteristic ideal of the p primary fine Selmer group of f over the cyclotomic mathbb Z p extension of mathbb Q and the greatest common divisor of signed Selmer groups attached to f defined using the theory of Wach modules. One of the key ingredients of our proof is a generalization of a result of Wingberg on the structure of fine Selmer groups of abelian varieties with supersingular reduction at p to the context of modular forms.


Fusing RGBD Tracking and Segmentation Tree Sampling for Multi Hypothesis Volumetric Segmentation. Despite rapid progress in scene segmentation in recent years, 3D segmentation methods are still limited when there is severe occlusion. The key challenge is estimating the segment boundaries of (partially) occluded objects, which are inherently ambiguous when considering only a single frame. In this work, we propose Multihypothesis Segmentation Tracking (MST), a novel method for volumetric segmentation in changing scenes, which allows scene ambiguity to be tracked and our estimates to be adjusted over time as we interact with the scene. Two main innovations allow us to tackle this difficult problem 1) A novel way to sample possible segmentations from a segmentation tree and 2) A novel approach to fusing tracking results with multiple segmentation estimates. These methods allow MST to track the segmentation state over time and incorporate new information, such as new objects being revealed. We evaluate our method on several cluttered tabletop environments in simulation and reality. Our results show that MST outperforms baselines in all tested scenes.


PVTSI boldmath(m) A Novel Approach to Computation of Hadamard Finite Parts of Nonperiodic Singular Integrals. We consider the numerical computation of I f intBar b a f(x) ,dx , the Hadamard Finite Part of the finite range singular integral int b a f(x) ,dx , f(x) g(x) (x t) m with a t b and m in 1,2, ldots , assuming that (i) , g in C infty(a,b) and (ii) , g(x) is allowed to have arbitrary integrable singularities at the endpoints x a and x b . We first prove that intBar b a f(x) ,dx is invariant under any suitable variable transformation x psi( xi) , psi alpha, beta rightarrow a,b , hence there holds intBar beta alpha F( xi) ,d xi intBar b a f(x) ,dx , where F( xi) f( psi( xi)) , psi'( xi) . Based on this result, we next choose psi( xi) such that the transformed integrand F( xi) is sufficiently periodic with period T beta alpha , and prove, with the help of some recent extension generalization of the Euler Maclaurin expansion, that we can apply to intBar beta alpha F( xi) ,d xi the quadrature formulas derived for periodic singular integrals developed in an earlier work of the author. We give a whole family of numerical quadrature formulas for intBar beta alpha F( xi) ,d xi for each m , which we denote widehat T (s) m,n cal F , where cal F ( xi) is the T periodic extension of F( xi) .


Carton dataset synthesis method for domain shift based on foreground texture decoupling and replacement. One major impediment in rapidly deploying object detection models for industrial applications is the lack of large annotated datasets. We currently have presented the Sacked Carton Dataset(SCD) that contains carton images from three scenarios, such as comprehensive pharmaceutical logistics company(CPLC), e commerce logistics company(ECLC), fruit market(FM). However, due to domain shift, the model trained with one of the three scenarios in SCD has poor generalization ability when applied to the rest scenarios. To solve this problem, a novel image synthesis method is proposed to replace the foreground texture of the source datasets with the texture of the target datasets. Our method can keep the context relationship of foreground objects and backgrounds unchanged and greatly augment the target datasets. We firstly propose a surface segmentation algorithm to achieve texture decoupling of each instance. Secondly, a contour reconstruction algorithm is proposed to keep the occlusion and truncation relationship of the instance unchanged. Finally, the Gaussian fusion algorithm is used to replace the foreground texture from the source datasets with the texture from the target datasets. The novel image synthesis method can largely boost AP by at least 4.3 6.5 on RetinaNet and 3.4 6.8 on Faster R CNN for the target domain. Code is available at https github.com hustgetlijun RCAN.


Vacuum Static Spaces with Harmonic Curvature. In this paper, we classify n dimensional ( n geq 5 ) vacuum static spaces with harmonic curvature, thus extending the 4 dimensional work by Kim Shin cite KS . As a consequence, we provide new counterexamples to the Fischer Marsden conjecture on compact vacuum static spaces.


Edge service resource allocation strategy based on intelligent prediction. Artificial intelligence is one of the important technologies for industrial applications, but it requires a lot of computing resources and sensor data to support it. With the development of edge computing and the Internet of Things, artificial intelligence are playing an increasingly important role in the field of edge services. Therefore, how to make intelligent algorithms provide better services and the development of the Internet of Things has become an increasingly important topic. This paper focuses on the application of edge service distribution strategy, and proposes an edge service distribution strategy based on intelligent prediction, which reduces the bandwidth consumption of edge service providers and minimizes the cost of edge service providers. In addition, this article uses the real data provided by the Wangsu Technology Company and an improved long and short term memory prediction method to dynamically change the bandwidth, and achieves better optimization of resources allocation comparing with actual industrial applications.The simulation results show that our intelligent prediction can achieve good results, and the mechanism can achieve higher resource utilization.


Primary decomposition of modules a computational differential approach. We study primary submodules and primary decompositions from a differential and computational point of view. Our main theoretical contribution is a general structure theory and a representation theorem for primary submodules of an arbitrary finitely generated module over a polynomial ring. We characterize primary submodules in terms of differential operators and punctual Quot schemes. Moreover, we introduce and implement an algorithm that computes a minimal differential primary decomposition for a module.


Chow rings of stacks of prestable curves II. We continue the study of the Chow ring of the moduli stack mathfrak M g,n of prestable curves begun in arXiv 2012.09887v2 . In genus 0 , we show that the Chow ring of mathfrak M 0,n coincides with the tautological ring and give a complete description in terms of (additive) generators and relations. This generalizes earlier results by Keel and Kontsevich Manin for the spaces of stable curves. Our argument uses the boundary stratification of the moduli stack together with the study of the first higher Chow groups of the strata, in particular providing a new proof of the results of Kontsevich and Manin.


Virtual Augmentation Supported Contrastive Learning of Sentence Representations. Despite profound successes, contrastive representation learning relies on carefully designed data augmentations using domain specific knowledge. This challenge is magnified in natural language processing where no general rules exist for data augmentation due to the discrete nature of natural language. We tackle this challenge by presenting a Virtual augmentation Supported Contrastive Learning of sentence representations (VaSCL). Originating from the interpretation that data augmentation essentially constructs the neighborhoods of each training instance, we in turn utilize the neighborhood to generate effective data augmentations. Leveraging the large training batch size of contrastive learning, we approximate the neighborhood of an instance via its K nearest in batch neighbors in the representation space. We then define an instance discrimination task regarding this neighborhood and generate the virtual augmentation in an adversarial training manner. We access the performance of VaSCL on a wide range of downstream tasks, and set a new state of the art for unsupervised sentence representation learning.


Intelligence and Unambitiousness Using Algorithmic Information Theory. Algorithmic Information Theory has inspired intractable constructions of general intelligence (AGI), and undiscovered tractable approximations are likely feasible. Reinforcement Learning (RL), the dominant paradigm by which an agent might learn to solve arbitrary solvable problems, gives an agent a dangerous incentive to gain arbitrary "power" in order to intervene in the provision of their own reward. We review the arguments that generally intelligent algorithmic information theoretic reinforcement learners such as Hutter's (2005) AIXI would seek arbitrary power, including over us. Then, using an information theoretic exploration schedule, and a setup inspired by causal influence theory, we present a variant of AIXI which learns to not seek arbitrary power we call it "unambitious". We show that our agent learns to accrue reward at least as well as a human mentor, while relying on that mentor with diminishing probability. And given a formal assumption that we probe empirically, we show that eventually, the agent's world model incorporates the following true fact intervening in the "outside world" will have no effect on reward acquisition hence, it has no incentive to shape the outside world.


The porous medium equation as a singular limit of the thin film Muskat problem. The singular limit of the thin film Muskat problem is performed when the density (and possibly the viscosity) of the lighter fluid vanishes and the porous medium equation is identified as the limit problem. In particular, the height of the denser fluid is shown to converge towards the solution to the porous medium equation and an explicit rate for this convergence is provided in space dimension d le 4. Moreover, the limit of the height of the lighter fluid is determined in a certain regime and is given by the corresponding initial condition.


Model Free Learning of Safe yet Effective Controllers. We study the problem of learning safe control policies that are also effective i.e., maximizing the probability of satisfying a linear temporal logic (LTL) specification of a task, and the discounted reward capturing the (classic) control performance. We consider unknown environments modeled as Markov decision processes. We propose a model free reinforcement learning algorithm that learns a policy that first maximizes the probability of ensuring safety, then the probability of satisfying the given LTL specification and lastly, the sum of discounted Quality of Control rewards. Finally, we illustrate applicability of our RL based approach.


Blow up of solutions to semilinear wave equations with a time dependent strong damping. The paper investigates a class of a semilinear wave equation with time dependent damping term ( frac 1 (1 t) beta Delta u t ) and a nonlinearity u p . We will show the influence of the the parameter beta in the blow up results under some hypothesis on the initial data and the exponent p by using the test function method. We also study the local existence in time of mild solution in the energy space H 1( mathbb R n) times L 2( mathbb R n) .


On multiple IoT data streams processing using LoRaWAN. LoraWAN has turned out to be one of the most successful frameworks in IoT devices. Real world scenarios demand the use of such networks along with a robust stream processing application layer. To maintain the exactly once processing semantics one must ensure that we have proper ways to proactively detect message drops and handle the same. An important use case where stream processing plays a crucial role is joining various data streams that are transmitted via gateways connected to edge devices which are related to each other as part of some common business requirement. LoraWAN supports connectivity to multiple gateways for edge devices and by virtue of its different device classes, the network can send and receive messages in an effective way that conserves battery power as well as network bandwidth. Rather than relying on explicit acknowledgements for the transmitted messages we take the advantage of these characteristics of the devices to detect , handle missing messages and finally process them.


A Lockable ERC20 Token for Peer to Peer Energy Trading. In this paper, we address the digitization of physical assets using blockchain technology focusing on energy and peer to peer trading on decentralized energy markets. Because they are forward markets and operate on a day ahead timeline, the energy transactions are settled only at the movement of energy delivery. Having the option of locking the energy tokens by a third party escrow becomes a highly desirable feature. Thus, we define a Lockable ERC20 token that provides the option for an owner to lock some of its tokens using smart contracts. A time lock and an escrow party account or smart contract can be specified allowing the tokens to be unlocked when certain business conditions are met. For validation purposes, we have considered a peer to peer energy trading scenario in which the Lockable ERC20 token was used to digitize the surplus of energy of prosumers. In this case, the energy tokens committed in blockchain transactions are successfully locked up until the actual delivery of energy, the settlement considering the monitored data of energy meters.


The homotopy automorphisms of a marked n stage. We show nilpotency and completeness results for the homotopy automorphisms of a marked n stage for an unstable coalgebra. These objects figure in the moduli problem of unstable coalgebras. Our theorems extend classical work of Dror, Zabrodsky, Maruyama and M o ller.


AI in (and for) Games. This chapter outlines the relation between artificial intelligence (AI) machine learning (ML) algorithms and digital games. This relation is two fold on one hand, AI ML researchers can generate large, in the wild datasets of human affective activity, player behaviour (i.e. actions within the game world), commercial behaviour, interaction with graphical user interface elements or messaging with other players, while games can utilise intelligent algorithms to automate testing of game levels, generate content, develop intelligent and responsive non player characters (NPCs) or predict and respond player behaviour across a wide variety of player cultures. In this work, we discuss some of the most common and widely accepted uses of AI ML in games and how intelligent systems can benefit from those, elaborating on estimating player experience based on expressivity and performance, and on generating proper and interesting content for a language learning game.


Return probabilities on nonunimodular transitive graphs. Consider simple random walk (S n) n geq0 on a transitive graph with spectral radius rho . Let u n mathbb P S n S 0 be the n step return probability. It is a folklore conjecture that on transient, transitive graphs u n rho n is at most of the order n 3 2 . We prove this conjecture for graphs with a closed, transitive, amenable and nonunimodular subgroup of automorphisms. We also study the first return probability f n . For a graph G with a closed, transitive, nonunimodular subgroup of automorphisms, we show that there is a positive constant c such that f n geq frac u n cn c . We also make some conjectures related to f n and u n for transient, transitive graphs.


MixACM Mixup Based Robustness Transfer via Distillation of Activated Channel Maps. Deep neural networks are susceptible to adversarially crafted, small and imperceptible changes in the natural inputs. The most effective defense mechanism against these examples is adversarial training which constructs adversarial examples during training by iterative maximization of loss. The model is then trained to minimize the loss on these constructed examples. This min max optimization requires more data, larger capacity models, and additional computing resources. It also degrades the standard generalization performance of a model. Can we achieve robustness more efficiently? In this work, we explore this question from the perspective of knowledge transfer. First, we theoretically show the transferability of robustness from an adversarially trained teacher model to a student model with the help of mixup augmentation. Second, we propose a novel robustness transfer method called Mixup Based Activated Channel Maps (MixACM) Transfer. MixACM transfers robustness from a robust teacher to a student by matching activated channel maps generated without expensive adversarial perturbations. Finally, extensive experiments on multiple datasets and different learning scenarios show our method can transfer robustness while also improving generalization on natural images.


Anchor DETR Query Design for Transformer Based Object Detection. In this paper, we propose a novel query design for the transformer based object detection. In previous transformer based detectors, the object queries are a set of learned embeddings. However, each learned embedding does not have an explicit physical meaning and we cannot explain where it will focus on. It is difficult to optimize as the prediction slot of each object query does not have a specific mode. In other words, each object query will not focus on a specific region. To solved these problems, in our query design, object queries are based on anchor points, which are widely used in CNN based detectors. So each object query focuses on the objects near the anchor point. Moreover, our query design can predict multiple objects at one position to solve the difficulty "one region, multiple objects". In addition, we design an attention variant, which can reduce the memory cost while achieving similar or better performance than the standard attention in DETR. Thanks to the query design and the attention variant, the proposed detector that we called Anchor DETR, can achieve better performance and run faster than the DETR with 10 times fewer training epochs. For example, it achieves 44.2 AP with 19 FPS on the MSCOCO dataset when using the ResNet50 DC5 feature for training 50 epochs. Extensive experiments on the MSCOCO benchmark prove the effectiveness of the proposed methods. Code is available at url https github.com megvii research AnchorDETR .


Positivity preserving methods for population models. Many important applications are modelled by differential equations with positive solutions. However, it remains an outstanding open problem to develop numerical methods that are both (i) of a high order of accuracy and (ii) capable of preserving positivity. It is known that the two main families of numerical methods, Runge Kutta methods and multistep methods, face an order barrier if they preserve positivity, then they are constrained to low accuracy they cannot be better than first order. We propose novel methods that overcome this barrier our methods are of second order, and they are guaranteed to preserve positivity. Our methods apply to a large class of differential equations that have a special graph Laplacian structure, which we elucidate. The equations need be neither linear nor autonomous and the graph Laplacian need not be symmetric. This algebraic structure arises naturally in many important applications where positivity is required. We showcase our new methods on applications where standard high order methods fail to preserve positivity, including infectious diseases, Markov processes, master equations and chemical reactions.


Automated Evolutionary Approach for the Design of Composite Machine Learning Pipelines. The effectiveness of the machine learning methods for real world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is equivalent to computation workflows that consist of models and data operations. The approach combines key ideas of both automated machine learning and workflow management systems. It designs the pipelines with a customizable graph based structure, analyzes the obtained results, and reproduces them. The evolutionary approach is used for the flexible identification of pipeline structure. The additional algorithms for sensitivity analysis, atomization, and hyperparameter tuning are implemented to improve the effectiveness of the approach. Also, the software implementation on this approach is presented as an open source framework. The set of experiments is conducted for the different datasets and tasks (classification, regression, time series forecasting). The obtained results confirm the correctness and effectiveness of the proposed approach in the comparison with the state of the art competitors and baseline solutions.


Modelling of Bi directional Spatio Temporal Dependence and Users' Dynamic Preferences for Missing POI Check in Identification. Human mobility data accumulated from Point of Interest (POI) check ins provides great opportunity for user behavior understanding. However, data quality issues (e.g., geolocation information missing, unreal check ins, data sparsity) in real life mobility data limit the effectiveness of existing POI oriented studies, e.g., POI recommendation and location prediction, when applied to real applications. To this end, in this paper, we develop a model, named Bi STDDP, which can integrate bi directional spatio temporal dependence and users' dynamic preferences, to identify the missing POI check in where a user has visited at a specific time. Specifically, we first utilize bi directional global spatial and local temporal information of POIs to capture the complex dependence relationships. Then, target temporal pattern in combination with user and POI information are fed into a multi layer network to capture users' dynamic preferences. Moreover, the dynamic preferences are transformed into the same space as the dependence relationships to form the final model. Finally, the proposed model is evaluated on three large scale real world datasets and the results demonstrate significant improvements of our model compared with state of the art methods. Also, it is worth noting that the proposed model can be naturally extended to address POI recommendation and location prediction tasks with competitive performances.


Multi agent system for target tracking on a sphere and its asymptotic behavior. We propose a second order multi agent system for target tracking on a sphere. The model contains a centripetal force, a bonding force, a velocity alignment operator to the target, and cooperative control between flocking agents. We propose an appropriate regularized rotation operator instead of Rodrigues' rotation operator to derive the velocity alignment operator for target tracking. By the regularized rotation operator, we can decompose the phase of agents into translational and structural parts. By analyzing the translational part of this reference frame decomposition, we can obtain rendezvous results to the given target. If the multi agent system can obtain the target's position, velocity, and acceleration vectors, then the complete rendezvous occurs. Even in the absence of the target's acceleration information, if the coefficients are sufficiently large enough, then the practical rendezvous occurs.


Learning Salient Boundary Feature for Anchor free Temporal Action Localization. Temporal action localization is an important yet challenging task in video understanding. Typically, such a task aims at inferring both the action category and localization of the start and end frame for each action instance in a long, untrimmed video.While most current models achieve good results by using pre defined anchors and numerous actionness, such methods could be bothered with both large number of outputs and heavy tuning of locations and sizes corresponding to different anchors. Instead, anchor free methods is lighter, getting rid of redundant hyper parameters, but gains few attention. In this paper, we propose the first purely anchor free temporal localization method, which is both efficient and effective. Our model includes (i) an end to end trainable basic predictor, (ii) a saliency based refinement module to gather more valuable boundary features for each proposal with a novel boundary pooling, and (iii) several consistency constraints to make sure our model can find the accurate boundary given arbitrary proposals. Extensive experiments show that our method beats all anchor based and actionness guided methods with a remarkable margin on THUMOS14, achieving state of the art results, and comparable ones on ActivityNet v1.3. Code is available at https github.com TencentYoutuResearch ActionDetection AFSD.


L convex polyominoes and 201 avoiding ascent sequences. For L convex polyominoes we give the asymptotics of the generating function coefficients, obtained by analysis of the coefficients derived from the functional equation given by Castiglione et al. cite CFMRR7 . For 201 avoiding ascent sequences, we conjecture the solution, obtained from the first 23 coefficients of the generating function. The solution is D finite, indeed algebraic. The conjectured solution then correctly generates all subsequent coefficients. We also obtain the asymptotics, both from direct analysis of the coefficients, and from the conjectured solution. As well as presenting these new results, our purpose is to illustrate the methods used, so that they may be more widely applied.


Computational Polarization An Information theoretic Method for Resilient Computing. We introduce an error resilient distributed computing method based on an extension of the channel polarization phenomenon to distributed algorithms. The method leverages an algorithmic split operation that transforms two identical compute nodes to slow and fast workers, which parallels the channel split operation in Polar Codes. This operation preserves the average runtime, analogous to the conservation of Shannon capacity in channel polarization. By leveraging a recursive construction in a similar spirit to the Fast Fourier Transform, this method synthesizes virtual compute nodes with dispersed return time distributions, which we call computational polarization. We show that the runtime distributions form a functional martingale processes, identify their limiting distributions in closed form expressions together with non asymptotic convergence rates, and prove strong convergence results in Banach spaces. We provide an information theoretic lower bound on the overall runtime of any coded computation method and show that the computational polarization approach asymptotically achieves the optimal runtime for computing linear functions. An important advantage is the near linear time decoding procedure, which is significantly cheaper than Maximum Distance Separable codes.


Risk Aware Fine Grained Access Control in Cyber Physical Contexts. Access to resources by users may need to be granted only upon certain conditions and contexts, perhaps particularly in cyber physical settings. Unfortunately, creating and modifying context sensitive access control solutions in dynamic environments creates ongoing challenges to manage the authorization contexts. This paper proposes RASA, a context sensitive access authorization approach and mechanism leveraging unsupervised machine learning to automatically infer risk based authorization decision boundaries. We explore RASA in a healthcare usage environment, wherein cyber and physical conditions create context specific risks for protecting private health information. The risk levels are associated with access control decisions recommended by a security policy. A coupling method is introduced to track coexistence of the objects within context using frequency and duration of coexistence, and these are clustered to reveal sets of actions with common risk levels these are used to create authorization decision boundaries. In addition, we propose a method for assessing the risk level and labelling the clusters with respect to their corresponding risk levels. We evaluate the promise of RASA generated policies against a heuristic rule based policy. By employing three different coupling features (frequency based, duration based, and combined features), the decisions of the unsupervised method and that of the policy are more than 99 consistent.


Auxiliary Classifier GAN for Malware Analysis. Generative adversarial networks (GAN) are a class of powerful machine learning techniques, where both a generative and discriminative model are trained simultaneously. GANs have been used, for example, to successfully generate "deep fake" images. A recent trend in malware research consists of treating executables as images and employing image based analysis techniques. In this research, we generate fake malware images using auxiliary classifier GANs (AC GAN), and we consider the effectiveness of various techniques for classifying the resulting images. Our results indicate that the resulting multiclass classification problem is challenging, yet we can obtain strong results when restricting the problem to distinguishing between real and fake samples. While the AC GAN generated images often appear to be very similar to real malware images, we conclude that from a deep learning perspective, the AC GAN generated samples do not rise to the level of deep fake malware images.


Topological semantics of conservativity and interpretability logics. We introduce and develop a topological semantics of conservativity logics and interpretability logics. We prove the topological compactness theorem of consistent normal extensions of the conservativity logic mathbf CL by extending Shehtman's ultrabouquet construction method to our framework. As a consequence, we prove that several extensions of mathbf CL such as mathbf IL , mathbf ILM , mathbf ILP and mathbf ILW are strongly complete with respect to our topological semantics.


SeaNet Towards A Knowledge Graph Based Autonomic Management of Software Defined Networks. Automatic network management driven by Artificial Intelligent technologies has been heatedly discussed over decades. However, current reports mainly focus on theoretic proposals and architecture designs, works on practical implementations on real life networks are yet to appear. This paper proposes our effort toward the implementation of knowledge graph driven approach for autonomic network management in software defined networks (SDNs), termed as SeaNet. Driven by the ToCo ontology, SeaNet is reprogrammed based on Mininet (a SDN emulator). It consists three core components, a knowledge graph generator, a SPARQL engine, and a network management API. The knowledge graph generator represents the knowledge in the telecommunication network management tasks into formally represented ontology driven model. Expert experience and network management rules can be formalized into knowledge graph and by automatically inferenced by SPARQL engine, Network management API is able to packet technology specific details and expose technology independent interfaces to users. The Experiments are carried out to evaluate proposed work by comparing with a commercial SDN controller Ryu implemented by the same language Python. The evaluation results show that SeaNet is considerably faster in most circumstances than Ryu and the SeaNet code is significantly more compact. Benefit from RDF reasoning, SeaNet is able to achieve O(1) time complexity on different scales of the knowledge graph while the traditional database can achieve O(nlogn) at its best. With the developed network management API, SeaNet enables researchers to develop semantic intelligent applications on their own SDNs.


On the Canonical Contact Structure of the Space of Null Geodesics of a Spacetime. The space of null geodesics of a spacetime carries a canonical contact structure which has proved to be key in the discussion of causality in spacetimes. However, not much progress has been made on its nature and not many explicit calculations for specific spacetimes can be found over the literature. We compute the spaces of null geodesics and their canonical contact structures for the manifold mathbb S 2 times mathbb S 1 equipped with the family of metrics g c g circ frac 1 c 2 dt 2 c in mathbb N . We obtain that these are the lens spaces L(2c,1) and that the contact structures are the pushforward of the canonical contact structure on ST mathbb S 2 cong L(2,1) under the projection map. We also study the applicability of Engel geometry on the discussion of three dimensional spacetimes. We show that, for a particular type of three dimensional spacetimes, one can obtain the space of null geodesics and its contact structure solely from the information of the Lorentz prolongation of the spacetime. We present an approach that makes use of this result to recover the spacetime from its space of null geodesics and skies.


Improving Robustness of Learning based Autonomous Steering Using Adversarial Images. For safety of autonomous driving, vehicles need to be able to drive under various lighting, weather, and visibility conditions in different environments. These external and environmental factors, along with internal factors associated with sensors, can pose significant challenges to perceptual data processing, hence affecting the decision making and control of the vehicle. In this work, we address this critical issue by introducing a framework for analyzing robustness of the learning algorithm w.r.t varying quality in the image input for autonomous driving. Using the results of sensitivity analysis, we further propose an algorithm to improve the overall performance of the task of "learning to steer". The results show that our approach is able to enhance the learning outcomes up to 48 . A comparative study drawn between our approach and other related techniques, such as data augmentation and adversarial training, confirms the effectiveness of our algorithm as a way to improve the robustness and generalization of neural network training for autonomous driving.


Does injecting linguistic structure into language models lead to better alignment with brain recordings?. Neuroscientists evaluate deep neural networks for natural language processing as possible candidate models for how language is processed in the brain. These models are often trained without explicit linguistic supervision, but have been shown to learn some linguistic structure in the absence of such supervision (Manning et al., 2020), potentially questioning the relevance of symbolic linguistic theories in modeling such cognitive processes (Warstadt and Bowman, 2020). We evaluate across two fMRI datasets whether language models align better with brain recordings, if their attention is biased by annotations from syntactic or semantic formalisms. Using structure from dependency or minimal recursion semantic annotations, we find alignments improve significantly for one of the datasets. For another dataset, we see more mixed results. We present an extensive analysis of these results. Our proposed approach enables the evaluation of more targeted hypotheses about the composition of meaning in the brain, expanding the range of possible scientific inferences a neuroscientist could make, and opens up new opportunities for cross pollination between computational neuroscience and linguistics.


On column convex and convex Carlitz polyominoes. In this paper, we introduce and study it Carlitz polyominoes . In particular, we show that, as n grows to infinity, asymptotically the number of begin enumerate item column convex Carlitz polyominoes with perimeter 2n is beq frac 9 sqrt 2 (14 3 sqrt 3 ) 2704 sqrt pi n 3 4 n. feq item convex Carlitz polyominoes with perimeter 2n is beq frac n 1 10 left( frac 3 sqrt 5 2 right) n 2 . feq end enumerate


Rethinking Negative Sampling for Handling Missing Entity Annotations. Negative sampling is highly effective in handling missing annotations for named entity recognition (NER). One of our contributions is an analysis on how it makes sense through introducing two insightful concepts missampling and uncertainty. Empirical studies show low missampling rate and high uncertainty are both essential for achieving promising performances with negative sampling. Based on the sparsity of named entities, we also theoretically derive a lower bound for the probability of zero missampling rate, which is only relevant to sentence length. The other contribution is an adaptive and weighted sampling distribution that further improves negative sampling via our former analysis. Experiments on synthetic datasets and well annotated datasets (e.g., CoNLL 2003) show that our proposed approach benefits negative sampling in terms of F1 score and loss convergence. Besides, models with improved negative sampling have achieved new state of the art results on real world datasets (e.g., EC).


Self Labeling of Fully Mediating Representations by Graph Alignment. To be able to predict a molecular graph structure ( W ) given a 2D image of a chemical compound ( U ) is a challenging problem in machine learning. We are interested to learn f U rightarrow W where we have a fully mediating representation V such that f factors into U rightarrow V rightarrow W . However, observing V requires detailed and expensive labels. We propose graph aligning approach that generates rich or detailed labels given normal labels W . In this paper we investigate the scenario of domain adaptation from the source domain where we have access to the expensive labels V to the target domain where only normal labels W are available. Focusing on the problem of predicting chemical compound graphs from 2D images the fully mediating layer is represented using the planar embedding of the chemical graph structure we are predicting. The use of a fully mediating layer implies some assumptions on the mechanism of the underlying process. However if the assumptions are correct it should allow the machine learning model to be more interpretable, generalize better and be more data efficient at training time. The empirical results show that, using only 4000 data points, we obtain up to 4x improvement of performance after domain adaptation to target domain compared to pretrained model only on the source domain. After domain adaptation, the model is even able to detect atom types that were never seen in the original source domain. Finally, on the Maybridge data set the proposed self labeling approach reached higher performance than the current state of the art.


Polynomial Spline Neural Networks with Exact Integrals. Using neural networks to solve variational problems, and other scientific machine learning tasks, has been limited by a lack of consistency and an inability to exactly integrate expressions involving neural network architectures. We address these limitations by formulating a novel neural network architecture that combines a polynomial mixture of experts model with free knot B1 spline basis functions. Effectively, our architecture performs piecewise polynomial approximation on each cell of a trainable partition of unity. Our architecture exhibits both h and p refinement for regression problems at the convergence rates expected from approximation theory, allowing for consistency in solving variational problems. Moreover, this architecture, its moments, and its partial derivatives can all be integrated exactly, obviating a reliance on sampling or quadrature and enabling error free computation of variational forms. We demonstrate the success of our network on a range of regression and variational problems that illustrate the consistency and exact integrability of our network architecture.


cs.LG cs.AI math.DS math.OC physics.geo-ph

Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data Driven State Estimation. Data assimilation (DA) is integrated with machine learning in order to perform entirely data driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of the DA cycle in numerical weather prediction (NWP), including the conventional numerical forecast model, the forecast error covariance matrix, and the tangent linear and adjoint models. It is shown how these RNNs can be initialized using DA methods to directly update the hidden reservoir state with observations of the target system. The results indicate that these techniques can be applied to estimate the state of a system for the repeated initialization of short term forecasts, even in the absence of a traditional numerical forecast model. Further, it is demonstrated how these integrated RNN DA methods can scale to higher dimensions by applying domain localization and parallelization, providing a path for practical applications in NWP.


Some remarks on rotation theorems for complex polynomials. For any complex polynomial P having all its zeros in the unit disk, we estimate the rate of change of the argument P (z) when the point z runs through the boundary of this disk.


High performance coherent population trapping atomic clock with direct modulation distributed Bragg reflector laser. The coherent population trapping (CPT) atomic clock is very promising for use in next generation spaceborne applications owing to its compactness and high performance. In this paper, we propose and implement a CPT atomic clock based on the direct modulation of a large modulation bandwidth and narrow linewidth distributed Bragg reflector laser, which replaces the usually used external bulk modulator in the high performance CPT clock. Our method retains the high performance while significantly reducing the size. Using this highly compact bichromatic light source and simplest CPT configuration, in which a circularly polarized bichromatic laser interrogates the 87 Rb atom system, a CPT signal of clock transition with a narrow linewidth and high contrast is observed. We then lock the local oscillator frequency to the CPT error signal and demonstrate a short term frequency stability of 3.6 times 10 13 tau 1 2 (4 s le tau le 200 s). We attribute it to the ultralow laser frequency and intensity noise as well as to the high quality factor CPT signal. This study can pave the way for the development of compact high performance CPT clocks based on our scheme.


Computer Vision based Social Distancing Surveillance Solution with Optional Automated Camera Calibration for Large Scale Deployment. Social distancing has been suggested as one of the most effective measures to break the chain of viral transmission in the current COVID 19 pandemic. We herein describe a computer vision based AI assisted solution to aid compliance with social distancing norms. The solution consists of modules to detect and track people and to identify distance violations. It provides the flexibility to choose between a tool based mode or an automated mode of camera calibration, making the latter suitable for large scale deployments. In this paper, we discuss different metrics to assess the risk associated with social distancing violations and how we can differentiate between transient or persistent violations. Our proposed solution performs satisfactorily under different test scenarios, processes video feed at real time speed as well as addresses data privacy regulations by blurring faces of detected people, making it ideal for deployments.


Cyclic arcs of Singer type and strongly regular Cayley graphs over finite fields. In cite M18 , the first author gave a construction of strongly regular Cayley graphs on the additive group of finite fields by using three valued Gauss periods. In particular, together with the result in cite BLMX , it was shown that there exists a strongly regular Cayley graph with negative Latin square type parameters (q 6,r(q 3 1), q 3 r 2 3r,r 2 r) , where r M(q 2 1) 2 , in the following cases (i) M 1 and q equiv 3 ,( mod 4 ) (ii) M 3 and q equiv 7 ,( mod 24 ) and (iii) M 7 and q equiv 11,51 ,( mod 56 ) . The existence of strongly regular Cayley graphs with the above parameters for odd M 7 was left open. In this paper, we prove that if there is an h , 1 le h le M 1 , such that M , ,(h 2 h 1) and the order of 2 in ( bf Z M bf Z ) times is odd,then there exist infinitely many primes q such that strongly regular Cayley graphs with the aforementioned parameters exist.


Homogeneous operators and homogeneous integral operators. We introduce and study in a general setting the concept of homogeneity of an operator and, in particular, the notion of homogeneity of an integral operator. In the latter case, homogeneous kernels of such operators are also studied. The concept of homogeneity is associated with transformations of a measure measure dilations, which are most natural in the context of our general research scheme. For the study of integral operators, the notions of weak and strong homogeneity of the kernel are introduced. The weak case is proved to generate a homogeneous operator in the sense of our definition, while the stronger condition corresponds to the most relevant specific examples classes of homogeneous integral operators on various metric spaces, and allows us to obtain an explicit general form for the kernels of such operators. The examples given in the article various specific cases illustrate general statements and results given in the paper and at the same time are of interest in their own way.


The Hilbert Grunwald specialization property over number fields. Given a finite group G and a number field K , we investigate the following question Does there exist a Galois extension E K(t) with group G whose set of specializations yields solutions to all Grunwald problems for the group G , outside a finite set of primes? Following previous work, such a Galois extension would be said to have the "Hilbert Grunwald property". In this paper we reach a complete classification of groups G which admit an extension with the Hilbert Grunwald property over fields such as K mathbb Q . We thereby also complete the determination of the local dimension" of finite groups over mathbb Q .


Fundamental limits to the refractive index of transparent optical materials. Increasing the refractive index available for optical and nanophotonic systems opens new vistas for design for applications ranging from broadband metalenses to ultrathin photovoltaics to high quality factor resonators, higher index directly leads to better devices with greater functionality. Although standard transparent materials have been limited to refractive indices smaller than 3 in the visible, recent metamaterials designs have achieved refractive indices above 5, accompanied by high losses, and near the phase transition of a ferroelectric perovskite a broadband index above 26 has been claimed. In this work, we derive fundamental limits to the refractive index of any material, given only the underlying electron density and either the maximum allowable dispersion or the minimum bandwidth of interest. The Kramers Kronig relations provide a representation for any passive (and thereby causal) material, and a well known sum rule constrains the possible distribution of oscillator strengths. In the realm of small to modest dispersion, our bounds are closely approached and not surpassed by a wide range of natural materials, showing that nature has already nearly reached a Pareto frontier for refractive index and dispersion. Surprisingly, our bound shows a cube root dependence on electron density, meaning that a refractive index of 26 over all visible frequencies is likely impossible. Conversely, for narrow bandwidth applications, nature does not provide the highly dispersive, high index materials that our bounds suggest should be possible. We use the theory of composites to identify metal based metamaterials that can exhibit small losses and sizeable increases in refractive index over the current best materials.


A New Electrostatic mode in Two Fluid (ENe Ion) Formalism of a Partially Ionized Plasma. It is economical to devise ways and means to simplify a multi species particle system. The single fluid MHD description of a plasma is sufficiently adequate to study plasma phenomena . A plasma containing multi species of particles can also be described by representing each particle species by the corresponding fluid. A partially ionized plasma consisting of electrons, ions and the neutral particles can be described as a single fluid by appropriately combining the dynamics of each of the species. The three component plasma can also be reduced to a two fluid system. The most obvious way is to combine the electron and the ion fluids to obtain a single fluid in the MHD limit and the neutral particles to form the second fluid. The other two possibilities are 1) to combine electron fluid and the neutral fluid into one fluid, here, christened as ENe fluid, and treat the ions as the second fluid and 2) to combine the ion fluid and the neutral fluid into one fluid, here, christened as INe fluid, and treat the electrons as the second fluid. It is found that the process of combining the electrons and the neutrals endows the neutrals with a negative electric charge. So, here is a new plasma with heavy ( with mass of the neutral particle assuming the electron mass to be negligible) negatively charged particles along with the positively charged ions. One could in principle, similarly treat the second possibility. However , since there can be a huge variation between the relative masses of the neutrals and the ions, the system turns out to be more complex and its discussion is deferred until later. Here, after establishing the framework for the two fluid ENe Ion system, the characteristic electrostatic wave mode of this novel two fluid plasma is determined. The wave frequency is found to be a function of the collision frequencies in addition to the dependence on usual parameters.


Partial Differential Equations is All You Need for Generating Neural Architectures A Theory for Physical Artificial Intelligence Systems. In this work, we generalize the reaction diffusion equation in statistical physics, Schr "odinger equation in quantum mechanics, Helmholtz equation in paraxial optics into the neural partial differential equations (NPDE), which can be considered as the fundamental equations in the field of artificial intelligence research. We take finite difference method to discretize NPDE for finding numerical solution, and the basic building blocks of deep neural network architecture, including multi layer perceptron, convolutional neural network and recurrent neural networks, are generated. The learning strategies, such as Adaptive moment estimation, L BFGS, pseudoinverse learning algorithms and partial differential equation constrained optimization, are also presented. We believe it is of significance that presented clear physical image of interpretable deep neural networks, which makes it be possible for applying to analog computing device design, and pave the road to physical artificial intelligence.


Parametrized Euler class and semicohomology theory. We extend Ghys' theory about semiconjugacy to the world of measurable cocycles. More precisely, given a measurable cocycle with values into text Homeo ( mathbb S 1) , we can construct a text L infty parametrized Euler class in bounded cohomology. We show that such a class vanishes if and only if the cocycle can be lifted to text Homeo mathbb Z ( mathbb R ) and it admits an equivariant family of points. We define the notion of semicohomologous cocycles and we show that two measurable cocycles are semicohomologous if and only if they induce the same parametrized Euler class. Since for minimal cocycles, semicohomology boils down to cohomology, the parametrized Euler class is constant for minimal cohomologous cocycles. We conclude by studying the vanishing of the real parametrized Euler class and we obtain some results of elementarity.


Schedule Based Temporal Difference Algorithms. Learning the value function of a given policy from data samples is an important problem in Reinforcement Learning. TD( lambda ) is a popular class of algorithms to solve this problem. However, the weights assigned to different n step returns in TD( lambda ), controlled by the parameter lambda , decrease exponentially with increasing n . In this paper, we present a lambda schedule procedure that generalizes the TD( lambda ) algorithm to the case when the parameter lambda could vary with time step. This allows flexibility in weight assignment, i.e., the user can specify the weights assigned to different n step returns by choosing a sequence lambda t t geq 1 . Based on this procedure, we propose an on policy algorithm TD( lambda ) schedule, and two off policy algorithms GTD( lambda ) schedule and TDC( lambda ) schedule, respectively. We provide proofs of almost sure convergence for all three algorithms under a general Markov noise framework.


Data Augmentation Methods for Anaphoric Zero Pronouns. In pro drop language like Arabic, Chinese, Italian, Japanese, Spanish, and many others, unrealized (null) arguments in certain syntactic positions can refer to a previously introduced entity, and are thus called anaphoric zero pronouns. The existing resources for studying anaphoric zero pronoun interpretation are however still limited. In this paper, we use five data augmentation methods to generate and detect anaphoric zero pronouns automatically. We use the augmented data as additional training materials for two anaphoric zero pronoun systems for Arabic. Our experimental results show that data augmentation improves the performance of the two systems, surpassing the state of the art results.


Simultaneous inversion of layered velocity and density profiles using Direct Waveform Inversion (DWI) 1D case. We propose and test the Direct Waveform Inversion (DWI) scheme to simultaneously invert for layered velocity and density profiles, using reflection seismic waveforms recorded on the surface. The recorded data include primary reflections and interbed multiples. DWI is implemented in the time space domain. By explicitly enforcing the wavefield time space causality, DWI can recursively determine the subsurface seismic structure in a local fashion for both sharp interfaces as well as the properties of the layers, from shallow to deep depths. DWI is different from the layer stripping methods in the frequency domain. By not requiring a global initial model, DWI avoids many nonlinear optimization problems, such as the local minima and the need for an accurate initial model in most full waveform inversion schemes. Using two numerical tests here, we demonstrate that the DWI scheme for multi parameter seismic inversion for velocity and density of layered media, using plane waves of different incident angles. This represents a significant step comparing with the previous DWI only inverting for the velocity.


Joint invariant sets for non commutative expanding Markov maps of the circle. A long standing question is what invariant sets can be shared by two maps acting on the same space. A similar question stands for invariant measures. A particular interesting case are expanding Markov maps of the circle. If the two involved maps are commuting the answer is almost complete. However very little is known in the non commutative case. A first step is to analyze the structure of the invariant sets of a single map. For a mapping of the circle of class C alpha , alpha 1 , we study the topological structure of the set containing all compact invariant sets. Furthermore for a fixed such mapping we examine locally, in the category sense, how big is the subset of all maps that have at least one non trivial joint invariant compact set. Lastly we show the strong dimensional relation of the maximal invariant set of a given Markov map contained in a subinterval of 0,1) and the set of all right endpoints of its invariants sets contained in the same subinterval as well as the continuity dependence of the dimension on the endpoints of the subinterval.


A New Partial Order on SYT. We define a new partial order on SYT n , the set of all standard Young tableaux with n cells, by combining the chain order with the notion of horizontal strips. We prove various desirable properties of this new order.


Performance evaluation results of evolutionary clustering algorithm star for clustering heterogeneous datasets. This article presents the data used to evaluate the performance of evolutionary clustering algorithm star (ECA ) compared to five traditional and modern clustering algorithms. Two experimental methods are employed to examine the performance of ECA against genetic algorithm for clustering (GENCLUST ), learning vector quantisation (LVQ) , expectation maximisation (EM) , K means (KM ) and K means (KM). These algorithms are applied to 32 heterogenous and multi featured datasets to determine which one performs well on the three tests. For one, ther paper examines the efficiency of ECA in contradiction of its corresponding algorithms using clustering evaluation measures. These validation criteria are objective function and cluster quality measures. For another, it suggests a performance rating framework to measurethe the performance sensitivity of these algorithms on varos dataset features (cluster dimensionality, number of clusters, cluster overlap, cluster shape and cluster structure). The contributions of these experiments are two folds (i) ECA exceeds its counterpart aloriths in ability to find out the right cluster number (ii) ECA is less sensitive towards dataset features compared to its competitive techniques. Nonetheless, the results of the experiments performed demonstrate some limitations in the ECA (i) ECA is not fully applied based on the premise that no prior knowledge exists (ii) Adapting and utilising ECA on several real applications has not been achieved yet.


Numerical computation of Neumann controllers for the heat equation on a finite interval. This paper presents a new numerical method which approximates Neumann type null controllers for the heat equation and is based on the Fokas method. This is a direct method for solving problems originating from the control theory, which allows the realisation of an efficient numerical algorithm that requires small computational effort for determining the null controller with exponentially small error. Furthermore, the unified character of the Fokas method makes the extension of the numerical algorithm to a wide range of other linear PDEs and different type of boundary conditions straightforward.


physics.comp-ph cs.LG cs.NA math.NA physics.flu-dyn

Physics and Equality Constrained Artificial Neural Networks Application to Forward and Inverse Problems with Multi fidelity Data Fusion. Physics informed neural networks (PINNs) have been proposed to learn the solution of partial differential equations (PDE). In PINNs, the residual form of the PDE of interest and its boundary conditions are lumped into a composite objective function as soft penalties. Here, we show that this specific way of formulating the objective function is the source of severe limitations in the PINN approach when applied to different kinds of PDEs. To address these limitations, we propose a versatile framework based on a constrained optimization problem formulation, where we use the augmented Lagrangian method (ALM) to constrain the solution of a PDE with its boundary conditions and any high fidelity data that may be available. Our approach is adept at forward and inverse problems with multi fidelity data fusion. We demonstrate the efficacy and versatility of our physics and equality constrained deep learning framework by applying it to several forward and inverse problems involving multi dimensional PDEs. Our framework achieves orders of magnitude improvements in accuracy levels in comparison with state of the art physics informed neural networks.


Super Resolving Cross Domain Face Miniatures by Peeking at One Shot Exemplar. Conventional face super resolution methods usually assume testing low resolution (LR) images lie in the same domain as the training ones. Due to different lighting conditions and imaging hardware, domain gaps between training and testing images inevitably occur in many real world scenarios. Neglecting those domain gaps would lead to inferior face super resolution (FSR) performance. However, how to transfer a trained FSR model to a target domain efficiently and effectively has not been investigated. To tackle this problem, we develop a Domain Aware Pyramid based Face Super Resolution network, named DAP FSR network. Our DAP FSR is the first attempt to super resolve LR faces from a target domain by exploiting only a pair of high resolution (HR) and LR exemplar in the target domain. To be specific, our DAP FSR firstly employs its encoder to extract the multi scale latent representations of the input LR face. Considering only one target domain example is available, we propose to augment the target domain data by mixing the latent representations of the target domain face and source domain ones, and then feed the mixed representations to the decoder of our DAP FSR. The decoder will generate new face images resembling the target domain image style. The generated HR faces in turn are used to optimize our decoder to reduce the domain gap. By iteratively updating the latent representations and our decoder, our DAP FSR will be adapted to the target domain, thus achieving authentic and high quality upsampled HR faces. Extensive experiments on three newly constructed benchmarks validate the effectiveness and superior performance of our DAP FSR compared to the state of the art.


SiT Self supervised vIsion Transformer. Self supervised learning methods are gaining increasing traction in computer vision due to their recent success in reducing the gap with supervised learning. In natural language processing (NLP) self supervised learning and transformers are already the methods of choice. The recent literature suggests that the transformers are becoming increasingly popular also in computer vision. So far, the vision transformers have been shown to work well when pretrained either using a large scale supervised data or with some kind of co supervision, e.g. in terms of teacher network. These supervised pretrained vision transformers achieve very good results in downstream tasks with minimal changes. In this work we investigate the merits of self supervised learning for pretraining image vision transformers and then using them for downstream classification tasks. We propose Self supervised vIsion Transformers (SiT) and discuss several self supervised training mechanisms to obtain a pretext model. The architectural flexibility of SiT allows us to use it as an autoencoder and work with multiple self supervised tasks seamlessly. We show that a pretrained SiT can be finetuned for a downstream classification task on small scale datasets, consisting of a few thousand images rather than several millions. The proposed approach is evaluated on standard datasets using common protocols. The results demonstrate the strength of the transformers and their suitability for self supervised learning. We outperformed existing self supervised learning methods by large margin. We also observed that SiT is good for few shot learning and also showed that it is learning useful representation by simply training a linear classifier on top of the learned features from SiT. Pretraining, finetuning, and evaluation codes will be available under https github.com Sara Ahmed SiT.


Sustaining Research Software via Research Software Engineers and Professional Associations. Research software is a class of software developed to support research. Today a wealth of such software is created daily in universities, government, and commercial research enterprises worldwide. The sustainability of this software faces particular challenges due, at least in part, to the type of people who develop it. These Research Software Engineers (RSEs) face challenges in developing and sustaining software that differ from those faced by the developers of traditional software. As a result, professional associations have begun to provide support, advocacy, and resources for RSEs. These benefits are critical to sustaining RSEs, especially in environments where their contributions are often undervalued and not rewarded. This paper focuses on how professional associations, such as the United States Research Software Engineer Association (US RSE), can provide this.


FSNet A Failure Detection Framework for Semantic Segmentation. Semantic segmentation is an important task that helps autonomous vehicles understand their surroundings and navigate safely. During deployment, even the most mature segmentation models are vulnerable to various external factors that can degrade the segmentation performance with potentially catastrophic consequences for the vehicle and its surroundings. To address this issue, we propose a failure detection framework to identify pixel level misclassification. We do so by exploiting internal features of the segmentation model and training it simultaneously with a failure detection network. During deployment, the failure detector can flag areas in the image where the segmentation model have failed to segment correctly. We evaluate the proposed approach against state of the art methods and achieve 12.30 , 9.46 , and 9.65 performance improvement in the AUPR Error metric for Cityscapes, BDD100K, and Mapillary semantic segmentation datasets.


Resolvent of the parallel composition and proximity operator of the infimal postcomposition. In this paper we provide the resolvent computation of the infimal postcomposition of a maximally monotone operator by a linear operator under mild assumptions. Connections with a modification of the warped resolvent are provided. In the context of convex optimization, we obtain the proximity operator of the infimal postcomposition of a convex function by a linear operator and we extend full range conditions on the linear operator to mild qualification conditions. We also introduce a generalization of the proximity operator involving a general linear bounded operator leading to a generalization of Moreau's decomposition for composite convex optimization.


TND NAS Towards Non Differentiable Objectives in Differentiable Neural Architecture Search. Differentiable architecture search has gradually become the mainstream research topic in the field of Neural Architecture Search (NAS) for its high efficiency compared with the early NAS (EA based, RL based) methods. Recent differentiable NAS also aims at further improving the search performance and reducing the GPU memory consumption. However, these methods are no longer naturally capable of tackling the non differentiable objectives, e.g., energy, resource constrained efficiency, and other metrics, let alone the multi objective search demands. Researches in the multi objective NAS field target this but requires vast computational resources cause of the sole optimization of each candidate architecture. In light of this discrepancy, we propose the TND NAS, which is with the merits of the high efficiency in differentiable NAS framework and the compatibility among non differentiable metrics in Multi objective NAS. Under the differentiable NAS framework, with the continuous relaxation of the search space, TND NAS has the architecture parameters ( alpha ) been optimized in discrete space, while resorting to the progressive search space shrinking by alpha . Our representative experiment takes two objectives (Parameters, Accuracy) as an example, we achieve a series of high performance compact architectures on CIFAR10 (1.09M 3.3 , 2.4M 2.95 , 9.57M 2.54 ) and CIFAR100 (2.46M 18.3 , 5.46 16.73 , 12.88 15.20 ) datasets. Favorably, compared with other multi objective NAS methods, TND NAS is less time consuming (1.3 GPU days on NVIDIA 1080Ti, 1 6 of that in NSGA Net), and can be conveniently adapted to real world NAS scenarios (resource constrained, platform specialized).


Block decomposition of the category of l modular smooth representations of finite length of GL(m,D). Let F be a non Archimedean locally compact field of residue characteristic p, let G be an inner form of GL(n,F) with n 0, and let l be a prime number different from p. We describe the block decomposition of the category of finite length smooth representations of G with coefficients in an algebraically closed field of characteristic l. Unlike the case of complex representations of an arbitrary p adic reductive group and that of l modular representations of GL(n,F), several non isomorphic supercuspidal supports may correspond to the same block. We describe the (finitely many) supercuspidal supports corresponding to a given block. We also prove that a supercuspidal block is equivalent to the principal (that is, the one which contains the trivial character) block of the multiplicative group of a suitable division algebra, and we determine those irreducible representations having a nontrivial extension with a given supercuspidal representation of G.


An L p Primal Dual Weak Galerkin Method for Convection Diffusion Equations. In this article, the authors present a new L p primal dual weak Galerkin method ( L p PDWG) for convection diffusion equations with p 1 . The existence and uniqueness of the numerical solution is discussed, and an optimal order error estimate is derived in the L q norm for the primal variable, where frac 1p frac 1q 1 . Furthermore, error estimates are established for the numerical approximation of the dual variable in the standard W m,p norm, 0 le m le 2 . Numerical results are presented to demonstrate the efficiency and accuracy of the proposed L p PDWG method.


EPIC KITCHENS 100 Unsupervised Domain Adaptation Challenge for Action Recognition 2021 Team M3EM Technical Report. In this report, we describe the technical details of our submission to the 2021 EPIC KITCHENS 100 Unsupervised Domain Adaptation Challenge for Action Recognition. Leveraging multiple modalities has been proved to benefit the Unsupervised Domain Adaptation (UDA) task. In this work, we present Multi Modal Mutual Enhancement Module (M3EM), a deep module for jointly considering information from multiple modalities to find the most transferable representations across domains. We achieve this by implementing two sub modules for enhancing each modality using the context of other modalities. The first sub module exchanges information across modalities through the semantic space, while the second sub module finds the most transferable spatial region based on the consensus of all modalities.


Parallel Attention Network with Sequence Matching for Video Grounding. Given a video, video grounding aims to retrieve a temporal moment that semantically corresponds to a language query. In this work, we propose a Parallel Attention Network with Sequence matching (SeqPAN) to address the challenges in this task multi modal representation learning, and target moment boundary prediction. We design a self guided parallel attention module to effectively capture self modal contexts and cross modal attentive information between video and text. Inspired by sequence labeling tasks in natural language processing, we split the ground truth moment into begin, inside, and end regions. We then propose a sequence matching strategy to guide start end boundary predictions using region labels. Experimental results on three datasets show that SeqPAN is superior to state of the art methods. Furthermore, the effectiveness of the self guided parallel attention module and the sequence matching module is verified.


A Compositional Sheaf Theoretic Framework for Event Based Systems. A compositional sheaf theoretic framework for the modeling of complex event based systems is presented. We show that event based systems are machines, with inputs and outputs, and that they can be composed with machines of different types, all within a unified, sheaf theoretic formalism. We take robotic systems as an exemplar of complex systems and rigorously describe actuators, sensors, and algorithms using this framework.


Weibel instability beyond bi Maxwellian anisotropy. The shape of the anisotropic velocity distribution function, beyond the realm of strict Maxwellians can play a significant role in determining the evolution of the Weibel instability dictating the dynamics of self generated magnetic fields. For non Maxwellian distribution functions, we show that the direction of the maximum growth rate wavevector changes with shape. We investigate different laser plasma interaction model distributions which show that their Weibel generated magnetic fields may require closer scrutiny beyond the second moment (temperature) anisotropy ratio characterization.


Multi task transfer learning for finding actionable information from crisis related messages on social media. The Incident streams (IS) track is a research challenge aimed at finding important information from social media during crises for emergency response purposes. More specifically, given a stream of crisis related tweets, the IS challenge asks a participating system to 1) classify what the types of users' concerns or needs are expressed in each tweet, known as the information type (IT) classification task and 2) estimate how critical each tweet is with regard to emergency response, known as the priority level prediction task. In this paper, we describe our multi task transfer learning approach for this challenge. Our approach leverages state of the art transformer models including both encoder based models such as BERT and a sequence to sequence based T5 for joint transfer learning on the two tasks. Based on this approach, we submitted several runs to the track. The returned evaluation results show that our runs substantially outperform other participating runs in both IT classification and priority level prediction.


Control in Hilbert Space and First Order Mean Field Type Problem. We extend the work cite bensoussan2019control by two of the coauthors, which dealt with a deterministic control problem for which the Hilbert space could be generic and investigated a novel form of the lifting' technique proposed by P. L. Lions. In cite bensoussan2019control , we only showed the local existence and uniqueness of solutions to the FBODEs in the Hilbert space which were associated to the control problems with drift function consisting of the control only. In this article, we establish the global existence and uniqueness of the solutions to the FBODEs in Hilbert space corresponding to control problems with separable drift function which is nonlinear in state and linear in control. We shall also prove the sufficiency of the Pontryagin Maximum Principle and derive the corresponding Bellman equation. Besides, we shall show an analogue in the stationary case. Finally, by using the lifting' idea as in cite stochasticv2,stochasticv1 , we shall apply the result to solve the linear quadratic mean field type control problems, and to show the global existence of the corresponding Bellman equations.


Bound Preserving Finite Volume Schemes for Systems of Continuity Equations with Saturation. We propose finite volume schemes for general continuity equations which preserve positivity and global bounds that arise from saturation effects in the mobility function. In the case of gradient flows, the schemes dissipate the free energy at the fully discrete level. Moreover, these schemes are generalised to coupled systems of non linear continuity equations, such as multispecies models in mathematical physics or biology, preserving the bounds and the dissipation of the energy whenever applicable. These results are illustrated through extensive numerical simulations which explore known behaviours in biology and showcase new phenomena not yet described by the literature.


Vehicle Re identification Method Based on Vehicle Attribute and Mutual Exclusion Between Cameras. Vehicle Re identification aims to identify a specific vehicle across time and camera view. With the rapid growth of intelligent transportation systems and smart cities, vehicle Re identification technology gets more and more attention. However, due to the difference of shooting angle and the high similarity of vehicles belonging to the same brand, vehicle re identification becomes a great challenge for existing method. In this paper, we propose a vehicle attribute guided method to re rank vehicle Re ID result. The attributes used include vehicle orientation and vehicle brand . We also focus on the camera information and introduce camera mutual exclusion theory to further fine tune the search results. In terms of feature extraction, we combine the data augmentations of multi resolutions with the large model ensemble to get a more robust vehicle features. Our method achieves mAP of 63.73 and rank 1 accuracy 76.61 in the CVPR 2021 AI City Challenge.


On the explainability of hospitalization prediction on a large COVID 19 patient dataset. We develop various AI models to predict hospitalization on a large (over 110 k ) cohort of COVID 19 positive tested US patients, sourced from March 2020 to February 2021. Models range from Random Forest to Neural Network (NN) and Time Convolutional NN, where combination of the data modalities (tabular and time dependent) are performed at different stages (early vs. model fusion). Despite high data unbalance, the models reach average precision 0.96 0.98 (0.75 0.85), recall 0.96 0.98 (0.74 0.85), and F 1 score 0.97 0.98 (0.79 0.83) on the non hospitalized (or hospitalized) class. Performances do not significantly drop even when selected lists of features are removed to study model adaptability to different scenarios. However, a systematic study of the SHAP feature importance values for the developed models in the different scenarios shows a large variability across models and use cases. This calls for even more complete studies on several explainability methods before their adoption in high stakes scenarios.


Spatiotemporal helicon wavepackets. Propagation invariant or non diffracting optical beams have received considerable attention during the last two decades. However, the pulsed nature of light waves and the structured property of optical media like waveguides are often overlooked. We here present a four dimensional spatiotemporal approach that extends and unifies both concepts of conical waves and helicon beams, mainly studied in bulk media. By taking advantage of tight correlations between the spatial modes, the topological charges, and the frequencies embedded in an optical field, we reveal propagation invariant (dispersion and diffraction free) space time wavepackets carrying orbital angular momentum (OAM) that evolve on spiraling trajectories in both time and space in bulk media or multimode fibers. Besides their intrinsic linear nature, we show that such wave structures can spontaneously emerge when a rather intense ultrashort pulse propagates nonlinearly in OAM modes. With emerging technologies of pulse beam shaping, multimode fibers and modal multiplexing, our proposed scheme to create OAM carrying helicon wavepackets could find a plethora of applications.


High accuracy power series method for solving scalar, vector, and inhomogeneous nonlinear Schr "odinger equations. We develop a high accuracy power series method for solving partial differential equations with emphasis on the nonlinear Schr "odinger equations. The accuracy and computing speed can be systematically and arbitrarily increased to orders of magnitude larger than those of other methods. Machine precision accuracy can be easily reached and sustained for long evolution times within rather short computing time. In depth analysis and characterisation for all sources of error are performed by comparing the numerical solutions with the exact analytical ones. Exact and approximate boundary conditions are considered and shown to minimise errors for solutions with finite background. The method is extended to cases with external potentials and coupled nonlinear Schr "odinger equations.


Every nice graph is (1,5) choosable. A graph G (V,E) is total weight (k,k') choosable if the following holds For any list assignment L which assigns to each vertex v a set L(v) of k real numbers, and assigns to each edge e a set L(e) of k' real numbers, there is a proper L total weighting, i.e., a map phi V cup E to mathbb R such that phi(z) in L(z) for z in V cup E , and sum e in E(u) phi(e) phi(u) ne sum e in E(v) phi(e) phi(v) for every edge u,v . A graph is called nice if it contains no isolated edges. As a strengthening of the famous 1 2 3 conjecture, it was conjectured in T. Wong and X. Zhu, Total weigt choosability of graphs, J. Graph Th. 66 (2011),198 212 that every nice graph is total weight (1,3) choosable. The problem whether there is a constant k such that every nice graph is total weight (1,k) choosable remained open for a decade and was recently solved by Cao L. Cao, Total weight choosability of graphs Towards the 1 2 3 conjecture, J. Combin. Th. B, 149(2021), 109 146 , who proved that every nice graph is total weight (1, 17) choosable. This paper improves this result and proves that every nice graph is total weight (1, 5) choosable.


Infinite Time Horizon Safety of Bayesian Neural Networks. Bayesian neural networks (BNNs) place distributions over the weights of a neural network to model uncertainty in the data and the network's prediction. We consider the problem of verifying safety when running a Bayesian neural network policy in a feedback loop with infinite time horizon systems. Compared to the existing sampling based approaches, which are inapplicable to the infinite time horizon setting, we train a separate deterministic neural network that serves as an infinite time horizon safety certificate. In particular, we show that the certificate network guarantees the safety of the system over a subset of the BNN weight posterior's support. Our method first computes a safe weight set and then alters the BNN's weight posterior to reject samples outside this set. Moreover, we show how to extend our approach to a safe exploration reinforcement learning setting, in order to avoid unsafe trajectories during the training of the policy. We evaluate our approach on a series of reinforcement learning benchmarks, including non Lyapunovian safety specifications.


On the Foundations of Grounding in Answer Set Programming. We provide a comprehensive elaboration of the theoretical foundations of variable instantiation, or grounding, in Answer Set Programming (ASP). Building on the semantics of ASP's modeling language, we introduce a formal characterization of grounding algorithms in terms of (fixed point) operators. A major role is played by dedicated well founded operators whose associated models provide semantic guidance for delineating the result of grounding along with on the fly simplifications. We address an expressive class of logic programs that incorporates recursive aggregates and thus amounts to the scope of existing ASP modeling languages. This is accompanied with a plain algorithmic framework detailing the grounding of recursive aggregates. The given algorithms correspond essentially to the ones used in the ASP grounder gringo.


A contextual analysis of multi layer perceptron models in classifying hand written digits and letters limited resources. Classifying hand written digits and letters has taken a big leap with the introduction of ConvNets. However, on very constrained hardware the time necessary to train such models would be high. Our main contribution is twofold. First, we extensively test an end to end vanilla neural network (MLP) approach in pure numpy without any pre processing or feature extraction done beforehand. Second, we show that basic data mining operations can significantly improve the performance of the models in terms of computational time, without sacrificing much accuracy. We illustrate our claims on a simpler variant of the Extended MNIST dataset, called Balanced EMNIST dataset. Our experiments show that, without any data mining, we get increased generalization performance when using more hidden layers and regularization techniques, the best model achieving 84.83 accuracy on a test dataset. Using dimensionality reduction done by PCA we were able to increase that figure to 85.08 with only 10 of the original feature space, reducing the memory size needed by 64 . Finally, adding methods to remove possibly harmful training samples like deviation from the mean helped us to still achieve over 84 test accuracy but with only 32.8 of the original memory size for the training set. This compares favorably to the majority of literature results obtained through similar architectures. Although this approach gets outshined by state of the art models, it does scale to some (AlexNet, VGGNet) trained on 50 of the same dataset.


Using automated decision making (ADM) to allocate Covid 19 vaccinations? Exploring the roles of trust and social group preference on the legitimacy of ADM vs. human decision making. In combating the ongoing global health threat of the Covid 19 pandemic, decision makers have to take actions based on a multitude of relevant health data with severe potential consequences for the affected patients. Because of their presumed advantages in handling and analyzing vast amounts of data, computer systems of automated decision making (ADM) are implemented and substitute humans in decision making processes. In this study, we focus on a specific application of ADM in contrast to human decision making (HDM), namely the allocation of Covid 19 vaccines to the public. In particular, we elaborate on the role of trust and social group preference on the legitimacy of vaccine allocation. We conducted a survey with a 2x2 randomized factorial design among n 1602 German respondents, in which we utilized distinct decision making agents (HDM vs. ADM) and prioritization of a specific social group (teachers vs. prisoners) as design factors. Our findings show that general trust in ADM systems and preference for vaccination of a specific social group influence the legitimacy of vaccine allocation. However, contrary to our expectations, trust in the agent making the decision did not moderate the link between social group preference and legitimacy. Moreover, the effect was also not moderated by the type of decision maker (human vs. algorithm). We conclude that trustworthy ADM systems must not necessarily lead to the legitimacy of ADM systems.


Approximating Maximum Independent Set for Rectangles in the Plane. We give a polynomial time constant factor approximation algorithm for maximum independent set for (axis aligned) rectangles in the plane. Using a polynomial time algorithm, the best approximation factor previously known is O( log log n) . The results are based on a new form of recursive partitioning in the plane, in which faces that are constant complexity and orthogonally convex are recursively partitioned into a constant number of such faces.


Corynebacterium glutamicum regulation beyond transcription Organizing principles and reconstruction of an extended regulatory network incorporating regulations mediated by small RNA and protein protein interactions. Corynebacterium glutamicum is a Gram positive bacterium found in soil where the condition changes demand plasticity of the regulatory machinery. The study of such machinery at the global scale has been challenged by the lack of data integration. Here, we report three regulatory network models for C. glutamicum strong (3040 interactions) constructed solely with regulations previously supported by directed experiments all evidence (4665 interactions) containing the strong network, regulations previously supported by non directed experiments, and protein protein interactions with a direct effect on gene transcription and sRNA (5222 interactions) containing the all evidence network and sRNA mediated regulations. Compared to the previous version (2018), the strong and all evidence networks increased by 75 and 1225 interactions, respectively. We analyzed the system level components of the three networks to identify how they differ and compared their structures against those for the networks of more than 40 species. The inclusion of the sRNAs regulations changed the proportions of the system level components and increased the number of modules but decreased their size. The C. glutamicum regulatory structure contrasted with other bacterial regulatory networks. Finally, we used the strong networks of three model organisms to provide insights and future directions of the C. glutamicum regulatory network characterization.


Pseudo Haptic Button for Improving User Experience of Mid Air Interaction in VR. Mid air interaction is one of the promising interaction modalities in virtual reality (VR) due to its merits in naturalness and intuitiveness, but the interaction suffers from the lack of haptic feedback as no force or vibrotactile feedback can be provided in mid air. As a breakthrough to compensate for this insufficiency, the application of pseudo haptic features which create the visuo haptic illusion without actual physical haptic stimulus can be explored. Therefore, this study aimed to investigate the effect of four pseudo haptic features proximity feedback, protrusion, hit effect, and penetration blocking on user experience for free hand mid air button interaction in VR. We conducted a user study on 21 young subjects to collect user ratings on various aspects of user experience while users were freely interacting with 16 buttons with different combinations of four features. Results indicated that all investigated features significantly improved user experience in terms of haptic illusion, embodiment, sense of reality, spatiotemporal perception, satisfaction, and hedonic quality. In addition, protrusion and hit effect were more beneficial in comparison with the other two features. It is recommended to utilize the four proposed pseudo haptic features in 3D user interfaces (UIs) to make users feel more pleased and amused, but caution is needed when using proximity feedback together with other features. The findings of this study could be helpful for VR developers and UI designers in providing better interactive buttons in the 3D interfaces.