Networked Time Series Prediction with Incomplete Data. A networked time series (NETS) is a family of time series on a given graph, one for each node. It has found a wide range of applications from intelligent transportation, environment monitoring to mobile network management. An important task in such applications is to predict the future values of a NETS based on its historical values and the underlying graph. Most existing methods require complete data for training. However, in real world scenarios, it is not uncommon to have missing data due to sensor malfunction, incomplete sensing coverage, etc. In this paper, we study the problem of NETS prediction with incomplete data. We propose NETS ImpGAN, a novel deep learning framework that can be trained on incomplete data with missing values in both history and future. Furthermore, we propose novel Graph Temporal Attention Networks by incorporating the attention mechanism to capture both inter time series correlations and temporal correlations. We conduct extensive experiments on three real world datasets under different missing patterns and missing rates. The experimental results show that NETS ImpGAN outperforms existing methods except when data exhibit very low variance, in which case NETS ImpGAN still achieves competitive performance.


A hypothesis free bridging of disease dynamics and non pharmaceutical policies. Accurate prediction of the number of daily or weekly confirmed cases of COVID 19 is critical to the control of the pandemic. Existing mechanistic models nicely capture the disease dynamics. However, to forecast the future, they require the transmission rate to be known, limiting their prediction power. Typically, a hypothesis is made on the form of the transmission rate with respect to time. Yet the real form is too complex to be mechanistically modeled due to the unknown dynamics of many influential factors. We tackle this problem by using a hypothesis free machine learning algorithm to estimate the transmission rate from data on non pharmaceutical policies, and in turn forecast the confirmed cases using a mechanistic disease model. More specifically, we build a hybrid model consisting of a mechanistic ordinary differential equation (ODE) model and a generalized boosting model (GBM). To calibrate the parameters, we develop an "inverse method" that obtains the transmission rate inversely in time from the other variables in the ODE model and then feed it into the GBM to connect with the policy data. The resulting model forecasted the number of daily confirmed cases up to 35 days in the future in the United States with an averaged mean absolute percentage error of 27 . Being partly data driven, the method is more accurate than typical mechanistic models and meanwhile more intuitive, and possibly reliable, than purely data based machine learning models. Moreover, it can identify the most informative predictive variables, which can be helpful in designing improved forecasters as well as informing policymakers.


Designing a scalable framework for declarative automation on distributed systems. As distributed systems grow in scale and complexity, the need for flexible automation of systems management functions also grows. We outline a framework for building tools that provide distributed, scalable, declarative, modular, and continuous automation for distributed systems. We focus on four points of design 1) a state management approach that prescribes source of truth for configured and discovered system states 2) a technique to solve the declarative unification problem for a class of automation problems, providing state convergence and modularity 3) an eventual consistency approach to state synchronization which provides automation at scale 4) an event driven architecture that provides always on state enforcement. We describe the methodology, software architecture for the framework, and constraints for these techniques to apply to an automation problem. We overview a reference application built on this framework that provides state aware system provisioning and node lifecycle management, highlighting key advantages. We conclude with a discussion of current and future applications.


Weed Recognition using Deep Learning Techniques on Class imbalanced Imagery. Most weed species can adversely impact agricultural productivity by competing for nutrients required by high value crops. Manual weeding is not practical for large cropping areas. Many studies have been undertaken to develop automatic weed management systems for agricultural crops. In this process, one of the major tasks is to recognise the weeds from images. However, weed recognition is a challenging task. It is because weed and crop plants can be similar in colour, texture and shape which can be exacerbated further by the imaging conditions, geographic or weather conditions when the images are recorded. Advanced machine learning techniques can be used to recognise weeds from imagery. In this paper, we have investigated five state of the art deep neural networks, namely VGG16, ResNet 50, Inception V3, Inception ResNet v2 and MobileNetV2, and evaluated their performance for weed recognition. We have used several experimental settings and multiple dataset combinations. In particular, we constructed a large weed crop dataset by combining several smaller datasets, mitigating class imbalance by data augmentation, and using this dataset in benchmarking the deep neural networks. We investigated the use of transfer learning techniques by preserving the pre trained weights for extracting the features and fine tuning them using the images of crop and weed datasets. We found that VGG16 performed better than others on small scale datasets, while ResNet 50 performed better than other deep networks on the large combined dataset.


Siegel Zeros and Sarnak's Conjecture. Assuming the existence of Siegel zeros, we prove that there exists an increasing sequence of positive integers for which Chowla's Conjecture on k point correlations of the Liouville function holds. This extends work of Germ 'an and K 'atai, where they studied the case k 2 under identical hypotheses. An immediate corollary, which follows from a well known argument due to Sarnak, is that Sarnak's Conjecture on M "obius disjointness holds. More precisely, assuming the existence of Siegel zeros, there exists a subsequence of the natural numbers for which the Liouville function is asymptotically orthogonal to any sequence of topological entropy zero.


On Clusters that are Separated but Large. renewcommand Re mathbb R Given a set P of n points in Re d , consider the problem of computing k subsets of P that form clusters that are well separated from each other, and each of them is large (cardinality wise). We provide tight upper and lower bounds, and corresponding algorithms, on the quality of separation, and the size of the clusters that can be computed, as a function of n,d,k,s , and Phi , where s is the desired separation, and Phi is the spread of the point set P .


Anti Adversarially Manipulated Attributions for Weakly and Semi Supervised Semantic Segmentation. Weakly supervised semantic segmentation produces a pixel level localization from a classifier, but it is likely to restrict its focus to a small discriminative region of the target object. AdvCAM is an attribution map of an image that is manipulated to increase the classification score. This manipulation is realized in an anti adversarial manner, which perturbs the images along pixel gradients in the opposite direction from those used in an adversarial attack. It forces regions initially considered not to be discriminative to become involved in subsequent classifications, and produces attribution maps that successively identify more regions of the target object. In addition, we introduce a new regularization procedure that inhibits the incorrect attribution of regions unrelated to the target object and limits the attributions of the regions that already have high scores. On PASCAL VOC 2012 test images, we achieve mIoUs of 68.0 and 76.9 for weakly and semi supervised semantic segmentation respectively, which represent a new state of the art.


Precise, Sub Nanosecond, and High Voltage Switching of Complex Loads Enabled by Gallium Nitride Electronics. In this work, we report the use of commercial Gallium Nitride (GaN) power electronics to precisely switch complex distributed loads, such as electron lenses and deflectors, without impedance matching. Depending on the chosen GaN field effect transistor (GaNFET) and driver, these GaN pulsers are capable of generating pulses ranging from 100 650 V and 5 60 A in 0.25 8 ns using simple designs with easy control, few nanosecond propagation delays, and MHz repetition rates. We experimentally demonstrate a simple 250 ps, 100 V pulser measured by a directly coupled 2 GHz oscilloscope. By introducing resistive dampening, we can eliminate ringing to allow for precise 100 V transitions that complete a 10 V to 90 V transition in 1.5 ns, limited primarily by the inductance of the oscilloscope measurement path. The performance of the pulser attached to various load structures is simulated, demonstrating the possibility of even faster switching of internal fields in these loads. These circuits also have 0.25 cm mathrm 2 active regions and 1 W power dissipation, enabling their integration into a wide variety of environments and apparatus. The proximity of the GaNFETs to the load due to this integration minimizes parasitic quantities that slow switching as well as remove the need to match from 50 Omega lines by allowing for a lumped element approximation small loads. We expect these GaN pulsers to have broad application in fields such as optics, nuclear sciences, charged particle optics, and atomic physics that require nanosecond, high voltage transitions.


Complete Characterization of Fuchsian groups in terms of invariant laminations. In a paper of the first author, he proposed a program to study groups acting faithfully on S 1 in terms of the numbers of invariant laminations. In the paper, roughly speaking, he also showed that a torsion free discrete subgroup of the orientation preserving circle homeomorphism group operatorname Homeo (S 1) is a Fuchsian group if and only if it admits three different very full invariant laminations that satisfy a kind of transversality condition. The purpose of this article is to generalize the result to the case of general Fuchsian groups without torsion free assumption while providing more complete details of the argument. Also, we give a structure theorem for complete 2 dimensional hyperbolic orbifolds, including the case of infinite type, to construct laminations on the orbifolds.


Using Machine Learning Predictions to Speed up Dijkstra's Shortest Path Algorithm. We study the use of machine learning techniques to solve a fundamental shortest path problem, which is also known as the single source many targets shortest path problem (SSMTSP). Given a directed graph with non negative edge weights, our goal is to compute a shortest path from a given source node to any of several designated target nodes. Basically, our idea is to combine a machine learning approach with an adapted version of Dijkstra's algorithm to solve this problem Based on the trace of Dijkstra's algorithm, we design a neural network that predicts the shortest path distance after only a few iterations. The prediction is then used to prune the search space explored by Dijkstra's algorithm, which allows us to save a significant fraction of operations on the underlying priority queue. Crucially, our approach always computes the exact shortest path distances, even if the prediction is inaccurate, and never uses more queue operations than the standard algorithm. In fact, we are able to prove a lower bound on the number of queue operations saved by our new algorithm, which depends on the accuracy of the prediction. Our bound applies to arbitrary graphs as long as (some of) the edge weights are drawn at random. Our experimental findings on random graphs confirm these bounds and show that the actual savings are oftentimes significantly higher.


A High Performance Sparse Tensor Algebra Compiler in Multi Level IR. Tensor algebra is widely used in many applications, such as scientific computing, machine learning, and data analytics. The tensors represented real world data are usually large and sparse. There are tens of storage formats designed for sparse matrices and or tensors and the performance of sparse tensor operations depends on a particular architecture and or selected sparse format, which makes it challenging to implement and optimize every tensor operation of interest and transfer the code from one architecture to another. We propose a tensor algebra domain specific language (DSL) and compiler infrastructure to automatically generate kernels for mixed sparse dense tensor algebra operations, named COMET. The proposed DSL provides high level programming abstractions that resemble the familiar Einstein notation to represent tensor algebra operations. The compiler performs code optimizations and transformations for efficient code generation while covering a wide range of tensor storage formats. COMET compiler also leverages data reordering to improve spatial or temporal locality for better performance. Our results show that the performance of automatically generated kernels outperforms the state of the art sparse tensor algebra compiler, with up to 20.92x, 6.39x, and 13.9x performance improvement, for parallel SpMV, SpMM, and TTM over TACO, respectively.


On finite subnormal Cayley graphs. In this paper we introduce and study a type of Cayley graph subnormal Cayley graph. We prove that a subnormal 2 arc transitive Cayley graph is a normal Cayley graph or a normal cover of a complete bipartite graph K p d,p d with p prime. Then we obtain a generic method for constructing half symmetric (namely edge transitive but not arc transitive) Cayley graphs.


Resolved and subgrid scale crossing trajectory effects in Eulerian large eddy simulations of polydisperse droplet transport. We study the dispersion characteristics of slightly buoyant droplets in a turbulent jet using large eddy simulations (LES). The droplet number density fields are represented using an Eulerian approach with the dispersed phase modelled using the Fast Eulerian method (Ferry Balachandar 2001) that includes the droplet rise velocity. Radial concentration profiles and turbulent concentration fluxes for droplets of different sizes are analyzed to quantify the "trajectory crossing effect", when relative motions between particles and turbulent eddies tend to reduce turbulent diffusion. For finer LES grid resolutions, the model captures the differential, size based dispersion characteristics of the droplets with the transverse dispersion of the larger droplet sizes suppressed, since trajectory crossing effects are explicitly resolved in LES. We examine a similarity solution model for the size dependent radial concentration profiles based on a modified Schmidt number derived from the theory of turbulent diffusion of particles in the atmosphere proposed by Csanady 1963. The results are validated with the high resolution LES data and show good agreement. Then, the size dependent Schmidt number model is reformulated as a model for unresolved subgrid scale trajectory crossing effects and used to calculate the subgrid concentration flux in a coarse LES of a turbulent jet, with slightly buoyant droplets injected at the centerline in the self similar region of the jet. The results are compared to a simulation with higher grid resolution and a coarse simulation with a constant Schmidt number SGS model. We find that the subgrid model enhances the prediction accuracy of the concentration profiles and turbulent concentration flux for the coarse LES.


Argentina Atomic Power. 70 years after the most spectacular announcement a dream, a disappointment and the origins of national nuclear development. "On February 16, 1951, at the atomic energy pilot plant on Huemul Island, San Carlos de Bariloche, thermonuclear reactions were carried out under control conditions on a technical scale." This is how Gral. Peron announced, on March 24, 1951, the amazing result of what became known as the Huemul Project. In this article we review that story of misadventures that, despite its extravagant development and announced end, came to mean the beginning of Argentine nuclear development.


Remote Learners, Home Makers How Digital Fabrication Was Taught Online During a Pandemic. Digital fabrication courses that relied on physical makerspaces were severely disrupted by COVID 19. As universities shut down in Spring 2020, instructors developed new models for digital fabrication at a distance. Through interviews with faculty and students and examination of course materials, we recount the experiences of eight remote digital fabrication courses. We found that learning with hobbyist equipment and online social networks could emulate using industrial equipment in shared workshops. Furthermore, at home digital fabrication offered unique learning opportunities including more iteration, machine tuning, and maintenance. These opportunities depended on new forms of labor and varied based on student living situations. Our findings have implications for remote and in person digital fabrication instruction. They indicate how access to tools was important, but not as critical as providing opportunities for iteration they show how remote fabrication exacerbated student inequities and they suggest strategies for evaluating trade offs in remote fabrication models with respect to learning objectives.


The "Shut the f k up" Phenomenon Characterizing Incivility in Open Source Code Review Discussions. Code review is an important quality assurance activity for software development. Code review discussions among developers and maintainers can be heated and sometimes involve personal attacks and unnecessary disrespectful comments, demonstrating, therefore, incivility. Although incivility in public discussions has received increasing attention from researchers in different domains, the knowledge about the characteristics, causes, and consequences of uncivil communication is still very limited in the context of software development, and more specifically, code review. To address this gap in the literature, we leverage the mature social construct of incivility as a lens to understand confrontational conflicts in open source code review discussions. For that, we conducted a qualitative analysis on 1,545 emails from the Linux Kernel Mailing List (LKML) that were associated with rejected changes. We found that more than half 66.66 of the non technical emails included uncivil features. Particularly, frustration, name calling, and impatience are the most frequent features in uncivil emails. We also found that there are civil alternatives to address arguments, while uncivil comments can potentially be made by any people when discussing any topic. Finally, we identified various causes and consequences of such uncivil communication. Our work serves as the first study about the phenomenon of in(civility) in open source software development, paving the road for a new field of research about collaboration and communication in the context of software engineering activities.


Secure Artificial Intelligence of Things for Implicit Group Recommendations. The emergence of Artificial Intelligence of Things (AIoT) has provided novel insights for many social computing applications such as group recommender systems. As distance among people has been greatly shortened, it has been a more general demand to provide personalized services to groups instead of individuals. In order to capture group level preference features from individuals, existing methods were mostly established via aggregation and face two aspects of challenges secure data management workflow is absent, and implicit preference feedbacks is ignored. To tackle current difficulties, this paper proposes secure Artificial Intelligence of Things for implicit Group Recommendations (SAIoT GR). As for hardware module, a secure IoT structure is developed as the bottom support platform. As for software module, collaborative Bayesian network model and non cooperative game are can be introduced as algorithms. Such a secure AIoT architecture is able to maximize the advantages of the two modules. In addition, a large number of experiments are carried out to evaluate the performance of the SAIoT GR in terms of efficiency and robustness.


Compositional Processing Emerges in Neural Networks Solving Math Problems. A longstanding question in cognitive science concerns the learning mechanisms underlying compositionality in human cognition. Humans can infer the structured relationships (e.g., grammatical rules) implicit in their sensory observations (e.g., auditory speech), and use this knowledge to guide the composition of simpler meanings into complex wholes. Recent progress in artificial neural networks has shown that when large models are trained on enough linguistic data, grammatical structure emerges in their representations. We extend this work to the domain of mathematical reasoning, where it is possible to formulate precise hypotheses about how meanings (e.g., the quantities corresponding to numerals) should be composed according to structured rules (e.g., order of operations). Our work shows that neural networks are not only able to infer something about the structured relationships implicit in their training data, but can also deploy this knowledge to guide the composition of individual meanings into composite wholes.


Weak strong uniqueness principle for compressible barotropic self gravitating fluids. The aim of this work is to prove the weak strong uniqueness principle for the compressible Navier Stokes Poisson system on an exterior domain, with an isentropic pressure of the type p( varrho) a varrho gamma and allowing the density to be close or equal to zero. In particular, the result will be first obtained for an adiabatic exponent gamma in 9 5,2 and afterwards, this range will be slightly enlarged via pressure estimates "up to the boundary", deduced relaying on boundedness of a proper singular integral operator.


Proof of non convergence of the short maturity expansion for the SABR model. We study the convergence properties of the short maturity expansion of option prices in the uncorrelated log normal ( beta 1 ) SABR model. In this model the option time value can be represented as an integral of the form V(T) int 0 infty e frac u 2 2T g(u) du with g(u) a "payoff function" which is given by an integral over the McKean kernel G(s,t) . We study the analyticity properties of the function g(u) in the complex u plane and show that it is holomorphic in the strip Im(u) pi . Using this result we show that the T series expansion of V(T) and implied volatility are asymptotic (non convergent for any T 0 ). In a certain limit which can be defined either as the large volatility limit sigma 0 to infty at fixed omega 1 , or the small vol of vol limit omega to 0 limit at fixed omega sigma 0 , the short maturity T expansion for the implied volatility has a finite convergence radius T c frac 1.32 omega sigma 0 .


Boundedness of bilinear pseudo differential operators of S 0,0 type in Wiener amalgam spaces and in Lebesgue spaces. We extend and improve the known results about the boundedness of the bilinear pseudo differential operators with symbols in the bilinear H "ormander class BS m 0,0 ( mathbb R n) . We consider wider classes of symbols and improve estimates for the corresponding operators. A key idea is to consider the operators in Wiener amalgam spaces.


General Compound Hawkes Processes for Mid Price Prediction. High frequency financial data is burdened by a level of randomness that is unavoidable and obfuscates the task of modelling. This idea is reflected in the intraday evolution of limit orders book data for many financial assets and suggests several justifications for the use of stochastic models. For instance, the arbitrary distribution of inter arrival times and the subsequent dependence structure between consecutive book events. This has lead to the development of many stochastic models for the dynamics of limit order books. In this paper we look to examine the adaptability of one family of such models, the General Compound Hawkes Process (GCHP) models, to new data and new tasks. We further focus on the prediction problem for the mid price within a limit order book and the practical applications of these stochastic models, which is the main contribution of this paper. To this end we examine the use of the GCHP for predicting the direction and volatility of futures and stock data and discuss possible extensions of the model to help improve its predictive capabilities.


Affine geometry and Frobenius algebra. The associativity of the multiplication on a Frobenius manifold is equivalent to the WDVV equation of a symmetric cubic form in flat coordinates. Frobenius manifold could be regarded a very special type of statistical manifold. There is a natural commutative product on each tangent space of a statistical manifold. We show that it is associative, hence making it into a manifold with Frobenius algebra structure, if and only if the sectional K curvature vanishes. In other words, WDVV equation is equivalent to zero sectional K curvature. This gives a curvature interpretation for WDVV equation.


Cone Types, Automata, and Regular Partitions in Coxeter Groups. In this article we introduce the notion of a textit regular partition of a Coxeter group. We develop the theory of these partitions, and show that the class of regular partitions is essentially equivalent to the class of automata (not necessarily finite state) recognising the language of reduced words in the Coxeter group. As an application of this theory we prove that each cone type in a Coxeter group has a unique minimal length representative. This result can be seen as an analogue of Shi's classical result that each component of the Shi arrangement of an affine Coxeter group has a unique minimal length element. We further develop the theory of cone types in Coxeter groups by identifying the minimal set of roots required to express a cone type as an intersection of half spaces. This set of textit boundary roots is closely related to the elementary inversion sets of Brink and Howlett, and also to the notion of the base of an inversion set introduced by Dyer.


Identifying hidden coalitions in the US House of Representatives by optimally partitioning signed networks based on generalized balance. In network science, identifying optimal partitions of a signed network into internally cohesive and mutually divisive clusters based on generalized balance theory is computationally challenging. We reformulate and generalize two binary linear programming models that tackle this challenge, demonstrating their practicality by applying them them to partition networks of collaboration in the US House of Representatives. These models guarantee a globally optimal network partition and can be practically applied to signed networks containing up to 30,000 edges. In the US House context, we find that a three cluster partition is better than a conventional two cluster partition, where the otherwise hidden third coalition is composed of highly effective legislators who are ideologically aligned with the majority party.


Papaya Global Typestate Analysis of Aliased Objects Extended Version. Typestates are state machines used in object oriented programming to specify and verify correct order of method calls on an object. To avoid inconsistent object states, typestates enforce linear typing, which eliminates or at best limits aliasing. However, aliasing is an important feature in programming, and the state of the art on typestates is too restrictive if we want typestates to be adopted in real world software systems. In this paper, we present a type system for an object oriented language with typestate annotations, which allows for unrestricted aliasing, and as opposed to previous approaches it does not require linearity constraints. The typestate analysis is global and tracks objects throughout the entire program graph, which ensures that well typed programs conform and complete the declared protocols. We implement our framework in the Scala programming language and illustrate our approach using a running example that shows the interplay between typestates and aliases.


FedFm Towards a Robust Federated Learning Approach For Fault Mitigation at the Edge Nodes. Federated Learning deviates from the norm of "send data to model" to "send model to data". When used in an edge ecosystem, numerous heterogeneous edge devices collecting data through different means and connected through different network channels get involved in the training process. Failure of edge devices in such an ecosystem due to device fault or network issues is highly likely. In this paper, we first analyse the impact of the number of edge devices on an FL model and provide a strategy to select an optimal number of devices that would contribute to the model. We observe how the edge ecosystem behaves when the selected devices fail and provide a mitigation strategy to ensure a robust Federated Learning technique.


Domains with radical polynomial X ray transform. Let K be a compact convex body in mathbb R n. For any affine line L, denote widehat chi K(L) int L chi K(x)dl(x), where dl is the arc length measure, the X ray transform of the characteristic function chi K, i.e., the length of the chord K cap L. We prove that if K is bounded by a C infty real algebraic hypersurface partial K and the X ray transform widehat chi K(L) behaves, under small parallel translations of the line L to the distance t, as the m th root of a polynomial of t , for some fixed m in mathbb N, then partial K is an ellipsoid.


Ultralow Threshold, Single Mode InGaAs GaAs Multi Quantum Disk Nanowire Lasers. We present single mode nanowire (NW) lasers with ultralow threshold in the near infrared spectral range. To ensure the single mode operation, the NW diameter and length are reduced specifically to minimize the longitudinal and transverse modes of the NW cavity. Increased optical losses and reduced gain volume by the dimension reduction are compensated by excellent NW morphology and InGaAs GaAs multi quantum disks. At 5 K, a threshold low as 1.6 mu J cm2 per pulse is achieved with a resulting quality factor exceeding 6400. By further passivating the NW with an AlGaAs shell to suppress surface non radiative recombination, single mode lasing operation is obtained with a threshold of only 48 mu J cm2 per pulse at room temperature with a high characteristic temperature of 223 K and power output of 0.9 mu W. These single mode, ultralow threshold, high power output NW lasers are promising for the development of near infrared nanoscale coherent light sources for integrated photonic circuits, sensing, and spectroscopy.


Capacity Expansion in the College Admission Problem. The college admission problem plays a fundamental role in several real world allocation mechanisms such as school choice and supply chain stability. The classical framework assumes that the capacity of each college is known and fixed in advance. However, increasing the quota of even a single college would improve the overall cost of the students. In this work, we study the problem of finding the college capacity expansion that achieves the best cost of the students, subject to a cardinality constraint. First, we show that this problem is NP hard to solve, even under complete and strict preference lists. We provide an integer quadratically constrained programming formulation and study its linear reformulation. We also propose two natural heuristics A greedy algorithm and an LP based method. We empirically evaluate the performance of our approaches in a detailed computational study. We observe the practical superiority of the linearized model in comparison with its quadratic counterpart and we outline their computational limits. In terms of solution quality, we note that the allocation of a few extra spots can significantly impact the overall student satisfaction.


On Hom Nambu Poisson superalgebras structures and their representations. The purpose of this paper is to study some results of constructions on Hom Poisson superal gebras we use the representations and Rota Baxter operators. We introduce the structures ofn ary Hom Nambu Poisson superalgebras and their representations and we study relationships between Hom Poissonsuperalgebras and its inducedn ary Hom Nambu Poisson superalgebras. The same concept is given for therepresentations ofn ary Hom Nambu Poisson superalgebras.


Determination of the Autocorrelation Distribution and 2 Adic Complexity of Generalized Cyclotomic Binary Sequences of Order 2 with Period pq. The generalized cyclotomic binary sequences S S(a, b, c) with period n pq have good autocorrelation property where (a, b, c) in 0, 1 3 and p, q are distinct odd primes. For some cases, the sequences S have ideal or optimal autocorrelation. In this paper we determine the autocorrelation distribution and 2 adic complexity of the sequences S S(a, b, c) for all (a, b, c) in 0, 1 3 in a unified way by using group ring language and a version of quadratic Gauss sums valued in group ring R mathbb Z Gamma where Gamma is a cyclic group of order n .


Explicit Explore, Exploit, or Escape ( E 4 ) near optimal safety constrained reinforcement learning in polynomial time. In reinforcement learning (RL), an agent must explore an initially unknown environment in order to learn a desired behaviour. When RL agents are deployed in real world environments, safety is of primary concern. Constrained Markov decision processes (CMDPs) can provide long term safety constraints however, the agent may violate the constraints in an effort to explore its environment. This paper proposes a model based RL algorithm called Explicit Explore, Exploit, or Escape ( E 4 ), which extends the Explicit Explore or Exploit ( E 3 ) algorithm to a robust CMDP setting. E 4 explicitly separates exploitation, exploration, and escape CMDPs, allowing targeted policies for policy improvement across known states, discovery of unknown states, as well as safe return to known states. E 4 robustly optimises these policies on the worst case CMDP from a set of CMDP models consistent with the empirical observations of the deployment environment. Theoretical results show that E 4 finds a near optimal constraint satisfying policy in polynomial time whilst satisfying safety constraints throughout the learning process. We discuss robust constrained offline optimisation algorithms as well as how to incorporate uncertainty in transition dynamics of unknown states based on empirical inference and prior knowledge.


Passive scintillometer Theory and proof of concept. We propose design of a low cost passive scintillometer that measures the strength of optical turbulence by analyzing scintillation in the image of a straight edge between the two areas of uniform, but distinct brightness. Two theoretical approaches to scintillations description are developed that are based on the phase screen and rigorous path integral propagation imaging models. Asymptotic analysis of both models leads to four distinctive imaging situations. We propose two uniform approximations that cover the most promising conclusion for the passive scintillometer applications. Both the strength of scintillation and the width of the area where scintillations exist can be used to estimate the turbulence strength. We present the results of the proof of concept experiment where images of the specifically made target were taken by a consumer grade camera equipped with a telephoto lens. We describe the image processing that separates the target characteristics from the turbulence scintillations. The spatial profiles of the image variances at three spectral bands and for several apertures were calculated. As was expected, scintillations are concentrated around the sharp edge and are absent at the uniformly bright parts of the target. Observed edge scintillation variances are within the theoretical limits, and provide reasonable estimates for the turbulence structure constant across the three spectral bands. However, the width of the scintillation area and dependence on the aperture are inconsistent with the thin lens imaging theory for larger apertures. We attribute this to the Additional bench tests on bar targets revealed that the camera and lens resolution are well below the nominal thin lens diffraction limit, and a different optical setup should be used in order to exploit the spatial distribution and aperture dependence of fluctuations.


Geometric Data Augmentation Based on Feature Map Ensemble. Deep convolutional networks have become the mainstream in computer vision applications. Although CNNs have been successful in many computer vision tasks, it is not free from drawbacks. The performance of CNN is dramatically degraded by geometric transformation, such as large rotations. In this paper, we propose a novel CNN architecture that can improve the robustness against geometric transformations without modifying the existing backbones of their CNNs. The key is to enclose the existing backbone with a geometric transformation (and the corresponding reverse transformation) and a feature map ensemble. The proposed method can inherit the strengths of existing CNNs that have been presented so far. Furthermore, the proposed method can be employed in combination with state of the art data augmentation algorithms to improve their performance. We demonstrate the effectiveness of the proposed method using standard datasets such as CIFAR, CUB 200, and Mnist rot 12k.


Leveraging Static Models for Link Prediction in Temporal Knowledge Graphs. The inclusion of temporal scopes of facts in knowledge graph embedding (KGE) presents significant opportunities for improving the resulting embeddings, and consequently for increased performance in downstream applications. Yet, little research effort has focussed on this area and much of the carried out research reports only marginally improved results compared to models trained without temporal scopes (static models). Furthermore, rather than leveraging existing work on static models, they introduce new models specific to temporal knowledge graphs. We propose a novel perspective that takes advantage of the power of existing static embedding models by focussing effort on manipulating the data instead. Our method, SpliMe, draws inspiration from the field of signal processing and early work in graph embedding. We show that SpliMe competes with or outperforms the current state of the art in temporal KGE. Additionally, we uncover issues with the procedure currently used to assess the performance of static models on temporal graphs and introduce two ways to counteract them.


On the metric subgraphs of a graph. The three subgraphs of a connected graph induced by the center, annulus and periphery are called its metric subgraphs. The main results are as follows. (1) There exists a graph of order n whose metric subgraphs are all paths if and only if n ge 13 and the smallest size of such a graph of order 13 is 22 (2) there exists a graph of order n whose metric subgraphs are all cycles if and only if n ge 15, and there are exactly three such graphs of order 15 (3) for every integer k ge 3, we determine the possible orders for the existence of a graph whose metric subgraphs are all connected k regular graphs (4) there exists a graph of order n whose metric subgraphs are connected and pairwise isomorphic if and only if n ge 24 and n is divisible by 3. An unsolved problem is posed.


Spectra for Toeplitz Operators Associated with a Constrained Subalgebra. A two point algebra is a set of bounded analytic functions on the unit disk that agree at two distinct points a,b in mathbb D . This algebra serves as a multiplier algebra for the family of Hardy Hilbert spaces H 2 t f in H 2 f(a) tf(b) , where t in mathbb C cup infty . We show that various spectra of certain Toeplitz operators acting on these spaces are connected.


Architecture and Performance Evaluation of Distributed Computation Offloading in Edge Computing. Edge computing is an emerging paradigm to enable low latency applications, like mobile augmented reality, because it takes the computation on processing devices that are closer to the users. On the other hand, the need for highly scalable execution of stateless tasks for cloud systems is driving the definition of new technologies based on serverless computing. In this paper, we propose a novel architecture where the two converge to enable low latency applications this is achieved by offloading short lived stateless tasks from the user terminals to edge nodes. Furthermore, we design a distributed algorithm that tackles the research challenge of selecting the best executor, based on real time measurements and simple, yet effective, prediction algorithms. Finally, we describe a new performance evaluation framework specifically designed for an accurate assessment of algorithms and protocols in edge computing environments, where the nodes may have very heterogeneous networking and processing capabilities. The proposed framework relies on the use of real components on lightweight virtualization mixed with simulated computation and is well suited to the analysis of several applications and network environments. Using our framework, we evaluate our proposed architecture and algorithms in small and large scale edge computing scenarios, showing that our solution achieves similar or better delay performance than a centralized solution, with far less network utilization.


Pseudo Anosov homeomorphisms of punctured non orientable surfaces with small stretch factor. We prove that in the non orientable setting, the minimal stretch factor of a pseudo Anosov homeomorphism of a surface of genus g with a fixed number of punctures is asymptotically on the order of frac 1 g . Our result adapts the work of Yazdi to non orientable surfaces. We include the details of Thurston's theory of fibered faces for non orientable 3 manifolds.


Edge but not Least Cross View Graph Pooling. Graph neural networks have emerged as a powerful model for graph representation learning to undertake graph level prediction tasks. Various graph pooling methods have been developed to coarsen an input graph into a succinct graph level representation through aggregating node embeddings obtained via graph convolution. However, most graph pooling methods are heavily node centric and are unable to fully leverage the crucial information contained in global graph structure. This paper presents a cross view graph pooling (Co Pooling) method to better exploit crucial graph structure information. The proposed Co Pooling fuses pooled representations learnt from both node view and edge view. Through cross view interaction, edge view pooling and node view pooling seamlessly reinforce each other to learn more informative graph level representations. Co Pooling has the advantage of handling various graphs with different types of node attributes. Extensive experiments on a total of 15 graph benchmark datasets validate the effectiveness of our proposed method, demonstrating its superior performance over state of the art pooling methods on both graph classification and graph regression tasks.


Generalization Through Hand Eye Coordination An Action Space for Learning Spatially Invariant Visuomotor Control. Imitation Learning (IL) is an effective framework to learn visuomotor skills from offline demonstration data. However, IL methods often fail to generalize to new scene configurations not covered by training data. On the other hand, humans can manipulate objects in varying conditions. Key to such capability is hand eye coordination, a cognitive ability that enables humans to adaptively direct their movements at task relevant objects and be invariant to the objects' absolute spatial location. In this work, we present a learnable action space, Hand eye Action Networks (HAN), that can approximate human's hand eye coordination behaviors by learning from human teleoperated demonstrations. Through a set of challenging multi stage manipulation tasks, we show that a visuomotor policy equipped with HAN is able to inherit the key spatial invariance property of hand eye coordination and achieve zero shot generalization to new scene configurations. Additional materials available at https sites.google.com stanford.edu han


Summing mu(n) a faster elementary algorithm. We present a new elementary algorithm that takes mathrm time O epsilon left(x frac 3 5 ( log x) frac 3 5 epsilon right) mathrm and mathrm space O left(x frac 3 10 ( log x) frac 13 10 right) for computing M(x) sum n leq x mu(n), where mu(n) is the M " o bius function. This is the first improvement in the exponent of x for an elementary algorithm since 1985. We also show that it is possible to reduce space consumption to O(x 1 5 ( log x) 5 3 ) by the use of (Helfgott, 2020 arxiv.org 1712.09130), at the cost of letting time rise to the order of x 3 5 ( log x) .


Exponential stability analysis for a class of switched nonlinear time varying functional differential systems. This paper proposes a unified approach for studying global exponential stability of a general class of switched systems described by time varying nonlinear functional differential equations. Some new delay independent criteria of global exponential stability are established for this class of systems under arbitrary switching which satisfies some assumptions on the average dwell time. The obtained criteria are shown to cover and improve many previously known results, including, in particular, sufficient conditions for absolute exponential stability of switched time delay systems with sector nonlinearities. Some simple examples are given to illustrate the proposed method.


Vector fields and differential forms on the orbit space of a proper action. In this paper we study differential forms and vector fields on the orbit space of a proper action of a Lie group on a smooth manifold, defining them as multilinear maps on the generators of infinitesimal diffeomorphisms, respectively. This yields an intrinsic view of vector fields and differential forms on the orbit space.


The dynamics of discontinuities in a cylindrical energy deposition based on a nanosecond discharge. The focusing of a secondary shock wave was experimentally recorded during the implementation of an extended nanosecond high current discharge of a cylindrical configuration in air. Using high speed shadowgraph recording (up to 300 000 frames s) of the emerging unsteady flow, cylindrically symmetric gas dynamic discontinuities were visualized a diverging shock wave moving from the discharge plasma boundary, a diverging contact discontinuity separating the shock heated gas from the nonequilibrium region excited by the discharge plasma, and also a converging compression wave (secondary shock wave) moving from the contact surface to the axis of symmetry and focusing on it 50 60 microseconds after discharge with the formation of a heated long lived cord.


Spatial temporal Conv sequence Learning with Accident Encoding for Traffic Flow Prediction. In an intelligent transportation system, the key problem of traffic forecasting is how to extract periodic temporal dependencies and complex spatial correlations. Current state of the art methods for predicting traffic flow are based on graph architectures and sequence learning models, but they do not fully exploit dynamic spatial temporal information in the traffic system. Specifically, the temporal dependencies in the short range are diluted by recurrent neural networks. Moreover, local spatial information is also ignored by existing sequence models, because their convolution operation uses global average pooling. Besides, accidents may occur during object transition, which will cause congestion in the real world and further decrease prediction accuracy. To overcome these challenges, we propose Spatial Temporal Conv sequence Learning (STCL), where a focused temporal block uses unidirectional convolution to capture short term periodic temporal dependencies effectively, and a patial temporal fusion module is responsible for extracting dependencies of interactions and decreasing the feature dimensions. Moreover, as the accidents features have an impact on local traffic congestion, we employ position encoding to detect anomalies in complex traffic situations. We have conducted a large number of experiments on real world tasks and verified the effectiveness of our proposed method.


Multi frame Collaboration for Effective Endoscopic Video Polyp Detection via Spatial Temporal Feature Transformation. Precise localization of polyp is crucial for early cancer screening in gastrointestinal endoscopy. Videos given by endoscopy bring both richer contextual information as well as more challenges than still images. The camera moving situation, instead of the common camera fixed object moving one, leads to significant background variation between frames. Severe internal artifacts (e.g. water flow in the human body, specular reflection by tissues) can make the quality of adjacent frames vary considerately. These factors hinder a video based model to effectively aggregate features from neighborhood frames and give better predictions. In this paper, we present Spatial Temporal Feature Transformation (STFT), a multi frame collaborative framework to address these issues. Spatially, STFT mitigates inter frame variations in the camera moving situation with feature alignment by proposal guided deformable convolutions. Temporally, STFT proposes a channel aware attention module to simultaneously estimate the quality and correlation of adjacent frames for adaptive feature aggregation. Empirical studies and superior results demonstrate the effectiveness and stability of our method. For example, STFT improves the still image baseline FCOS by 10.6 and 20.6 on the comprehensive F1 score of the polyp localization task in CVC Clinic and ASUMayo datasets, respectively, and outperforms the state of the art video based method by 3.6 and 8.0 , respectively. Code is available at url https github.com lingyunwu14 STFT .


Understanding Developers Well Being and Productivity A Longitudinal Analysis of the COVID 19 Pandemic. COVID 19 has likely been the most disruptive event at a global scale the world experienced since WWII. Our discipline never experienced such a phenomenon, whereby software engineers were forced to abruptly work from home. Nearly every developer started new working habits and organizational routines, while trying to stay mentally healthy and productive during the lockdowns. We are now starting to realize that some of these new habits and routines may stick with us in the future. Therefore, it is of importance to understand how we have worked from home so far. We investigated whether 15 psychological, social, and situational variables such as quality of social contacts or loneliness predict software engineers' well being and productivity across a four wave longitudinal study of over 14 months. Additionally, we tested whether there were changes in any of these variables across time. We found that developers' well being and quality of social contacts improved between April 2020 and July 2021, while their emotional loneliness went down. Other variables, such as productivity and boredom have not changed. We further found that developers' stress measured in May 2020 negatively predicted their well being 14 months later, even after controlling for many other variables. Finally, comparisons of women and men, as well as between developers residing in the UK and USA, were not statistically different but revealed substantial similarities.


Making Better Use of Bilingual Information for Cross Lingual AMR Parsing. Abstract Meaning Representation (AMR) is a rooted, labeled, acyclic graph representing the semantics of natural language. As previous works show, although AMR is designed for English at first, it can also represent semantics in other languages. However, they find that concepts in their predicted AMR graphs are less specific. We argue that the misprediction of concepts is due to the high relevance between English tokens and AMR concepts. In this work, we introduce bilingual input, namely the translated texts as well as non English texts, in order to enable the model to predict more accurate concepts. Besides, we also introduce an auxiliary task, requiring the decoder to predict the English sequences at the same time. The auxiliary task can help the decoder understand what exactly the corresponding English tokens are. Our proposed cross lingual AMR parser surpasses previous state of the art parser by 10.6 points on Smatch F1 score. The ablation study also demonstrates the efficacy of our proposed modules.


Spectral control of high order harmonics through non linear propagation effects. High harmonic generation (HHG) in crystals has revealed a wealth of perspectives such as all optical mapping of the electronic band structure, ultrafast quantum information and the creation of novel all solid state attosecond sources. Significant efforts have been made to understand the microscopic aspects of HHG in crystals, whereas the macroscopic effects, such as non linear propagation effects of the driving pulse inside the dense solid media and its impact on the HHG process is often overlooked. In this work, we study macroscopic effects by comparing two materials with distinct optical properties, silicon (Si) and zinc oxide (ZnO). By scanning the focal position of 85 fs, 2.123 mu m wavelength pulses inside the crystals (Z scan) we reveal spectral shifts in the generated harmonics. We interpret the overall blueshift of the emitted harmonic spectrum as an imprint of the driving field spectral modulation occurring during the propagation inside the crystal. This is supported with numerical simulations. This study demonstrates that through manipulation of the fundamental driving field through non linear propagation effects, precise control of the emitted HHG spectrum in solids can be realised. This method could offer a robust way to tailor HHG spectra for a range of spectroscopic applications.


Odd moments for the trace of Frobenius and the Sato Tate conjecture in arithmetic progressions. In this paper, we consider the moments of the trace of Frobenius of elliptic curves if the trace is restricted to a fixed arithmetic progression. We determine the asymptotic behavior for the ratio of the (2k 1) th moment to the zeroeth moment as the size of the finite field mathbb F p r goes to infinity. These results follow from similar asymptotic formulas relating sums and moments of Hurwitz class numbers where the sums are restricted to certain arithmetic progressions. As an application, we prove that the distribution of the trace of Frobenius in arithmetic progressions is equidistributed with respect to the Sato Tate measure.


Optimum Risk Portfolio and Eigen Portfolio A Comparative Analysis Using Selected Stocks from the Indian Stock Market. Designing an optimum portfolio that allocates weights to its constituent stocks in a way that achieves the best trade off between the return and the risk is a challenging research problem. The classical mean variance theory of portfolio proposed by Markowitz is found to perform sub optimally on the real world stock market data since the error in estimation for the expected returns adversely affects the performance of the portfolio. This paper presents three approaches to portfolio design, viz, the minimum risk portfolio, the optimum risk portfolio, and the Eigen portfolio, for seven important sectors of the Indian stock market. The daily historical prices of the stocks are scraped from Yahoo Finance website from January 1, 2016, to December 31, 2020. Three portfolios are built for each of the seven sectors chosen for this study, and the portfolios are analyzed on the training data based on several metrics such as annualized return and risk, weights assigned to the constituent stocks, the correlation heatmaps, and the principal components of the Eigen portfolios. Finally, the optimum risk portfolios and the Eigen portfolios for all sectors are tested on their return over a period of a six month period. The performances of the portfolios are compared and the portfolio yielding the higher return for each sector is identified.


Hermitian Adjacency Matrices of Mixed Graphs. The traditional adjacency matrix of a mixed graph is not symmetric in general, hence its eigenvalues may be not real. To overcome this obstacle, several authors have recently defined and studied various Hermitian adjacency matrices of digraphs or mixed graphs. The usual idea is to choose a complex number alpha in mathbb C with vert alpha vert 1 . The traditional adjacency matrix is modified such that the value alpha (resp. bar alpha ) replaces the previous value at position (i,j) whenever the only edge between the vertices i and j is an arc from i to j (resp. from j to i ). So far, the choices alpha i and alpha e frac pi 3 i have attracted particular interest. It has even been argued that the latter choice might be ideal, in a certain sense. The present paper extends and generalizes previous results and, moreover, proposes another particular choice for alpha that appears just as favourable, if not more.


Ab Initio Molecular Dynamics with Screened Lorentz Forces. Part II. Efficient Propagators and Rovibrational Spectra in Strong Magnetic Fields. Strong magnetic fields have a large impact on the dynamics of molecules. In addition to the changes of the electronic structure, the nuclei are exposed to the Lorentz force with the magnetic field being screened by the electrons. In this work, we explore these effects using ab initio molecular dynamics simulations based on an effective Hamiltonian calculated at the Hartree Fock level of theory. To correctly include these non conservative forces in the dynamics, we have designed a series of novel propagators that show both good efficiency and stability in test cases. As a first application, we analyze simulations of He and H 2 at two field strengths characteristic of magnetic white dwarfs (0.1 B 0 2.35 times 10 4 T and B 0 2.35 times 10 5 T). While the He simulations clearly demonstrate the importance of electron screening of the Lorentz force in the dynamics, the extracted rovibrational spectra of H 2 reveal a number of fascinating features not observed in the field free case couplings of rotations vibrations with the cyclotron rotation, overtones with unusual selection rules, and hindered rotations that transmute into librations with increasing field strength. We conclude that our presented framework is a powerful tool to investigate molecules in these extreme environments.


Continuous Time Fitted Value Iteration for Robust Policies. Solving the Hamilton Jacobi Bellman equation is important in many domains including control, robotics and economics. Especially for continuous control, solving this differential equation and its extension the Hamilton Jacobi Isaacs equation, is important as it yields the optimal policy that achieves the maximum reward on a give task. In the case of the Hamilton Jacobi Isaacs equation, which includes an adversary controlling the environment and minimizing the reward, the obtained policy is also robust to perturbations of the dynamics. In this paper we propose continuous fitted value iteration (cFVI) and robust fitted value iteration (rFVI). These algorithms leverage the non linear control affine dynamics and separable state and action reward of many continuous control problems to derive the optimal policy and optimal adversary in closed form. This analytic expression simplifies the differential equations and enables us to solve for the optimal value function using value iteration for continuous actions and states as well as the adversarial case. Notably, the resulting algorithms do not require discretization of states or actions. We apply the resulting algorithms to the Furuta pendulum and cartpole. We show that both algorithms obtain the optimal policy. The robustness Sim2Real experiments on the physical systems show that the policies successfully achieve the task in the real world. When changing the masses of the pendulum, we observe that robust value iteration is more robust compared to deep reinforcement learning algorithm and the non robust version of the algorithm. Videos of the experiments are shown at https sites.google.com view rfvi


Polynomials of least deviation from zero in Sobolev p norm. The first part of this paper complements previous results on characterization of polynomials of least deviation from zero in Sobolev p norm ( 1 p infty ) for the case p 1 . Some relevant examples are indicated. The second part deals with the location of zeros of polynomials of least deviation in discrete Sobolev p norm. The asymptotic distribution of zeros is established on general conditions. Under some order restriction in the discrete part, we prove that, the n th polynomial of least deviation has at least n mathbf d zeros on the convex hull of the support of the measure, where mathbf d denotes the number of terms in the discrete part.


Data envelopment analysis a flexible device to assessing SMEs performance. In a context of global economy, addressing SMEs performance within a local framework appears rather a naive approach. The key drawback of such an approach stems from its restriction to socio economic factors that might lead to biased decisions regarding potential venues for performance improvement. In practice, the key objective of performance analysis consists in identifying benchmarks for best managerial practices with respect to resource allocation as well as production level setting. Conducting the analysis within a specific country, let it be a developing country, may be misleading. Although, the best of the class (benchmark) can be a valid reference for its peers within the same class, its status might not be preserved if the analysis is projected outside the borders of the class. Indeed, the likelihood for outperformance is high. In order to set targets for global competition, decision makers ought to look at the concept of performance from a broader geographical perspective, instead of confining it to a local scope. Here, we analyze, through a case study, SMEs performance within local and global production technology frameworks and we highlight the impact of the economy scope on various decisions. Data envelopment analysis (DEA) is used as a mathematical tool to support such decisions.


Multiscale decompositions of Hardy spaces. An inspiration at the origin of wavelet analysis (when Grossmann, Morlet, Meyer and collaborators were interacting and exploring versions of multiscale representations) was provided by the analysis of holomorphic signals, for which the images of the phase of Cauchy wavelets were remarkable in their ability to reveal intricate singularities or dynamic structures, such as instantaneous frequency jumps in musical recordings. Our goal is to follow their seminal work and introduce recent developments in nonlinear analysis. In particular we sketch methods extending conventional Fourier analysis, exploiting both phase and amplitudes of holomorphic functions. The Blaschke factors are a key ingredient, in building analytic tools, starting with the Malmquist Takenaka orthonormal bases of the Hardy space, continuing with "best" adapted bases obtained through phase unwinding, and concluding with relations to composition of Blaschke products and their dynamics. We also remark that the phase of a Blaschke product is a one layer neural net with arctan as an activation sigmoid and that the composition is a "Deep Neural Net" whose depth is the number of compositions. Our results provide a wealth of related library of orthonormal bases.


Selective Pseudo label Clustering. Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering techniques. As clustering is typically performed in a purely unsupervised setting, where no training labels are available, the question then arises as to how the DNN feature extractor can be trained. The most accurate existing approaches combine the training of the DNN with the clustering objective, so that information from the clustering process can be used to update the DNN to produce better features for clustering. One problem with this approach is that these pseudo labels'' produced by the clustering algorithm are noisy, and any errors that they contain will hurt the training of the DNN. In this paper, we propose selective pseudo label clustering, which uses only the most confident pseudo labels for training the DNN. We formally prove the performance gains under certain conditions. Applied to the task of image clustering, the new approach achieves a state of the art performance on three popular image datasets. Code is available at https github.com Lou1sM clustering.


Manifestly Phased Communication via Shared Session Types. Session types denote message protocols between concurrent processes, allowing a type safe expression of inter process communication. Although previous work demonstrate a well defined notion of subtyping where processes have different perceptions of the protocol, these formulations were limited to linear session types where each channel of communication has a unique provider and client. In this paper, we extend subtyping to shared session types where channels can now have multiple clients instead of a single client. We demonstrate that this generalization can statically capture protocol requirements that span multiple phases of interactions of a client with a shared service provider, something not possible in prior proposals. Moreover, the phases are manifest in the type of the client.


Enabling rapid and accurate construction of CCSD(T) level potential energy surface of large molecules using molecular tailoring approach. The construction of the potential energy surface (PES) of even a medium sized molecule employing correlated theory, such as CCSD(T), is an arduous task due to the high computational cost. In this Letter, we report the possibility of efficient construction of such a PES employing the molecular tailoring approach (MTA) on off the shelf hardware. The full calculation (FC) as well as MTA energies at CCSD(T) aug cc pVTZ level for three test molecules, viz. acetylacetone, N methyacetamide, and tropolone are reported. All the MTA energies are in excellent agreement with their FC counterparts (typical error being sub millihartree) with a time advantage factor of 3 to 5. The energy barrier from the ground to transition state is accurately captured. Further, the accuracy and efficiency of the MTA method for estimating energy gradients at CCSD(T) level are demonstrated. This work brings out the possibility of the construction of PES for large molecules using MTA with the computational economy at a high level of theory and or basis set.


Global existence, uniform boundedness, and stabilization in a chemotaxis system with density suppressed motility and nutrient consumption. Well posedness and uniform in time boundedness of classical solutions are investigated for a three component parabolic system which describes the dynamics of a population of cells interacting with a chemoattractant and a nutrient. The former induces a chemotactic bias in the diffusive motion of the cells and is accounted for by a density suppressed motility. Well posedness is first established for generic positive and non increasing motility functions vanishing at infinity. Growth conditions on the motility function guaranteeing the uniform in time boundedness of solutions are next identified. Finally, for sublinearly decaying motility functions, convergence to a spatially homogeneous steady state is shown, with an exponential rate for consumption rates behaving linearly near zero.


Optimizations for Hardware in the Loop Based V2X Validation Platforms. Connectivity and automation are increasingly getting importance in the automotive industry, which is observing a radical change from vehicles driven by humans to fully automated and remotely controlled ones. The test and validation of all the related devices and applications is thus becoming a crucial aspect this is raising the interest on hardware in the loop (HiL) platforms which reduce the need for complicated field trials, thus limiting the costs and delay added to the process. With reference to the test and validation of vehicle to everything (V2X) communications aspects, and assuming either sidelink LTE 5GV2X or IEEE 802.11p bd technologies, in this work we focus on the real time HiL simulation of the information exchanged by one vehicle under test and the surrounding, simulated, objects. Such exchange must be reproduced in a time efficient manner, with elaborations done fast enough to allow testing the applications in real time. More precisely, we discuss the simulation of nonideal positioning and channel propagation taking into account current impairments. We also provide details on optimization solutions that allowed us to trade off minor loss in accuracy with a significant reduction of the computation time burden, reaching up to more than one order of magnitude speed increase in our experiments.


Order Optimal One Shot Federated Learning for non Convex Loss Functions. We consider the problem of federated learning in a one shot setting in which there are m machines, each observing n samples function from an unknown distribution on non convex loss functions. Let F 1,1 d to mathbb R be the expected loss function with respect to this unknown distribution. The goal is to find an estimate of the minimizer of F . Based on its observations, each machine generates a signal of bounded length B and sends it to a server. The sever collects signals of all machines and outputs an estimate of the minimizer of F . We propose a distributed learning algorithm, called Multi Resolution Estimator for Non Convex loss function (MRE NC), whose expected error is bounded by max big(1 sqrt n (mB) 1 d , 1 sqrt mn big) , up to polylogarithmic factors. We also provide a matching lower bound on the performance of any algorithm, showing that MRE NC is order optimal in terms of n and m . Experiments on synthetic and real data show the effectiveness of MRE NC in distributed learning of model's parameters for non convex loss functions.


Isolating special solutions in the delta method The case of a diagonal cubic equation in evenly many variables over mathbb Q . Let F in mathbb Z boldsymbol x be a diagonal cubic form in m in 4,6 variables. In the "standard cubic delta method" of Duke Friedlander Iwaniec and Heath Brown, we extract a weighted count of certain special solutions boldsymbol x in mathbb Z m to F( boldsymbol x ) 0 with boldsymbol x ll X , asymptotically as X to infty , by "restricting attention" to the set of vectors boldsymbol c neq boldsymbol 0 (in the "dual lattice" mathbb Z m ) for which the (projective) hyperplane section F( boldsymbol x ) boldsymbol c cdot boldsymbol x 0 is singular over mathbb C . In an appendix, we explain how boldsymbol c boldsymbol 0 instead isolates the singular series, at least for m geq 5 . We also highlight a decay property that helps to "separate" boldsymbol c boldsymbol 0 from the aforementioned tuples boldsymbol c neq boldsymbol 0 when m 6 , in the spirit of a conjecture of Hooley. Our main results are unconditional. Heath Brown's past work actually already includes our main theorem for m 4 , but not for m 6 . Our overall strategy seems new, and also suggests a framework that may allow for non diagonal smooth F in the future.


On Compositional Generalization of Neural Machine Translation. Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks such as WMT. However, there still exist significant issues such as robustness, domain generalization, etc. In this paper, we study NMT models from the perspective of compositional generalization by building a benchmark dataset, CoGnition, consisting of 216k clean and consistent sentence pairs. We quantitatively analyze effects of various factors using compound translation error rate, then demonstrate that the NMT model fails badly on compositional generalization, although it performs remarkably well under traditional metrics.


Network Compression for Machine Learnt Fluid Simulations. Multi scale, multi fidelity numerical simulations form the pillar of scientific applications related to numerically modeling fluids. However, simulating the fluid behavior characterized by the non linear Navier Stokes equations are often times computational expensive. Physics informed machine learning methods is a viable alternative and as such has seen great interest in the community refer to Kutz (2017) Brunton et al. (2020) Duraisamy et al. (2019) for a detailed review on this topic . For full physics emulators, the cost of network inference is often trivial. However, in the current paradigm of data driven fluid mechanics models are built as surrogates for complex sub processes. These models are then used in conjunction to the Navier Stokes solvers, which makes ML model inference an important factor in the terms of algorithmic latency. With the ever growing size of networks, and often times overparameterization, exploring effective network compression techniques becomes not only relevant but critical for engineering systems design. In this study, we explore the applicability of pruning and quantization (FP32 to int8) methods for one such application relevant to modeling fluid turbulence. Post compression, we demonstrate the improvement in the accuracy of network predictions and build intuition in the process by comparing the compressed to the original network state.


Determining the doubly slice genera of prime knots with up to 12 crossings. For a knot K , the doubly slice genus g ds (K) is the minimal g such that K divides a closed, orientable, and unknotted surface of genus g embedded in S 4 . In this paper, we identify the doubly slice genera of 2909 of the 2977 prime knots which have a crossing number of 12 or fewer.


Performance Analysis and Window Design for Channel Estimation of OTFS Modulation. In this paper, we investigate the impacts of transmitter and receiver windows on orthogonal time frequency space (OTFS) modulation and propose a window design to improve the OTFS channel estimation performance. Assuming ideal pulse shaping filters at the transceiver, we first identify the role of window in effective channel and the reduced channel sparsity with conventional rectangular window. Then, we characterize the impacts of windowing on the effective channel estimation performance for OTFS modulation. Based on the revealed insights, we propose to apply a Dolph Chebyshev (DC) window at either the transmitter or the receiver to effectively enhance the sparsity of the effective channel. As such, the channel spread due to the fractional Doppler is significantly reduced, which leads to a lower error floor in channel estimation compared with that of the rectangular window. Simulation results verify the accuracy of the obtained analytical results and confirm the superiority of the proposed window designs in improving the channel estimation performance over the conventional rectangular or Sine windows.


Planar Surface Reconstruction from Sparse Views. The paper studies planar surface reconstruction of indoor scenes from two views with unknown camera poses. While prior approaches have successfully created object centric reconstructions of many scenes, they fail to exploit other structures, such as planes, which are typically the dominant components of indoor scenes. In this paper, we reconstruct planar surfaces from multiple views, while jointly estimating camera pose. Our experiments demonstrate that our method is able to advance the state of the art of reconstruction from sparse views, on challenging scenes from Matterport3D. Project site https jinlinyi.github.io SparsePlanes


Reexamining a Geometric Theory of Biological Growth. A first principles approach to the theoretical description of the development of biological forms, from a fertilized egg to a functioning embryo, remains a central challenge to applied physics and theoretical biology. Rather than refer to principles of self organization and non equilibrium statistical mechanics to describe a developing embryo from its active cellular constituents, a purely geometric theory is constructed that references the properties of the ambient space that the embryo occupies. In 1975 the Fields laureate Ren ' e Thom developed a system of techniques and local dynamical models that are capable of reconstructing the local dynamic of an embryo at each new growth event of the system. Each new growth event (the development of a limb, for example) is a topological change in the dynamic of the system that can be classified only according to the properties of space. The local models can be non conservative flows with robust attractor behavior that serve as organizing centers for systems development. Hamiltonian flows can also be considered with novel, self reproducing vague attractor behavior. The set of growth events become an unfolding space related to the differentiable manifold of states. The set of growth events, which Thom refers to as the catastrophe set, has special algebraic properties which permit these models to be low dimensional the local model contains few parameters. We present Thom's work as a research program outlining a framework for the construction of these local models, and, ultimately, the synthesis of these models into a full theoretical description of a developing biological organism. We give examples of the application of selected models to key growth events in the process of gastrulation.


Approximating the Permanent with Deep Rejection Sampling. We present a randomized approximation scheme for the permanent of a matrix with nonnegative entries. Our scheme extends a recursive rejection sampling method of Huber and Law (SODA 2008) by replacing the upper bound for the permanent with a linear combination of the subproblem bounds at a moderately large depth of the recursion tree. This method, we call deep rejection sampling, is empirically shown to outperform the basic, depth zero variant, as well as a related method by Kuck et al. (NeurIPS 2019). We analyze the expected running time of the scheme on random (0, 1) matrices where each entry is independently 1 with probability p . Our bound is superior to a previous one for p less than 1 5 , matching another bound that was known to hold when every row and column has density exactly p .


A vertex scheme for two phase flow in heterogeneous media. This paper presents the numerical solution of immiscible two phase flows in porous media, obtained by a first order finite element method equipped with mass lumping and flux up winding. The unknowns are the physical phase pressure and phase saturation. Our numerical experiments confirm that the method converges optimally for manufactured solutions. For both structured and unstructured meshes, we observe the high accuracy wetting saturation profile that ensures minimal numerical diffusion at the front. Performing several examples of quarter five spot problems in two and three dimensions, we show that the method can easily handle heterogeneities in the permeability field. Two distinct features that make the method appealing to reservoir simulators are (i) maximum principle is satisfied, and (ii) mass balance is locally conserved.


Spatial Temporal Deep Intention Destination Networks for Online Travel Planning. Nowadays, artificial neural networks are widely used for users' online travel planning. Personalized travel planning has many real applications and is affected by various factors, such as transportation type, intention destination estimation, budget limit and crowdness prediction. Among those factors, users' intention destination prediction is an essential task in online travel platforms. The reason is that, the user may be interested in the travel plan only when the plan matches his real intention destination. Therefore, in this paper, we focus on predicting users' intention destinations in online travel platforms. In detail, we act as online travel platforms (such as Fliggy and Airbnb) to recommend travel plans for users, and the plan consists of various vacation items including hotel package, scenic packages and so on. Predicting the actual intention destination in travel planning is challenging. Firstly, users' intention destination is highly related to their travel status (e.g., planning for a trip or finishing a trip). Secondly, users' actions (e.g. clicking, searching) over different product types (e.g. train tickets, visa application) have different indications in destination prediction. Thirdly, users may mostly visit the travel platforms just before public holidays, and thus user behaviors in online travel platforms are more sparse, low frequency and long period. Therefore, we propose a Deep Multi Sequences fused neural Networks (DMSN) to predict intention destinations from fused multi behavior sequences. Real datasets are used to evaluate the performance of our proposed DMSN models. Experimental results indicate that the proposed DMSN models can achieve high intention destination prediction accuracy.


AdaFit Rethinking Learning based Normal Estimation on Point Clouds. This paper presents a neural network for robust normal estimation on point clouds, named AdaFit, that can deal with point clouds with noise and density variations. Existing works use a network to learn point wise weights for weighted least squares surface fitting to estimate the normals, which has difficulty in finding accurate normals in complex regions or containing noisy points. By analyzing the step of weighted least squares surface fitting, we find that it is hard to determine the polynomial order of the fitting surface and the fitting surface is sensitive to outliers. To address these problems, we propose a simple yet effective solution that adds an additional offset prediction to improve the quality of normal estimation. Furthermore, in order to take advantage of points from different neighborhood sizes, a novel Cascaded Scale Aggregation layer is proposed to help the network predict more accurate point wise offsets and weights. Extensive experiments demonstrate that AdaFit achieves state of the art performance on both the synthetic PCPNet dataset and the real word SceneNN dataset.


Pseudo Hadamard matrices of the first generation and an algorithm for producing them. Hadamard matrices in 0,1 presentation are square m times m matrices whose entries are zeros and ones and whose rows considered as vectors in Bbb R m produce the Gram matrix of a special form with respect to the standard scalar product in Bbb R m . The concept of Hadamard matrices is extended in the present paper. As a result pseudo Hadamard matrices of the first generation are defined and investigated. An algorithm for generating these pseudo Hadamard matrices is designed and is used for testing some conjectures.


Deep Level Set for Box supervised Instance Segmentation in Aerial Images. Box supervised instance segmentation has recently attracted lots of research efforts while little attention is received in aerial image domain. In contrast to the general object collections, aerial objects have large intra class variances and inter class similarity with complex background. Moreover, there are many tiny objects in the high resolution satellite images. This makes the recent pairwise affinity modeling method inevitably to involve the noisy supervision with the inferior results. To tackle these problems, we propose a novel aerial instance segmentation approach, which drives the network to learn a series of level set functions for the aerial objects with only box annotations in an end to end fashion. Instead of learning the pairwise affinity, the level set method with the carefully designed energy functions treats the object segmentation as curve evolution, which is able to accurately recover the object's boundaries and prevent the interference from the indistinguishable background and similar objects. The experimental results demonstrate that the proposed approach outperforms the state of the art box supervised instance segmentation methods. The source code is available at https github.com LiWentomng boxlevelset.


Vanishing viscosity for linear quadratic mean field control problems. We consider a mean field control problem with linear dynamics and quadratic control. We apply the vanishing viscosity method we add a (regularizing) heat diffusion with a small viscosity coefficient and let such coefficient go to zero. The main result is that, in this case, the limit optimal control is exactly the optimal control of the original problem.


Material absorption based carrier generation model for modeling optoelectronic devices. The generation rate of photocarriers in optoelectronic materials is commonly calculated using the Poynting vector in the frequency domain. In time domain approaches where the nonlinear coupling between electromagnetic (EM) waves and photocarriers can be accounted for, the Poynting vector model is no longer applicable. One main reason is that the photocurrent radiates low frequency EM waves out of the spectrum of the source, e.g., terahertz (THz) waves are generated in THz photoconductive antennas. These frequency components do not contribute to the photocarrier generation since the corresponding photon energy is smaller than the optoelectronic material's bandgap energy. However, the instantaneous Poynting vector does not distinguish the power flux of different frequency components. This work proposes a material absorption based model capable of calculating the carrier generation rate accurately in the time domain. Using the Lorentz dispersion model with poles reside in the optical frequency region, the instantaneous optical absorption, which corresponds to the power dissipation in the polarization, is calculated and used to calculate the generation rate. The Lorentz model is formulated with an auxiliary differential equation method that updates the polarization current density, from which the absorbed optical power corresponding to each Lorentz pole is directly calculated in the time domain. Examples show that the proposed model is more accurate than the Poynting vector based model and is stable even when the generated low frequency component is strong.


Effective mapping class group dynamics III Counting filling closed curves on surfaces. We prove a quantitative estimate with a power saving error term for the number of filling closed geodesics of a given topological type and length leq L on an arbitrary closed, orientable, negatively curved surface. More generally, we prove estimates of the same kind for the number of free homotopy classes of filling closed curves of a given topological type on a closed, orientable surface whose geometric intersection number with respect to a given filling geodesic current is leq L . The proofs rely on recent progress made on the study of the effective dynamics of the mapping class group on Teichm "uller space and the space of closed curves of a closed, orientable surface, and introduce a novel method for addressing counting problems of mapping class group orbits that naturally yields power saving error terms. This method is also applied to study counting problems of mapping class group orbits of Teichm "uller space with respect to Thurston's asymmetric metric.


Long Short Temporal Contrastive Learning of Video Transformers. Video transformers have recently emerged as a competitive alternative to 3D CNNs for video understanding. However, due to their large number of parameters and reduced inductive biases, these models require supervised pretraining on large scale image datasets to achieve top performance. In this paper, we empirically demonstrate that self supervised pretraining of video transformers on video only datasets can lead to action recognition results that are on par or better than those obtained with supervised pretraining on large scale image datasets, even massive ones such as ImageNet 21K. Since transformer based models are effective at capturing dependencies over extended temporal spans, we propose a simple learning procedure that forces the model to match a long term view to a short term view of the same video. Our approach, named Long Short Temporal Contrastive Learning (LSTCL), enables video transformers to learn an effective clip level representation by predicting temporal context captured from a longer temporal extent. To demonstrate the generality of our findings, we implement and validate our approach under three different self supervised contrastive learning frameworks (MoCo v3, BYOL, SimSiam) using two distinct video transformer architectures, including an improved variant of the Swin Transformer augmented with space time attention. We conduct a thorough ablation study and show that LSTCL achieves competitive performance on multiple video benchmarks and represents a convincing alternative to supervised image based pretraining.


Tutorial synthetic frequency dimensions in dynamically modulated ring resonators. The concept of synthetic dimensions in photonics has attracted rapidly growing interest in the past few years. Among a variety of photonic systems, the ring resonator system under dynamic modulation has been investigated in depth both in theory and experiment, and has proven to be a powerful way to build synthetic frequency dimensions. In this tutorial, we start with a pedagogical introduction to the theoretical approaches in describing the dynamically modulated ring resonator system, and then review experimental methods in building such a system. Moreover, we discuss important physical phenomena in synthetic dimensions, including nontrivial topological physics. Our tutorial provides a pathway towards studying the dynamically modulated ring resonator system, understanding synthetic dimensions in photonics, and discusses future prospects for both fundamental research and practical applications using synthetic dimensions.


Wave turbulence and collective behavior models for wave equations with short and long range interactions. In this work, we discuss a situation which could lead to both wave turbulence and collective behavior kinetic equations. The wave turbulence kinetic models appear in the kinetic limit when the wave equations have local differential operators. Viewing wave equations on the lattice as chains of anharmonic oscillators and replacing the local differential operators (short range interactions) by non local ones (long range interactions), we arrive at a new Vlasov type kinetic model in the mean field limit under the molecular chaos assumption reminiscent of models for collective behavior in which anharmonic oscillators replace individual particles.


Do Long Range Language Models Actually Use Long Range Context?. Language models are generally trained on short, truncated input sequences, which limits their ability to use discourse level information present in long range context to improve their predictions. Recent efforts to improve the efficiency of self attention have led to a proliferation of long range Transformer language models, which can process much longer sequences than models of the past. However, the ways in which such models take advantage of the long range context remain unclear. In this paper, we perform a fine grained analysis of two long range Transformer language models (including the emph Routing Transformer , which achieves state of the art perplexity on the PG 19 long sequence LM benchmark dataset) that accept input sequences of up to 8K tokens. Our results reveal that providing long range context (i.e., beyond the previous 2K tokens) to these models only improves their predictions on a small set of tokens (e.g., those that can be copied from the distant context) and does not help at all for sentence level prediction tasks. Finally, we discover that PG 19 contains a variety of different document types and domains, and that long range context helps most for literary novels (as opposed to textbooks or magazines).


Explicit Bounds for Linear Forms in the Exponentials of Algebraic Numbers. In this paper, we study linear forms lambda beta 1 mathrm e alpha 1 cdots beta m mathrm e alpha m , where alpha i and beta i are algebraic numbers. An explicit lower bound for lambda is proved, which is derived from "th 'eor eme de Lindemann Weierstrass effectif" via constructive methods in algebraic computation. Besides, an explicit upper bound for the minimal lambda is established on systematic results of counting algebraic numbers.


Generalized q difference equations for general q polynomials with double q binomial coefficients. In this paper, we use the generalized q polynomials with double q binomial coefficients and homogeneous q operators J. Difference Equ. Appl. 20 (2014), 837 851. to construct q difference equations with seven variables, which generalize recent works of Jia et al Symmetry 2021, 13, 1222. . In addition, we derive Rogers formulas, extended Rogers formulas and Srivastava Agarwal type bilinear generating functions for generalized q polynomials, which generalize generating functions for Cigler's polynomials J. Difference Equ. Appl. 24 (2018), 479 502. . Finally, we also derive mixed generating functions using q difference equations.


Monotonicity Marking from Universal Dependency Trees. Dependency parsing is a tool widely used in the field of Natural language processing and computational linguistics. However, there is hardly any work that connects dependency parsing to monotonicity, which is an essential part of logic and linguistic semantics. In this paper, we present a system that automatically annotates monotonicity information based on Universal Dependency parse trees. Our system utilizes surface level monotonicity facts about quantifiers, lexical items, and token level polarity information. We compared our system's performance with existing systems in the literature, including NatLog and ccg2mono, on a small evaluation dataset. Results show that our system outperforms NatLog and ccg2mono.


Writing in The Air Unconstrained Text Recognition from Finger Movement Using Spatio Temporal Convolution. In this paper, we introduce a new benchmark dataset for the challenging writing in the air (WiTA) task an elaborate task bridging vision and NLP. WiTA implements an intuitive and natural writing method with finger movement for human computer interaction (HCI). Our WiTA dataset will facilitate the development of data driven WiTA systems which thus far have displayed unsatisfactory performance due to lack of dataset as well as traditional statistical models they have adopted. Our dataset consists of five sub datasets in two languages (Korean and English) and amounts to 209,926 video instances from 122 participants. We capture finger movement for WiTA with RGB cameras to ensure wide accessibility and cost efficiency. Next, we propose spatio temporal residual network architectures inspired by 3D ResNet. These models perform unconstrained text recognition from finger movement, guarantee a real time operation by processing 435 and 697 decoding frames per second for Korean and English, respectively, and will serve as an evaluation standard. Our dataset and the source codes are available at https github.com Uehwan WiTA.


Random switching in an ecosystem with two prey and one predator. In this paper we study the long term dynamics of two prey species and one predator species. In the deterministic setting, if we assume the interactions are of Lotka Volterra type (competition or predation), the long term behavior of this system is well known. However, nature is usually not deterministic. All ecosystems experience some type of random environmental fluctuations. We incorporate these into a natural framework as follows. Suppose the environment has two possible states. In each of the two environmental states the dynamics is governed by a system of Lotka Volterra ODE. The randomness comes from spending an exponential amount of time in each environmental state and then switching to the other one. We show how this random switching can create very interesting phenomena. In some cases the randomness can facilitate the coexistence of the three species even though coexistence is impossible in each of the two environmental states. In other cases, even though there is coexistence in each of the two environmental states, switching can lead to the loss of one or more species. We look into how predators and environmental fluctuations can mediate coexistence among competing species.


Local Augmentation for Graph Neural Networks. Data augmentation has been widely used in image data and linguistic data but remains under explored for Graph Neural Networks (GNNs). Existing methods focus on augmenting the graph data from a global perspective and largely fall into two genres structural manipulation and adversarial training with feature noise injection. However, recent graph data augmentation methods ignore the importance of local information for the GNNs' message passing mechanism. In this work, we introduce the local augmentation, which enhances the locality of node representations by their subgraph structures. Specifically, we model the data augmentation as a feature generation process. Given a node's features, our local augmentation approach learns the conditional distribution of its neighbors' features and generates more neighbors' features to boost the performance of downstream tasks. Based on the local augmentation, we further design a novel framework LA GNN, which can apply to any GNN models in a plug and play manner. Extensive experiments and analyses show that local augmentation consistently yields performance improvement for various GNN architectures across a diverse set of benchmarks.