Gradient Assisted Learning. In decentralized settings, collaborations between different organizations, such as financial institutions, medical centers, and retail markets, are crucial to providing improved service and performance. However, the underlying organizations may have little interest in sharing their private data, proprietary models, and objective functions. These privacy requirements have created new challenges for organizational collaboration. In this work, we propose Gradient Assisted Learning (GAL), a new method for multiple organizations to assist each other in supervised learning tasks without sharing data, models, and objective functions. In this framework, all participants collaboratively optimize the aggregate of local loss functions, and each participant autonomously builds its own model by iteratively fitting the gradients of the objective function. Experimental studies demonstrate that Gradient Assisted Learning can achieve performance close to centralized learning when all data, models, and objective functions are fully disclosed.


Multiagent based state transition algorithm for global optimization. In this paper, a novel multiagent based state transition optimization algorithm with linear convergence rate named MASTA is constructed. It first generates an initial population randomly and uniformly. Then, it applies the basic state transition algorithm (STA) to the population and generates a new population. After that, It computes the fitness values of all individuals and finds the best individuals in the new population. Moreover, it performs an effective communication operation and updates the population. With the above iterative process, the best optimal solution is found out. Experimental results based on some common benchmark functions and comparison with some stat of the art optimization algorithms, the proposed MASTA algorithm has shown very superior and comparable performance.


Examples of fourth order scattering type operators with embedded eigenvalues in their continuous spectra. We give examples of fourth order scattering type operators, acting on L 2( mathbb R ) , which have eigenvalues embedded in their continuous spectra.


Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance. The ability to identify and resolve uncertainty is crucial for the robustness of a dialogue system. Indeed, this has been confirmed empirically on systems that utilise Bayesian approaches to dialogue belief tracking. However, such systems consider only confidence estimates and have difficulty scaling to more complex settings. Neural dialogue systems, on the other hand, rarely take uncertainties into account. They are therefore overconfident in their decisions and less robust. Moreover, the performance of the tracking task is often evaluated in isolation, without consideration of its effect on the downstream policy optimisation. We propose the use of different uncertainty measures in neural belief tracking. The effects of these measures on the downstream task of policy optimisation are evaluated by adding selected measures of uncertainty to the feature space of the policy and training policies through interaction with a user simulator. Both human and simulated user results show that incorporating these measures leads to improvements both of the performance and of the robustness of the downstream dialogue policy. This highlights the importance of developing neural dialogue belief trackers that take uncertainty into account.


Fully Dynamic Set Cover via Hypergraph Maximal Matching An Optimal Approximation Through a Local Approach. In the (fully) dynamic set cover problem, we have a collection of m sets from a universe of size n that undergo element insertions and deletions the goal is to maintain an approximate set cover of the universe after each update. We give an O(f 2) update time algorithm for this problem that achieves an f approximation, where f is the maximum number of sets that an element belongs to under the unique games conjecture, this approximation is best possible for any fixed f . This is the first algorithm for dynamic set cover with approximation ratio that exactly matches f (as opposed to almost f in prior work), as well as the first one with runtime emph independent of n,m (for any approximation factor of o(f 3) ). Prior to our work, the state of the art algorithms for this problem were O(f 2) update time algorithms of Gupta et al. STOC'17 and Bhattacharya et al. IPCO'17 with O(f 3) approximation, and the recent algorithm of Bhattacharya et al. FOCS'19 with O(f cdot log n epsilon 2) update time and (1 epsilon) cdot f approximation, improving the O(f 2 cdot log n epsilon 5) bound of Abboud et al. STOC'19 . The key technical ingredient of our work is an algorithm for maintaining a maximal matching in a dynamic hypergraph of rank r , where each hyperedge has at most r vertices, which undergoes hyperedge insertions and deletions in O(r 2) amortized update time our algorithm is randomized, and the bound on the update time holds in expectation and with high probability. This result generalizes the maximal matching algorithm of Solomon FOCS'16 with constant update time in ordinary graphs to hypergraphs, and is of independent merit the previous state of the art algorithms for set cover do not translate to (integral) matchings for hypergraphs, let alone a maximal one. Our quantitative result for the set cover problem is ...


FONTNET On Device Font Understanding and Prediction Pipeline. Fonts are one of the most basic and core design concepts. Numerous use cases can benefit from an in depth understanding of Fonts such as Text Customization which can change text in an image while maintaining the Font attributes like style, color, size. Currently, Text recognition solutions can group recognized text based on line breaks or paragraph breaks, if the Font attributes are known multiple text blocks can be combined based on context in a meaningful manner. In this paper, we propose two engines Font Detection Engine, which identifies the font style, color and size attributes of text in an image and a Font Prediction Engine, which predicts similar fonts for a query font. Major contributions of this paper are three fold First, we developed a novel CNN architecture for identifying font style of text in images. Second, we designed a novel algorithm for predicting similar fonts for a given query font. Third, we have optimized and deployed the entire engine On Device which ensures privacy and improves latency in real time applications such as instant messaging. We achieve a worst case On Device inference time of 30ms and a model size of 4.5MB for both the engines.


A note on twisted group rings and semilinearization. In this short note, we construct a right adjoint to the functor which associates to a ring R equipped with a group action its twisted group ring. This right adjoint admits an interpretation as semilinearization, in that it sends an R module to the group of semilinear R module automorphisms of the module. As an immediate corollary, we provide a novel proof of the classical observation that modules over a twisted group ring are modules over the base ring together with a semilinear action.


AI Ethics Statements Analysis and lessons learnt from NeurIPS Broader Impact Statements. Ethics statements have been proposed as a mechanism to increase transparency and promote reflection on the societal impacts of published research. In 2020, the machine learning (ML) conference NeurIPS broke new ground by requiring that all papers include a broader impact statement. This requirement was removed in 2021, in favour of a checklist approach. The 2020 statements therefore provide a unique opportunity to learn from the broader impact experiment to investigate the benefits and challenges of this and similar governance mechanisms, as well as providing an insight into how ML researchers think about the societal impacts of their own work. Such learning is needed as NeurIPS and other venues continue to question and adapt their policies. To enable this, we have created a dataset containing the impact statements from all NeurIPS 2020 papers, along with additional information such as affiliation type, location and subject area, and a simple visualisation tool for exploration. We also provide an initial quantitative analysis of the dataset, covering representation, engagement, common themes, and willingness to discuss potential harms alongside benefits. We investigate how these vary by geography, affiliation type and subject area. Drawing on these findings, we discuss the potential benefits and negative outcomes of ethics statement requirements, and their possible causes and associated challenges. These lead us to several lessons to be learnt from the 2020 requirement (i) the importance of creating the right incentives, (ii) the need for clear expectations and guidance, and (iii) the importance of transparency and constructive deliberation. We encourage other researchers to use our dataset to provide additional analysis, to further our understanding of how researchers responded to this requirement, and to investigate the benefits and challenges of this and related mechanisms.


Atmospheric Density Model Optimization and Spacecraft Orbit Prediction Improvements Based on Q Sat Orbit Data. Atmospheric drag calculation error greatly reduce the low earth orbit spacecraft trajectory prediction fidelity. To solve the issue, the "correction prediction" strategy is usually employed. In the method, one parameter is fixed and other parameters are revised by inverting spacecraft orbit data. However, based on a single spacecraft data, the strategy usually performs poorly as parameters in drag force calculation are coupled with each other, which result in convoluted errors. A gravity field recovery and atmospheric density detection satellite, Q Sat, developed by xxxxx Lab at xxx University, is launched on August 6th, 2020. The satellite is designed to be spherical for a constant drag coefficient regardless of its attitude. An orbit prediction method for low earth orbit spacecraft with employment of Q Sat data is proposed in present paper for decoupling atmospheric density and drag coefficient identification. For the first step, by using a dynamic approach based inversion, several empirical atmospheric density models are revised based on Q Sat orbit data. Depending on the performs, one of the revised atmospheric density model would be selected for the next step in which the same inversion is employed for drag coefficient identification for a low earth orbit operating spacecraft whose orbit needs to be predicted. Finally, orbit prediction is conducted by extrapolation with the dynamic parameters in the previous steps. Tests are carried out with the proposed method by using a GOCE satellite 15 day continuous orbit data. Compared with legacy "correction prediction" method in which only GOCE data is employed, the accuracy of the 24 hour orbit prediction is improved by about 171m the highest for the proposed method. 14 day averaged 24 hour prediction precision is elevated by approximately 70m.


Simple Harish Chandra modules over the super affine Virasoro algebras. In this paper, we classify all simple Harish Chandra modules over the super affine Virasoro algebra widehat mathcal L mathcal W ltimes( mathfrak g otimes mathcal A ) oplus mathbb C C , where mathcal A mathbb C t pm 1 otimes Lambda(1) is the tensor superalgebra of the Laurent polynomial algebra in even variable t and the Grassmann algebra in odd variable xi , mathcal W is the Lie superalgebra of superderivations of mathcal A , and mathfrak g is a finite dimensional perfect Lie superalgebra.


A System for Automated Open Source Threat Intelligence Gathering and Management. To remain aware of the fast evolving cyber threat landscape, open source Cyber Threat Intelligence (OSCTI) has received growing attention from the community. Commonly, knowledge about threats is presented in a vast number of OSCTI reports. Despite the pressing need for high quality OSCTI, existing OSCTI gathering and management platforms, however, have primarily focused on isolated, low level Indicators of Compromise. On the other hand, higher level concepts (e.g., adversary tactics, techniques, and procedures) and their relationships have been overlooked, which contain essential knowledge about threat behaviors that is critical to uncovering the complete threat scenario. To bridge the gap, we propose SecurityKG, a system for automated OSCTI gathering and management. SecurityKG collects OSCTI reports from various sources, uses a combination of AI and NLP techniques to extract high fidelity knowledge about threat behaviors, and constructs a security knowledge graph. SecurityKG also provides a UI that supports various types of interactivity to facilitate knowledge graph exploration.


Multi Instance Training for Question Answering Across Table and Linked Text. Answering natural language questions using information from tables (TableQA) is of considerable recent interest. In many applications, tables occur not in isolation, but embedded in, or linked to unstructured text. Often, a question is best answered by matching its parts to either table cell contents or unstructured text spans, and extracting answers from either source. This leads to a new space of TextTableQA problems that was introduced by the HybridQA dataset. Existing adaptations of table representation to transformer based reading comprehension (RC) architectures fail to tackle the diverse modalities of the two representations through a single system. Training such systems is further challenged by the need for distant supervision. To reduce cognitive burden, training instances usually include just the question and answer, the latter matching multiple table rows and text passages. This leads to a noisy multi instance training regime involving not only rows of the table, but also spans of linked text. We respond to these challenges by proposing MITQA, a new TextTableQA system that explicitly models the different but closely related probability spaces of table row selection and text span selection. Our experiments indicate the superiority of our approach compared to recent baselines. The proposed method is currently at the top of the HybridQA leaderboard with a held out test set, achieving 21 absolute improvement on both EM and F1 scores over previous published results.


Commutator Matrix in Phase Space Mapping Models for Nonadiabatic Quantum Dynamics. We show that a novel, general phase space mapping Hamiltonian for nonadiabatic systems, which is reminiscent of the renowned Meyer Miller mapping Hamiltonian, involves a commutator variable matrix rather than the conventional zero point energy parameter. In the exact mapping formulation on constraint space for phase space approaches for nonadiabatic dynamics, the general mapping Hamiltonian with commutator variables can be employed to generate approximate trajectory based dynamics. Various benchmark model tests, which range from gas phase to condensed phase systems, suggest that the overall performance of the general mapping Hamiltonian is better than that of the conventional Meyer Miller Hamiltonian.


The twisted Ruelle zeta function on compact hyperbolic orbisurfaces and Reidemeister Turaev torsion. Let X be a compact hyperbolic surface with finite order singularities, X 1 its unit tangent bundle. We consider the Ruelle zeta function R(s rho) associated to a representation rho colon pi 1(X 1) to operatorname GL (V rho) . If rho does not factor through pi 1(X) , we show that the value at 0 of the Ruelle zeta function is the Reidemeister Turaev torsion of (X 1, rho) with respect to the Euler structure induced by the geodesic flow, thus generalizing Fried's conjecture to this setting. We also compute the vanishing order and the leading coefficient of the Ruelle zeta function at s 0 when rho factors through pi 1(X) .


On the validity of pre trained transformers for natural language processing in the software engineering domain. Transformers are the current state of the art of natural language processing in many domains and are using traction within software engineering research as well. Such models are pre trained on large amounts of data, usually from the general domain. However, we only have a limited understanding regarding the validity of transformers within the software engineering domain, i.e., how good such models are at understanding words and sentences within a software engineering context and how this improves the state of the art. Within this article, we shed light on this complex, but crucial issue. We compare BERT transformer models trained with software engineering data with transformers based on general domain data in multiple dimensions their vocabulary, their ability to understand which words are missing, and their performance in classification tasks. Our results show that for tasks that require understanding of the software engineering context, pre training with software engineering data is valuable, while general domain models are sufficient for general language understanding, also within the software engineering domain.


Gamma positivity for a Refinement of Median Genocchi Numbers. We study the generating function of descent numbers for the permutations with descent pairs of prescribed parities, the distribution of which turns out to be a refinement of median Genocchi numbers. We prove the gamma positivity for the polynomial and derive the generating function for the gamma vectors, expressed in the form of continued fraction. We also come up with an artificial statistic that gives a q analogue of the gamma positivity for the permutations with descents only allowed from an odd value to an odd value.


Generalizing to the Open World Deep Visual Odometry with Online Adaptation. Despite learning based visual odometry (VO) has shown impressive results in recent years, the pretrained networks may easily collapse in unseen environments. The large domain gap between training and testing data makes them difficult to generalize to new scenes. In this paper, we propose an online adaptation framework for deep VO with the assistance of scene agnostic geometric computations and Bayesian inference. In contrast to learning based pose estimation, our method solves pose from optical flow and depth while the single view depth estimation is continuously improved with new observations by online learned uncertainties. Meanwhile, an online learned photometric uncertainty is used for further depth and pose optimization by a differentiable Gauss Newton layer. Our method enables fast adaptation of deep VO networks to unseen environments in a self supervised manner. Extensive experiments including Cityscapes to KITTI and outdoor KITTI to indoor TUM demonstrate that our method achieves state of the art generalization ability among self supervised VO methods.


Counterexample to cut elimination in cyclic proof system for first order logic with inductive definitions. A cyclic proof system is a proof system whose proof figure is a tree with cycles. The cut elimination in a proof system is fundamental. It is conjectured that the cut elimination in the cyclic proof system for first order logic with inductive definitions does not hold. This paper shows that the conjecture is correct by giving a sequent not provable without the cut rule but provable in the cyclic proof system.


A Trigger Sense Memory Flow Framework for Joint Entity and Relation Extraction. Joint entity and relation extraction framework constructs a unified model to perform entity recognition and relation extraction simultaneously, which can exploit the dependency between the two tasks to mitigate the error propagation problem suffered by the pipeline model. Current efforts on joint entity and relation extraction focus on enhancing the interaction between entity recognition and relation extraction through parameter sharing, joint decoding, or other ad hoc tricks (e.g., modeled as a semi Markov decision process, cast as a multi round reading comprehension task). However, there are still two issues on the table. First, the interaction utilized by most methods is still weak and uni directional, which is unable to model the mutual dependency between the two tasks. Second, relation triggers are ignored by most methods, which can help explain why humans would extract a relation in the sentence. They're essential for relation extraction but overlooked. To this end, we present a Trigger Sense Memory Flow Framework (TriMF) for joint entity and relation extraction. We build a memory module to remember category representations learned in entity recognition and relation extraction tasks. And based on it, we design a multi level memory flow attention mechanism to enhance the bi directional interaction between entity recognition and relation extraction. Moreover, without any human annotations, our model can enhance relation trigger information in a sentence through a trigger sensor module, which improves the model performance and makes model predictions with better interpretation. Experiment results show that our proposed framework achieves state of the art results by improves the relation F1 to 52.44 ( 3.2 ) on SciERC, 66.49 ( 4.9 ) on ACE05, 72.35 ( 0.6 ) on CoNLL04 and 80.66 ( 2.3 ) on ADE.


Homogenization of a nonlinear drift diffusion system for multiple charged species in a porous medium. We consider a nonlinear drift diffusion system for multiple charged species in a porous medium in 2D and 3D with periodic microstructure. The system consists of a transport equation for the concentration of the species and Poisson's equation for the electric potential. The diffusion terms depend nonlinearly on the concentrations. We consider non homogeneous Neumann boundary condition for the electric potential. The aim is the rigorous derivation of an effective (homogenized) model in the limit when the scale parameter epsilon tends to zero. This is based on uniform textit a priori estimates for the solutions of the microscopic model. The crucial result is the uniform L infty estimate for the concentration in space and time. This result exploits the fact that the system admits a nonnegative energy functional which decreases in time along the solutions of the system. By using weak and strong (two scale) convergence properties of the microscopic solutions, effective models are derived in the limit epsilon to 0 for different scalings of the microscopic model.


ShapeMap 3 D Efficient shape mapping through dense touch and vision. Knowledge of 3 D object shape is of great importance to robot manipulation tasks, but may not be readily available in unstructured environments. While vision is often occluded during robot object interaction, high resolution tactile sensors can give a dense local perspective of the object. However, tactile sensors have limited sensing area and the shape representation must faithfully approximate non contact areas. In addition, a key challenge is efficiently incorporating these dense tactile measurements into a 3 D mapping framework. In this work, we propose an incremental shape mapping method using a GelSight tactile sensor and a depth camera. Local shape is recovered from tactile images via a learned model trained in simulation. Through efficient inference on a spatial factor graph informed by a Gaussian process, we build an implicit surface representation of the object. We demonstrate visuo tactile mapping in both simulated and real world experiments, to incrementally build 3 D reconstructions of household objects.


3D Restoration of sedimentary terrains The GeoChron Approach. Three dimensional restoration of complex structural models has become a recognized validation method. Bringing a sedimentary structural model back in time to various deposition stages may also help understand the geological history of a study area and follow the evolution of potential hydrocarbon source rocks, reservoirs and closures. Most current restoration methods rely on finite element codes which require a mesh that conforms to both horizons and faults, a difficult object to generate in complex structural settings. Some innovative approaches use implicit horizon representations to circumvent meshing requirements. In all cases, finite element restoration codes depend on elasticity theory which relies on mechanical parameters to characterize rock behavior during the physical unfolding process. In this paper, we present a geometric restoration method based on the mathematical theory provided by the GeoChron framework. No assumption is made on the extent of deformation, nor on the nature of terrains being restored. Equations derived from the theory developed for the GeoChron model ensure model consistency at each restored stage. As the only essential input is a GeoChron model, this restoration technique does not require any specialist knowledge and can be included in any existing structural model building workflow as a standard validation tool. A model can quickly be restored to any desired stage without providing input mechanical parameters for each layer nor defining boundary conditions, enabling geologists to iterate on the structural model and refine their interpretations until they are satisfied with both input and restored models.


Off axis gyration induces large area circular motion of anisotropic microparticles in a dynamic magnetic trap. Magnetic tweezers are crucial for single molecule and atomic characterization, and biomedical isolation of microparticle carriers. The trapping component of magnetic tweezing can be relying on a magnetic potential well that can confine the relevant species to a localized region. Here, we report that magnetic microparticles with tailored anisotropy can transition from localized off axis gyration to large area locomotion in a rotating magnetic trap. The microparticles, consisting of assemblies of magnetic cores, are observed to either rotate about its structural geometric center or gyrate about one of the magnetic cores, the switching of which can be modulated by the external field. Raising the magnetic field strength above a threshold, the particles can go beyond the traditional synchronous rotation and asynchronous oscillation modes, and into a scenario of large area circular motion. This results in peculiar retrograde locomotion related to the magnetization maxima of the microparticle. Our finding suggests the important role of the microparticle's magnetic morphology in the controlled transport of microparticles and developing smart micro actuators and micro robot devices.


Backward Compatible Prediction Updates A Probabilistic Approach. When machine learning systems meet real world applications, accuracy is only one of several requirements. In this paper, we assay a complementary perspective originating from the increasing availability of pre trained and regularly improving state of the art models. While new improved models develop at a fast pace, downstream tasks vary more slowly or stay constant. Assume that we have a large unlabelled data set for which we want to maintain accurate predictions. Whenever a new and presumably better ML models becomes available, we encounter two problems (i) given a limited budget, which data points should be re evaluated using the new model? and (ii) if the new predictions differ from the current ones, should we update? Problem (i) is about compute cost, which matters for very large data sets and models. Problem (ii) is about maintaining consistency of the predictions, which can be highly relevant for downstream applications our demand is to avoid negative flips, i.e., changing correct to incorrect predictions. In this paper, we formalize the Prediction Update Problem and present an efficient probabilistic approach as answer to the above questions. In extensive experiments on standard classification benchmark data sets, we show that our method outperforms alternative strategies along key metrics for backward compatible prediction updates.


Phase shift cavity ring down spectroscopy in linear and active fiber cavities for sensing applications at 1550 nm. Liquid phase sensing applications at 1550 nm are highly desirable due to widely available off the shelf components. Generally, liquids at 1550 nm induce a high absorption loss that limits the overall sensor's sensitivity and detection limit. One solution is to use an active fiber loop in conjunction with cavity ring down spectroscopy to overcome these absorption losses. However, the amplifier inside the fiber loop suffers from inherent gain fluctuations that limit the sensing system's overall performance. Here, we provide a novel sensor using the wavelength scanned phase shift cavity ring down spectroscopy (PS CRDS) in conjunction with a linear active fiber cavity that potentially offers a more sensitive solution than traditional fiber loop sensors. We use a tapered fiber as a sensing head inside the active cavity built from fiber Bragg gratings. We derive a theoretical phase shift expression for our system and simulate it using the finite element method to determine optimum tapered fiber diameter for glucose sensing in DI water. Compared to a non amplified system, we find that our amplified system can increase the sensitivity by fourteen times via the amplifier gain tuning. We also conduct experimental measurements using 0 15.5 mM glucose solutions and find them in excellent agreement with our theoretical predictions. Experimentally we obtain the sensor's sensitivity of 0.768 o mM (1164 o RIU) and detection limit of 0.75 mM ( 4.5 times 10 4 RIU) without any temperature stabilization in the system. We anticipate that the present work will find a wide range of sensing applications in fiber cavities, ring resonators, and other microcavity structures.


Optical symmetric pushing, uni bi directional null, and pulling pushing flipped forces in one dimensional PT symmetric photonics. We discuss the optical forces exerted on parity time (PT) symmetric heterostructures under normal incidence of a single and two counter propagating plane waves. The underlying strategy is through generalized parametric space, stemming from consideration of PT symmetry condition and Lorentz reciprocity theorem. In such a generalized parametric space, we are able to not only exhaustively indicate various PT phases and extraordinary wave phenomena, but also deduce the directionality and magnitudes of optical forces. We find that when the system is illuminated by a normally incident wave, it can exhibit the symmetric pushing effect in the exact symmetry phase, uni directional null (UNF) and bi directional null force (BNF) at the exceptional point (EP), and pulling pushing flipped forces in the broken symmetry phase, with BNF found at the pushing pulling turning point. In two counter propagating plane waves interference, the magnitudes as well as the directionality of resultant optical force can be tuned by relative phase of incident waves. More interestingly, we observe that there has a null force independent of the relative phase occurred in a specific region of broken symmetry phase and exceptional point. In addition, we offer several PT symmetric heterostructures to support our findings. Our results may be beneficial for applications in PT optomechanics and force rectifiers.


Generalized Riordan groups and zero generalized Pascal matrices. The generalized Riordan group consists of infinite lower triangular matrices that correspond to certain operators in the space of formal power series. Each such group contains the matrix (generalized Pascal matrix), elements of which are generalized binomial coefficients. Generalized Pascal matrices with non negative elements form an infinite dimensional vector space. The paper gives an idea of groups similar to the generalized Riordan groups, but associated with matrices, which in the space of generalized Pascal matrices correspond to the points at infinity examples of such matrices are the matrix of q binomial coefficients for q 1 and the Pascal triangle modulo 2 . An analog of the Lagrange inversion theorem for these groups is given and the corresponding examples are considered.


Benchmarking Off The Shelf Solutions to Robotic Assembly Tasks. In recent years, many learning based approaches have been studied to realize robotic manipulation and assembly tasks, often including vision and force tactile feedback. However, it remains frequently unclear what is the baseline state of the art performance and what are the bottleneck problems. In this work, we evaluate some off the shelf (OTS) industrial solutions on a recently introduced benchmark, the National Institute of Standards and Technology (NIST) Assembly Task Boards. A set of assembly tasks are introduced and baseline methods are provided to understand their intrinsic difficulty. Multiple sensor based robotic solutions are then evaluated, including hybrid force motion control and 2D 3D pattern matching algorithms. An end to end integrated solution that accomplishes the tasks is also provided. The results and findings throughout the study reveal a few noticeable factors that impede the adoptions of the OTS solutions expertise dependent, limited applicability, lack of interoperability, no scene awareness or error recovery mechanisms, and high cost. This paper also provides a first attempt of an objective benchmark performance on the NIST Assembly Task Boards as a reference comparison for future works on this problem.


Operation is the hardest teacher estimating DNN accuracy looking for mispredictions. Deep Neural Networks (DNN) are typically tested for accuracy relying on a set of unlabelled real world data (operational dataset), from which a subset is selected, manually labelled and used as test suite. This subset is required to be small (due to manual labelling cost) yet to faithfully represent the operational context, with the resulting test suite containing roughly the same proportion of examples causing misprediction (i.e., failing test cases) as the operational dataset. However, while testing to estimate accuracy, it is desirable to also learn as much as possible from the failing tests in the operational dataset, since they inform about possible bugs of the DNN. A smart sampling strategy may allow to intentionally include in the test suite many examples causing misprediction, thus providing this way more valuable inputs for DNN improvement while preserving the ability to get trustworthy unbiased estimates. This paper presents a test selection technique (DeepEST) that actively looks for failing test cases in the operational dataset of a DNN, with the goal of assessing the DNN expected accuracy by a small and ''informative'' test suite (namely with a high number of mispredictions) for subsequent DNN improvement. Experiments with five subjects, combining four DNN models and three datasets, are described. The results show that DeepEST provides DNN accuracy estimates with precision close to (and often better than) those of existing sampling based DNN testing techniques, while detecting from 5 to 30 times more mispredictions, with the same test suite size.


Using Graph Theoretic Machine Learning to Predict Human Driver Behavior. Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio cultural norms. It is known that socially aware AVs can be designed if there exists a mechanism to understand the behaviors of human drivers. We present an approach that leverages machine learning to predict, the behaviors of human drivers. This is similar to how humans implicitly interpret the behaviors of drivers on the road, by only observing the trajectories of their vehicles. We use graph theoretic tools to extract driver behavior features from the trajectories and machine learning to obtain a computational mapping between the extracted trajectory of a vehicle in traffic and the driver behaviors. Compared to prior approaches in this domain, we prove that our method is robust, general, and extendable to broad ranging applications such as autonomous navigation. We evaluate our approach on real world traffic datasets captured in the U.S., India, China, and Singapore, as well as in simulation.


Some Connections Between Discrepancy, Finite Gap Properties, and Pair Correlations. A generic uniformly distributed sequence (x n) n in mathbb N in 0,1) possesses Poissonian pair correlations (PPC). Vice versa, it has been proven that a sequence with PPC is uniformly distributed. Grepstad and Larcher gave an explicit formula to calculate the discrepancy of a sequence given that it has PPC. As a first result, we generalize here their result to the case of converging number variance with exponents 0 alpha 1 . Since the highest possible level of uniformity is achieved by low discrepancy sequences it is tempting to assume that these sequences also have PPC. Although there are no such known examples, we prove that every low discrepancy sequence has at least converging number variance for all exponents 0 alpha 1 . According to Larcher and Stockinger, the reason why many known classes of low discrepancy sequences fail to have PPC is their finite gap property. In this article, we furthermore show that the discrepancy of a sequence with the finite gap property plus a condition on the distribution of the different gap lengths can be estimated. As a concrete application of this estimation, we re prove the fact that van der Corput and Kronecker sequences are low discrepancy sequences. Consequently, it follows from the finite gap property that these sequences have converging number variance for exponents 0 alpha 1 .


Differentially Private Algorithms for Clustering with Stability Assumptions. We study the problem of differentially private clustering under input stability assumptions. Despite the ever growing volume of works on differential privacy in general and differentially private clustering in particular, only three works (Nissim et al. 2007, Wang et al. 2015, Huang et al. 2018) looked at the problem of privately clustering "nice" k means instances, all three relying on the sample and aggregate framework and all three measuring utility in terms of Wasserstein distance between the true cluster centers and the centers returned by the private algorithm. In this work we improve upon this line of works on multiple axes. We present a far simpler algorithm for clustering stable inputs (not relying on the sample and aggregate framework), and analyze its utility in both the Wasserstein distance and the k means cost. Moreover, our algorithm has straight forward analogues for "nice" k median instances and for the local model of differential privacy.


What are Hybrid Development Methods Made Of? An Evidence based Characterization. Among the multitude of software development processes available, hardly any is used by the book. Regardless of company size or industry sector, a majority of project teams and companies use customized processes that combine different development methods so called hybrid development methods. Even though such hybrid development methods are highly individualized, a common understanding of how to systematically construct synergetic practices is missing. In this paper, we make a first step towards devising such guidelines. Grounded in 1,467 data points from a large scale online survey among practitioners, we study the current state of practice in process use to answer the question What are hybrid development methods made of? Our findings reveal that only eight methods and few practices build the core of modern software development. This small set allows for statistically constructing hybrid development methods. Using an 85 agreement level in the participants' selections, we provide two examples illustrating how hybrid development methods are characterized by the practices they are made of. Our evidence based analysis approach lays the foundation for devising hybrid development methods.


Local stability of cooperation in a continuous model of indirect reciprocity. Reputation is a powerful mechanism to enforce cooperation among unrelated individuals through indirect reciprocity, but it suffers from disagreement originating from private assessment, noise, and incomplete information. In this work, we investigate stability of cooperation in the donation game by regarding each player's reputation and behaviour as continuous variables. Through perturbative calculation, we derive a condition that a social norm should satisfy to give penalties to its close variants, provided that everyone initially cooperates with a good reputation, and this result is supported by numerical simulation. A crucial factor of the condition is whether a well reputed player's donation to an ill reputed co player is appreciated by other members of the society, and the condition can be reduced to a threshold for the benefit cost ratio of cooperation which depends on the reputational sensitivity to a donor's behaviour as well as on the behavioural sensitivity to a recipient's reputation. Our continuum formulation suggests how indirect reciprocity can work beyond the dichotomy between good and bad even in the presence of inhomogeneity, noise, and incomplete information.


Real time Emotion and Gender Classification using Ensemble CNN. Analysing expressions on the person's face plays a very vital role in identifying emotions and behavior of a person. Recognizing these expressions automatically results in a crucial component of natural human machine interfaces. Therefore research in this field has a wide range of applications in bio metric authentication, surveillance systems , emotion to emoticons in various social media platforms. Another application includes conducting customer satisfaction surveys. As we know that the large corporations made huge investments to get feedback and do surveys but fail to get equitable responses. Emotion Gender recognition through facial gestures is a technology that aims to improve product and services performance by monitoring customer behavior to specific products or service staff by their evaluation. In the past few years there have been a wide variety of advances performed in terms of feature extraction mechanisms , detection of face and also expression classification techniques. This paper is the implementation of an Ensemble CNN for building a real time system that can detect emotion and gender of the person. The experimental results shows accuracy of 68 for Emotion classification into 7 classes (angry, fear , sad , happy , surprise , neutral , disgust) on FER 2013 dataset and 95 for Gender classification (Male or Female) on IMDB dataset. Our work can predict emotion and gender on single face images as well as multiple face images. Also when input is given through webcam our complete pipeline of this real time system can take less than 0.5 seconds to generate results.


Providing Assurance and Scrutability on Shared Data and Machine Learning Models with Verifiable Credentials. Adopting shared data resources requires scientists to place trust in the originators of the data. When shared data is later used in the development of artificial intelligence (AI) systems or machine learning (ML) models, the trust lineage extends to the users of the system, typically practitioners in fields such as healthcare and finance. Practitioners rely on AI developers to have used relevant, trustworthy data, but may have limited insight and recourse. This paper introduces a software architecture and implementation of a system based on design patterns from the field of self sovereign identity. Scientists can issue signed credentials attesting to qualities of their data resources. Data contributions to ML models are recorded in a bill of materials (BOM), which is stored with the model as a verifiable credential. The BOM provides a traceable record of the supply chain for an AI system, which facilitates on going scrutiny of the qualities of the contributing components. The verified BOM, and its linkage to certified data qualities, is used in the AI Scrutineer, a web based tool designed to offer practitioners insight into ML model constituents and highlight any problems with adopted datasets, should they be found to have biased data or be otherwise discredited.


Fast Projection onto the Capped Simplex with Applications to Sparse Regression in Bioinformatics. We consider the problem of projecting a vector onto the so called k capped simplex, which is a hyper cube cut by a hyperplane. For an n dimensional input vector with bounded elements, we found that a simple algorithm based on Newton's method is able to solve the projection problem to high precision with a complexity roughly about O(n), which has a much lower computational cost compared with the existing sorting based methods proposed in the literature. We provide a theory for partial explanation and justification of the method. We demonstrate that the proposed algorithm can produce a solution of the projection problem with high precision on large scale datasets, and the algorithm is able to significantly outperform the state of the art methods in terms of runtime (about 6 8 times faster than a commercial software with respect to CPU time for input vector with 1 million variables or more). We further illustrate the effectiveness of the proposed algorithm on solving sparse regression in a bioinformatics problem. Empirical results on the GWAS dataset (with 1,500,000 single nucleotide polymorphisms) show that, when using the proposed method to accelerate the Projected Quasi Newton (PQN) method, the accelerated PQN algorithm is able to handle huge scale regression problem and it is more efficient (about 3 6 times faster) than the current state of the art methods.


Reducing Tactile Sim2Real Domain Gaps via Deep Texture Generation Networks. Recently simulation methods have been developed for optical tactile sensors to enable the Sim2Real learning, i.e., firstly training models in simulation before deploying them on the real robot. However, some artefacts in the real objects are unpredictable, such as imperfections caused by fabrication processes, or scratches by the natural wear and tear, and thus cannot be represented in the simulation, resulting in a significant gap between the simulated and real tactile images. To address this Sim2Real gap, we propose a novel texture generation network that maps the simulated images into photorealistic tactile images that resemble a real sensor contacting a real imperfect object. Each simulated tactile image is first divided into two types of regions areas that are in contact with the object and areas that are not. The former is applied with generated textures learned from real textures in the real tactile images, whereas the latter maintains its appearance as when the sensor is not in contact with any object. This makes sure that the artefacts are only applied to the deformed regions of the sensor. Our extensive experiments show that the proposed texture generation network can generate these realistic artefacts on the deformed regions of the sensor, while avoiding leaking the textures into areas of no contact. Quantitative experiments further reveal that when using the adapted images generated by our proposed network for a Sim2Real classification task, the drop in accuracy caused by the Sim2Real gap is reduced from 38.43 to merely 0.81 . As such, this work has the potential to accelerate the Sim2Real learning for robotic tasks requiring tactile sensing.


Limits of Jensen polynomials for partitions and other sequences. It was discovered recently by Griffin, Ono, Rolen and Zagier that the Jensen polynomials associated to many sequences have Hermite polynomial limits. We develop this theory in detail, based on the log polynomial property which is a refinement of log concavity and log convexity. Applications to various partition sequences are given. An application to the sequence of factorials leads naturally to evaluating limits of generalized Laguerre polynomials.


Equivalence of critical and subcritical sharp Trudinger Moser inequalities in fractional dimensions and extremal functions. We establish critical and subcritical sharp Trudinger Moser inequalities for fractional dimensions on the whole space. Moreover, we obtain asymptotic lower and upper bounds for the fractional subcritical Trudinger Moser supremum from which we can prove the equivalence between critical and subcritical inequalities. Using this equivalence, we prove the existence of maximizers for both the subcritical and critical associated extremal problems. As a by product of this development, we can explicitly calculate the value of the critical supremum in some special situations.


ArtiBoost Boosting Articulated 3D Hand Object Pose Estimation via Online Exploration and Synthesis. Estimating the articulated 3D hand object pose from a single RGB image is a highly ambiguous and challenging problem, requiring large scale datasets that contain diverse hand poses, object types, and camera viewpoints. Most real world datasets lack these diversities. In contrast, data synthesis can easily ensure those diversities separately. However, constructing both valid and diverse hand object interactions and efficiently learning from the vast synthetic data is still challenging. To address the above issues, we propose ArtiBoost, a lightweight online data enhancement method. ArtiBoost can cover diverse hand object poses and camera viewpoints through sampling in a Composited hand object Configuration and Viewpoint space (CCV space) and can adaptively enrich the current hard discernable items by loss feedback and sample re weighting. ArtiBoost alternatively performs data exploration and synthesis within a learning pipeline, and those synthetic data are blended into real world source data for training. We apply ArtiBoost on a simple learning baseline network and witness the performance boost on several hand object benchmarks. Our models and code are available at https github.com lixiny ArtiBoost.


Predicting Job Titles from Job Descriptions with Multi label Text Classification. Finding a suitable job and hunting for eligible candidates are important to job seeking and human resource agencies. With the vast information about job descriptions, employees and employers need assistance to automatically detect job titles based on job description texts. In this paper, we propose the multi label classification approach for predicting relevant job titles from job description texts, and implement the Bi GRU LSTM CNN with different pre trained language models to apply for the job titles prediction problem. The BERT with multilingual pre trained model obtains the highest result by F1 scores on both development and test sets, which are 62.20 on the development set, and 47.44 on the test set.


Positive measure of effective quasi periodic motion near a Diophantine torus. It was conjectured by Herman that an analytic Lagrangian Diophantine quasi periodic torus mathcal T 0 , invariant by a real analytic Hamiltonian system, is always accumulated by a set of positive Lebesgue measure of other Lagrangian Diophantine quasi periodic invariant tori. While the conjecture is still open, we will prove the following weaker statement there exists an open set of positive measure (in fact, the relative measure of the complement is exponentially small) around mathcal T 0 such that the motion of all initial conditions in this set is "effectively" quasi periodic in the sense that they are close to being quasi periodic for an interval of time which is doubly exponentially long with respect to the inverse of the distance to mathcal T 0 . This open set can be thought as a neighborhood of a hypothetical invariant set of Lagrangian Diophantine quasi periodic tori, which may or may not exist.


Capacity for Electromagnetic Information Theory. Traditional channel capacity based on one dimensional time domain mismatches the four dimensional electromagnetic fields, thus it cannot fully exploit the information in the spatial dimensions. Therefore, electromagnetic information theory based on the four dimensional electromagnetic fields becomes necessary to reveal the fundamental theoretical capacity bound of the communication systems. Existing works on electromagnetic information theory focused on deterministic signals and degrees of freedom, which were unable to derive the capacity due to the lack of entropy definition. In this paper, we first model the communication between two continuous regions by random field. Then, we analyze a special case with parallel linear source and destination to derive the capacity bound. Specifically, for parallel infinite length source and destination, we analyze the mutual information by spatial spectral density and derive the best current distribution on the source to achieve the maximum mutual information, i.e., the capacity. Then, we analyze the scenario with infinite length source and finite length destination. We use Mercer expansion to derive the mutual information between the source and the destination. Finally, for a practical model with finite length source and destination, we analyze its Mercer expansion and reveal its connection with the infinite length case. The capacity we analyzed reveals the theoretical limit of the communication rate between two continuous regions.


MViTv2 Improved Multiscale Vision Transformers for Classification and Detection. In this paper, we study Multiscale Vision Transformers (MViTv2) as a unified architecture for image and video classification, as well as object detection. We present an improved version of MViT that incorporates decomposed relative positional embeddings and residual pooling connections. We instantiate this architecture in five sizes and evaluate it for ImageNet classification, COCO detection and Kinetics video recognition where it outperforms prior work. We further compare MViTv2s' pooling attention to window attention mechanisms where it outperforms the latter in accuracy compute. Without bells and whistles, MViTv2 has state of the art performance in 3 domains 88.8 accuracy on ImageNet classification, 58.7 boxAP on COCO object detection as well as 86.1 on Kinetics 400 video classification. Code and models are available at https github.com facebookresearch mvit.


Explaining Classes through Word Attribution. In recent years, several methods have been proposed for explaining individual predictions of deep learning models, yet there has been little study of how to aggregate these predictions to explain how such models view classes as a whole in text classification tasks. In this work, we propose a method for explaining classes using deep learning models and the Integrated Gradients feature attribution technique by aggregating explanations of individual examples in text classification to general descriptions of the classes. We demonstrate the approach on Web register (genre) classification using the XML R model and the Corpus of Online Registers of English (CORE), finding that the method identifies plausible and discriminative keywords characterizing all but the smallest class.


On irreducible characters of the Iwahori Hecke algebra in type A . We use vertex operators to compute irreducible characters of the Iwahori Hecke algebra of type A . Two general formulas are given for the irreducible characters in terms of those of the symmetric groups or the Iwahori Hecke algebras in lower degrees. Explicit formulas are derived for the irreducible characters labeled by hooks and two row partitions. Using duality, we also formulate a determinant type Murnaghan Nakayama formula and give another proof of Ram's combinatorial Murnaghan Nakayama formula. As applications, we study super characters of the Iwahori Hecke algebra as well as the bitrace of the regular representation and provide a simple proof of the Halverson Luduc Ram formula.


Facilitating Machine Learning Model Comparison and Explanation Through A Radial Visualisation. Building an effective Machine Learning (ML) model for a data set is a difficult task involving various steps. One of the most important steps is to compare generated substantial amounts of ML models to find the optimal one for the deployment. It is challenging to compare such models with dynamic number of features. Comparison is more than just finding differences of ML model performance, users are also interested in the relations between features and model performance such as feature importance for ML explanations. This paper proposes RadialNet Chart, a novel visualisation approach to compare ML models trained with a different number of features of a given data set while revealing implicit dependent relations. In RadialNet Chart, ML models and features are represented by lines and arcs respectively. These lines are generated effectively using a recursive function. The dependence of ML models with dynamic number of features is encoded into the structure of visualisation, where ML models and their dependent features are directly revealed from related line connections. ML model performance information is encoded with colour and line width in RadialNet Chart. Together with the structure of visualisation, feature importance can be directly discerned in RadialNet Chart for ML explanations.


Image Based Reconstruction of Liquids from 2D Surface Detections. In this work, we present a solution to the challenging problem of reconstructing liquids from image data. The challenges in reconstructing liquids, which is not faced in previous reconstruction works on rigid and deforming surfaces, lies in the inability to use depth sensing and color features due the variable index of refraction, opacity, and environmental reflections. Therefore, we limit ourselves to only surface detections (i.e. binary mask) of liquids as observations and do not assume any prior knowledge on the liquids properties. A novel optimization problem is posed which reconstructs the liquid as particles by minimizing the error between a rendered surface from the particles and the surface detections while satisfying liquid constraints. Our solvers to this optimization problem are presented and no training data is required to apply them. We also propose a dynamic prediction to seed the reconstruction optimization from the previous time step. We test our proposed methods in simulation and on two new liquid datasets which we open source so the broader research community can continue developing in this under explored area.


Higher dimensional topology and generalized Hopf bifurcations for discrete dynamical systems. In this paper we study generalized Poincar 'e Andronov Hopf bifurcations of discrete dynamical systems. We prove a general result for attractors in n dimensional manifolds satisfying some suitable conditions. This result allows us to obtain sharper Hopf bifurcation theorems for fixed points in the general case and other attractors in low dimensional manifolds. Topological techniques based on the notion of concentricity of manifolds play a substantial role in the paper.


Representations of closed quadratic forms associated with Stieltjes and inverse Stieltjes holomorphic families of linear relations. In this paper holomorphic families of linear relations which belong to the Stieltjes or inverse Stieltjes class are studied. It is shown that in their domain of holomorphy mathbb C setminus mathbb R the values of Stieltjes and inverse Stieltjes families are, up to a rotation, maximal sectorial. This leads to a study of the associated closed sesquilinear forms and their representations. In particular, it is shown that the closed forms associated with the Stieltjes and inverse Stieltjes families of linear relations are holomorphic families of type (B) in the sense of Kato. These results are proved by using linear fractional transforms which connect these families to holomorphic functions that belong to a combined Nevanlinna Schur class and a key tool then relies on a specific structure of contractive operators.


The periodic orbit conjecture for steady Euler flows. The periodic orbit conjecture states that, on closed manifolds, the set of lengths of the orbits of a non vanishing vector field all whose orbits are closed admits an upper bound. This conjecture is known to be false in general due to a counterexample by Sullivan. However, it is satisfied under the geometric condition of being geodesible. In this work, we use the recent characterization of Eulerisable flows (or more generally flows admitting a strongly adapted one form) to prove that the conjecture remains true for this larger class of vector fields.


Some invariant subalgebras are graded isolated singularities. In this note, we prove that the invariant subalgebra of the ( 1) skew polynomial algebra under a permutation action is a graded isolated singularity, and thus a conjecture of Chan Young Zhang is true.


Efficient and Less Centralized Federated Learning. With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims to harness this expanding skewed data locally in order to develop rich and informative models. In centralized FL, a collection of devices collaboratively solve a ML task under the coordination of a central server. However, existing FL frameworks make an over simplistic assumption about network connectivity and ignore the communication bandwidth of the different links in the network. In this paper, we present and study a novel FL algorithm, in which devices mostly collaborate with other devices in a pairwise manner. Our nonparametric approach is able to exploit network topology to reduce communication bottlenecks. We evaluate our approach on various FL benchmarks and demonstrate that our method achieves 10X better communication efficiency and around 8 increase in accuracy compared to the centralized approach.


Weak entropy solution for a Keller Segel type fluid model. In this paper, we consider a Keller Segel type fluid model, which is a kind of Euler Poisson system with a self gravitational force. We show that similar to the parabolic case, there is a critical mass 8 pi such that if the initial total mass M is supercritical, i.e., M 8 pi , then any weak entropy solution with the same mass M must blow up in finite time. The a priori estimates of weak entropy solutions for critical mass M 8 pi and subcritical mass M 8 pi are also obtained.


Computation of the Biot Savart line integral with higher order convergence using straight segments. One common approach to computing the magnetic field produced by a filamentary current carrying coil is to approximate the coil as a series of straight segments. The Biot Savart field from each straight segment is known analytically. However, if the endpoints of the straight segments are chosen to lie on the coil, then the accuracy of the Biot Savart computation is generally only second order in the number of endpoints. We propose a simple modification shift each endpoint off the coil in the outwards normal direction by an amount proportional to the local curvature. With this modification, the Biot Savart accuracy increases to fourth order and the numerical error is dramatically reduced for a given number of discretization points.


Individual Pulse Monitoring and Dose Control System for Pre Clinical Implementation of FLASH RT. Ultra high dose rate electron sources require dose rate independent dosimeters and a calibrated dose control system for accurate delivery. In this study, we developed a single pulse dose monitoring and a real time dose based control system for a converted clinical linear accelerator (LINAC). A point scintillator detector was coupled to a gated amplifier and a real time controller for dose monitoring and feedback control loop. The controller was programmed to integrate dose and measure pulse width of each radiation pulse and gate the LINAC beam when the prescribed dose was delivered. The scintillator was mounted in solid water phantom and placed underneath mice skin for in vivo dose monitoring. Additionally, the scintillator was characterized in terms of its radiation stability, mean dose rate, and dose per pulse dependence. Dose integration was performed for each radiation pulse and displayed in real time. The scintillator was shown to be linear with mean dose rate (40 380 Gy s) and dose per pulse (0.3 1.3 Gy Pulse) to within 3 . However, the plastic scintillator was subject to significant radiation damage (16 kGy) and would need to be calibrated frequently. Pulse counting control was accurately implemented with direct correspondence between the intended and the actual delivered pulses. The dose based control was sufficient to gate on any pulse of the LINAC. In vivo dosimetry monitoring with a 1 cm circular cut out revealed that a ramp up of 4 5 pulses was present during which the average dose per pulse was 0.045 0.004 Gy Pulse, whereas after the ramp up it stabilized at 0.65 0.01 Gy Pulse. The tools presented in this study can be used to determine the beam parameter space pertinent to the FLASH effect. Additionally, this study is the first instance of real time dose based control for a modified LINAC at ultra high dose rates.


Version Reconciliation for Collaborative Databases. We propose MindPalace, a prototype of a versioned database for efficient collaborative data management. MindPalace supports offline collaboration, where users work independently without real time correspondence. The core of MindPalace is a critical step of offline collaboration reconciling divergent branches made by simultaneous data manipulation. We formalize the concept of auto mergeability, a condition under which branches may be reconciled without human intervention, and propose an efficient framework for determining whether two branches are auto mergeable and identifying particular records for manual reconciliation.


C infty symplectic invariants of parabolic orbits and flaps in integrable Hamiltonian systems. In the present paper, we consider a smooth C infty symplectic classification of Lagrangian fibrations near cusp singularities, parabolic orbits and cuspidal tori. We show that for these singularities as well as for an arrangement of singularities known as a flap, which arises in the integrable subcritical Hamiltonian Hopf bifurcation, the action variables form a complete set of C infty symplectic invariants. We also give a symplectic classification for parabolic orbits in the real analytic case. Namely, we prove that a complete symplectic invariant in this case is given by a real analytic function germ in two variables. Additionally, we construct several symplectic normal forms in the C infty and or real analytic categories, including real analytic right and right left symplectic normal forms for parabolic orbits.


Predicting Zip Code Level Vaccine Hesitancy in US Metropolitan Areas Using Machine Learning Models on Public Tweets. Although the recent rise and uptake of COVID 19 vaccines in the United States has been encouraging, there continues to be significant vaccine hesitancy in various geographic and demographic clusters of the adult population. Surveys, such as the one conducted by Gallup over the past year, can be useful in determining vaccine hesitancy, but can be expensive to conduct and do not provide real time data. At the same time, the advent of social media suggests that it may be possible to get vaccine hesitancy signals at an aggregate level (such as at the level of zip codes) by using machine learning models and socioeconomic (and other) features from publicly available sources. It is an open question at present whether such an endeavor is feasible, and how it compares to baselines that only use constant priors. To our knowledge, a proper methodology and evaluation results using real data has also not been presented. In this article, we present such a methodology and experimental study, using publicly available Twitter data collected over the last year. Our goal is not to devise novel machine learning algorithms, but to evaluate existing and established models in a comparative framework. We show that the best models significantly outperform constant priors, and can be set up using open source tools.


Revealing spatial spillover effect in high tech industry agglomeration from a high skilled labor flow network perspective. Understanding the high tech industrial agglomeration from a spatial spillover perspective is essential for cities to gain economic and technological competitive advantages. Along with rapid urbanization and the development of fast transportation networks, socioeconomic interactions between cities have been ever increasing, traditional spatial metrics are not enough to describe actual inter city connections. High skilled labor flow between cities strongly influences the high tech industrial agglomeration, yet receives less attention. By exploiting unique large scale datasets and tools from complex network and data mining, we construct an inter city high skilled labor flow network, which was integrated into spatial econometric models. Our regression results indicate that spatial spillover effects exist in the development of high tech industries in the Yangtze River Delta Urban Agglomeration region. Moreover, the spatial spillover effects are stronger among cities with a higher volume of high skilled labor flows than among cities with just stronger geographic connections. Additionally, we investigate the channels for the spillover effects and discover that inadequate local government expenses on science and technology likely hamper the high tech industrial agglomeration, so does the inadequate local educational provision. The increasing foreign direct investments in one city likely encourages the high tech industrial agglomeration in other cities because of the policy inertia toward traditional industries.


Contrastive Learning Inverts the Data Generating Process. Contrastive learning has recently seen tremendous success in self supervised learning. So far, however, it is largely unclear why the learned representations generalize so effectively to a large variety of downstream tasks. We here prove that feedforward models trained with objectives belonging to the commonly used InfoNCE family learn to implicitly invert the underlying generative model of the observed data. While the proofs make certain statistical assumptions about the generative model, we observe empirically that our findings hold even if these assumptions are severely violated. Our theory highlights a fundamental connection between contrastive learning, generative modeling, and nonlinear independent component analysis, thereby furthering our understanding of the learned representations as well as providing a theoretical foundation to derive more effective contrastive losses.


Higher order probabilistic adversarial computations Categorical semantics and program logics. Adversarial computations are a widely studied class of computations where resource bounded probabilistic adversaries have access to oracles, i.e., probabilistic procedures with private state. These computations arise routinely in several domains, including security, privacy and machine learning. In this paper, we develop program logics for reasoning about adversarial computations in a higher order setting. Our logics are built on top of a simply typed lambda calculus extended with a graded monad for probabilities and state. The grading is used to model and restrict the memory footprint and the cost (in terms of oracle calls) of computations. Under this view, an adversary is a higher order expression that expects as arguments the code of its oracles. We develop unary program logics for reasoning about error probabilities and expected values, and a relational logic for reasoning about coupling based properties. All logics feature rules for adversarial computations, and yield guarantees that are valid for all adversaries that satisfy a fixed resource policy. We prove the soundness of the logics in the category of quasi Borel spaces, using a general notion of graded predicate liftings, and we use logical relations over graded predicate liftings to establish the soundness of proof rules for adversaries. We illustrate the working of our logics with simple but illustrative examples.


Fast and High Yield Loading of a D 2 MOT of Potassium from a Cryogenic Buffer Gas Beam. We demonstrate the direct loading of a D 2 MOT of potassium 39 atoms from a cryogenic buffer gas beam source. We load 10 8 atoms in a 10 ms pulse, with no degradation in performance up to a 10 Hz repetition rate. Observed densities reach sim10 11 atoms cm 3 in a single pulse, achieved with no sub Doppler cooling or transverse compression. This system produces an ideal starting point for ultracold atom experiments where high experimental repetition rates are desirable and initial high densities are critical. Extension to other atomic species (e.g., refractory metals) that present technical challenges to high yield production using oven based sources is straightforward.


Sparse and Imperceptible Adversarial Attack via a Homotopy Algorithm. Sparse adversarial attacks can fool deep neural networks (DNNs) by only perturbing a few pixels (regularized by l 0 norm). Recent efforts combine it with another l infty imperceptible on the perturbation magnitudes. The resultant sparse and imperceptible attacks are practically relevant, and indicate an even higher vulnerability of DNNs that we usually imagined. However, such attacks are more challenging to generate due to the optimization difficulty by coupling the l 0 regularizer and box constraints with a non convex objective. In this paper, we address this challenge by proposing a homotopy algorithm, to jointly tackle the sparsity and the perturbation bound in one unified framework. Each iteration, the main step of our algorithm is to optimize an l 0 regularized adversarial loss, by leveraging the nonmonotone Accelerated Proximal Gradient Method (nmAPG) for nonconvex programming it is followed by an l 0 change control step, and an optional post attack step designed to escape bad local minima. We also extend the algorithm to handling the structural sparsity regularizer. We extensively examine the effectiveness of our proposed homotopy attack for both targeted and non targeted attack scenarios, on CIFAR 10 and ImageNet datasets. Compared to state of the art methods, our homotopy attack leads to significantly fewer perturbations, e.g., reducing 42.91 on CIFAR 10 and 75.03 on ImageNet (average case, targeted attack), at similar maximal perturbation magnitudes, when still achieving 100 attack success rates. Our codes are available at https github.com VITA Group SparseADV Homotopy.


T Quadratic Forms and Spectral Analysis of T Symmetric Tensors. An n times n times p tensor is called a T square tensor. It arises from many applications, such as the image feature extraction problem and the multi view clustering problem. We may symmetrize a T square tensor to a T symmetric tensor. For each T square tensor, we define a T quadratic form, whose variable is an n times p matrix, and whose value is a p dimensional vector. We define eigentuples and eigenmatrices for T square tensors. We show that a T symmetric tensor has unique largest and smallest eigentuples, and a T quadratic form is positive semi definite (definite) if and only if its smallest eigentuple is nonnegative (positive). The relation between the eigen decomposition of T symmetric tensors, and the TSVD of general third order tensors are also studied.


The Analysis of Discrete Event System in Autonomous Package Delivery using Legged Robot and Conveyor Belt. In this paper, the supervisory control of a Discrete Event System (DES) analyses states and events to construct an autonomous package delivery system. The delivery system includes a legged robot in order to autonomously navigate uneven indoor terrain and a conveyor belt for transporting the package to the legged robot.The aim of the paper is using the theory of supervisory control of DES to supervise and control machine's state and event and ensure robots autonomously collaborate. By applying the theory, we show the collaboration of two individual robots to deliver goods in a multi floor environment. The obtained results from the theory of supervisory control are implemented and verified in a simulation environment.


Some Intrinsic Characterizations of Besov Triebel Lizorkin Morrey type Spaces on Lipschitz Domains. We give Littlewood Paley type characterizations for Besov Triebel Lizorkin type spaces mathscr B pq s tau , mathscr F pq s tau and Besov Morrey spaces mathcal N upq s on a special Lipschitz domain Omega subset mathbb R n for a suitable sequence of Schwartz functions ( phi j) j 0 infty , f mathscr B pq s tau ( Omega) approx sup P text dyadic cubes P tau (2 js phi j ast f) j log 2 ell(P) infty ell q(L p( Omega cap P)) f mathscr F pq s tau ( Omega) approx sup P text dyadic cubes P tau (2 js phi j ast f) j log 2 ell(P) infty L p( Omega cap P ell q) f mathcal N upq s ( Omega) approx big big( sup P text dyadic cubes P frac1u frac1p cdot 2 js phi j ast f L p( Omega cap P) big) j 0 infty big ell q . We also show that f mathscr B pq s tau ( Omega) , f mathscr F pq s tau ( Omega) and f mathcal N upq s ( Omega) have equivalent (quasi )norms via derivatives for mathscr X bullet in mathscr B pq bullet, tau , mathscr F pq bullet, tau , mathcal N upq bullet , we have f mathscr X s( Omega) approx sum alpha le m partial alpha f mathscr X s m ( Omega) . In particular f mathscr F infty q s( Omega) approx sum alpha le m partial alpha f mathscr F infty q s m ( Omega) approx sup P P n q (2 js phi j ast f) j log 2 ell(P) infty ell q(L q( Omega cap P)) for all 0 q infty .


Parallel Transport on Kendall Shape Spaces. Kendall shape spaces are a widely used framework for the statistical analysis of shape data arising from many domains, often requiring the parallel transport as a tool to normalise time series data or transport gradient in optimisation procedures. We present an implementation of the pole ladder, an algorithm to compute parallel transport based on geodesic parallelograms and compare it to methods by integration of the parallel transport ordinary differential equation.


A Novel Global Feature Oriented Relational Triple Extraction Model based on Table Filling. Table filling based relational triple extraction methods are attracting growing research interests due to their promising performance and their abilities on extracting triples from complex sentences. However, this kind of methods are far from their full potential because most of them only focus on using local features but ignore the global associations of relations and of token pairs, which increases the possibility of overlooking some important information during triple extraction. To overcome this deficiency, we propose a global feature oriented triple extraction model that makes full use of the mentioned two kinds of global associations. Specifically, we first generate a table feature for each relation. Then two kinds of global associations are mined from the generated table features. Next, the mined global associations are integrated into the table feature of each relation. This "generate mine integrate" process is performed multiple times so that the table feature of each relation is refined step by step. Finally, each relation's table is filled based on its refined table feature, and all triples linked to this relation are extracted based on its filled table. We evaluate the proposed model on three benchmark datasets. Experimental results show our model is effective and it achieves state of the art results on all of these datasets. The source code of our work is available at https github.com neukg GRTE.


Convex Mixed Integer Nonlinear Programs Derived from Generalized Disjunctive Programming using Cones. We propose the formulation of convex Generalized Disjunctive Programming (GDP) problems using conic inequalities leading to conic GDP problems. We then show the reformulation of conic GDPs into Mixed Integer Conic Programming (MICP) problems through both the Big M and Hull Reformulations. These reformulations have the advantage that they are representable using the same cones as the original conic GDP. In the case of HR, they require no approximation of the perspective function. Moreover, the MICP problems derived can be solved by specialized conic solvers and offer a natural extended formulation amenable to both conic and gradient based solvers. We present the closed form of several convex functions and their respective perspectives in conic sets, allowing users to easily formulate their conic GDP problems. We finally implement a large set of conic GDP examples and solve them via the traditional and conic mixed integer reformulations. These examples include applications from Process Systems Engineering, Machine learning, and randomly generated instances. Our results show that the conic structure can be exploited to solve these challenging MICP problems more efficiently.


Launching Adversarial Attacks against Network Intrusion Detection Systems for IoT. As the internet continues to be populated with new devices and emerging technologies, the attack surface grows exponentially. Technology is shifting towards a profit driven Internet of Things market where security is an afterthought. Traditional defending approaches are no longer sufficient to detect both known and unknown attacks to high accuracy. Machine learning intrusion detection systems have proven their success in identifying unknown attacks with high precision. Nevertheless, machine learning models are also vulnerable to attacks. Adversarial examples can be used to evaluate the robustness of a designed model before it is deployed. Further, using adversarial examples is critical to creating a robust model designed for an adversarial environment. Our work evaluates both traditional machine learning and deep learning models' robustness using the Bot IoT dataset. Our methodology included two main approaches. First, label poisoning, used to cause incorrect classification by the model. Second, the fast gradient sign method, used to evade detection measures. The experiments demonstrated that an attacker could manipulate or circumvent detection with significant probability.


KPop Fandoms drive COVID 19 Public Health Messaging on Social Media. This report examines an unexpected but significant source of positive public health messaging during the COVID 19 pandemic K pop fandoms. Leveraging more than 7 million tweets related to mask wearing and K pop between March 2020 and March 2021, we analyzed the online spread of the hashtag WearAMask amid anti mask sentiments and public health misinformation. Analyses reveal the South Korean boyband BTS as the most significant driver of health discourse. Tweets from health agencies and prominent figures that mentioned K pop generate 111 times more of online response compared to tweets that did not. These tweets also elicited a strong responses from South America, Southeast Asia, and rural States areas often neglected in Twitter based messaging by mainstream social media campaigns. Our results suggest that public health institutions may leverage pre existing audience markets to synergistically diffuse and target under served communities both domestically and globally, especially during health crises such as COVID 19.


Zariski dense orbits for regular self maps of split semiabelian varieties in positive characteristic. We prove the Zariski dense orbit conjecture in positive characteristic for regular self maps of split semiabelian varieties.


Code Completion by Modeling Flattened Abstract Syntax Trees as Graphs. Code completion has become an essential component of integrated development environments. Contemporary code completion methods rely on the abstract syntax tree (AST) to generate syntactically correct code. However, they cannot fully capture the sequential and repetitive patterns of writing code and the structural information of the AST. To alleviate these problems, we propose a new code completion approach named CCAG, which models the flattened sequence of a partial AST as an AST graph. CCAG uses our proposed AST Graph Attention Block to capture different dependencies in the AST graph for representation learning in code completion. The sub tasks of code completion are optimized via multi task learning in CCAG, and the task balance is automatically achieved using uncertainty without the need to tune task weights. The experimental results show that CCAG has superior performance than state of the art approaches and it is able to provide intelligent code completion.


DC GNet Deep Mesh Relation Capturing Graph Convolution Network for 3D Human Shape Reconstruction. In this paper, we aim to reconstruct a full 3D human shape from a single image. Previous vertex level and parameter regression approaches reconstruct 3D human shape based on a pre defined adjacency matrix to encode positive relations between nodes. The deep topological relations for the surface of the 3D human body are not carefully exploited. Moreover, the performance of most existing approaches often suffer from domain gap when handling more occlusion cases in real world scenes. In this work, we propose a Deep Mesh Relation Capturing Graph Convolution Network, DC GNet, with a shape completion task for 3D human shape reconstruction. Firstly, we propose to capture deep relations within mesh vertices, where an adaptive matrix encoding both positive and negative relations is introduced. Secondly, we propose a shape completion task to learn prior about various kinds of occlusion cases. Our approach encodes mesh structure from more subtle relations between nodes in a more distant region. Furthermore, our shape completion module alleviates the performance degradation issue in the outdoor scene. Extensive experiments on several benchmarks show that our approach outperforms the previous 3D human pose and shape estimation approaches.


Utility maximization with ratchet and drawdown constraints on consumption in incomplete semimartingale markets. This paper studies expected utility maximization under ratchet and drawdown constraints on consumption in a general incomplete semimartingale market using duality methods. The optimization is considered with respect to two parameters the initial wealth and the essential lower bound on consumption process. In order to state the problem and define the primal domains, we introduce a natural extension of the notion of running maximum to arbitrary non negative optional processes and study its properties. The dual domains for optimization are characterized in terms of solidity with respect to an ordering that is introduced on the set of non negative optional processes. The abstract duality result we obtain for the optimization problem is used in order to derive a more specific characterization of solution in case of ratchet constraint in a complete market. The method described in the paper might be useful for other control problems involving running maxima or increasing controls.


On Selmer groups in the supersingular reduction case. Let p be a fixed odd prime. Let E be an elliptic curve defined over a number field F with good supersingular reduction at all primes above p . We study both the classical and plus minus Selmer groups over the cyclotomic mathbb Z p extension of F . In particular, we give sufficient conditions for these Selmer groups to not contain a non trivial sub module of finite index. Furthermore, when p splits completely in F , we calculate the Euler characteristics of the plus minus Selmer groups over the compositum of all mathbb Z p extensions of F when they are defined.


Diode pumped silicate fiber for visible laser emission. We demonstrate yellow laser emission using silicate glass fiber as the gain medium. By employing core pumping using widely available GaN diode lasers with emission at 445 nm, we show that Dy3 doped aluminosilicate glass fiber can be readily excited creating sufficient gain at 581 nm. In this proof of concept demonstration, the maximum output power generated was 3 mW with a slope efficiency approximately 1.8 with respect to injected pump.


A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods. Opinion and sentiment analysis is a vital task to characterize subjective information in social media posts. In this paper, we present a comprehensive experimental evaluation and comparison with six state of the art methods, from which we have re implemented one of them. In addition, we investigate different textual and visual feature embeddings that cover different aspects of the content, as well as the recently introduced multimodal CLIP embeddings. Experimental results are presented for two different publicly available benchmark datasets of tweets and corresponding images. In contrast to the evaluation methodology of previous work, we introduce a reproducible and fair evaluation scheme to make results comparable. Finally, we conduct an error analysis to outline the limitations of the methods and possibilities for the future work.


Discrete Approximation to Brownian Motion with Varying Dimension in Unbounded Domains. We establish the discrete approximation to Brownian motion with varying dimension (BMVD in abbreviation) by random walks. The setting is very similar to that in 11 , but here we use a different method allowing us to get rid the restrictions in 11 (or 3 ) that the underlying state space has to be bounded, and that the initial distribution of the limiting continuous process has to be its invariant distribution. The approach in this paper is that we first obtain heat kernel upper bounds for the approximating random walks that are uniform in their mesh size, by establishing a Nash type inequality based on their Dirichlet form characterization. Using the heat kernel upper bound, we then show the tightness of the approximating random walks by delicate analysis.


Profit equitably An investigation of market maker's impact on equitable outcomes. We look at discovering the impact of market microstructure on equitability for market participants at public exchanges such as the New York Stock Exchange or NASDAQ. Are these environments equitable venues for low frequency participants (such as retail investors)? In particular, can market makers contribute to equitability for these agents? We use a simulator to assess the effect a market marker can have on equality of outcomes for consumer or retail traders by adjusting its parameters. Upon numerically quantifying market equitability by the entropy of the price returns distribution of consumer agents, we demonstrate that market makers indeed support equitability and that a negative correlation is observed between the profits of the market maker and equitability. We then use multi objective reinforcement learning to concurrently optimize for the two objectives of consumer agent equitability and market maker profitability, which leads us to learn policies that facilitate lower market volatility and tighter spreads for comparable profit levels.


A threshold search based memetic algorithm for the disjunctively constrained knapsack problem. The disjunctively constrained knapsack problem consists in packing a subset of pairwisely compatible items in a capacity constrained knapsack such that the total profit of the selected items is maximized while satisfying the knapsack capacity. DCKP has numerous applications and is however computationally challenging (NP hard). In this work, we present a threshold search based memetic algorithm for solving the DCKP that combines the memetic framework with threshold search to find high quality solutions. Extensive computational assessments on two sets of 6340 benchmark instances in the literature demonstrate that the proposed algorithm is highly competitive compared to the state of the art methods. In particular, we report 24 and 354 improved best known results (new lower bounds) for Set I (100 instances) and for Set II (6240 instances), respectively. We analyze the key algorithmic components and shed lights on their roles for the performance of the algorithm. The code of our algorithm will be made publicly available.


DNA Origami Catenanes Templated by Gold Nanoparticles. Mechanically interlocked molecules have marked a breakthrough in the field of topological chemistry and boosted the vigorous development of molecular machinery. As an archetypal example of the interlocked molecules, catenanes comprise macrocycles that are threaded through one another like links in a chain. Inspired by the transition metal templated approach of catenanes synthesis, the hierarchical assembly of DNA origami catenanes templated by gold nanoparticles is demonstrated in this work. DNA origami catenanes, which contain two, three or four interlocked rings are successfully created. In particular, the origami rings within the individual catenanes can be set free with respect to one another by releasing the interconnecting gold nanoparticles. This work will set the basis for rich progress toward DNA based molecular architectures with unique structural programmability and well defined topology.


Exploratory evaluation of politeness in human robot interaction. Aiming to explore the impact of politeness on Human robot interaction, this study tested varying levels of politeness in a human robot collaborative table setting task. Polite behaviour was designed based on the politeness rules of Lakoff. A graphical user interface was developed for the interaction with the robot offering three levels of politeness, and an experiment was conducted with 20 older adults and 30 engineering students. Results indicated that the quality of interaction was influenced by politeness as participants significantly preferred the polite mode of the robot. However, the older adults were less able to distinguish between the three politeness levels. Future studies should thus include pre experiment training to increase the familiarity of the older adults with robotic technology. These studies should also include other permutations of the politeness rules of Lakoff.


Existence of varphi attractor and estimate of their attractive velocity for infinite dimensional dynamical systems. This paper is devoted to the quantitative study of the attractive velocity of generalized attractors for infinite dimensional dynamical systems. We introduce the notion of varphi attractor whose attractive speed is characterized by a general non negative decay function varphi , and prove that varphi decay with respect to noncompactness measure is a sufficient condition for a dissipitive system to have a varphi attractor. Furthermore, several criteria for varphi decay with respect to noncompactness measure are provided. Finally, as an application, we establish the existence of a generalized exponential attractor and the specific estimate of its attractive velocity for a semilinear wave equation with a critical nonlinearity.


Exploiting co execution with oneAPI heterogeneity from a modern perspective. Programming efficiently heterogeneous systems is a major challenge, due to the complexity of their architectures. Intel oneAPI, a new and powerful standards based unified programming model, built on top of SYCL, addresses these issues. In this paper, oneAPI is provided with co execution strategies to run the same kernel between different devices, enabling the exploitation of static and dynamic policies. On top of that, static and dynamic load balancing algorithms are integrated and analyzed. This work evaluates the performance and energy efficiency for a well known set of regular and irregular HPC benchmarks, using an integrated GPU and CPU. Experimental results show that co execution is worthwhile when using dynamic algorithms, improving efficiency even more when using unified shared memory.


Convergence of Densities of Spatial Averages of Stochastic Heat Equation. In this paper, we consider the one dimensional stochastic heat equation driven by a space time white noise. In two different scenarios it (i) initial condition u 0 1 and general nonlinear coefficient sigma and it (ii) initial condition u 0 delta 0 and sigma(x) x (Parabolic Anderson Model), we establish rates of convergence for the uniform distance between the density of (renormalized) spatial averages and the standard normal density. These results are based on the combination of Stein method for normal approximations and Malliavin calculus techniques. A key ingredient in Case (i) is a new estimate on the L p norm of the second Malliavin derivative.


An Empirical Comparison of Off policy Prediction Learning Algorithms in the Four Rooms Environment. Many off policy prediction learning algorithms have been proposed in the past decade, but it remains unclear which algorithms learn faster than others. We empirically compare 11 off policy prediction learning algorithms with linear function approximation on two small tasks the Rooms task, and the High Variance Rooms task. The tasks are designed such that learning fast in them is challenging. In the Rooms task, the product of importance sampling ratios can be as large as 2 14 and can sometimes be two. To control the high variance caused by the product of the importance sampling ratios, step size should be set small, which in turn slows down learning. The High Variance Rooms task is more extreme in that the product of the ratios can become as large as 2 14 times 25 . This paper builds upon the empirical study of off policy prediction learning algorithms by Ghiassian and Sutton (2021). We consider the same set of algorithms as theirs and employ the same experimental methodology. The algorithms considered are Off policy TD( lambda ), five Gradient TD algorithms, two Emphatic TD algorithms, Tree Backup( lambda ), Vtrace( lambda ), and ABTD( zeta ). We found that the algorithms' performance is highly affected by the variance induced by the importance sampling ratios. The data shows that Tree Backup( lambda ), Vtrace( lambda ), and ABTD( zeta ) are not affected by the high variance as much as other algorithms but they restrict the effective bootstrapping parameter in a way that is too limiting for tasks where high variance is not present. We observed that Emphatic TD( lambda ) tends to have lower asymptotic error than other algorithms, but might learn more slowly in some cases. We suggest algorithms for practitioners based on their problem of interest, and suggest approaches that can be applied to specific algorithms that might result in substantially improved algorithms.