Exploring a Handwriting Programming Language for Educational Robots. Recently, introducing computer science and educational robots in compulsory education has received increasing attention. However, the use of screens in classrooms is often met with resistance, especially in primary school. To address this issue, this study presents the development of a handwriting based programming language for educational robots. Aiming to align better with existing classroom practices, it allows students to program a robot by drawing symbols with ordinary pens and paper. Regular smartphones are leveraged to process the hand drawn instructions using computer vision and machine learning algorithms, and send the commands to the robot for execution. To align with the local computer science curriculum, an appropriate playground and scaffolded learning tasks were designed. The system was evaluated in a preliminary test with eight teachers, developers and educational researchers. While the participants pointed out that some technical aspects could be improved, they also acknowledged the potential of the approach to make computer science education in primary school more accessible.


Discourse Comprehension A Question Answering Framework to Represent Sentence Connections. While there has been substantial progress in text comprehension through simple factoid question answering, more holistic comprehension of a discourse still presents a major challenge. Someone critically reflecting on a text as they read it will pose curiosity driven, often open ended questions, which reflect deep understanding of the content and require complex reasoning to answer. A key challenge in building and evaluating models for this type of discourse comprehension is the lack of annotated data, especially since finding answers to such questions (which may not be answered at all) requires high cognitive load for annotators over long documents. This paper presents a novel paradigm that enables scalable data collection targeting the comprehension of news documents, viewing these questions through the lens of discourse. The resulting corpus, DCQA (Discourse Comprehension by Question Answering), consists of 22,430 question answer pairs across 607 English documents. DCQA captures both discourse and semantic links between sentences in the form of free form, open ended questions. On an evaluation set that we annotated on questions from the INQUISITIVE dataset, we show that DCQA provides valuable supervision for answering open ended questions. We additionally design pre training methods utilizing existing question answering resources, and use synthetic data to accommodate unanswerable questions.


On the Unimportance of Superintelligence. Humankind faces many existential threats, but has limited resources to mitigate them. Choosing how and when to deploy those resources is, therefore, a fateful decision. Here, I analyze the priority for allocating resources to mitigate the risk of superintelligences. Part I observes that a superintelligence unconnected to the outside world (de efferented) carries no threat, and that any threat from a harmful superintelligence derives from the peripheral systems to which it is connected, e.g., nuclear weapons, biotechnology, etc. Because existentially threatening peripheral systems already exist and are controlled by humans, the initial effects of a superintelligence would merely add to the existing human derived risk. This additive risk can be quantified and, with specific assumptions, is shown to decrease with the square of the number of humans having the capability to collapse civilization. Part II proposes that biotechnology ranks high in risk among peripheral systems because, according to all indications, many humans already have the technological capability to engineer harmful microbes having pandemic spread. Progress in biomedicine and computing will proliferate this threat. Savant'' software that is not generally superintelligent will underpin much of this progress, thereby becoming the software responsible for the highest and most imminent existential risk ahead of hypothetical risk from superintelligences. The analysis concludes that resources should be preferentially applied to mitigating the risk of peripheral systems and savant software. Concerns about superintelligence are at most secondary, and possibly superfluous.


Tractable Fragments of the Maximum Nash Welfare Problem. We study the problem of maximizing Nash welfare (MNW) while allocating indivisible goods to asymmetric agents. The Nash welfare of an allocation is the weighted geometric mean of agents' utilities, and the allocation with maximum Nash welfare is known to satisfy several desirable fairness and efficiency properties. However, computing such an MNW allocation is NP hard, even for two agents with identical, additive valuations. Hence, we aim to identify tractable classes that either admit a PTAS, an FPTAS, or an exact polynomial time algorithm. To this end, we design a PTAS for finding an MNW allocation for the case of asymmetric agents with identical, additive valuations, thus generalizing a similar result for symmetric agents. Our techniques can also be adapted to give a PTAS for the problem of computing the optimal p mean welfare. We also show that an MNW allocation can be computed exactly in polynomial time for identical agents with k ary valuations when k is a constant, where every agent has at most k different values for the goods. Next, we consider the special case where every agent finds at most two goods valuable, and show that this class admits an efficient algorithm, even for general monotone valuations. In contrast, we note that when agents can value three or more goods, maximizing Nash welfare is NP hard, even when agents are symmetric and have additive valuations, showing our algorithmic result is essentially tight. Finally, we show that for constantly many asymmetric agents with additive valuations, the MNW problem admits an FPTAS.


Inferring bias and uncertainty in camera calibration. Accurate camera calibration is a precondition for many computer vision applications. Calibration errors, such as wrong model assumptions or imprecise parameter estimation, can deteriorate a system's overall performance, making the reliable detection and quantification of these errors critical. In this work, we introduce an evaluation scheme to capture the fundamental error sources in camera calibration systematic errors (biases) and uncertainty (variance). The proposed bias detection method uncovers smallest systematic errors and thereby reveals imperfections of the calibration setup and provides the basis for camera model selection. A novel resampling based uncertainty estimator enables uncertainty estimation under non ideal conditions and thereby extends the classical covariance estimator. Furthermore, we derive a simple uncertainty metric that is independent of the camera model. In combination, the proposed methods can be used to assess the accuracy of individual calibrations, but also to benchmark new calibration algorithms, camera models, or calibration setups. We evaluate the proposed methods with simulations and real cameras.


Are automated static analysis tools worth it? An investigation into relative warning density and external software quality. Automated Static Analysis Tools (ASATs) are part of software development best practices. ASATs are able to warn developers about potential problems in the code. On the one hand, ASATs are based on best practices so there should be a noticeable effect on software quality. On the other hand, ASATs suffer from false positive warnings, which developers have to inspect and then ignore or mark as invalid. In this article, we ask the question if ASATs have a measurable impact on external software quality, using the example of PMD for Java. We investigate the relationship between ASAT warnings emitted by PMD on defects per change and per file. Our case study includes data for the history of each file as well as the differences between changed files and the project in which they are contained. We investigate whether files that induce a defect have more static analysis warnings than the rest of the project. Moreover, we investigate the impact of two different sets of ASAT rules. We find that, bug inducing files contain less static analysis warnings than other files of the project at that point in time. However, this can be explained by the overall decreasing warning density. When compared with all other changes, we find a statistically significant difference in one metric for all rules and two metrics for a subset of rules. However, the effect size is negligible in all cases, showing that the actual difference in warning density between bug inducing changes and other changes is small at best.


M3DSSD Monocular 3D Single Stage Object Detector. In this paper, we propose a Monocular 3D Single Stage object Detector (M3DSSD) with feature alignment and asymmetric non local attention. Current anchor based monocular 3D object detection methods suffer from feature mismatching. To overcome this, we propose a two step feature alignment approach. In the first step, the shape alignment is performed to enable the receptive field of the feature map to focus on the pre defined anchors with high confidence scores. In the second step, the center alignment is used to align the features at 2D 3D centers. Further, it is often difficult to learn global information and capture long range relationships, which are important for the depth prediction of objects. Therefore, we propose a novel asymmetric non local attention block with multi scale sampling to extract depth wise features. The proposed M3DSSD achieves significantly better performance than the monocular 3D object detection methods on the KITTI dataset, in both 3D object detection and bird's eye view tasks.


Unsupervised Knowledge Graph Alignment by Probabilistic Reasoning and Semantic Embedding. Knowledge Graph (KG) alignment is to discover the mappings (i.e., equivalent entities, relations, and others) between two KGs. The existing methods can be divided into the embedding based models, and the conventional reasoning and lexical matching based systems. The former compute the similarity of entities via their cross KG embeddings, but they usually rely on an ideal supervised learning setting for good performance and lack appropriate reasoning to avoid logically wrong mappings while the latter address the reasoning issue but are poor at utilizing the KG graph structures and the entity contexts. In this study, we aim at combining the above two solutions and thus propose an iterative framework named PRASE which is based on probabilistic reasoning and semantic embedding. It learns the KG embeddings via entity mappings from a probabilistic reasoning system named PARIS, and feeds the resultant entity mappings and embeddings back into PARIS for augmentation. The PRASE framework is compatible with different embedding based models, and our experiments on multiple datasets have demonstrated its state of the art performance.


Balancing Rational and Other Regarding Preferences in Cooperative Competitive Environments. Recent reinforcement learning studies extensively explore the interplay between cooperative and competitive behaviour in mixed environments. Unlike cooperative environments where agents strive towards a common goal, mixed environments are notorious for the conflicts of selfish and social interests. As a consequence, purely rational agents often struggle to achieve and maintain cooperation. A prevalent approach to induce cooperative behaviour is to assign additional rewards based on other agents' well being. However, this approach suffers from the issue of multi agent credit assignment, which can hinder performance. This issue is efficiently alleviated in cooperative setting with such state of the art algorithms as QMIX and COMA. Still, when applied to mixed environments, these algorithms may result in unfair allocation of rewards. We propose BAROCCO, an extension of these algorithms capable to balance individual and social incentives. The mechanism behind BAROCCO is to train two distinct but interwoven components that jointly affect each agent's decisions. Our meta algorithm is compatible with both Q learning and Actor Critic frameworks. We experimentally confirm the advantages over the existing methods and explore the behavioural aspects of BAROCCO in two mixed multi agent setups.


Stochastic transport equation with singular drift. We prove existence, uniqueness and Sobolev regularity of weak solution of the Cauchy problem of the stochastic transport equation with drift in a large class of singular vector fields containing, in particular, the L d class, the weak L d class, as well as some vector fields that are not even in L rm loc 2 varepsilon for any varepsilon 0 .


Quasi strongly regular graphs of grade three with diameter two. A quasi strongly regular graph of grade p with parameters (n, k, a c 1, ldots, c p) is a k regular graph of order n such that any two adjacent vertices share a common neighbours and any two non adjacent vertices share c i common neighbours for some 1 leq i leq p . This is a generalization of a strongly regular graph. In this paper, we focus on strictly quasi strongly regular graphs of grade 3 with c i k i for i 1, 2, 3 . The main result is to show the sharp bounds of order n for a given k geq 4 . Furthermore, by this result, we characterize all of these graphs whose n satisfies upper or lower bounds.


Measure and Improve Robustness in NLP Models A Survey. As NLP models achieved state of the art performances over benchmarks and gained wide applications, it has been increasingly important to ensure the safe deployment of these models in the real world, e.g., making sure the models are robust against unseen or challenging scenarios. Despite robustness being an increasingly studied topic, it has been separately explored in applications like vision and NLP, with various definitions, evaluation and mitigation strategies in multiple lines of research. In this paper, we aim to provide a unifying survey of how to define, measure and improve robustness in NLP. We first connect multiple definitions of robustness, then unify various lines of work on identifying robustness failures and evaluating models' robustness. Correspondingly, we present mitigation strategies that are data driven, model driven, and inductive prior based, with a more systematic view of how to effectively improve robustness in NLP models. Finally, we conclude by outlining open challenges and future directions to motivate further research in this area.


Paired Examples as Indirect Supervision in Latent Decision Models. Compositional, structured models are appealing because they explicitly decompose problems and provide interpretable intermediate outputs that give confidence that the model is not simply latching onto data artifacts. Learning these models is challenging, however, because end task supervision only provides a weak indirect signal on what values the latent decisions should take. This often results in the model failing to learn to perform the intermediate tasks correctly. In this work, we introduce a way to leverage paired examples that provide stronger cues for learning latent decisions. When two related training examples share internal substructure, we add an additional training objective to encourage consistency between their latent decisions. Such an objective does not require external supervision for the values of the latent output, or even the end task, yet provides an additional training signal to that provided by individual training examples themselves. We apply our method to improve compositional question answering using neural module networks on the DROP dataset. We explore three ways to acquire paired questions in DROP (a) discovering naturally occurring paired examples within the dataset, (b) constructing paired examples using templates, and (c) generating paired examples using a question generation model. We empirically demonstrate that our proposed approach improves both in and out of distribution generalization and leads to correct latent decision predictions.


Ballast water mediated species spread risk dynamics and policy implications to reduce the invasion risk to the Mediterranean Sea. The Mediterranean Sea is one of the most heavily invaded marine regions. This work focuses on the dynamics and potential policy options for ballast water mediated nonindigenous species to the Mediterranean. Specifically, we (1) estimated port risks in years 2012, 2015, and 2018, (2) identified hub ports that connect many clusters, and (3) evaluated four regulatory scenarios. The risk results show that Gibraltar, Suez, and Istanbul remained high risk ports from 2012 2018, and they served as hub ports that connected several spread clusters. With policy scenario analysis, we found that regulating the high risk hub ports can disproportionately reduce the overall risk to the Mediterranean the average risk to all ports was reduced by 5 10 by regulating one high risk hub port, while the average risk to all ports was only reduced by 0.2 by regulating one average risk Mediterranean port. We also found that only regulating high risk ports cannot reduce their risks effectively.


Effect of pseudo datasets for the classification based engineering design. Machine learning classification techniques have been used widely to recognize the feasible design domain and discover hidden patterns in engineering design. An accurate classification model needs a large dataset however, generating a large dataset is costly for complex simulation based problems. After training by a small dataset, surrogate models can generate a large pseudo dataset efficiently. Errors, however, may be introduced by surrogate modeling. This paper investigates the mutual effect of a large pseudo dataset and surrogate modeling uncertainty. Four widely used methods, i.e., Naive Bayes classifier, support vector machine, random forest regression, and artificial neural network for classification, are studied on four benchmark problems. Kriging is used as the basic surrogate model method. The results show that a large pseudo dataset improves the classification accuracy, which depends on both design problems and classification algorithms. Except for the Naive Bayes, the other three methods are recommended for using pseudo data to improve classification performance. Also, a wind turbine design problem is used to illustrate the effect of the pseudo dataset on feasible subspace recognition. The large pseudo dataset improves the recognized subspace bound greatly, which can be reproduced by classification models well except for the Naive Bayes classifier. Under the uncertainty of surrogate modeling, the random forest presents high robustness to recognize the feasible design domain bound, while the artificial neural network demonstrates a high sensitivity to uncertainty with the recognized bound deteriorated.


Report on the AAPM deep learning sparse view CT (DL sparse view CT) Grand Challenge. Purpose The purpose of the challenge is to find the deep learning technique for sparse view CT image reconstruction that can yield the minimum RMSE under ideal conditions, thereby addressing the question of whether or not deep learning can solve inverse problems in imaging. Methods The challenge set up involves a 2D breast CT simulation, where the simulated breast phantom has random fibro glandular structure and high contrast specks. The phantom allows for arbitrarily large training sets to be generated with perfectly known truth. The training set consists of 4000 cases where each case consists of the truth image, 128 view sinogram data, and the corresponding 128 view filtered back projection (FBP) image. The networks are trained to predict the truth image from either the sinogram or FBP data. Geometry information is not provided. The participating algorithms are tested on a data set consisting of 100 new cases. Results About 60 groups participated in the challenge at the validation phase, and 25 groups submitted test phase results along with reports on their deep learning methodology. The winning team improved reconstruction accuracy by two orders of magnitude over our previous CNN based study on a similar test problem. Conclusions The DL sparse view challenge provides a unique opportunity to examine the state of the art in deep learning techniques for solving the sparse view CT inverse problem.


Locating Faulty Methods with a Mixed RNN and Attention Model. IR based fault localization approaches achieves promising results when locating faulty files by comparing a bug report with source code. Unfortunately, they become less effective to locate faulty methods. We conduct a preliminary study to explore its challenges, and identify three problems the semantic gap problem, the representation sparseness problem, and the single revision problem. To tackle these problems, we propose MRAM, a mixed RNN and attention model, which combines bug fixing features and method structured features to explore both implicit and explicit relevance between methods and bug reports for method level fault localization task. The core ideas of our model are (1) constructing code revision graphs from code, commits and past bug reports, which reveal the latent relations among methods to augment short methods and as well provide all revisions of code and past fixes to train more accurate models (2) embedding three method structured features (token sequences, API invocation sequences, and comments) jointly with RNN and soft attention to represent source methods and obtain their implicit relevance with bug reports and (3) integrating multirevision bug fixing features, which provide the explicit relevance between bug reports and methods, to improve the performance. We have implemented MRAM and conducted a controlled experiment on five open source projects. Comparing with stateof the art approaches, our MRAM improves MRR values by 3.8 5.1 (3.7 5.4 ) when the dataset contains (does not contain) localized bug reports. Our statistics test shows that our improvements are significant


Injective and tilting resolutions for induced modules. Let k be an algebraically closed field of characteristic p 0 and let G be a symplectic or general linear group over k. We consider induced modules for G under the assumption that p is bigger than the greatest hook length in the partitions involved. We give explicit constructions of left resolutions of induced modules by tilting modules. We also give injective resolutions for induced modules in certain truncated categories. We show that the multiplicities of the indecomposable tilting and injective modules in these resolutions are the coefficients of certain Kazhdan Lusztig type polynomials. This builds further on work of Cox De Visscher and Brundan Stroppel.


Geometry and organization of coherent structures in stably stratified atmospheric boundary layers. Global intermittency is observed in the stably stratified Atmospheric Boundary Layer (ABL) and corresponds to having large nonturbulent flow regions to develop in an otherwise turbulent flow. In this paper, the differences between continuous and intermittent turbulence are quantified with the help of coherent structures. Eight classes of coherent structures are identified from literature, most of which are indicated by scalar criteria derived from velocity fields. A method is developed to geometrically classify structures into three categories blob like, tube like or sheet like. An alternate definition of the intermittency factor gamma based on coherent structures is introduced to separate turbulent and nonturbulent parts of a flow. Applying this conditioning technique and the geometrical characterization on direct numerical simulations (DNS) of an Ekman flow, we find the following (i) structures with similar geometries (either tube like or sheet like) are found regardless of the strength of stratification (ii) global intermittency affects all regions of the ABL viscous sublayer, buffer layer, inner, and outer layer (iii) for the highly stratified case, sweep ejection pairs form well separated clusters within the viscous sublayer which can possibly explain the abundance of hairpin like vortices with a particular orientation (iv) nonturbulent regions are occupied with streamwise velocity fluctuations and there is a switch between high and low speed streaks at a particular height for all stratified cases.


RockNER A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models. To audit the robustness of named entity recognition (NER) models, we propose RockNER, a simple yet effective method to create natural adversarial examples. Specifically, at the entity level, we replace target entities with other entities of the same semantic class in Wikidata at the context level, we use pre trained language models (e.g., BERT) to generate word substitutions. Together, the two levels of attack produce natural adversarial examples that result in a shifted distribution from the training data on which our target models have been trained. We apply the proposed method to the OntoNotes dataset and create a new benchmark named OntoRock for evaluating the robustness of existing NER models via a systematic evaluation protocol. Our experiments and analysis reveal that even the best model has a significant performance drop, and these models seem to memorize in domain entity patterns instead of reasoning from the context. Our work also studies the effects of a few simple data augmentation methods to improve the robustness of NER models.


Bimolecular chemistry in the ultracold regime. Advances in atomic, molecular, and optical (AMO) physics techniques allowed the cooling of simple molecules down to the ultracold regime ( lesssim 1 mK), and opened the opportunities to study chemical reactions with unprecedented levels of control. This review covers recent developments in studying bimolecular chemistry at ultralow temperatures. We begin with a brief overview of methods for producing, manipulating, and detecting ultracold molecules. We then survey experimental works that exploit the controllability of ultracold molecules to probe and modify their long range interactions. Further combining the use of physical chemistry techniques, such as mass spectrometry and ion imaging, significantly improved the detection of ultracold reactions and enabled explorations of their dynamics in the short range. We discuss a series of studies on the reaction KRb KRb rightarrow K 2 Rb 2 initiated below 1 mu K, including the direct observation of a long lived complex, the demonstration of product rotational state control via conserved nuclear spins, and a test of the statistical model using the complete quantum state distribution of the products.


Attention Weights in Transformer NMT Fail Aligning Words Between Sequences but Largely Explain Model Predictions. This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder decoder attention mechanism, we prove that attention weights systematically make alignment errors by relying mainly on uninformative tokens from the source sequence. However, we observe that NMT models assign attention to these tokens to regulate the contribution in the prediction of the two contexts, the source and the prefix of the target sequence. We provide evidence about the influence of wrong alignments on the model behavior, demonstrating that the encoder decoder attention mechanism is well suited as an interpretability method for NMT. Finally, based on our analysis, we propose methods that largely reduce the word alignment error rate compared to standard induced alignments from attention weights.


A Random Point Initialization Approach to Image Segmentation with Variational Level sets. Image segmentation is an essential component in many image processing and computer vision tasks. The primary goal of image segmentation is to simplify an image for easier analysis, and there are two broad approaches for achieving this edge based methods, which extract the boundaries of specific known objects, and region based methods, which partition the image into regions that are statistically homogeneous. One of the more prominent edge finding methods, known as the level set method, evolves a zero level contour in the image plane with gradient descent until the contour has converged to the object boundaries. While the classical level set method and its variants have proved successful in segmenting real images, they are susceptible to becoming stuck in noisy regions of the image plane without a priori knowledge of the image and they are unable to provide details beyond object outer boundary locations. We propose a modification to the variational level set image segmentation method that can quickly detect object boundaries by making use of random point initialization. We demonstrate the efficacy of our approach by comparing the performance of our method on real images to that of the prominent Canny Method.


Metric description of flexible octahedra. For flexibility of an octahedron we find necessary metric conditions in terms of edge lengths. These conditions yield a new description of Bricard's octahedra, suitable for solving some problems in metric geometry of octahedra, in particular, for searching the proof of I. ,Hh Sabitov hypothesis that all non leading coefficients of the volume polynomial for an octahedron of third type are zero.


Few shot Multi hop Question Answering over Knowledge Base. KBQA is a task that requires to answer questions by using semantic structured information in knowledge base. Previous work in this area has been restricted due to the lack of large semantic parsing dataset and the exponential growth of searching space with the increasing hops of relation paths. In this paper, we propose an efficient pipeline method equipped with a pre trained language model. By adopting Beam Search algorithm, the searching space will not be restricted in subgraph of 3 hops. Besides, we propose a data generation strategy, which enables our model to generalize well from few training samples. We evaluate our model on an open domain complex Chinese Question Answering task CCKS2019 and achieve F1 score of 62.55 on the test dataset. In addition, in order to test the few shot learning capability of our model, we ramdomly select 10 of the primary data to train our model, the result shows that our model can still achieves F1 score of 58.54 , which verifies the capability of our model to process KBQA task and the advantage in few shot Learning.


Resilient and consistent multirobot cooperative localization with covariance intersection. Cooperative localization is fundamental to autonomous multirobot systems, but most algorithms couple inter robot communication with observation, making these algorithms susceptible to failures in both communication and observation steps. To enhance the resilience of multirobot cooperative localization algorithms in a distributed system, we use covariance intersection to formalize a localization algorithm with an explicit communication update and ensure estimation consistency at the same time. We investigate the covariance boundedness criterion of our algorithm with respect to communication and observation graphs, demonstrating provable localization performance under even sparse communications topologies. We substantiate the resilience of our algorithm as well as the boundedness analysis through experiments on simulated and benchmark physical data against varying communications connectivity and failure metrics. Especially when inter robot communication is entirely blocked or partially unavailable, we demonstrate that our method is less affected and maintains desired performance compared to existing cooperative localization algorithms.


Backus problem in geophysics a resolution near the dipole in fractional Sobolev spaces. We consider Backus's problem in geophysics. This consists in reconstructing a harmonic potential outside the Earth when the intensity of the related field is measured on the Earth's surface. Thus, the boundary condition is (severely) nonlinear. The gravitational case is quite understood. It consists in the local resolution near a monopole, i.e. the potential generated by a point mass. In this paper, we consider the geomagnetic case. This consists in linearizing the field's intensity near the so called dipole, a harmonic function which models the solenoidal potential of a magnet. The problem is quite difficult, because the resolving operator related to the linearized problem is generally unbounded. Indeed, existence results for Backus's problem in this framework are not present in the literature. In this work, we locally solve the geomagnetic version of Backus's problem in the axially symmetric case. In mathematical terms, we show the existence of harmonic functions in the exterior of a sphere, with given (boundary) field's intensity sufficiently close to that of a dipole and which have the same axial symmetry of a dipole. We also show that unique solutions can be selected by prescribing the average of the potential on the equatorial circle of the sphere. We obtain those solutions as series of spherical harmonics. The functional framework entails the use of fractional Sobolev Hilbert spaces on the sphere, endowed with a spectral norm. A crucial ingredient is the algebra structure of suitable subspaces.


SilGAN Generating driving maneuvers for scenario based software in the loop testing. Automotive software testing continues to rely largely upon expensive field tests to ensure quality because alternatives like simulation based testing are relatively immature. As a step towards lowering reliance on field tests, we present SilGAN, a deep generative model that eases specification, stimulus generation, and automation of automotive software in the loop testing. The model is trained using data recorded from vehicles in the field. Upon training, the model uses a concise specification for a driving scenario to generate realistic vehicle state transitions that can occur during such a scenario. Such authentic emulation of internal vehicle behavior can be used for rapid, systematic and inexpensive testing of vehicle control software. In addition, by presenting a targeted method for searching through the information learned by the model, we show how a test objective like code coverage can be automated. The data driven end to end testing pipeline that we present vastly expands the scope and credibility of automotive simulation based testing. This reduces time to market while helping maintain required standards of quality.


The role physics can play in a multi disciplinary curriculum for non physics scientists and engineers. At many physics departments a significant fraction of teaching is in support of engineers and scientists in other majors. These service courses are thus an automatic crucible of interdisciplinary interaction, and at times, strife. For example, the traditional algebra based physics course is often considered by both biology faculty and students as having little relevance to their discipline. To address this issue, our multi disciplinary multi university team has been negotiating the role of a physics in the curriculum of life science students In NEXUS Physics we have designed a class that stresses traditional physics skills but in contexts chosen to better meet the needs of life science students. Non standard topics include chemical energy, diffusion and random motion, and thermodynamics with careful discussions of entropy, enthalpy, and Gibbs free energy. Explorations into how physics intertwines with an engineer's curriculum suggests places where analogous negotiations could lead to substantial modifications of physics courses for engineers that substantially enhance their value for engineering students.


Probabilistic Impact Score Generation using Ktrain BERT to Identify Hate Words from Twitter Discussions. Social media has seen a worrying rise in hate speech in recent times. Branching to several distinct categories of cyberbullying, gender discrimination, or racism, the combined label for such derogatory content can be classified as toxic content in general. This paper presents experimentation with a Keras wrapped lightweight BERT model to successfully identify hate speech and predict probabilistic impact score for the same to extract the hateful words within sentences. The dataset used for this task is the Hate Speech and Offensive Content Detection (HASOC 2021) data from FIRE 2021 in English. Our system obtained a validation accuracy of 82.60 , with a maximum F1 Score of 82.68 . Subsequently, our predictive cases performed significantly well in generating impact scores for successful identification of the hate tweets as well as the hateful words from tweet pools.


A Gated Fusion Network for Dynamic Saliency Prediction. Predicting saliency in videos is a challenging problem due to complex modeling of interactions between spatial and temporal information, especially when ever changing, dynamic nature of videos is considered. Recently, researchers have proposed large scale datasets and models that take advantage of deep learning as a way to understand what's important for video saliency. These approaches, however, learn to combine spatial and temporal features in a static manner and do not adapt themselves much to the changes in the video content. In this paper, we introduce Gated Fusion Network for dynamic saliency (GFSalNet), the first deep saliency model capable of making predictions in a dynamic way via gated fusion mechanism. Moreover, our model also exploits spatial and channel wise attention within a multi scale architecture that further allows for highly accurate predictions. We evaluate the proposed approach on a number of datasets, and our experimental analysis demonstrates that it outperforms or is highly competitive with the state of the art. Importantly, we show that it has a good generalization ability, and moreover, exploits temporal information more effectively via its adaptive fusion scheme.


A dynamical scan path model for task dependence during scene viewing. In real world scene perception human observers generate sequences of fixations to move image patches into the high acuity center of the visual field. Models of visual attention developed over the last 25 years aim to predict two dimensional probabilities of gaze positions for a given image via saliency maps. Recently, progress has also been made on models for the generation of scan paths under the constraints of saliency. However, experimental research demonstrated that task constraints can have a strong impact on viewing behavior. Here we propose a scan path model for both fixation positions and fixation durations, which includes influences of task instructions and interindividual differences. Based on an eye movement experiment with four different task conditions, we estimated model parameters for each individual observer and task condition using a fully Bayesian dynamical modeling framework. Resulting parameter values demonstrate that model properties such as the attentional span are adjusted to task requirements. Posterior predictive checks indicate that our dynamical model can reproduce task differences in scan path statistics across individual observers.


Causal Inference in Non linear Time series using Deep Networks and Knockoff Counterfactuals. Estimating causal relations is vital in understanding the complex interactions in multivariate time series. Non linear coupling of variables is one of the major challenges inaccurate estimation of cause effect relations. In this paper, we propose to use deep autoregressive networks (DeepAR) in tandem with counterfactual analysis to infer nonlinear causal relations in multivariate time series. We extend the concept of Granger causality using probabilistic forecasting with DeepAR. Since deep networks can neither handle missing input nor out of distribution intervention, we propose to use the Knockoffs framework (Barberand Cand es, 2015) for generating intervention variables and consequently counterfactual probabilistic forecasting. Knockoff samples are independent of their output given the observed variables and exchangeable with their counterpart variables without changing the underlying distribution of the data. We test our method on synthetic as well as real world time series datasets. Overall our method outperforms the widely used vector autoregressive Granger causality and PCMCI in detecting nonlinear causal dependency in multivariate time series.


Maximal perimeter and maximal width of a convex small polygon. A small polygon is a polygon of unit diameter. The maximal perimeter and the maximal width of a convex small polygon with n 2 s sides are unknown when s ge 4 . In this paper, we construct a family of convex small n gons, n 2 s with s ge 4 , and show that their perimeters and their widths are within O(1 n 8) and O(1 n 5) of the maximal perimeter and the maximal width, respectively. From this result, it follows that Mossinghoff's conjecture on the diameter graph of a convex small 2 s gon with maximal perimeter is not true when s ge 4 .


Symmetric Spaces for Graph Embeddings A Finsler Riemannian Approach. Learning faithful graph representations as sets of vertex embeddings has become a fundamental intermediary step in a wide range of machine learning applications. We propose the systematic use of symmetric spaces in representation learning, a class encompassing many of the previously used embedding targets. This enables us to introduce a new method, the use of Finsler metrics integrated in a Riemannian optimization scheme, that better adapts to dissimilar structures in the graph. We develop a tool to analyze the embeddings and infer structural properties of the data sets. For implementation, we choose Siegel spaces, a versatile family of symmetric spaces. Our approach outperforms competitive baselines for graph reconstruction tasks on various synthetic and real world datasets. We further demonstrate its applicability on two downstream tasks, recommender systems and node classification.


Deterministic matrix sketches for low rank compression of high dimensional simulation data. Matrices arising in scientific applications frequently admit linear low rank approximations due to smoothness in the physical and or temporal domain of the problem. In large scale problems, computing an optimal low rank approximation can be prohibitively expensive. Matrix sketching addresses this by reducing the input matrix to a smaller, but representative matrix via a low dimensional linear embedding. If the sketch matrix produced by the embedding captures sufficient geometric properties of the original matrix, then a near optimal approximation may be obtained. Much of the work done in matrix sketching has centered on random projection. Alternatively, in this work, deterministic matrix sketches which generate coarse representations, compatible with the corresponding PDE solve, are considered in the computation of the singular value decomposition and matrix interpolative decomposition. The deterministic sketching approaches in this work have many advantages over randomized sketches. Broadly, randomized sketches are data agnostic, whereas the proposed sketching methods exploit structures within data generated in complex PDE systems. These deterministic sketches are often faster, require access to a small fraction of the input matrix, and do not need to be explicitly constructed. A novel single pass, i.e., requiring one read over the input, power iteration algorithm is also presented. The power iteration method is particularly effective in improving low rank approximations when the singular value decay of data is slow. Finally, theoretical error bounds and estimates, as well as numerical results across three application problems, are provided.


Multi task fully convolutional network for tree species mapping in dense forests using small training hyperspectral data. This work proposes a multi task fully convolutional architecture for tree species mapping in dense forests from sparse and scarce polygon level annotations using hyperspectral UAV borne data. Our model implements a partial loss function that enables dense tree semantic labeling outcomes from non dense training samples, and a distance regression complementary task that enforces tree crown boundary constraints and substantially improves the model performance. Our multi task architecture uses a shared backbone network that learns common representations for both tasks and two task specific decoders, one for the semantic segmentation output and one for the distance map regression. We report that introducing the complementary task boosts the semantic segmentation performance compared to the single task counterpart in up to 11 reaching an average user's accuracy of 88.63 and an average producer's accuracy of 88.59 , achieving state of art performance for tree species classification in tropical forests.


Anisotropic interpolation error estimates using a new geometric parameter. We present precise anisotropic interpolation error estimates for smooth functions using a new geometric parameter and inverse inequalities on anisotropic meshes. In our theory, the error of interpolation is bound in terms of the diameter of a simplex and the geometric parameter. Imposing additional assumptions makes it possible to obtain anisotropic error estimates. This paper also includes corrections to an error in "General theory of interpolation error estimates on anisotropic meshes" (Japan Journal of Industrial and Applied Mathematics, 38 (2021) 163 191), in which Theorem 2 was incorrect.


A C 17 Thread Pool for High Performance Scientific Computing. We present a modern C 17 compatible thread pool implementation, built from scratch with high performance scientific computing in mind. The thread pool is implemented as a single lightweight and self contained class, and does not have any dependencies other than the C 17 standard library, thus allowing a great degree of portability. In particular, our implementation does not utilize OpenMP or any other high level multithreading APIs, and thus gives the programmer precise low level control over the details of the parallelization, which permits more robust optimizations. The thread pool was extensively tested on both AMD and Intel CPUs with up to 40 cores and 80 threads. This paper provides motivation, detailed usage instructions, and performance tests.


An external approach to set theory. We begin with a primitive context with weaker logic and much simpler axioms than traditional set theory. The basic ingredients of the primitive context are essentially the object and morphism primitives of category theory. Inside this context we find relaxed' set theory. This is considerably closer to the way sets are commonly used than is traditional axiomatic set theory, eg. the Zermillo Fraenkel Choice (ZFC) axioms, so seems to offer a better formal foundation for mathematics. This should enable more precision in work that pushes the boundaries of set theory, for example in category theory and the construction of universal objects. Next, we describe a universal well founded pairing, and see that it essentially satisfies the ZFC axioms. Universality implies that if a collection of set theory axioms includes the axiom of Foundation, then models appear as sub objects of this universal theory. This might, for instance, provide a way to organize the profound work on ZFC models done in the last century. It may also have consequences for the theory of large cardinals. This connects with the theory mentioned above by an object is a relaxed set' if and only if it is bijective to a set in the universal ZFC theory. This version provides full details, and focuses on the connection with traditional axiomatic set theory. A sequel explores consequences for category theory. These papers replace the earlier version, emph A construction of set theory ( arXiv 2009.08867 )


Learning by Design Structuring and Documenting the Human Choices in Machine Learning Development. The influence of machine learning (ML) is quickly spreading, and a number of recent technological innovations have applied ML as a central technology. However, ML development still requires a substantial amount of human expertise to be successful. The deliberation and expert judgment applied during ML development cannot be revisited or scrutinized if not properly documented, and this hinders the further adoption of ML technologies especially in safety critical situations. In this paper, we present a method consisting of eight design questions, that outline the deliberation and normative choices going into creating a ML model. Our method affords several benefits, such as supporting critical assessment through methodological transparency, aiding in model debugging, and anchoring model explanations by committing to a pre hoc expectation of the model's behavior. We believe that our method can help ML practitioners structure and justify their choices and assumptions when developing ML models, and that it can help bridge a gap between those inside and outside the ML field in understanding how and why ML models are designed and developed the way they are.


Dynamic behavior of nanobeams under axial loads Integral elasticity modeling and size dependent eigenfrequencies assessment. In this article, eigenfrequencies of nano beams under axial loads are assessed by making recourse to the well posed stress driven nonlocal model (SDM) and strain driven two phase local nonlocal formulation (NstrainG) of elasticity and Bernoulli Euler kinematics. The developed nonlocal methodology is applicable to a wide variety of nano engineered materials, such as carbon nanotubes, and modern small scale beam like devices of nanotechnological interest. Eigenfrequencies calculated using SDM, are compared with NstrainG and other pertinent results in literature obtained by other nonlocal strategies. Influence of nonlocal thermoelastic effects and initial axial force (tension and compression) on dynamic responses are analyzed and discussed. Model hardening size effects from stress driven approach is compared to model softening size effects from strain driven two phase local nonlocal approach for increasing nonlocal parameters.


Towards Mobile Distributed Ledgers. Advances in mobile computing have paved the way for new types of distributed applications that can be executed solely by mobile devices on device to device (D2D) ecosystems (e.g., crowdsensing). Sophisticated applications, like cryptocurrencies, need distributed ledgers to function. Distributed ledgers, such as blockchains and directed acyclic graphs (DAGs), employ consensus protocols to add data in the form of blocks. However, such protocols are designed for resourceful devices that are interconnected via the Internet. Moreover, existing distributed ledgers are not deployable to D2D ecosystems since their storage needs are continuously increasing. In this work, we introduce and analyse Mneme, a DAG based distributed ledger that can be maintained solely by mobile devices. Mneme utilizes two novel consensus protocols Proof of Context (PoC) and Proof of Equivalence (PoE). PoC employs users' context to add data on Mneme. PoE is executed periodically to summarize data and produce equivalent blocks that require less storage. We analyze Mneme's security and justify the ability of PoC and PoE to guarantee the characteristics of distributed ledgers persistence and liveness. Furthermore, we analyze potential attacks from malicious users and prove that the probability of a successful attack is inversely proportional to the square of the number of mobile users who maintain Mneme.


Differentiable Event Stream Simulator for Non Rigid 3D Tracking. This paper introduces the first differentiable simulator of event streams, i.e., streams of asynchronous brightness change signals recorded by event cameras. Our differentiable simulator enables non rigid 3D tracking of deformable objects (such as human hands, isometric surfaces and general watertight meshes) from event streams by leveraging an analysis by synthesis principle. So far, event based tracking and reconstruction of non rigid objects in 3D, like hands and body, has been either tackled using explicit event trajectories or large scale datasets. In contrast, our method does not require any such processing or data, and can be readily applied to incoming event streams. We show the effectiveness of our approach for various types of non rigid objects and compare to existing methods for non rigid 3D tracking. In our experiments, the proposed energy based formulations outperform competing RGB based methods in terms of 3D errors. The source code and the new data are publicly available.


Accurate Mode Coupling Characterization of Low Crosstalk Ring Core Fibers using Integral Calculation based Swept Wavelength Interferometry Measurement. In this paper, to accurately characterize the low inter mode coupling of the weakly coupled few mode fibers (FMFs), we propose a modified inter mode coupling characterization method based on swept wavelength interferometry measurement, in which an integral calculation approach is used to eliminate significant sources of error that may lead to underestimation of the power coupling coefficient. Using the proposed characterization method, a low crosstalk ring core fiber (RCF) with low mode dependent loss (MDL) and with single span length up to 100 km is experimentally measured to have low power coupling coefficients between high order orbital angular momentum (OAM) mode groups of below 30 dB km over C band. The measured low coupling coefficients based on the proposed method are verified by the direct system power measurements, proving the feasibility and reliability of the proposed inter mode coupling characterization method.


Limitations of the Invertible Map Equivalences. This note draws conclusions that arise by combining two recent papers, by Anuj Dawar, Erich Gr "adel, and Wied Pakusa, published at ICALP 2019 and by Moritz Lichter, published at LICS 2021. In both papers, the main technical results rely on the combinatorial and algebraic analysis of the invertible map equivalences equiv text IM k,Q on certain variants of Cai F "urer Immerman (CFI) structures. These equiv text IM k,Q equivalences, for a natural number k and a set of primes Q , refine the well known Weisfeiler Leman equivalences used in algorithms for graph isomorphism. The intuition is that two graphs G equiv text IM k,Q H cannot be distinguished by iterative refinements of equivalences on k tuples defined via linear operators on vector spaces over fields of characteristic p in Q . In the first paper it has been shown that for a prime q notin Q , the equiv text IM k,Q equivalences are not strong enough to distinguish between non isomorphic CFI structures over the field mathbb F q . In the second paper, a similar but not identical construction for CFI structures over the rings mathbb Z 2 i has been shown to be indistinguishable with respect to equiv text IM k, 2 . Together with earlier work on rank logic, this second result suffices to separate rank logic from polynomial time. We show here that the two approaches can be unified to prove that CFI structures over the rings mathbb Z 2 i are indistinguishable with respect to equiv text IM k, mathbb P , for the set mathbb P of all primes. This implies the following two results. 1. There is no fixed k such that the invertible map equivalence equiv text IM k, mathbb P coincides with isomorphism on all finite graphs. 2. No extension of fixed point logic by linear algebraic operators over fields can capture polynomial time.


Extensions of Veech groups II Hierarchical hyperbolicity and quasi isometric rigidity. We show that for any lattice Veech group in the mapping class group mathrm Mod (S) of a closed surface S , the associated pi 1 S extension group is a hierarchically hyperbolic group. As a consequence, we prove that any such extension group is quasi isometrically rigid.


Parallax estimation for push frame satellite imagery application to super resolution and 3D surface modeling from Skysat products. Recent constellations of satellites, including the Skysat constellation, are able to acquire bursts of images. This new acquisition mode allows for modern image restoration techniques, including multi frame super resolution. As the satellite moves during the acquisition of the burst, elevation changes in the scene translate into noticeable parallax. This parallax hinders the results of the restoration. To cope with this issue, we propose a novel parallax estimation method. The method is composed of a linear Plane Parallax decomposition of the apparent motion and a multi frame optical flow algorithm that exploits all frames simultaneously. Using SkySat L1A images, we show that the estimated per pixel displacements are important for applying multi frame super resolution on scenes containing elevation changes and that can also be used to estimate a coarse 3D surface model.


Identify, Align, and Integrate Matching Knowledge Graphs to Commonsense Reasoning Tasks. Integrating external knowledge into commonsense reasoning tasks has shown progress in resolving some, but not all, knowledge gaps in these tasks. For knowledge integration to yield peak performance, it is critical to select a knowledge graph (KG) that is well aligned with the given task's objective. We present an approach to assess how well a candidate KG can correctly identify and accurately fill in gaps of reasoning for a task, which we call KG to task match. We show this KG to task match in 3 phases knowledge task identification, knowledge task alignment, and knowledge task integration. We also analyze our transformer based KG to task models via commonsense probes to measure how much knowledge is captured in these models before and after KG integration. Empirically, we investigate KG matches for the SocialIQA (SIQA) (Sap et al., 2019b), Physical IQA (PIQA) (Bisk et al., 2020), and MCScript2.0 (Ostermann et al., 2019) datasets with 3 diverse KGs ATOMIC (Sap et al., 2019a), ConceptNet (Speer et al., 2017), and an automatically constructed instructional KG based on WikiHow (Koupaee and Wang, 2018). With our methods we are able to demonstrate that ATOMIC, an event inference focused KG, is the best match for SIQA and MCScript2.0, and that the taxonomic ConceptNet and WikiHow based KGs are the best matches for PIQA across all 3 analysis phases. We verify our methods and findings with human evaluation.


The configuration space of a robotic arm over a graph. We investigate the configuration space mathcal S G,b, ell associated with the movement of a robotic arm of length ell on a grid over an underlying graph G , anchored at a vertex b in G . We study an associated PIP (poset with inconsistent pairs) text IP G,b, ell consisting of indexed paths on G . This PIP acts as a combinatorial model for the robotic arm, and we use text IP G,b, ell to show that the space mathcal S G,b, ell is a CAT(0) cubical complex, generalizing work of Ardila, Bastidas, Ceballos, and Guo. This establishes that geodesics exist within the configuration space, and yields explicit algorithms for moving the robotic arm between different configurations in an optimal fashion. We also give a tight bound on the diameter of the robotic arm transition graph (the maximal number of moves necessary to change from one configuration to another) and compute this diameter for a large family of underlying graphs G .


Constructing and calculating Adams operations on topological modular forms. We construct stable Adams operations on the cohomology theory Tmf of topological modular forms. This is done by extending the sheaf defining Tmf to be functorial with respect to isogenies of generalised elliptic curves of invertible degree. These Adams operations are then calculated on the homotopy groups of Tmf using a combination of descent spectral sequences, the theory of synthetic spectra, and Anderson duality.


Assessment of the Performance of DFT Functionals Using Off Diagonal Hypervirial Relationships. Off diagonal hypervirial relationships, combined with quantum mechanical sum rules of charge current conservation, offer a way for testing electronic excited state transition energies and moments, which does not need any external reference. A number of fundamental relations were recast into absolute deviations from zero, which have been used to assess the performance of some popular DFT functionals. Extended TD DFT calculations have been carried out for a pool of molecules chosen to the purpose, adopting a large basis set to ensure high quality results. A general agreement with previous benchmarks is observed.


Prompting Contrastive Explanations for Commonsense Reasoning Tasks. Many commonsense reasoning NLP tasks involve choosing between one or more possible answers to a question or prompt based on knowledge that is often implicit. Large pretrained language models (PLMs) can achieve near human performance on such tasks, while providing little human interpretable evidence of the underlying reasoning they use. In this work, we show how to use these same models to generate such evidence inspired by the contrastive nature of human explanations, we use PLMs to complete explanation prompts which contrast alternatives according to the key attribute(s) required to justify the correct answer (for example, peanuts are usually salty while raisins are sweet). Conditioning model decisions on these explanations improves performance on two commonsense reasoning benchmarks, as compared to previous non contrastive alternatives. These explanations are also judged by humans to be more relevant for solving the task, and facilitate a novel method to evaluate explanation faithfulfness.


Extracting the Unknown from Long Math Problems. In problem solving, understanding the problem that one seeks to solve is an essential initial step. In this paper, we propose computational methods for facilitating problem understanding through the task of recognizing the unknown in specifications of long Math problems. We focus on the topic of Probability. Our experimental results show that learning models yield strong results on the task, a promising first step towards human interpretable, modular approaches to understanding long Math problems.


A Competitive Analysis of Online Multi Agent Path Finding. We study online Multi Agent Path Finding (MAPF), where new agents are constantly revealed over time and all agents must find collision free paths to their given goal locations. We generalize existing complexity results of (offline) MAPF to online MAPF. We classify online MAPF algorithms into different categories based on (1) controllability (the set of agents that they can plan paths for at each time) and (2) rationality (the quality of paths they plan) and study the relationships between them. We perform a competitive analysis for each category of online MAPF algorithms with respect to commonly used objective functions. We show that a naive algorithm that routes newly revealed agents one at a time in sequence achieves a competitive ratio that is asymptotically bounded from both below and above by the number of agents with respect to flowtime and makespan. We then show a counter intuitive result that, if rerouting of previously revealed agents is not allowed, any rational online MAPF algorithms, including ones that plan optimal paths for all newly revealed agents, have the same asymptotic competitive ratio as the naive algorithm, even on 2D 4 neighbor grids. We also derive constant lower bounds on the competitive ratio of any rational online MAPF algorithms that allow rerouting. The results thus provide theoretical insights into the effectiveness of using MAPF algorithms in an online setting for the first time.


AI4D African Language Program. Advances in speech and language technologies enable tools such as voice search, text to speech, speech recognition and machine translation. These are however only available for high resource languages like English, French or Chinese. Without foundational digital resources for African languages, which are considered low resource in the digital context, these advanced tools remain out of reach. This work details the AI4D African Language Program, a 3 part project that 1) incentivised the crowd sourcing, collection and curation of language datasets through an online quantitative and qualitative challenge, 2) supported research fellows for a period of 3 4 months to create datasets annotated for NLP tasks, and 3) hosted competitive Machine Learning challenges on the basis of these datasets. Key outcomes of the work so far include 1) the creation of 9 open source, African language datasets annotated for a variety of ML tasks, and 2) the creation of baseline models for these datasets through hosting of competitive ML challenges.


The complete weight enumerator of the Reed Solomon code with dimension two or three. It is well known that Reed Solomon codes and extended Reed Solomon codes are two special classes of MDS codes with wide applications in practice. The complete weight enumerators of these codes are very important for determining the capability of both error detection and error correction. In this paper, for any positive integer m and prime p , basing on the character sums, we determine the complete weight enumerators of the Reed Solomon code and the extended Reed Solomon code with dimension k (k 2,3) over mathbb F p m , explictly, which are generalizations of the corresponding results in cite BK91,K04 .


Cheng maximal diameter theorem for hypergraphs. We prove that Cheng maximal diameter theorem for hypergraphs with positive coarse Ricci curvature.


Unit Tangent Bundles, CR Leaf Spaces, and Hypercomplex Structures. Unit tangent bundles UM of semi Riemannian manifolds M are shown to be examples of dynamical Legendrian contact structures, which were defined in recent work 25 of Sykes Zelenko to generalize leaf spaces of 2 nondegenerate CR manifolds. In doing so, Sykes Zelenko extended the classification in Porter Zelenko 20 of regular, 2 nondegenerate CR structures to those that can be recovered from their leaf space. The present paper treats dynamical Legendrian contact structures associated with 2 nondegenerate CR structures which were called "strongly regular" in Porter Zelenko, named "L contact structures." Closely related to Lie contact structures, L contact manifolds have homogeneous models given by isotropic Grassmannians of complex 2 planes whose algebra of infinitesimal symmetries is one of mathfrak so (p 2,q 2) or mathfrak so (2p 4) for p geq1 , q geq0 . Each 2 plane in the homogeneous model is a split quaternionic or quaternionic line, respectively, and more general L contact structures arise on contact manifolds with hypercomplex structures, unit tangent bundles being a prime example. The Ricci curvature tensor of M is used to define the "Ricci shifted" L contact structure on UM , whose Nijenhuis tensor vanishes when M is conformally flat. In the language of Sykes Zelenko (for M analytic), such UM is the leaf space of a 2 nondegenerate CR manifold which is "recoverable" from UM , providing a new source of examples of 2 nondegenerate CR structures.


A simplified Newton method to generate snapshots for POD models of semilinear optimal control problems. In PDE constrained optimization, proper orthogonal decomposition (POD) provides a surrogate model of a (potentially expensive) PDE discretization, on which optimization iterations are executed. Because POD models usually provide good approximation quality only locally, they have to be updated during optimization. Updating the POD model is usually expensive, however, and therefore often impossible in a model predictive control (MPC) context. Thus, reduced models of mediocre quality might be accepted. We take the view of a simplified Newton method for solving semilinear evolution equations to derive an algorithm that can serve as an offline phase to produce a POD model. Approaches that build the POD model with impulse response snapshots can be regarded as the first Newton step in this context. In particular, POD models that are based on impulse response snapshots are extended by adding a second simplified Newton step. This procedure improves the approximation quality of the POD model significantly by introducing a moderate amount of extra computational costs during optimization or the MPC loop. We illustrate our findings with an example satisfying our assumptions.


Sleeping beauties and temporal evolution of the coronavirus literature. Temporal evolution of the coronavirus literature over the last thirty years (N 43,769) is analyzed along with its subdomain of SARS CoV 2 articles (N 27,460) and the subdomain of reviews and meta analytic studies (N 1,027). (i) The analyses on the subset of SARS CoV 2 literature identified studies published prior to 2020 that have now proven highly instrumental in the development of various clusters of publications linked to SARS CoV 2. In particular, the so called sleeping beauties of the coronavirus literature with an awakening in 2020 were identified, i.e., previously published studies of this literature that had remained relatively unnoticed for several years but gained sudden traction in 2020 in the wake of the SARS CoV 2 outbreak. (ii) The subset of 2020 SARS CoV 2 articles is bibliographically distant from the rest of this literature published prior to 2020. Individual articles of the SARS CoV 2 segment with a bridging role between the two bodies of articles (i.e., before and after 2020) are identifiable. (iii) Furthermore, the degree of bibliographic coupling within the 2020 SARS CoV 2 cluster is much poorer compared to the cluster of articles published prior to 2020. This could, in part, be explained by the higher diversity of topics that are studied in relation to SARS CoV 2 compared to the literature of coronaviruses published prior to the SARS CoV 2 disease. This work demonstrates how scholarly efforts undertaken during peace time or prior to a disease outbreak could suddenly play a critical role in prevention and mitigation of health disasters caused by new diseases.


ROmodel Modeling robust optimization problems in Pyomo. This paper introduces ROmodel, an open source Python package extending the modeling capabilities of the algebraic modeling language Pyomo to robust optimization problems. ROmodel helps practitioners transition from deterministic to robust optimization through modeling objects which allow formulating robust models in close analogy to their mathematical formulation. ROmodel contains a library of commonly used uncertainty sets which can be generated using their matrix representations, but it also allows users to define custom uncertainty sets using Pyomo constraints. ROmodel supports adjustable variables via linear decision rules. The resulting models can be solved using ROmodels solvers which implement both the robust reformulation and cutting plane approach. ROmodel is a platform to implement and compare custom uncertainty sets and reformulations. We demonstrate ROmodel's capabilities by applying it to six case studies. We implement custom uncertainty sets based on (warped) Gaussian processes to show how ROmodel can integrate data driven models with optimization.


On the vanishing of the local Rayleigh condition and the finite time blow up of the semi lagrangian equations. This paper is devoted to the large time behaviour of the smooth solutions of the hydrostatic Euler equation satisfying the local Rayleigh condition. It is proven under certain assumptions that some quantities will blow up in finite time implying the vanishing of the local Rayleigh condition. Additionally, we find some conditions satisfied by the global smooth solutions of the hydrostatic Euler equation satisfying the local Rayleigh condition, which added to the compatibility condition found in Bre99 suggest that the above global solutions must be the stationary ones. Additionally, the finite time blow up of smooth solutions of the Semi Lagrangian equations introduced by Brenier in Bre99 is proved under certain conditions.


Inequality and Inequity in Network based Ranking and Recommendation Algorithms. Though algorithms promise many benefits including efficiency, objectivity and accuracy, they may also introduce or amplify biases. Here we study two well known algorithms, namely PageRank and Who to Follow (WTF), and show under which circumstances their ranks produce inequality and inequity when applied to directed social networks. To this end, we propose a directed network model with preferential attachment and homophily (DPAH) and demonstrate the influence of network structure on the rank distributions of these algorithms. Our main findings suggest that (i) inequality is positively correlated with inequity, (ii) inequality is driven by the interplay between preferential attachment, homophily, node activity and edge density, and (iii) inequity is mainly driven by homophily. In particular, these two algorithms amplify, replicate and reduce inequity in top ranks when majorities are homophilic, neutral and heterophilic, respectively. Moreover, when inequity is amplified, minorities may improve their visibility in the rank by connecting strategically in the network. For instance, by increasing their homophily when majorities are also homophilic. These findings shed light on social and algorithmic mechanisms that hinder equality and equity in network based ranking and recommendation algorithms.


Systolic blood pressure estimation using ECG and PPG in patients undergoing surgery. Background and Objectives In a significant portion of surgeries, blood pressure (BP) is often measured non invasively in an intermittent manner. This practice has a risk of missing clinically relevant BP changes between two adjacent intermittent BP measurements. This study proposes a method to non invasively estimate systolic blood pressure (SBP) with high accuracy in patients undergoing surgery Methods Continuous arterial blood pressure, ECG, and PPG signals were acquired from 29 patients undergoing surgery. After extracting 9 features from the PPG and ECG signals, we dynamically selected features upon each intermittent measurement (every 10 minutes) of SBP based on feature robustness and the principle of correlation feature selection. Finally, multiple linear regression models were built to combine these features to estimate SBP every 30 seconds. Results Compared to the reference SBP, the proposed method achieved a mean of difference at 0.07 mmHg, a standard deviation of difference at 7.92 mmHg, and a correlation coefficient at 0.89. Conclusions This study presents the feasibility of non invasively estimating SBP every 30 seconds with clinically acceptable accuracy during surgery based on ECG, PPG, and intermittent SBP measurements every 10 minutes. The proposed method has the potential to enhance blood pressure monitoring in the operating room, improving patient outcomes and experiences.


A low cost wave solar powered Unmanned Surface Vehicle. This paper presents a prototype of a low cost Unmanned Surface Vehicle (USV) that is operated by wave and solar energy which can be used to minimize the cost of ocean data collection. The current prototype is a compact USV, with a length of 1.2m that can be deployed and recovered by two persons. The design includes an electrically operated winch that can be used to retract and lower the underwater unit. Several elements of the design make use of additive manufacturing and inexpensive materials. The vehicle can be controlled using radio frequency (RF) and a satellite communication, through a custom developed web application. Both the surface and underwater units were optimized with regard to drag, lift, weight, and price by using recommendation of previous research work and advanced materials. The USV could be used in water condition monitoring by measuring several parameters, such as dissolved oxygen, salinity, temperature, and pH.


A view from lockdown mathematics discovered, invented, and inherited. The classical platonist formalist dilemma in philosophy of mathematics can be expressed in lay terms as a deceptively naive question emph Is new mathematics discovered or invented? Using examples from my own mathematical work during the Coronavirus lockdown, I argue that there is also a third way new mathematics can also be inherited. And entering into possession, making it your own, could be great fun.


EarlyBERT Efficient BERT Training via Early bird Lottery Tickets. Heavily overparameterized language models such as BERT, XLNet and T5 have achieved impressive success in many NLP tasks. However, their high model complexity requires enormous computation resources and extremely long training time for both pre training and fine tuning. Many works have studied model compression on large NLP models, but only focusing on reducing inference time while still requiring an expensive training process. Other works use extremely large batch sizes to shorten the pre training time, at the expense of higher computational resource demands. In this paper, inspired by the Early Bird Lottery Tickets recently studied for computer vision tasks, we propose EarlyBERT, a general computationally efficient training algorithm applicable to both pre training and fine tuning of large scale language models. By slimming the self attention and fully connected sub layers inside a transformer, we are the first to identify structured winning tickets in the early stage of BERT training. We apply those tickets towards efficient BERT training, and conduct comprehensive pre training and fine tuning experiments on GLUE and SQuAD downstream tasks. Our results show that EarlyBERT achieves comparable performance to standard BERT, with 35 45 less training time. Code is available at https github.com VITA Group EarlyBERT.


Few Shot Bayesian Optimization with Deep Kernel Surrogates. Hyperparameter optimization (HPO) is a central pillar in the automation of machine learning solutions and is mainly performed via Bayesian optimization, where a parametric surrogate is learned to approximate the black box response function (e.g. validation error). Unfortunately, evaluating the response function is computationally intensive. As a remedy, earlier work emphasizes the need for transfer learning surrogates which learn to optimize hyperparameters for an algorithm from other tasks. In contrast to previous work, we propose to rethink HPO as a few shot learning problem in which we train a shared deep surrogate model to quickly adapt (with few response evaluations) to the response function of a new task. We propose the use of a deep kernel network for a Gaussian process surrogate that is meta learned in an end to end fashion in order to jointly approximate the response functions of a collection of training data sets. As a result, the novel few shot optimization of our deep kernel surrogate leads to new state of the art results at HPO compared to several recent methods on diverse metadata sets.


RCP A Temporal Clustering Algorithm for Real time Controller Placement in Mobile SDN Systems. Software Defined Networking (SDN) is a recent paradigm in telecommunication networks that disentangles data and control planes and brings more flexibility and efficiency to the network as a result. The Controller Placement (CP) problem in SDN, which is typically subject to specific optimality criteria, is one of the primary problems in the design of SDN systems. em Dynamic Controller Placement (DCP) enables a placement solution that is adaptable to inherent variability in network components (traffic, locations, etc.). DCP has gained much attention in recent years, yet despite this, most solutions proposed in the literature cannot be implemented in real time, which is a critical concern especially in UAV drone based SDN networks where mobility is high and split second updates are necessary. As current conventional methods fail to be relevant to such scenarios, in this work we propose a real time control placement (RCP) algorithm. Namely, we propose a temporal clustering algorithm that provides real time solutions for DCP, based on a control theoretic framework for which we show the solution exponentially converges to a near optimal placement of controller devices. RCP has linear O(n) iteration computational complexity with respect to the underlying network size, n, i.e., the number of nodes, and also leverages the maximum entropy principle from information theory. This approach results in high quality solutions that are practically immune from getting stuck in poor local optima, a drawback that most works in the literature are susceptible to. We compare our work with a frame by frame approach and demonstrate its superiority, both in terms of speed and incurred cost, via simulations. According to our simulations RCP can be up to 25 times faster than the conventional frame by frame method.


Behavior rigidity near non isolated blow up points for the semilinear heat equation. We consider the semilinear heat equation with Sobolev subcritical power nonlinearity in dimension N 2 , and u(x,t) a solution which blows up in finite time T . Given a non isolated blow up point a , we assume that the Taylor expansion of the solution near (a,T) obeys some degenerate situation labeled by some even integer m(a) ge 4 . If we have a sequence a n to a as n to infty , we show after a change of coordinates and the extraction of a subsequence that either a n,1 a 1 o((a n,2 a 2) 2) or a n,1 a 1 a n,2 a 2 beta log a n,2 a 2 alpha to L 0 for some L 0 , up to extracting a subsequence still denoted the same, where alpha and beta enjoy a finite number of rational values with beta in(0,2 and L is a solution of a polynomial equation depending on the coefficients of the Taylor expansion of the solution. If m(a) 4 , then alpha 0 and either beta 3 2 or beta 2 .


Active Fire Detection in Landsat 8 Imagery a Large Scale Dataset and a Deep Learning Study. Active fire detection in satellite imagery is of critical importance to the management of environmental conservation policies, supporting decision making and law enforcement. This is a well established field, with many techniques being proposed over the years, usually based on pixel or region level comparisons involving sensor specific thresholds and neighborhood statistics. In this paper, we address the problem of active fire detection using deep learning techniques. In recent years, deep learning techniques have been enjoying an enormous success in many fields, but their use for active fire detection is relatively new, with open questions and demand for datasets and architectures for evaluation. This paper addresses these issues by introducing a new large scale dataset for active fire detection, with over 150,000 image patches (more than 200 GB of data) extracted from Landsat 8 images captured around the world in August and September 2020, containing wildfires in several locations. The dataset was split in two parts, and contains 10 band spectral images with associated outputs, produced by three well known handcrafted algorithms for active fire detection in the first part, and manually annotated masks in the second part. We also present a study on how different convolutional neural network architectures can be used to approximate these handcrafted algorithms, and how models trained on automatically segmented patches can be combined to achieve better performance than the original algorithms with the best combination having 87.2 precision and 92.4 recall on our manually annotated dataset. The proposed dataset, source codes and trained models are available on Github (https github.com pereira gha activefire), creating opportunities for further advances in the field


Two descent on some genus two curves. For the hyperelliptic curve C p with equation y 2 x(x 2p)(x p)(x p)(x 2p) with p a prime number, we discuss bounds for the rank of its Jacobian over Q, find many cases having 2 torsion in the associated Shafarevich Tate group, and we present some results on rational points of C p.


Approximate Novelty Search. Width based search algorithms seek plans by prioritizing states according to a suitably defined measure of novelty, that maps states into a set of novelty categories. Space and time complexity to evaluate state novelty is known to be exponential on the cardinality of the set. We present novel methods to obtain polynomial approximations of novelty and width based search. First, we approximate novelty computation via random sampling and Bloom filters, reducing the runtime and memory footprint. Second, we approximate the best first search using an adaptive policy that decides whether to forgo the expansion of nodes in the open list. These two techniques are integrated into existing width based algorithms, resulting in new planners that perform significantly better than other state of the art planners over benchmarks from the International Planning Competitions.


A real analogue of the Moore Tachikawa category. For each complex semisimple group G mathbb C , Moore and Tachikawa conjectured the existence of a certain two dimensional topological quantum field theory eta G mathbb C mathrm Cob 2 to mathrm MT whose target category has complex Lie groups as objects and holomorphic symplectic varieties with Hamiltonian actions of the groups as morphisms. The conjecture is motivated by string theory, where eta G mathbb C is obtained by taking the Higgs branch of some supersymmetric quantum field theories (called theories of class S ) depending on G mathbb C and a Riemann surface. The goal of this paper is to define a real analogue mathrm MT mathbb R of the target category mathrm MT and to rigorously prove that it is a category.


Oriented surface points for efficient and accurate radar odometry. This paper presents an efficient and accurate radar odometry pipeline for large scale localization. We propose a radar filter that keeps only the strongest reflections per azimuth that exceeds the expected noise level. The filtered radar data is used to incrementally estimate odometry by registering the current scan with a nearby keyframe. By modeling local surfaces, we were able to register scans by minimizing a point to line metric and accurately estimate odometry from sparse point sets, hence improving efficiency. Specifically, we found that a point to line metric yields significant improvements compared to a point to point metric when matching sparse sets of surface points. Preliminary results from an urban odometry benchmark show that our odometry pipeline is accurate and efficient compared to existing methods with an overall translation error of 2.05 , down from 2.78 from the previously best published method, running at 12.5ms per frame without need of environmental specific training.


For Better or for Worse? A Framework for Critical Analysis of ICT4D for Women. Diffusion of ICTs provide possibilities for women empowerment by greater participation and enhanced gender based digital equality. However, a critical analysis reveals that as ICT diffusion widens, there is a persistent threat of widening the gender based digital divide and exposes women to online sexual abuses, predominantly in developing countries characterized by the gendered nature of the social structure. Instead of accepting ICT as the facilitator to women empowerment, in this paper, we develop a critical research framework for a gender focused examination of ICT4D studies. Critical research methodology provides the appropriate ontology unveiling social realities through challenging the status quo and exposing the deeper societal inequalities. Using the critical research framework developed, we investigate past ICT4D initiatives and artifacts from literature and draw critical conclusions of its benefits and issues. This study would aid future ICT4D research to investigate areas of gender discrimination and understand the role of ICTs in a critical light.


Learning To Describe Player Form in The MLB. Major League Baseball (MLB) has a storied history of using statistics to better understand and discuss the game of baseball, with an entire discipline of statistics dedicated to the craft, known as sabermetrics. At their core, all sabermetrics seek to quantify some aspect of the game, often a specific aspect of a player's skill set such as a batter's ability to drive in runs (RBI) or a pitcher's ability to keep batters from reaching base (WHIP). While useful, such statistics are fundamentally limited by the fact that they are derived from an account of what happened on the field, not how it happened. As a first step towards alleviating this shortcoming, we present a novel, contrastive learning based framework for describing player form in the MLB. We use form to refer to the way in which a player has impacted the course of play in their recent appearances. Concretely, a player's form is described by a 72 dimensional vector. By comparing clusters of players resulting from our form representations and those resulting from traditional abermetrics, we demonstrate that our form representations contain information about how players impact the course of play, not present in traditional, publicly available statistics. We believe these embeddings could be utilized to predict both in game and game level events, such as the result of an at bat or the winner of a game.


Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning. We study the problem of dynamic visual reasoning on raw videos. This is a challenging problem currently, state of the art models often require dense supervision on physical object properties and events from simulation, which are impractical to obtain in real life. In this paper, we present the Dynamic Concept Learner (DCL), a unified framework that grounds physical objects and events from video and language. DCL first adopts a trajectory extractor to track each object over time and to represent it as a latent, object centric feature vector. Building upon this object centric representation, DCL learns to approximate the dynamic interaction among objects using graph networks. DCL further incorporates a semantic parser to parse questions into semantic programs and, finally, a program executor to run the program to answer the question, levering the learned dynamics model. After training, DCL can detect and associate objects across the frames, ground visual properties, and physical events, understand the causal relationship between events, make future and counterfactual predictions, and leverage these extracted presentations for answering queries. DCL achieves state of the art performance on CLEVRER, a challenging causal video reasoning dataset, even without using ground truth attributes and collision labels from simulations for training. We further test DCL on a newly proposed video retrieval and event localization dataset derived from CLEVRER, showing its strong generalization capacity.


Deep Neural Networks based Invisible Steganography for Audio into Image Algorithm. In the last few years, steganography has attracted increasing attention from a large number of researchers since its applications are expanding further than just the field of information security. The most traditional method is based on digital signal processing, such as least significant bit encoding. Recently, there have been some new approaches employing deep learning to address the problem of steganography. However, most of the existing approaches are designed for image in image steganography. In this paper, the use of deep learning techniques to hide secret audio into the digital images is proposed. We employ a joint deep neural network architecture consisting of two sub models the first network hides the secret audio into an image, and the second one is responsible for decoding the image to obtain the original audio. Extensive experiments are conducted with a set of 24K images and the VIVOS Corpus audio dataset. Through experimental results, it can be seen that our method is more effective than traditional approaches. The integrity of both image and audio is well preserved, while the maximum length of the hidden audio is significantly improved.


Development of neutron scattering kernels for cold neutron reflector materials. The newest neutron scattering applications are highly intensity limited techniques that demand reducing the neutron losses between source and detectors. In addition, the nuclear industry demands more accurate data and procedures for the design and optimization of advanced fission reactors, especially for the treatment of fuel and moderator materials. To meet these demands, it is necessary to improve the existing calculation tools, through the generation of better models that describe the interaction of neutrons with the systems of interest. The Neutron Physics Department at Centro Atomico Bariloche (CNEA, Argentina) has been developing over the time new models for the interaction of slow neutrons with materials, to produce scattering kernels and cross section data in the thermal and cold neutron energy region. Besides the studies carried out on neutron moderators, we have recently begun looking at materials that could serve as efficient neutron reflectors over those energy ranges. In this work we present the results of transmission and scattering experiments on diamond nanopowder and magnesium hydride, carried out simultaneously at the VESUVIO spectrometer (ISIS, UK), and compare them with newly generated cross section libraries.


Besov Orlicz path regularity of non Gaussian processes. In the article, Besov Orlicz regularity of sample paths of stochastic processes that are represented by multiple integrals of order n in mathbb N is treated. We give sufficient conditions for the considered processes to have paths in the exponential Besov Orlicz space B varPhi 2 n , infty alpha(0,T) qquad mbox with qquad varPhi 2 n (x) mathrm e x 2 n 1. These results provide an extension of what is known for scalar Gaussian stochastic processes to stochastic processes in an arbitrary finite Wiener chaos. As an application, the Besov Orlicz path regularity of fractionally filtered Hermite processes is studied. But while the main focus is on the non Gaussian case, some new path properties are obtained even for fractional Brownian motions.


A Structured Analysis of the Video Degradation Effects on the Performance of a Machine Learning enabled Pedestrian Detector. ML enabled software systems have been incorporated in many public demonstrations for automated driving (AD) systems. Such solutions have also been considered as a crucial approach to aim at SAE Level 5 systems, where the passengers in such vehicles do not have to interact with the system at all anymore. Already in 2016, Nvidia demonstrated a complete end to end approach for training the complete software stack covering perception, planning and decision making, and the actual vehicle control. While such approaches show the great potential of such ML enabled systems, there have also been demonstrations where already changes to single pixels in a video frame can potentially lead to completely different decisions with dangerous consequences. In this paper, a structured analysis has been conducted to explore video degradation effects on the performance of an ML enabled pedestrian detector. Firstly, a baseline of applying YOLO to 1,026 frames with pedestrian annotations in the KITTI Vision Benchmark Suite has been established. Next, video degradation candidates for each of these frames were generated using the leading video codecs libx264, libx265, Nvidia HEVC, and AV1 52 frames for the various compression presets for color and gray scale frames resulting in 104 degradation candidates per original KITTI frame and 426,816 images in total. YOLO was applied to each image to compute the intersection over union (IoU) metric to compare the performance with the original baseline. While aggressively lossy compression settings result in significant performance drops as expected, it was also observed that some configurations actually result in slightly better IoU results compared to the baseline. The findings show that carefully chosen lossy video configurations preserve a decent performance of particular ML enabled systems while allowing for substantial savings when storing or transmitting data.


Double phase implicit obstacle problems with convection and multivalued mixed boundary value conditions. In this paper we consider a mixed boundary value problem with a nonhomogeneous, nonlinear differential operator (called double phase operator), a nonlinear convection term (a reaction term depending on the gradient), three multivalued terms and an implicit obstacle constraint. Under very general assumptions on the data, we prove that the solution set of such implicit obstacle problem is nonempty (so there is at least one solution) and weakly compact. The proof of our main result uses the Kakutani Ky Fan fixed point theorem for multivalued operators along with the theory of nonsmooth analysis and variational methods for pseudomonotone operators.


Stability of a class of action functionals depending on convex functions. We study the stability of a class of action functionals induced by gradients of convex functions with respect to Mosco convergence, under mild assumptions on the underlying space.


Do Names Echo Semantics? A Large Scale Study of Identifiers Used in C 's Named Casts. Developers relax restrictions on a type to reuse methods with other types. While type casts are prevalent, in weakly typed languages such as C , they are also extremely permissive. If type conversions are performed without care, they can lead to software bugs. Therefore, there is a clear need to check whether a type conversion is essential and used adequately according to the developer's intent. In this paper, we propose a technique to judge the fidelity of type conversions from an explicit cast operation, using the identifiers in an assignment. We measure accord in the identifiers using entropy and use it to check if the semantics of the source expression in the cast match the semantics of the variable it is being assigned. We present the results of running our tool on 34 components of the Chromium project, which collectively account for 27MLOC. Our tool identified 1,368 cases of discord indicating potential anti patterns in the usage of explicit casts. We performed a manual evaluation of a random uniform sample of these cases. Our evaluation shows that our tool identified 25.6 cases representing incorrect implementations of named casts and 28.04 cases representing imprecise names of identifiers.