Augmenting Text Mining Approaches with Social Network Analysis to Understand the Complex Relationships among Users' Requests a Case Study of the Android Operating System. Text mining approaches are being used increasingly for business analytics. In particular, such approaches are now central to understanding users' feedback regarding systems delivered via online application distribution platforms such as Google Play. In such settings, large volumes of reviews of potentially numerous apps and systems means that it is infeasible to use manual mechanisms to extract insights and knowledge that could inform product improvement. In this context of identifying software system improvement options, text mining techniques are used to reveal the features that are mentioned most often as being in need of correction (e.g., GPS), and topics that are associated with features perceived as being defective (e.g., inaccuracy of GPS). Other approaches may supplement such techniques to provide further insights for online communities and solution providers. In this work we augment text mining approaches with social network analysis to demonstrate the utility of using multiple techniques. Our outcomes suggest that text mining approaches may indeed be supplemented with other methods to deliver a broader range of insights.


Patterns for Representing Knowledge Graphs to Communicate Situational Knowledge of Service Robots. Service robots are envisioned to be adaptive to their working environment based on situational knowledge. Recent research focused on designing visual representation of knowledge graphs for expert users. However, how to generate an understandable interface for non expert users remains to be explored. In this paper, we use knowledge graphs (KGs) as a common ground for knowledge exchange and develop a pattern library for designing KG interfaces for non expert users. After identifying the types of robotic situational knowledge from the literature, we present a formative study in which participants used cards to communicate the knowledge for given scenarios. We iteratively coded the results and identified patterns for representing various types of situational knowledge. To derive design recommendations for applying the patterns, we prototyped a lab service robot and conducted Wizard of Oz testing. The patterns and recommendations could provide useful guidance in designing knowledge exchange interfaces for robots.


(Optimal) Online Bipartite Matching with Predicted Degrees. We propose a model for online graph problems where algorithms are given access to an oracle that predicts (e.g., based on past data) the degrees of nodes in the graph. Within this model, we study the classic problem of online bipartite matching, and a natural greedy matching algorithm called MinPredictedDegree, which uses predictions of the degrees of offline nodes. For the bipartite version of a stochastic graph model due to Chung, Lu, and Vu where the expected values of the offline degrees are known and used as predictions, we show that MinPredictedDegree stochastically dominates any other online algorithm, i.e., it is optimal for graphs drawn from this model. Since the "symmetric" version of the model, where all online nodes are identical, is a special case of the well studied "known i.i.d. model", it follows that the competitive ratio of MinPredictedDegree on such inputs is at least 0.7299. For the special case of graphs with power law degree distributions, we show that MinPredictedDegree frequently produces matchings almost as large as the true maximum matching on such graphs. We complement these results with an extensive empirical evaluation showing that MinPredictedDegree compares favorably to state of the art online algorithms for online matching.


Surface Processing and Discharge Conditioning of High Voltage Electrodes for the Ra EDM Experiment. The Ra EDM experiment uses a pair of high voltage electrodes to search for the atomic electric dipole moment of 225 Ra. We use identical, plane parallel electrodes with a primary high gradient surface of 200 mm 2 to generate reversible DC electric fields. Our statistical sensitivity is linearly proportional to the electric field strength in the electrode gap. We adapted surface decontamination and processing techniques from accelerator physics literature to chemical polish and clean a suite of newly fabricated large grain niobium and grade 2 titanium electrodes. Three pairs of niobium electrodes and one pair of titanium electrodes were discharge conditioned with a custom high voltage test station at electric field strengths as high as 52.5 kV mm and 51.5 kV mm over electrode gap sizes ranging from 0.4 mm to 2.5 mm. One pair of large grain niobium electrodes was discharge conditioned and validated to operate at pm 20 kV mm with steady state leakage current leq 25 pA ( 1 sigma ) and a polarity averaged 98 pm 19 discharges per hour. These electrodes were installed in the Ra EDM experimental apparatus, replacing a copper electrode pair, and were revalidated to pm 20 kV mm. The niobium electrodes perform at an electric field strength 3.1 times larger than the legacy copper electrodes and are ultimately limited by the maximum output of our 30 kV bipolar power supply.


Linear Transformers Are Secretly Fast Weight Programmers. We show the formal equivalence of linearised self attention mechanisms and fast weight controllers from the early '90s, where a slow" neural net learns by gradient descent to program the fast weights" of another net through sequences of elementary programming instructions which are additive outer products of self invented activation patterns (today called keys and values). Such Fast Weight Programmers (FWPs) learn to manipulate the contents of a finite memory and dynamically interact with it. We infer a memory capacity limitation of recent linearised softmax attention variants, and replace the purely additive outer products by a delta rule like programming instruction, such that the FWP can more easily learn to correct the current mapping from keys to values. The FWP also learns to compute dynamically changing learning rates. We also propose a new kernel function to linearise attention which balances simplicity and effectiveness. We conduct experiments on synthetic retrieval problems as well as standard machine translation and language modelling tasks which demonstrate the benefits of our methods.


A Time Varying Network for Cryptocurrencies. Cryptocurrencies return cross predictability and technological similarity yield information on risk propagation and market segmentation. To investigate these effects, we build a time varying network for cryptocurrencies, based on the evolution of return cross predictability and technological similarities. We develop a dynamic covariate assisted spectral clustering method to consistently estimate the latent community structure of cryptocurrencies network that accounts for both sets of information. We demonstrate that investors can achieve better risk diversification by investing in cryptocurrencies from different communities. A cross sectional portfolio that implements an inter crypto momentum trading strategy earns a 1.08 daily return. By dissecting the portfolio returns on behavioral factors, we confirm that our results are not driven by behavioral mechanisms.


Constructing Cubic Curves with Involutions. In 1888, Heinrich Schroeter provided a ruler construction for points on cubic curves based on line involutions. Using Chasles' Theorem and the terminology of elliptic curves, we give a simple proof of Schroeter's construction. In addition, we show how to construct tangents and additional points on the curve using another ruler construction which is also based on line involutions.


Investigating the integrate and fire model as the limit of a random discharge model a stochastic analysis perspective. In the mean field integrate and fire model, the dynamics of a typical neuron within a large network is modeled as a diffusion jump stochastic process whose jump takes place once the voltage reaches a threshold. In this work, the main goal is to establish the convergence relationship between the regularized process and the original one where in the regularized process, the jump mechanism is replaced by a Poisson dynamic, and jump intensity within the classically forbidden domain goes to infinity as the regularization parameter vanishes. On the macroscopic level, the Fokker Planck equation for the process with random discharges (i.e. Poisson jumps) are defined on the whole space, while the equation for the limit process is on the half space. However, with the iteration scheme, the difficulty due to the domain differences has been greatly mitigated and the convergence for the stochastic process and the firing rates can be established. Moreover, we find a polynomial order convergence for the distribution by a re normalization argument in probability theory. Finally, by numerical experiments, we quantitatively explore the rate and the asymptotic behavior of the convergence for both linear and nonlinear models.


Delay aware Robust Control for Safe Autonomous Driving. With the advancement of affordable self driving vehicles using complicated nonlinear optimization but limited computation resources, computation time becomes a matter of concern. Other factors such as actuator dynamics and actuator command processing cost also unavoidably cause delays. In high speed scenarios, these delays are critical to the safety of a vehicle. Recent works consider these delays individually, but none unifies them all in the context of autonomous driving. Moreover, recent works inappropriately consider computation time as a constant or a large upper bound, which makes the control either less responsive or over conservative. To deal with all these delays, we present a unified framework by 1) modeling actuation dynamics, 2) using robust tube model predictive control, 3) using a novel adaptive Kalman filter without assuminga known process model and noise covariance, which makes the controller safe while minimizing conservativeness. On onehand, our approach can serve as a standalone controller on theother hand, our approach provides a safety guard for a high level controller, which assumes no delay. This can be used for compensating the sim to real gap when deploying a black box learning enabled controller trained in a simplistic environment without considering delays for practical vehicle systems.


A Wizard of Oz Study Simulating API Usage Dialogues with a Virtual Assistant. Virtual Assistant technology is rapidly proliferating to improve productivity in a variety of tasks. While several virtual assistants for everyday tasks are well known (e.g., Siri, Cortana, Alexa), assistants for specialty tasks such as software engineering are rarer. One key reason software engineering assistants are rare is that very few experimental datasets are available and suitable for training the AI that is the bedrock of current virtual assistants. In this paper, we present a set of Wizard of Oz experiments that we designed to build a dataset for creating a virtual assistant. Our target is a hypothetical virtual assistant for helping programmers use APIs. In our experiments, we recruited 30 professional programmers to complete programming tasks using two APIs. The programmers interacted with a simulated virtual assistant for help the programmers were not aware that the assistant was actually operated by human experts. We then annotated the dialogue acts in the corpus along four dimensions illocutionary intent, API information type(s), backward facing function, and traceability to specific API components. We observed a diverse range of interactions that will facilitate the development of dialogue strategies for virtual assistants for API usage.


Energy harvesting coil for circularly polarized fields in magnetic resonance imaging. Specialized radio frequency coils and sensors placed inside the magnetic resonance imaging (MRI) scanner considerably extend its functionality. However, since cable connected in bore devices have several disadvantages compared to wireless ones, the latter currently undergo active development. One of the promising concepts in wireless MRI coils is energy harvesting that relies on converting the energy carried by the radio frequency MRI field without the need for additional transmitters as in common wireless power transfer realizations. In this Article, we propose a compact harvesting coil design based on the combination of the loop and butterfly coils that allows energy harvesting of a circularly polarized field. By performing numerical simulations and experiments with commonly used Siemens Espree and Avanto 1.5 Tesla MRI scanners, we demonstrate that the proposed approach is safe, efficient, does not decrease the quality of MRI images, and allows doubling the harvested voltage compared to linearly polarized setups.


Minimal Supervision for Morphological Inflection. Neural models for the various flavours of morphological inflection tasks have proven to be extremely accurate given ample labeled data data that may be slow and costly to obtain. In this work we aim to overcome this annotation bottleneck by bootstrapping labeled data from a seed as little as em five labeled paradigms, accompanied by a large bulk of unlabeled text. Our approach exploits different kinds of regularities in morphological systems in a two phased setup, where word tagging based on em analogies is followed by word pairing based on em distances . We experiment with the Paradigm Cell Filling Problem over eight typologically different languages, and find that, in languages with relatively simple morphology, orthographic regularities on their own allow inflection models to achieve respectable accuracy. Combined orthographic and semantic regularities alleviate difficulties with particularly complex morpho phonological systems. Our results suggest that hand crafting many tagged examples might be an unnecessary effort. However, more work is needed in order to address rarely used forms.


An Empirical Study on Predictability of Software Code Smell Using Deep Learning Models. Code Smell, similar to a bad smell, is a surface indication of something tainted but in terms of software writing practices. This metric is an indication of a deeper problem lies within the code and is associated with an issue which is prominent to experienced software developers with acceptable coding practices. Recent studies have often observed that codes having code smells are often prone to a higher probability of change in the software development cycle. In this paper, we developed code smell prediction models with the help of features extracted from source code to predict eight types of code smell. Our work also presents the application of data sampling techniques to handle class imbalance problem and feature selection techniques to find relevant feature sets. Previous studies had made use of techniques such as Naive Bayes and Random forest but had not explored deep learning methods to predict code smell. A total of 576 distinct Deep Learning models were trained using the features and datasets mentioned above. The study concluded that the deep learning models which used data from Synthetic Minority Oversampling Technique gave better results in terms of accuracy, AUC with the accuracy of some models improving from 88.47 to 96.84.


Simultaneous non vanishing of central values of GL(2) times GL(3) and GL(3) L functions. We study simultaneous non vanishing of L( tfrac 1 2 , di) and L( tfrac 1 2 ,g otimes di) , when di runs over an orthogonal basis of the space of Hecke Maass cusp forms for SL(3, mathbb Z ) and g is a fixed SL(2, mathbb Z ) Hecke cusp form of weight k equiv 0 pmod 4 .


An attention based unsupervised adversarial model for movie review spam detection. With the prevalence of the Internet, online reviews have become a valuable information resource for people. However, the authenticity of online reviews remains a concern, and deceptive reviews have become one of the most urgent network security problems to be solved. Review spams will mislead users into making suboptimal choices and inflict their trust in online reviews. Most existing research manually extracted features and labeled training samples, which are usually complicated and time consuming. This paper focuses primarily on a neglected emerging domain movie review, and develops a novel unsupervised spam detection model with an attention mechanism. By extracting the statistical features of reviews, it is revealed that users will express their sentiments on different aspects of movies in reviews. An attention mechanism is introduced in the review embedding, and the conditional generative adversarial network is exploited to learn users' review style for different genres of movies. The proposed model is evaluated on movie reviews crawled from Douban, a Chinese online community where people could express their feelings about movies. The experimental results demonstrate the superior performance of the proposed approach.


MAAD A Model and Dataset for "Attended Awareness" in Driving. We propose a computational model to estimate a person's attended awareness of their environment. We define attended awareness to be those parts of a potentially dynamic scene which a person has attended to in recent history and which they are still likely to be physically aware of. Our model takes as input scene information in the form of a video and noisy gaze estimates, and outputs visual saliency, a refined gaze estimate, and an estimate of the person's attended awareness. In order to test our model, we capture a new dataset with a high precision gaze tracker including 24.5 hours of gaze sequences from 23 subjects attending to videos of driving scenes. The dataset also contains third party annotations of the subjects' attended awareness based on observations of their scan path. Our results show that our model is able to reasonably estimate attended awareness in a controlled setting, and in the future could potentially be extended to real egocentric driving data to help enable more effective ahead of time warnings in safety systems and thereby augment driver performance. We also demonstrate our model's effectiveness on the tasks of saliency, gaze calibration, and denoising, using both our dataset and an existing saliency dataset. We make our model and dataset available at https github.com ToyotaResearchInstitute att aware .


Living in a pandemic adaptation of individual mobility and social activity in the US. The non pharmaceutical interventions (NPIs), aimed at reducing the diffusion of the COVID 19 pandemic, has dramatically influenced our behaviour in everyday life. In this work, we study how individuals adapted their daily movements and person to person contact patterns over time in response to the COVID 19 pandemic and the NPIs. We leverage longitudinal GPS mobility data of hundreds of thousands of anonymous individuals in four US states and empirically show the dramatic disruption in people's life. We find that local interventions did not just impact the number of visits to different venues but also how people experience them. Individuals spend less time in venues, preferring simpler and more predictable routines and reducing person to person contact activities. Moreover, we show that the stringency of interventions alone does explain the number and duration of visits to venues individual patterns of visits seem to be influenced by the local severity of the pandemic and a risk adaptation factor, which increases the people's mobility regardless of the stringency of interventions.


Rule Based Classification of Hyperspectral Imaging Data. Due to its high spatial and spectral information content, hyperspectral imaging opens up new possibilities for a better understanding of data and scenes in a wide variety of applications. An essential part of this process of understanding is the classification part. In this article we present a general classification approach based on the shape of spectral signatures. In contrast to classical classification approaches (e.g. SVM, KNN), not only reflectance values are considered, but also parameters such as curvature points, curvature values, and the curvature behavior of spectral signatures are used to develop shape describing rules in order to use them for classification by a rule based procedure using IF THEN queries. The flexibility and efficiency of the methodology is demonstrated using datasets from two different application fields and leads to convincing results with good performance.


Higher Order Automatic Differentiation of Higher Order Functions. We present semantic correctness proofs of automatic differentiation (AD). We consider a forward mode AD method on a higher order language with algebraic data types, and we characterise it as the unique structure preserving macro given a choice of derivatives for basic operations. We describe a rich semantics for differentiable programming, based on diffeological spaces. We show that it interprets our language, and we phrase what it means for the AD method to be correct with respect to this semantics. We show that our characterisation of AD gives rise to an elegant semantic proof of its correctness based on a gluing construction on diffeological spaces. We explain how this is, in essence, a logical relations argument. Throughout, we show how the analysis extends to AD methods for computing higher order derivatives using a Taylor approximation.


Combinatoire des Sous Groupes de Congruence du Groupe Modulaire II. In this paper, we study combinatorics of congruence subgroups of the modular group. More precisely, we consider the matrix equation that naturally arises in the theory of Coxeter friezes and investigate its irreducible solutions. We give new properties for minimal monomial solutions. Furthermore, we introduce the notion of minimal dynomial solutions and study their irreducibility.


Fast Automated Reasoning over String Diagrams using Multiway Causal Structure. We introduce an intuitive algorithmic methodology for enacting automated rewriting of string diagrams within a general double pushout (DPO) framework, in which the sequence of rewrites is chosen in accordance with the causal structure of the underlying diagrammatic calculus. The combination of the rewriting structure and the causal structure may be elegantly formulated as a weak 2 category equipped with both total and partial monoidal bifunctors, thus providing a categorical semantics for the full multiway evolution causal graph of a generic Wolfram model hypergraph rewriting system. As an illustrative example, we show how a special case of this algorithm enables highly efficient automated simplification of quantum circuits, as represented in the ZX calculus.


MANA Microarchitecting an Instruction Prefetcher. L1 instruction (L1 I) cache misses are a source of performance bottleneck. Sequential prefetchers are simple solutions to mitigate this problem however, prior work has shown that these prefetchers leave considerable potentials uncovered. This observation has motivated many researchers to come up with more advanced instruction prefetchers. In 2011, Proactive Instruction Fetch (PIF) showed that a hardware prefetcher could effectively eliminate all of the instruction cache misses. However, its enormous storage cost makes it an impractical solution. Consequently, reducing the storage cost was the main research focus in the instruction prefetching in the past decade. Several instruction prefetchers, including RDIP and Shotgun, were proposed to offer PIF level performance with significantly lower storage overhead. However, our findings show that there is a considerable performance gap between these proposals and PIF. While these proposals use different mechanisms for instruction prefetching, the performance gap is largely not because of the mechanism, and instead, is due to not having sufficient storage. Prior proposals suffer from one or both of the following shortcomings (1) a large number of metadata records to cover the potential, and (2) a high storage cost of each record. The first problem causes metadata miss, and the second problem prohibits the prefetcher from storing enough records within reasonably sized storage.


Interactive Query Formulation using Point to Point Queries. Effective information disclosure in the context of databases with a large conceptual schema is known to be a non trivial problem. In particular the formulation of ad hoc queries is a major problem in such contexts. Existing approaches for tackling this problem include graphical query interfaces, query by navigation, and query by construction. In this article we propose the point to point query mechanism that can be combined with the existing mechanism into an unprecedented computer supported query formulation mechanism. In a point to point query a path through the information structure is build. This path can then be used to formulate more complex queries. A point to point query is typically useful when users know some object types which are relevant for their information need, but do not (yet) know how they are related in the conceptual schema. Part of the point to point query mechanism is therefore the selection of the most appropriate path between object types (points) in the conceptual schema. This article both discusses some of the pragmatic issues involved in the point to point query mechanism, and the theoretical issues involved in finding the relevant paths between selected object types.


On the Approximation of Cooperative Heterogeneous Multi Agent Reinforcement Learning (MARL) using Mean Field Control (MFC). Mean field control (MFC) is an effective way to mitigate the curse of dimensionality of cooperative multi agent reinforcement learning (MARL) problems. This work considers a collection of N mathrm pop heterogeneous agents that can be segregated into K classes such that the k th class contains N k homogeneous agents. We aim to prove approximation guarantees of the MARL problem for this heterogeneous system by its corresponding MFC problem. We consider three scenarios where the reward and transition dynamics of all agents are respectively taken to be functions of (1) joint state and action distributions across all classes, (2) individual distributions of each class, and (3) marginal distributions of the entire population. We show that, in these cases, the K class MARL problem can be approximated by MFC with errors given as e 1 mathcal O ( frac sqrt mathcal X sqrt mathcal U N mathrm pop sum k sqrt N k ) , e 2 mathcal O ( left sqrt mathcal X sqrt mathcal U right sum k frac 1 sqrt N k ) and e 3 mathcal O left( left sqrt mathcal X sqrt mathcal U right left frac A N mathrm pop sum k in K sqrt N k frac B sqrt N mathrm pop right right) , respectively, where A, B are some constants and mathcal X , mathcal U are the sizes of state and action spaces of each agent. Finally, we design a Natural Policy Gradient (NPG) based algorithm that, in the three cases stated above, can converge to an optimal MARL policy within mathcal O (e j) error with a sample complexity of mathcal O (e j 3 ) , j in 1,2,3 , respectively.


Lightweight Combinational Machine Learning Algorithm for Sorting Canine Torso Radiographs. The veterinary field lacks automation in contrast to the tremendous technological advances made in the human medical field. Implementation of machine learning technology can shorten any step of the automation process. This paper explores these core concepts and starts with automation in sorting radiographs for canines by view and anatomy. This is achieved by developing a new lightweight algorithm inspired by AlexNet, Inception, and SqueezeNet. The proposed module proves to be lighter than SqueezeNet while maintaining accuracy higher than that of AlexNet, ResNet, DenseNet, and SqueezeNet.


Advice Complexity of Online Non Crossing Matching. We study online matching in the Euclidean 2 dimesional plane with non crossing constraint. The offline version was introduced by Atallah in 1985 and the online version was introduced and studied more recently by Bose et al. The input to the problem consists of a sequence of points, and upon arrival of a point an algorithm can match it with a previously unmatched point provided that line segments corresponding to the matched edges do not intersect. The decisions are irrevocable, and while an optimal offline solution always matches all the points, an online algorithm cannot match all the points in the worst case, unless it is given some side information, i.e., advice. We study two versions of this problem monomchromatic (MNM) and bichromatic (BNM). We show that advice complexity of solving BNM optimally on a circle (or, more generally, on inputs in a convex position) is tightly bounded by the logarithm of the n text th Catalan number from above and below. This result corrects the previous claim of Bose et al. that the advice complexity is log(n!) . At the heart of the result is a connection between non crossing constraint in online inputs and 231 avoiding property of permutations of n elements We also show a lower bound of n 3 1 and an upper bound of 3n on the advice complexity for MNM on a plane. This gives an exponential improvement over the previously best known lower bound and an improvement in the constant of the leading term in the upper bound. In addition, we establish a lower bound of frac alpha 2 infdiv frac 2(1 alpha) alpha 1 4 n on the advice complexity for achieving competitive ratio alpha for MNM on a circle. Standard tools from advice complexity, such as partition trees and reductions from string guessing problem, do not seem to apply to MNM BNM, so we have to design our lower bounds from first principles.


Boosting Cross Lingual Transfer via Self Learning with Uncertainty Estimation. Recent multilingual pre trained language models have achieved remarkable zero shot performance, where the model is only finetuned on one source language and directly evaluated on target languages. In this work, we propose a self learning framework that further utilizes unlabeled data of target languages, combined with uncertainty estimation in the process to select high quality silver labels. Three different uncertainties are adapted and analyzed specifically for the cross lingual transfer Language Heteroscedastic Homoscedastic Uncertainty (LEU LOU), Evidential Uncertainty (EVI). We evaluate our framework with uncertainties on two cross lingual tasks including Named Entity Recognition (NER) and Natural Language Inference (NLI) covering 40 languages in total, which outperforms the baselines significantly by 10 F1 on average for NER and 2.5 accuracy score for NLI.


Identifying critical higher order interactions in complex networks. Information diffusion on networks is an important concept in network science observed in many situations such as information spreading and rumor controlling in social networks, disease contagion between individuals, cascading failures in power grids. The critical interactions in networks are the ones that play critical roles in information diffusion and primarily affect network structure and functions. Besides, interactions can occur between not only two nodes as pairwise interactions, i.e., edges, but also three or more nodes, described as higher order interactions. This report presents a novel method to identify critical higher order interactions. We propose two new Laplacians that allow redefining classical graph centrality measures for higher order interactions. We then compare the redefined centrality measures using the Susceptible Infected Recovered (SIR) simulation model. Experimental results suggest that the proposed method is promising in identifying critical higher order interactions.


Normal forms of nilpotent elements in semisimple Lie algebras. We find the normal form of nilpotent elements in semisimple Lie algebras that generalizes the Jordan normal form in mathfrak sl N , using the theory of cyclic elements.


HMS Hierarchical Modality Selection for Efficient Video Recognition. Videos are multimodal in nature. Conventional video recognition pipelines typically fuse multimodal features for improved performance. However, this is not only computationally expensive but also neglects the fact that different videos rely on different modalities for predictions. This paper introduces Hierarchical Modality Selection (HMS), a simple yet efficient multimodal learning framework for efficient video recognition. HMS operates on a low cost modality, i.e., audio clues, by default, and dynamically decides on the fly whether to use computationally expensive modalities, including appearance and motion clues, on a per input basis. This is achieved by the collaboration of three LSTMs that are organized in a hierarchical manner. In particular, LSTMs that operate on high cost modalities contain a gating module, which takes as inputs lower level features and historical information to adaptively determine whether to activate its corresponding modality otherwise it simply reuses historical information. We conduct extensive experiments on two large scale video benchmarks, FCVID and ActivityNet, and the results demonstrate the proposed approach can effectively explore multimodal information for improved classification performance while requiring much less computation.


Waypoint Models for Instruction guided Navigation in Continuous Environments. Little inquiry has explicitly addressed the role of action spaces in language guided visual navigation either in terms of its effect on navigation success or the efficiency with which a robotic agent could execute the resulting trajectory. Building on the recently released VLN CE setting for instruction following in continuous environments, we develop a class of language conditioned waypoint prediction networks to examine this question. We vary the expressivity of these models to explore a spectrum between low level actions and continuous waypoint prediction. We measure task performance and estimated execution time on a profiled LoCoBot robot. We find more expressive models result in simpler, faster to execute trajectories, but lower level actions can achieve better navigation metrics by approximating shortest paths better. Further, our models outperform prior work in VLN CE and set a new state of the art on the public leaderboard increasing success rate by 4 with our best model on this challenging task.


Customs Fraud Detection in the Presence of Concept Drift. Capturing the changing trade pattern is critical in customs fraud detection. As new goods are imported and novel frauds arise, a drift aware fraud detection system is needed to detect both known frauds and unknown frauds within a limited budget. The current paper proposes ADAPT, an adaptive selection method that controls the balance between exploitation and exploration strategies used for customs fraud detection. ADAPT makes use of the model performance trends and the amount of concept drift to determine the best exploration ratio at every time. Experiments on data from four countries over several years show that each country requires a different amount of exploration for maintaining its fraud detection system. We find the system with ADAPT can gradually adapt to the dataset and find the appropriate amount of exploration ratio with high performance.


Panoptic Narrative Grounding. This paper proposes Panoptic Narrative Grounding, a spatially fine and general formulation of the natural language visual grounding problem. We establish an experimental framework for the study of this new task, including new ground truth and metrics, and we propose a strong baseline method to serve as stepping stone for future work. We exploit the intrinsic semantic richness in an image by including panoptic categories, and we approach visual grounding at a fine grained level by using segmentations. In terms of ground truth, we propose an algorithm to automatically transfer Localized Narratives annotations to specific regions in the panoptic segmentations of the MS COCO dataset. To guarantee the quality of our annotations, we take advantage of the semantic structure contained in WordNet to exclusively incorporate noun phrases that are grounded to a meaningfully related panoptic segmentation region. The proposed baseline achieves a performance of 55.4 absolute Average Recall points. This result is a suitable foundation to push the envelope further in the development of methods for Panoptic Narrative Grounding.


Architecture Design for Human Driven Systems. This paper highlights humans' social and mobility behaviors' role in the continuous engineering of sustainable socio technical systems. Our approach relates the humans' characteristics and intentions with the system's goals, and models such interaction. Such a modeling approach aligns the architectural design and associated quality of service (QoS) with humans' quality of experience (QoE). We design a simulation environment that combines agent based social simulation (ABSS) with architectural models generated through a model driven engineering approach. Our modeling approach facilitates choosing the best architectural model and system configuration to enhance both the humans' and system's sustainability. We apply our approach to the Uffizi Galleries crowd management system. Taking advantage of real data, we model different scenarios that impact QoE. We then assess various architectural models with different SW HW configurations to propose the optimal model based on different scenarios concerning QoS QoE requirements.


A Closer Look at Self training for Zero Label Semantic Segmentation. Being able to segment unseen classes not observed during training is an important technical challenge in deep learning, because of its potential to reduce the expensive annotation required for semantic segmentation. Prior zero label semantic segmentation works approach this task by learning visual semantic embeddings or generative models. However, they are prone to overfitting on the seen classes because there is no training signal for them. In this paper, we study the challenging generalized zero label semantic segmentation task where the model has to segment both seen and unseen classes at test time. We assume that pixels of unseen classes could be present in the training images but without being annotated. Our idea is to capture the latent information on unseen classes by supervising the model with self produced pseudo labels for unlabeled pixels. We propose a consistency regularizer to filter out noisy pseudo labels by taking the intersections of the pseudo labels generated from different augmentations of the same image. Our framework generates pseudo labels and then retrain the model with human annotated and pseudo labelled data. This procedure is repeated for several iterations. As a result, our approach achieves the new state of the art on PascalVOC12 and COCO stuff datasets in the challenging generalized zero label semantic segmentation setting, surpassing other existing methods addressing this task with more complex strategies.


Enabling propagation of anisotropic polaritons along forbidden directions via a topological transition. Recent discoveries of polaritons in van der Waals (vdW) crystals with directional in plane propagation, ultra low losses, and broad spectral tunability have opened the door for unprecedented manipulation of the flow of light at the nanoscale. However, despite their extraordinary potential for nano optics, these unique polaritons also present an important limitation their directional propagation is intrinsically determined by the crystal structure of the host material, which imposes forbidden directions of propagation and hinders its control. Here, we theoretically predict and experimentally demonstrate that directional polaritons (in plane hyperbolic phonon polaritons) in a vdW biaxial slab (alpha phase molybdenum trioxide) can be steered along previously forbidden directions by inducing an optical topological transition, which naturally emerges when placing the slab on a substrate with a given negative permittivity (4H SiC). Importantly, due to the low loss nature of this topological transition, we are able to visualize in real space exotic intermediate polaritonic states between mutually orthogonal hyperbolic regimes, which permit to unveil the unique topological origin of the transition. This work provides new insights into the emergence of low loss optical topological transitions in vdW crystals, offering a novel route to efficiently steer the flow of energy at the nanoscale.


Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes. Long Short Term Memory LSTM based structures have demonstrated their efficiency for daily living recognition activities in smart homes by capturing the order of sensor activations and their temporal dependencies. Nevertheless, they still fail in dealing with the semantics and the context of the sensors. More than isolated id and their ordered activation values, sensors also carry meaning. Indeed, their nature and type of activation can translate various activities. Their logs are correlated with each other, creating a global context. We propose to use and compare two Natural Language Processing embedding methods to enhance LSTM based structures in activity sequences classification tasks Word2Vec, a static semantic embedding, and ELMo, a contextualized embedding. Results, on real smart homes datasets, indicate that this approach provides useful information, such as a sensor organization map, and makes less confusion between daily activity classes. It helps to better perform on datasets with competing activities of other residents or pets. Our tests show also that the embeddings can be pretrained on different datasets than the target one, enabling transfer learning. We thus demonstrate that taking into account the context of the sensors and their semantics increases the classification performances and enables transfer learning.


A family of simple non weight modules over the twisted N 2 superconformal algebra. We construct a class of non weight modules over the twisted N 2 superconformal algebra T . Let mathfrak h C L 0 oplus C G 0 be the Cartan subalgebra of T , and let mathfrak t C L 0 be the Cartan subalgebra of even part T bar 0 . These modules over T when restricted to the mathfrak h are free of rank 1 or when restricted to the mathfrak t are free of rank 2 . We provide the sufficient and necessary conditions for those modules being simple, as well as giving the sufficient and necessary conditions for two T modules being isomorphic. We also compute the action of an automorphism on them. Moreover, based on the weighting functor introduced in cite N2 , a class of intermediate series modules A sigma are obtained. As a byproduct, we give a sufficient condition for two T modules are not isomorphic.


ExBERT An External Knowledge Enhanced BERT for Natural Language Inference. Neural language representation models such as BERT, pre trained on large scale unstructured corpora lack explicit grounding to real world commonsense knowledge and are often unable to remember facts required for reasoning and inference. Natural Language Inference (NLI) is a challenging reasoning task that relies on common human understanding of language and real world commonsense knowledge. We introduce a new model for NLI called External Knowledge Enhanced BERT (ExBERT), to enrich the contextual representation with real world commonsense knowledge from external knowledge sources and enhance BERT's language understanding and reasoning capabilities. ExBERT takes full advantage of contextual word representations obtained from BERT and employs them to retrieve relevant external knowledge from knowledge graphs and to encode the retrieved external knowledge. Our model adaptively incorporates the external knowledge context required for reasoning over the inputs. Extensive experiments on the challenging SciTail and SNLI benchmarks demonstrate the effectiveness of ExBERT in comparison to the previous state of the art, we obtain an accuracy of 95.9 on SciTail and 91.5 on SNLI.


JOKR Joint Keypoint Representation for Unsupervised Cross Domain Motion Retargeting. The task of unsupervised motion retargeting in videos has seen substantial advancements through the use of deep neural networks. While early works concentrated on specific object priors such as a human face or body, recent work considered the unsupervised case. When the source and target videos, however, are of different shapes, current methods fail. To alleviate this problem, we introduce JOKR a JOint Keypoint Representation that captures the motion common to both the source and target videos, without requiring any object prior or data collection. By employing a domain confusion term, we enforce the unsupervised keypoint representations of both videos to be indistinguishable. This encourages disentanglement between the parts of the motion that are common to the two domains, and their distinctive appearance and motion, enabling the generation of videos that capture the motion of the one while depicting the style of the other. To enable cases where the objects are of different proportions or orientations, we apply a learned affine transformation between the JOKRs. This augments the representation to be affine invariant, and in practice broadens the variety of possible retargeting pairs. This geometry driven representation enables further intuitive control, such as temporal coherence and manual editing. Through comprehensive experimentation, we demonstrate the applicability of our method to different challenging cross domain video pairs. We evaluate our method both qualitatively and quantitatively, and demonstrate that our method handles various cross domain scenarios, such as different animals, different flowers, and humans. We also demonstrate superior temporal coherency and visual quality compared to state of the art alternatives, through statistical metrics and a user study. Source code and videos can be found at https rmokady.github.io JOKR .


Learning Span Level Interactions for Aspect Sentiment Triplet Extraction. Aspect Sentiment Triplet Extraction (ASTE) is the most recent subtask of ABSA which outputs triplets of an aspect target, its associated sentiment, and the corresponding opinion term. Recent models perform the triplet extraction in an end to end manner but heavily rely on the interactions between each target word and opinion word. Thereby, they cannot perform well on targets and opinions which contain multiple words. Our proposed span level approach explicitly considers the interaction between the whole spans of targets and opinions when predicting their sentiment relation. Thus, it can make predictions with the semantics of whole spans, ensuring better sentiment consistency. To ease the high computational cost caused by span enumeration, we propose a dual channel span pruning strategy by incorporating supervision from the Aspect Term Extraction (ATE) and Opinion Term Extraction (OTE) tasks. This strategy not only improves computational efficiency but also distinguishes the opinion and target spans more properly. Our framework simultaneously achieves strong performance for the ASTE as well as ATE and OTE tasks. In particular, our analysis shows that our span level approach achieves more significant improvements over the baselines on triplets with multi word targets or opinions.


Biased Gradient Estimate with Drastic Variance Reduction for Meta Reinforcement Learning. Despite the empirical success of meta reinforcement learning (meta RL), there are still a number poorly understood discrepancies between theory and practice. Critically, biased gradient estimates are almost always implemented in practice, whereas prior theory on meta RL only establishes convergence under unbiased gradient estimates. In this work, we investigate such a discrepancy. In particular, (1) We show that unbiased gradient estimates have variance Theta(N) which linearly depends on the sample size N of the inner loop updates (2) We propose linearized score function (LSF) gradient estimates, which have bias mathcal O (1 sqrt N ) and variance mathcal O (1 N) (3) We show that most empirical prior work in fact implements variants of the LSF gradient estimates. This implies that practical algorithms "accidentally" introduce bias to achieve better performance (4) We establish theoretical guarantees for the LSF gradient estimates in meta RL regarding its convergence to stationary points, showing better dependency on N than prior work when N is large.


Counting Rocks! An Introduction to Combinatorics. This textbook, "Counting Rocks!", is the written component of an interactive introduction to combinatorics at the undergraduate level. Throughout the text, we link to videos where we describe the material and provide examples. The major topics in this text are counting problems (Chapters 1 4), proof techniques (Chapter 5), recurrence relations and generating functions (Chapters 6 7), and an introduction to graph theory (Chapters 8 12). The material and the problems we include are standard for an undergraduate combinatorics course. In addition to the linked videos, most chapters contain an investigation section, where students are led through a series of deeper problems on a topic. In several sections, we show students how to use the free, open source computing software SAGE in order to solve problems. We have included many illustrative figures throughout the text, and we end each section and chapter with a list of exercises of varying difficulty.


Foliated affine and projective structures. We formalize the concepts of holomorphic affine and projective structures along the leaves of holomorphic foliations by curves on complex manifolds. We show that many foliations admit such structures, we provide local normal forms for them at singular points of the foliation, and we prove some index formulae in the case where the ambient manifold is compact. As a consequence of these, we establish that a regular foliation of general type on a compact algebraic manifold of even dimension does not admit a foliated projective structure. Finally, we classify foliated affine and projective structures along regular foliations on compact complex surfaces.


Trace Ratio Optimization with an Application to Multi view Learning. A trace ratio optimization problem over the Stiefel manifold is investigated from the perspectives of both theory and numerical computations. At least three special cases of the problem have arisen from Fisher linear discriminant analysis, canonical correlation analysis, and unbalanced Procrustes problem, respectively. Necessary conditions in the form of nonlinear eigenvalue problem with eigenvector dependency are established and a numerical method based on the self consistent field (SCF) iteration is designed and proved to be always convergent. As an application to multi view subspace learning, a new framework and its instantiated concrete models are proposed and demonstrated on real world data sets. Numerical results show that the efficiency of the proposed numerical methods and effectiveness of the new multi view subspace learning models.


DA LMR A Robust Lane Marking Representation for Data Association. While complete localization approaches are widely studied in the literature, their data association and data representation subprocesses usually go unnoticed. However, both are a key part of the final pose estimation. In this work, we present DA LMR (Delta Angle Lane Marking Representation), a robust data representation in the context of localization approaches. We propose a representation of lane markings that encodes how a curve changes in each point and includes this information in an additional dimension, thus providing a more detailed geometric structure description of the data. We also propose DC SAC (Distance Compatible Sample Consensus), a data association method. This is a heuristic version of RANSAC that dramatically reduces the hypothesis space by distance compatibility restrictions. We compare the presented methods with some state of the art data representation and data association approaches in different noisy scenarios. The DA LMR and DC SAC produce the most promising combination among those compared, reaching 98.1 in precision and 99.7 in recall for noisy data with 0.5 m of standard deviation.


On finiteness theorems of polynomial functions. Let d be a positive integer. We show a finiteness theorem for semialgebraic RL triviality of a Nash family of Nash functions defined on a Nash manifold, generalising Benedetti Shiota's finiteness theorem for semialgebraic RL equivalence classes appearing in the space of real polynomial functions of degree not exceeding d. We also prove Fukuda's claim, Theorem 1.3, and its semialgebraic version Theorem 1.4, on the finiteness of the local R types appearing in the space of real polynomial functions of real polynomial function germs of degree not exceeding d.


Explainable, automated urban interventions to improve pedestrian and vehicle safety. At the moment, urban mobility research and governmental initiatives are mostly focused on motor related issues, e.g. the problems of congestion and pollution. And yet, we can not disregard the most vulnerable elements in the urban landscape pedestrians, exposed to higher risks than other road users. Indeed, safe, accessible, and sustainable transport systems in cities are a core target of the UN's 2030 Agenda. Thus, there is an opportunity to apply advanced computational tools to the problem of traffic safety, in regards especially to pedestrians, who have been often overlooked in the past. This paper combines public data sources, large scale street imagery and computer vision techniques to approach pedestrian and vehicle safety with an automated, relatively simple, and universally applicable data processing scheme. The steps involved in this pipeline include the adaptation and training of a Residual Convolutional Neural Network to determine a hazard index for each given urban scene, as well as an interpretability analysis based on image segmentation and class activation mapping on those same images. Combined, the outcome of this computational approach is a fine grained map of hazard levels across a city, and an heuristic to identify interventions that might simultaneously improve pedestrian and vehicle safety. The proposed framework should be taken as a complement to the work of urban planners and public authorities.


Another simple reformulation of the four color theorem. We give a simple reformulation of the four color theorem as a problem on strings over a four letter alphabet.


Arachnophobia Exposure Therapy using Experience driven Procedural Content Generation via Reinforcement Learning (EDPCGRL). Personalized therapy, in which a therapeutic practice is adapted to an individual patient, leads to better health outcomes. Typically, this is accomplished by relying on a therapist's training and intuition along with feedback from a patient. While there exist approaches to automatically adapt therapeutic content to a patient, they rely on hand authored, pre defined rules, which may not generalize to all individuals. In this paper, we propose an approach to automatically adapt therapeutic content to patients based on physiological measures. We implement our approach in the context of arachnophobia exposure therapy, and rely on experience driven procedural content generation via reinforcement learning (EDPCGRL) to generate virtual spiders to match an individual patient. In this initial implementation, and due to the ongoing pandemic, we make use of virtual or artificial humans implemented based on prior arachnophobia psychology research. Our EDPCGRL method is able to more quickly adapt to these virtual humans with high accuracy in comparison to existing, search based EDPCG approaches.


Playable Video Generation. This paper introduces the unsupervised learning problem of playable video generation (PVG). In PVG, we aim at allowing a user to control the generated video by selecting a discrete action at every time step as when playing a video game. The difficulty of the task lies both in learning semantically consistent actions and in generating realistic videos conditioned on the user input. We propose a novel framework for PVG that is trained in a self supervised manner on a large dataset of unlabelled videos. We employ an encoder decoder architecture where the predicted action labels act as bottleneck. The network is constrained to learn a rich action space using, as main driving loss, a reconstruction loss on the generated video. We demonstrate the effectiveness of the proposed approach on several datasets with wide environment variety. Further details, code and examples are available on our project page willi menapace.github.io playable video generation website.


Order Preservation and Positive Correlation for Nonlinear Fokker Planck Equations. By investigating McKean Vlasov SDEs, the order preservation and positive correlation are characterized for nonlinear Fokker Planck equations. The main results recover the corresponding criteria on these properties established in 3, 5 for diffusion processes or linear Fokker Planck equations.


Towards Understanding the Impact of Real Time AI Powered Educational Dashboards (RAED) on Providing Guidance to Instructors. The objectives of this ongoing research are to build Real Time AI Powered Educational Dashboard (RAED) as a decision support tool for instructors, and to measure its impact on them while making decisions. Current developments in AI can be combined with the educational dashboards to make them AI Powered. Thus, AI can help in providing recommendations based on the students' performances. AI Powered educational dashboards can also assist instructors in tracking real time student activities. In this ongoing research, our aim is to develop the AI component as well as improve the existing design component of the RAED. Further, we will conduct experiments to study its impact on instructors, and understand how much they trust RAED to guide them while making decisions. This paper elaborates on the ongoing research and future direction.


Predicting Patient Outcomes with Graph Representation Learning. Recent work on predicting patient outcomes in the Intensive Care Unit (ICU) has focused heavily on the physiological time series data, largely ignoring sparse data such as diagnoses and medications. When they are included, they are usually concatenated in the late stages of a model, which may struggle to learn from rarer disease patterns. Instead, we propose a strategy to exploit diagnoses as relational information by connecting similar patients in a graph. To this end, we propose LSTM GNN for patient outcome prediction tasks a hybrid model combining Long Short Term Memory networks (LSTMs) for extracting temporal features and Graph Neural Networks (GNNs) for extracting the patient neighbourhood information. We demonstrate that LSTM GNNs outperform the LSTM only baseline on length of stay prediction tasks on the eICU database. More generally, our results indicate that exploiting information from neighbouring patient cases using graph neural networks is a promising research direction, yielding tangible returns in supervised learning performance on Electronic Health Records.


The Exact Rate Memory Tradeoff for Small Caches with Coded Placement. The idea of coded caching was introduced by Maddah Ali and Niesen who demonstrated the advantages of coding in caching problems. To capture the essence of the problem, they introduced the (N, K) canonical cache network in which K users with independent caches of size M request files from a server that has N files. Among other results, the caching scheme and lower bounds proposed by them led to a characterization of the exact rate memory tradeoff when M geq frac N K (K 1) . These lower bounds along with the caching scheme proposed by Chen et al. led to a characterization of the exact rate memory tradeoff when M leq frac 1 K . In this paper we focus on small caches where M in left 0, frac N K right and derive new lower bounds. For the case when big lceil frac K 1 2 big rceil leq N leq K and M in big frac 1 K , frac N K(N 1) big , our lower bounds demonstrate that the caching scheme introduced by G 'o mez Vilardeb 'o is optimal and thus extend the characterization of the exact rate memory tradeoff. For the case 1 leq N leq big lceil frac K 1 2 big rceil , we show that the new lower bounds improve upon the previously known lower bounds.


Formally Verified Convergence of Policy Rich DBF Routing Protocols. In this paper we present new general convergence results about the behaviour of Distributed Bellman Ford (DBF) family of routing protocols, which includes distance vector protocols (e.g. RIP) and path vector protocols (e.g. BGP). First, we propose a new algebraic model for abstract routing problems which has fewer primitives than previous models and can represent more expressive policy languages. The new model is also the first to allow concurrent reasoning about distance vector and path vector protocols. Second, we explicitly demonstrate how DBF routing protocols are instances of a larger class of asynchronous iterative algorithms, for which there already exist powerful results about convergence. These results allow us to build upon conditions previously shown by Sobrinho to be sufficient and necessary for the convergence of path vector protocols and generalise and strengthen them in various ways we show that, with a minor modification, they also apply to distance vector protocols we prove they guarantee that the final routing solution reached is unique, thereby eliminating the possibility of anomalies such as BGP wedgies we relax the model of asynchronous communication, showing that the results still hold if routing messages can be lost, reordered, and duplicated. Thirdly, our model and our accompanying theoretical results have been fully formalised in the Agda theorem prover. The resulting library is a powerful tool for quickly prototyping and formally verifying new policy languages. As an example, we formally verify the correctness of a policy language with many of the features of BGP including communities, conditional policy, path inflation and route filtering.


Brake orbits for Hamiltonian systems of classical type via Finsler geodesics. We consider Hamiltonian functions of classical type, namely even and convex with respect to the generalized momenta. A brake orbit is a periodic solution of Hamilton's equations such that the generalized momenta are zero on two different points. Under mild assumptions, this paper reduces the multiplicity problem of the brake orbits for a Hamiltonian function of classical type to the multiplicity problem of orthogonal geodesic chords in a concave Finslerian manifold with boundary. This paper will be used for a generalization of a Seifert's conjecture about the multiplicity of brake orbits to Hamiltonian functions of classical type.


Unconditional uniqueness for the Benjamin Ono equation. We study the unconditional uniqueness of solutions to the Benjamin Ono equation with initial data in H s , both on the real line and on the torus. We use the gauge transformation of Tao and two iterations of normal form reductions via integration by parts in time. By employing a refined Strichartz estimate we establish the result below the regularity threshold s 1 6 . As a by product of our proof, we also obtain a nonlinear smoothing property on the gauge variable at the same level of regularity.


Feature Fusion Methods for Indexing and Retrieval of Biometric Data Application to Face Recognition with Privacy Protection. Computationally efficient, accurate, and privacy preserving data storage and retrieval are among the key challenges faced by practical deployments of biometric identification systems worldwide. In this work, a method of protected indexing of biometric data is presented. By utilising feature level fusion of intelligently paired templates, a multi stage search structure is created. During retrieval, the list of potential candidate identities is successively pre filtered, thereby reducing the number of template comparisons necessary for a biometric identification transaction. Protection of the biometric probe templates, as well as the stored reference templates and the created index is carried out using homomorphic encryption. The proposed method is extensively evaluated in closed set and open set identification scenarios on publicly available databases using two state of the art open source face recognition systems. With respect to a typical baseline algorithm utilising an exhaustive search based retrieval algorithm, the proposed method enables a reduction of the computational workload associated with a biometric identification transaction by 90 , while simultaneously suffering no degradation of the biometric performance. Furthermore, by facilitating a seamless integration of template protection with open source homomorphic encryption libraries, the proposed method guarantees unlinkability, irreversibility, and renewability of the protected biometric data.


Model Parallel Model Selection for Deep Learning Systems. As deep learning becomes more expensive, both in terms of time and compute, inefficiencies in machine learning (ML) training prevent practical usage of state of the art models for most users. The newest model architectures are simply too large to be fit onto a single processor. To address the issue, many ML practitioners have turned to model parallelism as a method of distributing the computational requirements across several devices. Unfortunately, the sequential nature of neural networks causes very low efficiency and device utilization in model parallel training jobs. We propose a new form of "shard parallelism" combining task and model parallelism, then package it into a framework we name Hydra. Hydra recasts the problem of model parallelism in the multi model context to produce a fine grained parallel workload of independent model shards, rather than independent models. This new parallel design promises dramatic speedups relative to the traditional model parallelism paradigm.


Siegel's theorem via the Lawrence Venkatesh method. In the recent paper arXiv 1807.02721, B. Lawrence and A. Venkatesh develop a method of proving finiteness theorems in arithmetic geometry by studying the geometry of families over a base variety. Their results include a new proof of both the S unit theorem and Faltings' theorem, obtained by constructing and studying suitable abelian by finite families over mathbb P 1 setminus 0,1, infty and over an arbitrary curve of genus geq 2 respectively. In this paper, we apply this strategy to reprove Siegel's theorem we construct an abelian by finite family on a punctured elliptic curve to prove finiteness of S integral points on elliptic curves.


Kolmogorov Veloso Problems and Dialectica Categories. We investigate the categorical connection between Dialectica constructions, Kolmogorov problems, Veloso problems and Blass problems. We show that the work of Kolmogorov can be regarded as a bridge between Veloso's abstract notion of a problem and the conceptual problems Blass discussed in his questions and answers framework. This bridge can be seen by means of the categorical Dialectica constructions introduced in de Paiva's dissertation and reformulated by da Silva to account for set theoretical foundational assumptions. The use of categorical concepts allows us to provide several examples, connecting extremely different areas of mathematics, and using simple methods. This paper also shows that while Blass and Kolmogorov notions of problem can be investigated using the Zermelo Fraenkel (ZF) set theoretical framework, Veloso problems require the Axiom of Choice (AC). Moreover, weaker notions of choice (dependent choice and countable choice) can also be accounted for in the problems' framework.


OmniNet Omnidirectional Representations from Transformers. This paper proposes Omnidirectional Representations from Transformers (OmniNet). In OmniNet, instead of maintaining a strictly horizontal receptive field, each token is allowed to attend to all tokens in the entire network. This process can also be interpreted as a form of extreme or intensive attention mechanism that has the receptive field of the entire width and depth of the network. To this end, the omnidirectional attention is learned via a meta learner, which is essentially another self attention based model. In order to mitigate the computationally expensive costs of full receptive field attention, we leverage efficient self attention models such as kernel based (Choromanski et al.), low rank attention (Wang et al.) and or Big Bird (Zaheer et al.) as the meta learner. Extensive experiments are conducted on autoregressive language modeling (LM1B, C4), Machine Translation, Long Range Arena (LRA), and Image Recognition. The experiments show that OmniNet achieves considerable improvements across these tasks, including achieving state of the art performance on LM1B, WMT'14 En De En Fr, and Long Range Arena. Moreover, using omnidirectional representation in Vision Transformers leads to significant improvements on image recognition tasks on both few shot learning and fine tuning setups.


Theoretical analysis of the role of complex transition dipole phase in XUV transient absorption probing of charge migration. We theoretically investigate the role of complex dipole phase in the attosecond probing of charge migration. The iodobromoacetylene ion (ICCBr ) is considered as an example, in which one can probe charge migration by accessing both the iodine and bromine ends of the molecule with different spectral windows of an extreme ultraviolet (XUV) pulse. The analytical expression for transient absorption shows that the site specific information of charge migration is encoded in the complex phase of cross dipole products for XUV transitions between the I 4d and Br 3d spectral windows. Ab initio quantum chemistry calculations on ICCBr reveal that there is a constant pi phase difference between the I 4d and Br 3d transient absorption spectral windows, irrespective of the fine structure energy splittings. Transient absorption spectra are simulated with a multistate model including the complex dipole phase, and the results correctly reconstruct the charge migration dynamics via the quantum beats in the two element spectral windows, exhibiting out of phase oscillations.


WiCV 2020 The Seventh Women In Computer Vision Workshop. In this paper we present the details of Women in Computer Vision Workshop WiCV 2020, organized in alongside virtual CVPR 2020. This event aims at encouraging the women researchers in the field of computer vision. It provides a voice to a minority (female) group in computer vision community and focuses on increasingly the visibility of these researchers, both in academia and industry. WiCV believes that such an event can play an important role in lowering the gender imbalance in the field of computer vision. WiCV is organized each year where it provides a.) opportunity for collaboration with between researchers b.) mentorship to female junior researchers c.) financial support to presenters to overcome monetary burden and d.) large and diverse choice of role models, who can serve as examples to younger researchers at the beginning of their careers. In this paper, we present a report on the workshop program, trends over the past years, a summary of statistics regarding presenters, attendees, and sponsorship for the current workshop.


Introducing the Voxel Interactive Contour Tool for Online Radiation Intensity Analytics (VICTORIA). In this paper, the Voxel Interactive Contour Tool for Online Radiation Intensity Analytics (VICTORIA) web viewer is presented as a solution to the issue of inaccessible, expensive, and insecure Digital Imaging and Communications in Medicine (DICOM) and Monte Carlo (MC) dose viewers. VICTORIA is a tool for the visualization and comparison of dose distributions with underlying anatomy that is accessible, free, designed with security in mind, and available on the web. The code is open source and under the GNU General Public License, and it can be found at the EGSnrc Github repo in the DICOM viewer branch. The viewer should be useful for researchers using EGSnrc file types .egsphant and .3ddose from the EGSnrc toolkit, patients who want a simple tool to view files, or researchers using DICOM Computed Tomography (CT) and DICOM Radiotherapy (RT) Dose files in low or middle income countries without access to treatment planning systems.


Good sequencings of partial Steiner systems. A partial (n,k,t) lambda Steiner system is a pair (X, mathcal B ) where X is an n set of vertices and mathcal B is a collection of k subsets of X called blocks such that each t set of vertices is a subset of at most lambda blocks. An ell good sequencing of such a system is a labelling of its vertices with distinct elements of 0, ldots,n 1 such that no block is contained in a set of ell vertices with consecutive labels. Here we give a short proof that, for fixed k , t and lambda , any partial (n,k,t) lambda Steiner system has an ell good sequencing for some ell Theta(n 1 t ) as n becomes large. This improves on results of Blackburn and Etzion, and of Stinson and Veitch. Unlike those results, which are proved constructively, our proof relies on an application of the Lov ' a sz local lemma. Our result is perhaps of most interest in the case k t 1 where results of Kostochka, Mubayi and Verstra " e te show that the value of ell cannot be increased beyond Theta((n log n) 1 t ) . A special case of our result shows that every partial (n,3,2) 1 Steiner system has an ell good sequencing for each positive integer ell leq 0.0908 ,n 1 2 .


Leveraging Expert Consistency to Improve Algorithmic Decision Support. Due to their promise of superior predictive power relative to human assessment, machine learning models are increasingly being used to support high stakes decisions. However, the nature of the labels available for training these models often hampers the usefulness of predictive models for decision support. In this paper, we explore the use of historical expert decisions as a rich yet imperfect source of information, and we show that it can be leveraged to mitigate some of the limitations of learning from observed labels alone. We consider the problem of estimating expert consistency indirectly when each case in the data is assessed by a single expert, and propose influence functions based methodology as a solution to this problem. We then incorporate the estimated expert consistency into the predictive model meant for decision support through an approach we term label amalgamation. This allows the machine learning models to learn from experts in instances where there is expert consistency, and learn from the observed labels elsewhere. We show how the proposed approach can help mitigate common challenges of learning from observed labels alone, reducing the gap between the construct that the algorithm optimizes for and the construct of interest to experts. After providing intuition and theoretical results, we present empirical results in the context of child maltreatment hotline screenings. Here, we find that (1) there are high risk cases whose risk is considered by the experts but not wholly captured in the target labels used to train a deployed model, and (2) the proposed approach improves recall for these cases.


Scheduling Plans of Tasks. We present a heuristic algorithm for solving the problem of scheduling plans of tasks. The plans are ordered vectors of tasks, and tasks are basic operations carried out by resources. Plans are tied by temporal, precedence and resource constraints that makes the scheduling problem hard to solve in polynomial time. The proposed heuristic, that has a polynomial worst case time complexity, searches for a feasible schedule that maximize the number of plans scheduled, along a fixed time window, with respect to temporal, precedence and resource constraints.


"Facebook Promotes More Harassment" Social Media Ecosystem, Skill and Marginalized Hijra Identity in Bangladesh. Social interaction across multiple online platforms is a challenge for gender and sexual minorities (GSM) due to the stigmatization they face, which increases the complexity of their self presentation decisions. These online interactions and identity disclosures can be more complicated for GSM in non Western contexts due to consequentially different audiences and perceived affordances by the users, and limited baseline understanding of the conflation of these two with local norms and the opportunities they practically represent. Using focus group discussions and semi structured interviews, we engaged with 61 textit Hijra individuals from Bangladesh, a severely stigmatized GSM from south Asia, to understand their overall online participation and disclosure behaviors through the lens of personal social media ecosystems. We find that along with platform audiences, affordances, and norms, participant skill knowledge, and cultural influences also impact navigation through multiple platforms, resulting in differential benefits from privacy features. This impacts how Hijra perceive online spaces, and shape their self presentation and disclosure behaviors over time. Content Warning This paper discusses graphic contents (e.g. rape and sexual harassment) related to Hijra.


Large scale Autonomous Flight with Real time Semantic SLAM under Dense Forest Canopy. Semantic maps represent the environment using a set of semantically meaningful objects. This representation is storage efficient, less ambiguous, and more informative, thus facilitating large scale autonomy and the acquisition of actionable information in highly unstructured, GPS denied environments. In this letter, we propose an integrated system that can perform large scale autonomous flights and real time semantic mapping in challenging under canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. The autonomous navigation module utilizes a multi level planning and mapping framework and computes dynamically feasible trajectories that lead the UAV to build a semantic map of the user defined region of interest in a computationally and storage efficient manner. A drift compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability. This leads the UAV to execute its mission accurately and safely at scale. Code is released at https github.com KumarRobotics kr autonomous flight and https github.com KumarRobotics sloam.


Fine asymptotics for the maximum degree in weighted recursive trees with bounded random weights. A weighted recursive tree is an evolving tree in which vertices are assigned random vertex weights and new vertices connect to a predecessor with a probability proportional to its weight. Here, we study the maximum degree and near maximum degrees in weighted recursive trees when the vertex weights are almost surely bounded. We are able to specify higher order corrections to the first order growth of the maximum degree established in prior work. The accuracy of the results depends on the behaviour of the weight distribution near the largest possible value and in certain cases we manage to find the corrections up to random order. Additionally, we describe the tail distribution of the maximum degree, the distribution of the number of vertices attaining the maximum degree and establish asymptotic normality of the number of vertices with near maximum degree. Our analysis extends the results proved for random recursive trees (where the weights are constant) to the case of random weights. The main technical result shows that the degrees of several uniformly chosen vertices are asymptotically independent with explicit error corrections.


Effect of stepwise adjustment of Damping factor upon PageRank. The effect of adjusting damping factor alpha , from a small initial value alpha 0 to the final desired alpha f value, upon then iterations needed for PageRank computation is observed. Adjustment of the damping factor is done in one or more steps. Results show no improvement in performance over a fixed damping factor based PageRank.


An optimised deep spiking neural network architecture without gradients. We present an end to end trainable modular event driven neural architecture that uses local synaptic and threshold adaptation rules to perform transformations between arbitrary spatio temporal spike patterns. The architecture represents a highly abstracted model of existing Spiking Neural Network (SNN) architectures. The proposed Optimized Deep Event driven Spiking neural network Architecture (ODESA) can simultaneously learn hierarchical spatio temporal features at multiple arbitrary time scales. ODESA performs online learning without the use of error back propagation or the calculation of gradients. Through the use of simple local adaptive selection thresholds at each node, the network rapidly learns to appropriately allocate its neuronal resources at each layer for any given problem without using a real valued error measure. These adaptive selection thresholds are the central feature of ODESA, ensuring network stability and remarkable robustness to noise as well as to the selection of initial system parameters. Network activations are inherently sparse due to a hard Winner Take All (WTA) constraint at each layer. We evaluate the architecture on existing spatio temporal datasets, including the spike encoded IRIS and TIDIGITS datasets, as well as a novel set of tasks based on International Morse Code that we created. These tests demonstrate the hierarchical spatio temporal learning capabilities of ODESA. Through these tests, we demonstrate ODESA can optimally solve practical and highly challenging hierarchical spatio temporal learning tasks with the minimum possible number of computing nodes.


Large genus bounds for the distribution of triangulated surfaces in moduli space. Triangulated surfaces are compact Riemann surfaces equipped with a conformal triangulation by equilateral triangles. In 2004, Brooks and Makover asked how triangulated surfaces are distributed in the moduli space of Riemann surfaces as the genus tends to infinity. Mirzakhani raised this question in her 2010 ICM address. We show that in the large genus case, triangulated surfaces are well distributed in moduli space in a fairly strong sense. We do this by proving upper and lower bounds for the number of triangulated surfaces lying in a Teichm "uller ball in moduli space. In particular, we show that the number of triangulated surfaces lying in a Teichm "uller unit ball is at most exponential in the number of triangles, independent of the genus.


Positive Solutions of Competition Model with Saturation. In this paper, the positive solutions of a diffusive competition model with saturation are mainly discussed. Under certain conditions, the stability and multiplicities of coexistence states are analyzed. And by using the topological degree theory in cones, it is proved that the problem has at least two positive solutions under certain conditions. Finally, investigating the bifurcation of coexistence states emanating from the semi trivial solutions, some instability and multiplicity results of coexistence state are expressed.


A direct proof of Stahl's theorem for a generic class of algebraic functions. Under the assumption of the existence of Stahl's S compact set we give a short proof of the limit zeros distribution of Pad 'e polynomials and convergence in capacity of diagonal Pad 'e approximants for a generic class of algebraic functions. The proof is direct but not from the opposite as Stahl's original proof is. The generic class means in particular that all branch points of the multi sheeted Riemann surface of the algebraic function are of the first order (i.e., we assume the surface is such that all branch points are of square root type). We do not use the relations of orthogonality at all. The proof is based on the maximum principle only.


Electron loss to continuum cusp in collisions of U 89 with N 2 and Xe. We study the electron loss to continuum (ELC) cusp experimentally and theoretically by comparing the ionization of U 89 projectiles in collisions with N 2 and Xe targets, at a beam energy of 75.91 MeV u. The coincidence measurement between the singly ionized projectile and the energy of the emitted electron is used to compare the shape of the ELC cusp at weak and strong perturbations. A significant energy shift for the centroid of the electron cusp is observed for the heavy target of Xe as compared to the light target of N 2 . Our results provide a stringent test for fully relativistic calculations of double differential cross sections performed in the first order approximation and in the continuum distorted wave approach.


Semantics Disentangling for Generalized Zero Shot Learning. Generalized zero shot learning (GZSL) aims to classify samples under the assumption that some classes are not observable during training. To bridge the gap between the seen and unseen classes, most GZSL methods attempt to associate the visual features of seen classes with attributes or to generate unseen samples directly. Nevertheless, the visual features used in the prior approaches do not necessarily encode semantically related information that the shared attributes refer to, which degrades the model generalization to unseen classes. To address this issue, in this paper, we propose a novel semantics disentangling framework for the generalized zero shot learning task (SDGZSL), where the visual features of unseen classes are firstly estimated by a conditional VAE and then factorized into semantic consistent and semantic unrelated latent vectors. In particular, a total correlation penalty is applied to guarantee the independence between the two factorized representations, and the semantic consistency of which is measured by the derived relation network. Extensive experiments conducted on four GZSL benchmark datasets have evidenced that the semantic consistent features disentangled by the proposed SDGZSL are more generalizable in tasks of canonical and generalized zero shot learning. Our source code is available at https github.com uqzhichen SDGZSL.


Dynamical system related to primal dual splitting projection methods. We introduce a dynamical system to the problem of finding zeros of the sum of two maximally monotone operators. We investigate the existence, uniqueness and extendability of solutions to this dynamical system in a Hilbert space. We prove that the trajectories of the proposed dynamical system converge strongly to a primal dual solution of the considered problem. Under explicit time discretization of the dynamical system we obtain the best approximation algorithm for solving coupled monotone inclusion problem.


SketchLattice Latticed Representation for Sketch Manipulation. The key challenge in designing a sketch representation lies with handling the abstract and iconic nature of sketches. Existing work predominantly utilizes either, (i) a pixelative format that treats sketches as natural images employing off the shelf CNN based networks, or (ii) an elaborately designed vector format that leverages the structural information of drawing orders using sequential RNN based methods. While the pixelative format lacks intuitive exploitation of structural cues, sketches in vector format are absent in most cases limiting their practical usage. Hence, in this paper, we propose a lattice structured sketch representation that not only removes the bottleneck of requiring vector data but also preserves the structural cues that vector data provides. Essentially, sketch lattice is a set of points sampled from the pixelative format of the sketch using a lattice graph. We show that our lattice structure is particularly amenable to structural changes that largely benefits sketch abstraction modeling for generation tasks. Our lattice representation could be effectively encoded using a graph model, that uses significantly fewer model parameters (13.5 times lesser) than existing state of the art. Extensive experiments demonstrate the effectiveness of sketch lattice for sketch manipulation, including sketch healing and image to sketch synthesis.


The q golden ratio, Catalan numbers, and an identity of Sauermann Wigderson. In this note, we present some basic properties of q Fibonacci numbers and their relationship to the q golden ratio and Catalan numbers. We then use this relationship to give a short proof of a combinatorial identity.


Simple closed curves in stable covers of surfaces. Let f X to Y be a regular covering of a surface Y of finite type with nonempty boundary, with finitely generated (possibly infinite) deck group G . We give necessary and sufficient conditions for an integral homology class on X to admit a representative as a connected component of the preimage of a nonseparating simple closed curve on Y , possibly after passing to a "stabilization", i.e. a G equivariant embedding of covering spaces X hookrightarrow X .


Study of the exfoliation and functionalization of graphene from graphite flakes with plasma discharge in solution. Graphene flakes were produced by nanosecond plasma discharge at atmospheric pressure between an electrode and the surface of distilled water, in which were placed graphite flakes. The discharge ionizes the gas and forms free radicals on the surface of the water, functionalizing the graphite flakes in solution. The plasma also gives enough energy to break the Van der Waals bonds between the graphene layers but not enough to break the covalent C C bonds within the layers. Transmission electron microscopy confirmed the hexagonal structure of graphene sheets, and showed that they were monocrystalline. No contamination was found in the obtained nanomaterial. An unknown phenomenon has been found in the activated distilled water, making its electrical conductivity decrease with an increasing temperature. An acidification of the water is observed. The gas in which the discharge takes place plays a major role on the process, no exfoliation is observed if plasmogen argon gas is used.


Parallel and Flexible Dynamic Programming via the Randomized Mini Batch Operator. The Bellman operator constitutes the foundation of dynamic programming (DP). An alternative is presented by the Gauss Seidel operator, whose evaluation, differently from that of the Bellman operator where the states are all processed at once, updates one state at a time, while incorporating into the computation the interim results. The provably better convergence rate of DP methods based on the Gauss Seidel operator comes at the price of an inherent sequentiality, which prevents the exploitation of modern multi core systems. In this work we propose a new operator for dynamic programming, namely, the randomized mini batch operator, which aims at realizing the trade off between the better convergence rate of the methods based on the Gauss Seidel operator and the parallelization capability offered by the Bellman operator. After the introduction of the new operator, a theoretical analysis for validating its fundamental properties is conducted. Such properties allow one to successfully deploy the new operator in the main dynamic programming schemes, such as value iteration and modified policy iteration. We compare the convergence of the DP algorithm based on the new operator with its earlier counterparts, shedding light on the algorithmic advantages of the new formulation and the impact of the batch size parameter on the convergence. Finally, an extensive numerical evaluation of the newly introduced operator is conducted. In accordance with the theoretical derivations, the numerical results show the competitive performance of the proposed operator and its superior flexibility, which allows one to adapt the efficiency of its iterations to different structures of MDPs and hardware setups.


Learning To Ensemble by Contextual Rank Aggregation in E Commerce. Ensemble models in E commerce combine predictions from multiple sub models for ranking and revenue improvement. Industrial ensemble models are typically deep neural networks, following the supervised learning paradigm to infer conversion rate given inputs from sub models. However, this process has the following two problems. Firstly, the point wise scoring approach disregards the relationships between items and leads to homogeneous displayed results, while diversified display benefits user experience and revenue. Secondly, the learning paradigm focuses on the ranking metrics and does not directly optimize the revenue. In our work, we propose a new Learning To Ensemble (LTE) framework RAEGO, which replaces the ensemble model with a contextual Rank Aggregator (RA) and explores the best weights of sub models by the Evaluator Generator Optimization (EGO). To achieve the best online performance, we propose a new rank aggregation algorithm TournamentGreedy as a refinement of classic rank aggregators, which also produces the best average weighted Kendall Tau Distance (KTD) amongst all the considered algorithms with quadratic time complexity. Under the assumption that the best output list should be Pareto Optimal on the KTD metric for sub models, we show that our RA algorithm has higher efficiency and coverage in exploring the optimal weights. Combined with the idea of Bayesian Optimization and gradient descent, we solve the online contextual Black Box Optimization task that finds the optimal weights for sub models given a chosen RA model. RA EGO has been deployed in our online system and has improved the revenue significantly.


Nearest Neighbor Queries in Customizable Contraction Hierarchies and Applications. Customizable contraction hierarchies are one of the most popular route planning frameworks in practice, due to their simplicity and versatility. In this work, we present a novel algorithm for finding k nearest neighbors in customizable contraction hierarchies by systematically exploring the associated separator decomposition tree. Compared to previous bucket based approaches, our algorithm requires much less target dependent preprocessing effort. Moreover, we use our novel approach in two concrete applications. The first application are online k closest point of interest queries, where the points of interest are only revealed at query time. We achieve query times of about 25 milliseconds on a continental road network, which is fast enough for interactive systems. The second application is travel demand generation. We show how to accelerate a recently introduced travel demand generator by a factor of more than 50 using our novel nearest neighbor algorithm.


Galois Groups in Enumerative Geometry and Applications. As Jordan observed in 1870, just as univariate polynomials have Galois groups, so do problems in enumerative geometry. Despite this pedigree, the study of Galois groups in enumerative geometry was dormant for a century, with a systematic study only occuring in the past 15 years. We discuss the current directions of this study, including open problems and conjectures.


Uniform scrambles on graphs. A scramble on a connected multigraph is a collection of connected subgraphs that generalizes the notion of a bramble. The maximum order of a scramble, called the scramble number of a graph, was recently developed as a tool for lower bounding divisorial gonality. We present results on the scramble of all connected subgraphs with a fixed number of vertices, using these to calculate scramble number and gonality both for large families of graphs, and for specific examples like the 4 and 5 dimensional hypercube graphs. We also study the computational complexity of the egg cut number of a scramble.


Concadia Tackling Image Accessibility with Descriptive Texts and Context. Images have become an integral part of online media. This has enhanced the dissemination of knowledge, but it poses serious accessibility challenges. The HTML "alt" field is hidden by default and designated for supplying a description that could replace the image, but it is rarely used. By contrast, image captions appear alongside the image and are more abundant, but they are written to supply additional information and generally lack the details required for accessibility. These terms are often treated as synonyms, but we argue that a distinction is essential. To address this, we introduce the publicly available Wikipedia based corpus Concadia, which consists of 96,918 images with corresponding English language descriptions, captions, and surrounding context. We use Concadia to characterize the commonalities and differences between descriptions and captions. This leads us to the hypothesis that captions, while not substitutes for descriptions, can provide a useful signal for creating effective descriptions. We substantiate this hypothesis by showing that image description systems trained on Concadia benefit from having caption embeddings as part of their inputs. Finally, we provide evidence from a human subjects experiment that human created captions and descriptions have distinct communicative purposes, and that our generated texts follow this same pattern. These experiments begin to show how Concadia can be a powerful tool in addressing the underlying accessibility issues posed by image data.


Multi Receiver Online Bayesian Persuasion. Bayesian persuasion studies how an informed sender should partially disclose information to influence the behavior of a self interested receiver. Classical models make the stringent assumption that the sender knows the receiver's utility. This can be relaxed by considering an online learning framework in which the sender repeatedly faces a receiver of an unknown, adversarially selected type. We study, for the first time, an online Bayesian persuasion setting with multiple receivers. We focus on the case with no externalities and binary actions, as customary in offline models. Our goal is to design no regret algorithms for the sender with polynomial per iteration running time. First, we prove a negative result for any 0 alpha leq 1 , there is no polynomial time no alpha regret algorithm when the sender's utility function is supermodular or anonymous. Then, we focus on the case of submodular sender's utility functions and we show that, in this case, it is possible to design a polynomial time no (1 frac 1 e ) regret algorithm. To do so, we introduce a general online gradient descent scheme to handle online learning problems with a finite number of possible loss functions. This requires the existence of an approximate projection oracle. We show that, in our setting, there exists one such projection oracle which can be implemented in polynomial time.