Look back, look around a systematic analysis of effective predictors for new outlinks in focused Web crawling. Small and medium enterprises rely on detailed Web analytics to be informed about their market and competition. Focused crawlers meet this demand by crawling and indexing specific parts of the Web. Critically, a focused crawler must quickly find new pages that have not yet been indexed. Since a new page can be discovered only by following a new outlink, predicting new outlinks is very relevant in practice. In the literature, many feature designs have been proposed for predicting changes in the Web. In this work we provide a structured analysis of this problem, using new outlinks as our running prediction target. Specifically, we unify earlier feature designs in a taxonomic arrangement of features along two dimensions static versus dynamic features, and features of a page versus features of the network around it. Within this taxonomy, complemented by our new (mainly, dynamic network) features, we identify best predictors for new outlinks. Our main conclusion is that most informative features are the recent history of new outlinks on a page itself, and on its content related pages. Hence, we propose a new 'look back, look around' (LBLA) model, that uses only these features. With the obtained predictions, we design a number of scoring functions to guide a focused crawler to pages with most new outlinks, and compare their performance. Interestingly, the LBLA approach proved extremely effective, outperforming even the models that use a most complete set of features. One of the learners we use, is the recent NGBoost method that assumes a Poisson distribution for the number of new outlinks on a page, and learns its parameters. This connects the two so far unrelated avenues in the literature predictions based on features of a page, and those based on probabilistic modeling. All experiments were carried out on an original dataset, made available by a commercial focused crawler.


Semantic Relation Reasoning for Shot Stable Few Shot Object Detection. Few shot object detection is an imperative and long lasting problem due to the inherent long tail distribution of real world data. Its performance is largely affected by the data scarcity of novel classes. But the semantic relation between the novel classes and the base classes is constant regardless of the data availability. In this work, we investigate utilizing this semantic relation together with the visual information and introduce explicit relation reasoning into the learning of novel object detection. Specifically, we represent each class concept by a semantic embedding learned from a large corpus of text. The detector is trained to project the image representations of objects into this embedding space. We also identify the problems of trivially using the raw embeddings with a heuristic knowledge graph and propose to augment the embeddings with a dynamic relation graph. As a result, our few shot detector, termed SRR FSD, is robust and stable to the variation of shots of novel objects. Experiments show that SRR FSD can achieve competitive results at higher shots, and more importantly, a significantly better performance given both lower explicit and implicit shots. The benchmark protocol with implicit shots removed from the pretrained classification dataset can serve as a more realistic setting for future research.


Bond selective interferometric scattering microscopy. Interferometric scattering microscopy has been a very promising technology for highly sensitive label free imaging of a broad spectrum of biological nanoparticles from proteins to viruses in a high throughput manner. Although it can reveal the specimen's size and shape information, the chemical composition is inaccessible in interferometric measurements. Infrared spectroscopic imaging provides chemical specificity based on inherent chemical bond vibrations of specimens but lacks the ability to image and resolve individual nanoparticles due to long infrared wavelengths. Here, we describe a bond selective interferometric scattering microscope where the mid infrared induced photothermal signal is detected by a visible beam in a wide field common path interferometry configuration. A thin film layered substrate is utilized to reduce the reflected light and provide a reference field for the interferometric detection of the weakly scattered field. A pulsed mid IR laser is employed to modulate the interferometric signal. Subsequent demodulation via a virtual lock in camera offers simultaneous chemical information about tens of micro or nano particles. The chemical contrast arises from a minute change in the particle's scattered field in consequence of the vibrational absorption at the target molecule. We characterize the system with sub wavelength polymer beads and highlight biological applications by chemically imaging several microorganisms including Staphylococcus aureus, Escherichia coli, and Candida albicans. A theoretical framework is established to extend bond selective interferometric scattering microscopy to a broad range of biological micro and nano particles.


Aligning Pretraining for Detection via Object Level Contrastive Learning. Image level contrastive representation learning has proven to be highly effective as a generic model for transfer learning. Such generality for transfer learning, however, sacrifices specificity if we are interested in a certain downstream task. We argue that this could be sub optimal and thus advocate a design principle which encourages alignment between the self supervised pretext task and the downstream task. In this paper, we follow this principle with a pretraining method specifically designed for the task of object detection. We attain alignment in the following three aspects 1) object level representations are introduced via selective search bounding boxes as object proposals 2) the pretraining network architecture incorporates the same dedicated modules used in the detection pipeline (e.g. FPN) 3) the pretraining is equipped with object detection properties such as object level translation invariance and scale invariance. Our method, called Selective Object COntrastive learning (SoCo), achieves state of the art results for transfer performance on COCO detection using a Mask R CNN framework. Code is available at https github.com hologerry SoCo.


A characterisation of cross impact kernels. Trading a financial asset pushes its price as well as the prices of other assets, a phenomenon known as cross impact. We consider a general class of kernel based cross impact models and investigate suitable parameterisations for trading purposes. We focus on kernels that guarantee that prices are martingales and anticipate future order flow (martingale admissible kernels) and those that ensure there is no possible price manipulation (no statistical arbitrage admissible kernels). We determine the overlap between these two classes and provide formulas for calibration of cross impact kernels on data. We illustrate our results using SP500 futures data.


Wavelet analysis and energy based measures for oil food price relationship as a footprint of financialisation effect. In this paper we exploit the wavelet analysis approach to investigate oil food price correlation and its determinants in the domains of time and frequency. Wavelet analysis is able to differentiate high frequency from low frequency movements which correspond, respectively, to short and long run dynamics. We show that the significant local correlation between food and oil is only apparent and this is mainly due both to the activity of commodity index investments and, to a lesser extent, to a growing demand from emerging economies. Moreover, the activity of commodity index investments gives evidence of the overall financialisation process. In addition, we employ wavelet entropy to assess the predictability of the time series under consideration at different frequencies. We find that some variables share a similar predictability structure with food and oil. These variables are the ones that move the most along with oil and food. We also introduce a novel measure, the Cross Wavelet Energy Entropy Measure (CWEEM), based on wavelet transformation and information entropy, with the aim of quantifying the intrinsic predictability of food and oil given demand from emerging economies, commodity index investments, financial stress, and global economic activity. The results show that these dynamics are best predicted by global economic activity at all frequencies and by demand from emerging economies and commodity index investments at high frequencies only.


Fast, Reliable, and Secure Drone Communication A Comprehensive Survey. Drone security is currently a major topic of discussion among researchers and industrialists. Although there are multiple applications of drones, if the security challenges are not anticipated and required architectural changes are not made, the upcoming drone applications will not be able to serve their actual purpose. Therefore, in this paper, we present a detailed review of the security critical drone applications, and security related challenges in drone communication such as DoS attacks, Man in the middle attacks, De Authentication attacks, and so on. Furthermore, as part of solution architectures, the use of Blockchain, Software Defined Networks (SDN), Machine Learning, and Fog Edge computing are discussed as these are the most emerging technologies. Drones are highly resource constrained devices and therefore it is not possible to deploy heavy security algorithms on board. Blockchain can be used to cryptographically store all the data that is sent to from the drones, thereby saving it from tampering and eavesdropping. Various ML algorithms can be used to detect malicious drones in the network and to detect safe routes. Additionally, the SDN technology can be used to make the drone network reliable by allowing the controller to keep a close check on data traffic, and fog computing can be used to keep the computation capabilities closer to the drones without overloading them.


Monotone Value Neural Networks Exploiting Preference Monotonicity in Combinatorial Assignment. Many important resource allocation problems involve the combinatorial assignment of items (e.g., combinatorial auctions, combinatorial exchanges, and combinatorial course allocation). Because the bundle space grows exponentially in the number of items, preference elicitation is a key challenge in these domains, in particular because agents may view items as substitutes or complements. Recently, researchers have proposed machine learning (ML) based mechanisms that outperform traditional mechanisms while reducing preference elicitation costs for agents. However, one major shortcoming of the ML algorithms that were used is that they ignore important prior knowledge about agents' preferences. To address this, we introduce monotone value neural networks (MVNNs), which are carefully designed to capture combinatorial valuations, while enforcing monotonicity (i.e., adding an item to a bundle weakly increases its value) and normality (i.e., the empty bundle has zero value). On a technical level, we make two main contributions. First, we prove that our MVNNs are universal in the class of monotone and normalized value functions second, we provide a mixed integer program (MIP) formulation to make solving MVNN based winner determination problems practically feasible. We evaluate our MVNNs experimentally in spectrum auction domains. Our results show that MVNNs improve the prediction performance when learning agents' value functions, they improve the allocative efficiency of the auction, and they also reduce the run time of the winner determination problem.


Global solvability in a two species chemotaxis system with signal production. In this work, we study the Neumann initial boundary value problem for a two species chemotaxis system with Lotka Volterra competition and signal production. Under a rather weak and clean condition of sub quadratic type damping and merely integrable initial data, we establish the global existence of generalized solutions in an N dimensional bounded and smooth domain.


Probing the ultrafast gain and refractive index dynamics of a VECSEL. Typically, strong gain saturation and gain dynamics play a crucial role in semiconductor laser mode locking. While there have been several investigations of the ultrafast gain dynamics in vertical external cavity surface emitting lasers (VECSELs), little is known about the associated refractive index changes. Yet, such refractive index changes do not only have a profound impact on the pulse formation process leading to self phase modulation, which needs to be compensated by dispersion, but they are also of particular relevance for assessing the feasibility of Kerr lens mode locking of VECSELs. Here, we measure both refractive index as well as gain dynamics of a VECSEL chip using the ultrafast beam deflection method. We find that, in contrast to the gain dynamics, the refractive index dynamics is dominated by an instantaneous ( sim 100 fs) and a very slow component ( sim 100 ps). The time resolved measurement of nonlinear refraction allows us to predict a pulse length dependent, effective nonlinear refractive index n 2,eff , which is shown to be negative and in the order of 10 16 m 2 W for short pulse lengths ( sim 100 fs) . It becomes positive for large excitation fluences and large pulse lengths (few ps). These results agree with some previous reports of self mode locked VECSELs for which the cavity design and pulse properties determine sign and strength of the nonlinear refractive index when assuming Kerr lens mode locking.


Unsupervised Topic Discovery in User Comments. On social media platforms like Twitter, users regularly share their opinions and comments with software vendors and service providers. Popular software products might get thousands of user comments per day. Research has shown that such comments contain valuable information for stakeholders, such as feature ideas, problem reports, or support inquiries. However, it is hard to manually manage and grasp a large amount of user comments, which can be redundant and of a different quality. Consequently, researchers suggested automated approaches to extract valuable comments, e.g., through problem report classifiers. However, these approaches do not aggregate semantically similar comments into specific aspects to provide insights like how often users reported a certain problem. We introduce an approach for automatically discovering topics composed of semantically similar user comments based on deep bidirectional natural language processing algorithms. Stakeholders can use our approach without the need to configure critical parameters like the number of clusters. We present our approach and report on a rigorous multiple step empirical evaluation to assess how cohesive and meaningful the resulting clusters are. Each evaluation step was peer coded and resulted in inter coder agreements of up to 98 , giving us high confidence in the approach. We also report a thematic analysis on the topics discovered from tweets in the telecommunication domain.


Reliability Analysis of Slotted Aloha with Capture for an OWC based IoT system. In this article, we consider a random access scheme for an indoor Internet of Things (IoT) framework that uses optical wireless communication (OWC). We focus on a Slotted ALOHA (SA) based solution where a number of OWC IoT users contend to send data to a central OWC receiver. In any given slot, and for a randomly selected active user, we consider the reliability of decoding the user's data packet at the receiver. This is done by deriving the signal to noise and interference ratio (SINR) statistics from a randomly chosen user and evaluating the probability that the user's SINR is below a given threshold. By placing our analysis in the context of an indoor OWC IoT uplink setup, and employing the standard OWC channel model, we investigate the trade offs between the reliability and the OWC system parameters such as the cell area or the transmitter's semi angle. We obtain valuable insights into the design of an SA based random access solution for a typical indoor OWC cell.


On the Relationship Between the Developer's Perceptible Race and Ethnicity and the Evaluation of Contributions in OSS. Open Source Software (OSS) projects are typically the result of collective efforts performed by developers with different backgrounds. Although the quality of developers' contributions should be the only factor influencing the evaluation of the contributions to OSS projects, recent studies have shown that diversity issues are correlated with the acceptance or rejection of developers' contributions. This paper assists this emerging state of the art body on diversity research with the first empirical study that analyzes how developers' perceptible race and ethnicity relates to the evaluation of the contributions in OSS. We performed a large scale quantitative study of OSS projects in GitHub. We extracted the developers' perceptible race and ethnicity from their names in GitHub using the Name Prism tool and applied regression modeling of contributions (i.e, pull requests) data from GHTorrent and GitHub. We observed that among the developers whose perceptible race and ethnicity was captured by the tool, only 16.56 were perceptible as Non White developers contributions from perceptible White developers have about 6 10 higher odds of being accepted when compared to contributions from perceptible Non White developers and submitters with perceptible non white races and ethnicities are more likely to get their pull requests accepted when the integrator is estimated to be from their same race and ethnicity rather than when the integrator is estimated to be White. Our initial analysis shows a low number of Non White developers participating in OSS. Furthermore, the results from our regression analysis lead us to believe that there may exist differences between the evaluation of the contributions from different perceptible races and ethnicities. Thus, our findings reinforce the need for further studies on racial and ethnic diversity in software engineering to foster healthier OSS communities.


Variational Automatic Curriculum Learning for Sparse Reward Cooperative Multi Agent Problems. We introduce a curriculum learning algorithm, Variational Automatic Curriculum Learning (VACL), for solving challenging goal conditioned cooperative multi agent reinforcement learning problems. We motivate our paradigm through a variational perspective, where the learning objective can be decomposed into two terms task learning on the current task distribution, and curriculum update to a new task distribution. Local optimization over the second term suggests that the curriculum should gradually expand the training tasks from easy to hard. Our VACL algorithm implements this variational paradigm with two practical components, task expansion and entity progression, which produces training curricula over both the task configurations as well as the number of entities in the task. Experiment results show that VACL solves a collection of sparse reward problems with a large number of agents. Particularly, using a single desktop machine, VACL achieves 98 coverage rate with 100 agents in the simple spread benchmark and reproduces the ramp use behavior originally shown in OpenAI's hide and seek project. Our project website is at https sites.google.com view vacl neurips 2021.


The maximum number of stars in a graph without linear forest. For two graphs J and H , the generalized Tur ' a n number, denoted by ex(n,J,H) , is the maximum number of copies of J in an H free graph of order n . A linear forest F is the disjoint union of paths. In this paper, we determine the number ex(n,S r,F) when n is large enough and characterize the extremal graphs attaining ex(n,S r,F) , which generalizes the results on ex(n, S r, P k) , ex(n,K 2,(k 1) P 2) and ex(n,K 1,r ,(k 1) P 2) . Finally, we pose the problem whether the extremal graph for ex(n,J,F) is isomorphic to that for ex(n,S r,F) , where J is any graph such that the number of J 's in any graph G does not decrease by shifting operation on G .


The diagonal of cellular spaces and effective algebro homotopical constructions. In this survey article we discuss certain homotopy coherent enhancements of the coalgebra structure on cellular chains defined by an approximation to the diagonal. Over the rational numbers, C infty coalgebra structures control the mathbb Q complete homotopy theory of spaces, and over the integers, E infty coalgebras provide an appropriate setting to model the full homotopy category. Effective constructions of these structures, the focus of this work, carry geometric and combinatorial information which has found applications in various fields including deformation theory, higher category theory, and condensed matter physics.


Advanced Machine Learning Techniques for Fake News (Online Disinformation) Detection A Systematic Mapping Study. Fake news has now grown into a big problem for societies and also a major challenge for people fighting disinformation. This phenomenon plagues democratic elections, reputations of individual persons or organizations, and has negatively impacted citizens, (e.g., during the COVID 19 pandemic in the US or Brazil). Hence, developing effective tools to fight this phenomenon by employing advanced Machine Learning (ML) methods poses a significant challenge. The following paper displays the present body of knowledge on the application of such intelligent tools in the fight against disinformation. It starts by showing the historical perspective and the current role of fake news in the information war. Proposed solutions based solely on the work of experts are analysed and the most important directions of the application of intelligent systems in the detection of misinformation sources are pointed out. Additionally, the paper presents some useful resources (mainly datasets useful when assessing ML solutions for fake news detection) and provides a short overview of the most important R D projects related to this subject. The main purpose of this work is to analyse the current state of knowledge in detecting fake news on the one hand to show possible solutions, and on the other hand to identify the main challenges and methodological gaps to motivate future research.


Deep Dive into Semi Supervised ELBO for Improving Classification Performance. Decomposition of the evidence lower bound (ELBO) objective of VAE used for density estimation revealed the deficiency of VAE for representation learning and suggested ways to improve the model. In this paper, we investigate whether we can get similar insights by decomposing the ELBO for semi supervised classification using VAE model. Specifically, we show that mutual information between input and class labels decreases during maximization of ELBO objective. We propose a method to address this issue. We also enforce cluster assumption to aid in classification. Experiments on a diverse datasets verify that our method can be used to improve the classification performance of existing VAE based semi supervised models. Experiments also show that, this can be achieved without sacrificing the generative power of the model.


Functional equation of the p adic L function of Bianchi modular forms. Let K be an imaginary quadratic field with class number 1, in this paper we obtain the functional equation of the p adic L function of (1) a small slope p stabilisation of a Bianchi modular form, and (2) a critical slope p stabilisation of a Base change Bianchi modular form that is Sigma smooth. To treat case (2) we use p adic families of Bianchi modular forms.


A Caputo fractional derivative based algorithm for optimization. We propose a novel Caputo fractional derivative based optimization algorithm. Upon defining the Caputo fractional gradient with respect to the Cartesian coordinate, we present a generic Caputo fractional gradient descent (CFGD) method. We prove that the CFGD yields the steepest descent direction of a locally smoothed objective function. The generic CFGD requires three parameters to be specified, and a choice of the parameters yields a version of CFGD. We propose three versions non adaptive, adaptive terminal and adaptive order. By focusing on quadratic objective functions, we provide a convergence analysis. We prove that the non adaptive CFGD converges to a Tikhonov regularized solution. For the two adaptive versions, we derive error bounds, which show convergence to integer order stationary point under some conditions. We derive an explicit formula of CFGD for quadratic functions. We computationally found that the adaptive terminal (AT) CFGD mitigates the dependence on the condition number in the rate of convergence and results in significant acceleration over gradient descent (GD). For non quadratic functions, we develop an efficient implementation of CFGD using the Gauss Jacobi quadrature, whose computational cost is approximately proportional to the number of the quadrature points and the cost of GD. Our numerical examples show that AT CFGD results in acceleration over GD, even when a small number of the Gauss Jacobi quadrature points (including a single point) is used.


Crossing the Conversational Chasm A Primer on Natural Language Processing for Multilingual Task Oriented Dialogue Systems. In task oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research and development efforts, it is currently limited to a few narrow domains (e.g., food ordering, ticket booking) and a handful of languages (e.g., English, Chinese). This work provides an extensive overview of existing methods and resources in multilingual ToD as an entry point to this exciting and emerging field. We find that the most critical factor preventing the creation of truly multilingual ToD systems is the lack of datasets in most languages for both training and evaluation. In fact, acquiring annotations or human feedback for each component of modular systems or for data hungry end to end systems is expensive and tedious. Hence, state of the art approaches to multilingual ToD mostly rely on (zero or few shot) cross lingual transfer from resource rich languages (almost exclusively English), either by means of machine translation or multilingual representations. These approaches are currently viable only for typologically similar languages and languages with parallel monolingual corpora available. On the other hand, their effectiveness beyond these boundaries is doubtful or hard to assess due to the lack of linguistically diverse benchmarks (especially for natural language generation and end to end evaluation). To overcome this limitation, we draw parallels between components of the ToD pipeline and other NLP tasks, which can inspire solutions for learning in low resource scenarios. Finally, we list additional challenges that multilinguality poses for related areas (such as speech and human centred evaluation), and indicate future directions that hold promise to further expand language coverage and dialogue capabilities of current ToD systems.


Probabilistic Discriminative Models Address the Tactile Perceptual Aliasing Problem. In this paper, our aim is to highlight Tactile Perceptual Aliasing as a problem when using deep neural networks and other discriminative models. Perceptual aliasing will arise wherever a physical variable extracted from tactile data is subject to ambiguity between stimuli that are physically distinct. Here we address this problem using a probabilistic discriminative model implemented as a 5 component mixture density network comprised of a deep neural network that predicts the parameters of a Gaussian mixture model. We show that discriminative regression models such as deep neural networks and Gaussian process regression perform poorly on aliased data, only making accurate predictions when the sources of aliasing are removed. In contrast, the mixture density network identifies aliased data with improved prediction accuracy. The uncertain predictions of the model form patterns that are consistent with the various sources of perceptual ambiguity. In our view, perceptual aliasing will become an unavoidable issue for robot touch as the field progresses to training robots that act in uncertain and unstructured environments, such as with deep reinforcement learning.


Lipschitz Selectors may not Yield Competitive Algorithms for Convex Body Chasing. The current best algorithms for convex body chasing problem in online algorithms use the notion of the Steiner point of a convex set. In particular, the algorithm which always moves to the Steiner point of the request set is O(d) competitive for nested convex body chasing, and this is optimal among memoryless algorithms Bubeck et al. 2020 . A memoryless algorithm coincides with the notion of a selector in functional analysis. The Steiner point is noted for being Lipschitz with respect to the Hausdorff metric, and for achieving the minimal Lipschitz constant possible. It is natural to ask whether every selector with this Lipschitz property yields a competitive algorithm for nested convex body chasing. We answer this question in the negative by exhibiting a selector which yields a non competitive algorithm for nested convex body chasing but is Lipschitz with respect to Hausdorff distance. Furthermore, we show that being Lipschitz with respect to an L p type analog to the Hausdorff distance is sufficient to guarantee competitiveness if and only if p 1 .


Proposing an Interactive Audit Pipeline for Visual Privacy Research. In an ideal world, deployed machine learning models will enhance our society. We hope that those models will provide unbiased and ethical decisions that will benefit everyone. However, this is not always the case issues arise during the data preparation process throughout the steps leading to the models' deployment. The continued use of biased datasets and processes will adversely damage communities and increase the cost of fixing the problem later. In this work, we walk through the decision making process that a researcher should consider before, during, and after a system deployment to understand the broader impacts of their research in the community. Throughout this paper, we discuss fairness, privacy, and ownership issues in the machine learning pipeline we assert the need for a responsible human over the loop methodology to bring accountability into the machine learning pipeline, and finally, reflect on the need to explore research agendas that have harmful societal impacts. We examine visual privacy research and draw lessons that can apply broadly to artificial intelligence. Our goal is to systematically analyze the machine learning pipeline for visual privacy and bias issues. We hope to raise stakeholder (e.g., researchers, modelers, corporations) awareness as these issues propagate in this pipeline's various machine learning phases.


Linear and fully nonlinear elliptic equations with Morrey drift. We present some results concerning the solvability of linear elliptic equations in bounded domains with the main coefficients almost in VMO, the drift and the free terms in Morrey classes containing L d , and bounded zeroth order coefficient. We prove that the second order derivatives of solutions are in a local Morrey class containing W 2 p,loc . Actually, the exposition is given for fully nonlinear equations and encompasses the above mentioned results, which are new even if the main part of the equation is just the Laplacian.


Room Clearance with Feudal Hierarchical Reinforcement Learning. Reinforcement learning (RL) is a general framework that allows systems to learn autonomously through trial and error interaction with their environment. In recent years combining RL with expressive, high capacity neural network models has led to impressive performance in a diverse range of domains. However, dealing with the large state and action spaces often required for problems in the real world still remains a significant challenge. In this paper we introduce a new simulation environment, "Gambit", designed as a tool to build scenarios that can drive RL research in a direction useful for military analysis. Using this environment we focus on an abstracted and simplified room clearance scenario, where a team of blue agents have to make their way through a building and ensure that all rooms are cleared of (and remain clear) of enemy red agents. We implement a multi agent version of feudal hierarchical RL that introduces a command hierarchy where a commander at the higher level sends orders to multiple agents at the lower level who simply have to learn to follow these orders. We find that breaking the task down in this way allows us to solve a number of non trivial floorplans that require the coordination of multiple agents much more efficiently than the standard baseline RL algorithms we compare with. We then go on to explore how qualitatively different behaviour can emerge depending on what we prioritise in the agent's reward function (e.g. clearing the building quickly vs. prioritising rescuing civilians).


Pose Recognition in the Wild Animal pose estimation using Agglomerative Clustering and Contrastive Learning. Animal pose estimation has recently come into the limelight due to its application in biology, zoology, and aquaculture. Deep learning methods have effectively been applied to human pose estimation. However, the major bottleneck to the application of these methods to animal pose estimation is the unavailability of sufficient quantities of labeled data. Though there are ample quantities of unlabelled data publicly available, it is economically impractical to label large quantities of data for each animal. In addition, due to the wide variety of body shapes in the animal kingdom, the transfer of knowledge across domains is ineffective. Given the fact that the human brain is able to recognize animal pose without requiring large amounts of labeled data, it is only reasonable that we exploit unsupervised learning to tackle the problem of animal pose recognition from the available, unlabelled data. In this paper, we introduce a novel architecture that is able to recognize the pose of multiple animals fromunlabelled data. We do this by (1) removing background information from each image and employing an edge detection algorithm on the body of the animal, (2) Tracking motion of the edge pixels and performing agglomerative clustering to segment body parts, (3) employing contrastive learning to discourage grouping of distant body parts together. Hence we are able to distinguish between body parts of the animal, based on their visual behavior, instead of the underlying anatomy. Thus, we are able to achieve a more effective classification of the data than their human labeled counterparts. We test our model on the TigDog and WLD (WildLife Documentary) datasets, where we outperform state of the art approaches by a significant margin. We also study the performance of our model on other public data to demonstrate the generalization ability of our model.


Automatic Non Linear Video Editing Transfer. We propose an automatic approach that extracts editing styles in a source video and applies the edits to matched footage for video creation. Our Computer Vision based techniques considers framing, content type, playback speed, and lighting of each input video segment. By applying a combination of these features, we demonstrate an effective method that automatically transfers the visual and temporal styles from professionally edited videos to unseen raw footage. We evaluated our approach with real world videos that contained a total of 3872 video shots of a variety of editing styles, including different subjects, camera motions, and lighting. We reported feedback from survey participants who reviewed a set of our results.


The orbit spaces G n,2 T n and the Chow quotients G n,2 ! ! ( mathbb C ast ) n of the Grassmann manifolds G n,2 . The focus of our paper is on the complex Grassmann manifolds G n,2 which appear as one of the fundamental objects in developing the interaction between algebraic geometry and algebraic topology. In his well known paper Kapranov has proved that the Deligne Mumford compactification overline mathcal M (0,n) of n pointed curves of genus zero can be realized as the Chow quotient G n,2 ! ! ( mathbb C ast ) n . In our recent papers, the constructive description of the orbit space G n,2 T n has been obtained. In getting this result our notions of the CW complex of the admissible polytopes and the universal space of parameters mathcal F n for T n action on G n,2 were of essential use. Using technique of the wonderful compactification, in this paper it is given an explicit construction of the space mathcal F n . Together with Keel's description of overline mathcal M (0,n) , this construction enabled us to obtain an explicit diffeomorphism between mathcal F n and overline mathcal M (0,n) . Thus, we showed that the space G n,2 ! ! ( mathbb C ast ) n can be realized as our universal space of parameters mathcal F n . In this way, we give description of the structure in G n,2 ! ! ( mathbb C ast ) n , that is overline mathcal M (0,n) in terms of the CW complex of the admissible polytopes for G n,2 and their spaces of parameters.


10 GHz Generation with Ultra Low Phase Noise via the Transfer Oscillator Technique. Coherent frequency division of high stability optical sources permits the extraction of microwave signals with ultra low phase noise, enabling their application to systems with stringent timing precision. To date, the highest performance systems have required tight phase stabilization of laboratory grade optical frequency combs to Fabry Perot optical reference cavities for faithful optical to microwave frequency division. This requirement limits the technology to highly controlled laboratory environments. Here, we employ a transfer oscillator technique, which employs digital and RF analog electronics to coherently suppress additive optical frequency comb noise. This relaxes the stabilization requirements and allows for the extraction of multiple independent microwave outputs from a single comb, while at the same time, permitting low noise microwave generation from combs with higher noise profiles. Using this method we transferred the phase stability of two high Finesse optical sources at 1157 nm and 1070 nm to two independent 10 GHz signals using a single frequency comb. We demonstrated absolute phase noise below 106 dBc Hz at 1 Hz from carrier with corresponding 1 second fractional frequency instability below 2 times10 15 . Finally, the latter phase noise levels were attainable for comb linewidths broadened up to 2 MHz, demonstrating the potential for out of lab use with low SWaP lasers.


math.NA cs.NA physics.ao-ph physics.flu-dyn

A one step blended soundproof compressible model with balanced data assimilation theory and idealised tests. A challenge arising from the local Bayesian assimilation of data in an atmospheric flow simulation is the imbalances it may introduce. Acoustic fast mode imbalances of the order of the slower dynamics can be negated by employing a blended numerical model with seamless access to the compressible and the soundproof pseudo incompressible dynamics. Here, the blended modelling strategy by Benacchio et al., MWR, vol. 142 (2014) is upgraded in an advanced numerical framework and extended with a Bayesian local ensemble data assimilation method. Upon assimilation of data, the model configuration is switched to the pseudo incompressible regime for one time step. After that, the model configuration is switched back to the compressible model for the duration of the assimilation window. The switching between model regimes is repeated for each subsequent assimilation window. An improved blending strategy for the numerical model ensures that a single time step in the pseudo incompressible regime is sufficient to suppress imbalances coming from the initialisation and data assimilation. This improvement is based on three innovations (i) the association of pressure fields computed at different stages of the numerical integration with actual time levels (ii) a conversion of pressure related variables between the model regimes derived from low Mach number asymptotics and (iii) a judicious selection of the pressure variables used in converting numerical model states when a switch of models occurs. Idealised two dimensional travelling vortex and buoyancy driven bubble convection experiments show that acoustic imbalances arising from data assimilation can be eliminated by using this blended model, thereby achieving balanced analysis fields.


Efficient approximation of high dimensional exponentials by tensornetworks. In this work a general approach to compute a compressed representation of the exponential exp(h) of a high dimensional function h is presented. Such exponential functions play an important role in several problems in Uncertainty Quantification, e.g. the approximation of log normal random fields or the evaluation of Bayesian posterior measures. Usually, these high dimensional objects are intractable numerically and can only be accessed pointwise in sampling methods. In contrast, the proposed method constructs a functional representation of the exponential by exploiting its nature as a solution of an ordinary differential equation. The application of a Petrov Galerkin scheme to this equation provides a tensor train representation of the solution for which we derive an efficient and reliable a posteriori error estimator. Numerical experiments with a log normal random field and a Bayesian likelihood illustrate the performance of the approach in comparison to other recent low rank representations for the respective applications. Although the present work considers only a specific differential equation, the presented method can be applied in a more general setting. We show that the composition of a generic holonomic function and a high dimensional function corresponds to a differential equation that can be used in our method. Moreover, the differential equation can be modified to adapt the norm in the a posteriori error estimates to the problem at hand.


Cross Modal Discrete Representation Learning. Recent advances in representation learning have demonstrated an ability to represent information from different modalities such as video, text, and audio in a single high level embedding vector. In this work we present a self supervised learning framework that is able to learn a representation that captures finer levels of granularity across different modalities such as concepts or events represented by visual objects or spoken words. Our framework relies on a discretized embedding space created via vector quantization that is shared across different modalities. Beyond the shared embedding space, we propose a Cross Modal Code Matching objective that forces the representations from different views (modalities) to have a similar distribution over the discrete embedding space such that cross modal objects actions localization can be performed without direct supervision. In our experiments we show that the proposed discretized multi modal fine grained representation (e.g., pixel word frame) can complement high level summary representations (e.g., video sentence waveform) for improved performance on cross modal retrieval tasks. We also observe that the discretized representation uses individual clusters to represent the same semantic concept across modalities.


AutoFlow Learning a Better Training Set for Optical Flow. Synthetic datasets play a critical role in pre training CNN models for optical flow, but they are painstaking to generate and hard to adapt to new applications. To automate the process, we present AutoFlow, a simple and effective method to render training data for optical flow that optimizes the performance of a model on a target dataset. AutoFlow takes a layered approach to render synthetic data, where the motion, shape, and appearance of each layer are controlled by learnable hyperparameters. Experimental results show that AutoFlow achieves state of the art accuracy in pre training both PWC Net and RAFT. Our code and data are available at https autoflow google.github.io .


Continual Learning of a Mixed Sequence of Similar and Dissimilar Tasks. Existing research on continual learning of a sequence of tasks focused on dealing with catastrophic forgetting, where the tasks are assumed to be dissimilar and have little shared knowledge. Some work has also been done to transfer previously learned knowledge to the new task when the tasks are similar and have shared knowledge. To the best of our knowledge, no technique has been proposed to learn a sequence of mixed similar and dissimilar tasks that can deal with forgetting and also transfer knowledge forward and backward. This paper proposes such a technique to learn both types of tasks in the same network. For dissimilar tasks, the algorithm focuses on dealing with forgetting, and for similar tasks, the algorithm focuses on selectively transferring the knowledge learned from some similar previous tasks to improve the new task learning. Additionally, the algorithm automatically detects whether a new task is similar to any previous tasks. Empirical evaluation using sequences of mixed tasks demonstrates the effectiveness of the proposed model.


BOPI A Programming Interface For Reuse Of Research Data Available On DSpace Repositories. A recent study showed that more than 70 of researchers fail to reproduce their peers's experiments and more than half fail to reproduce their own experiments. Obviously, from a perspective of scientific quality this is a more than unsatisfying numbers. One approach to mitigate this flaw lies in the transparent provision of relevant research data to increase the base of available material to evaluate and possibly reconduct experiments. However, such data needs to be presented and accessed in a findable and purposefully usable way. In this work, we report the development of a programming interface to enhance findability and accessibility of research data (available in DSpace systems) and hence reproducibility of scientific experiments with data. This interface allows researchers to (i) find research data in multiples languages trough automatic translation of metadata (ii) display a preview of data without download it beforehand (iii) provide a detailed statistics of the data with interactive graphs for quality assessment (iv) automatic download of data directly from Python based experiments. Usability tests revealed that this interface improves the effectiveness, efficiency and satisfaction during the reuse of research data.


Spectral networks and stability conditions for Fukaya categories with coefficients. Given a holomorphic family of Bridgeland stability conditions over a surface, we define a notion of spectral network which is an object in a Fukaya category of the surface with coefficients in a triangulated DG category. These spectral networks are analogs of special Lagrangian submanifolds, combining a graph with additional algebraic data, and conjecturally correspond to semistable objects of a suitable stability condition on the Fukaya category with coefficients. They are closely related to the spectral networks of Gaiotto Moore Neitzke. One novelty of our approach is that we establish a general uniqueness results for spectral network representatives. We also verify the conjecture in the case when the surface is disk with six marked points on the boundary and the coefficients category is the derived category of representations of an A 2 quiver. This example is related, via homological mirror symmetry, to the stacky quotient of an elliptic curve by the cyclic group of order six.


Upper Bounds for Positive Semidefinite Propagation Time. The tight upper bound operatorname pt (G) leq left lceil frac left vert operatorname V (G) right vert operatorname Z (G) 2 right rceil is established for the positive semidefinite propagation time of a graph in terms of its positive semidefinite zero forcing number. To prove this bound, two methods of transforming one positive semidefinite zero forcing set into another and algorithms implementing these methods are presented. Consequences of the bound, including a tight Nordhaus Gaddum sum upper bound on positive semidefinite propagation time, are established.


Verification of a Merkle Patricia Tree Library Using F . A Merkle tree is a data structure for representing a key value store as a tree. Each node of a Merkle tree is equipped with a hash value computed from those of their descendants. A Merkle tree is often used for representing a state of a blockchain system since it can be used for efficiently auditing the state in a trustless manner. Due to the safety critical nature of blockchains, ensuring the correctness of their implementation is paramount. We show our formally verified implementation of the core part of Plebeia using F . Plebeia is a library to manipulate an extension of Merkle trees (called Plebeia trees). It is being implemented as a part of the storage system of the Tezos blockchain system. To this end, we gradually ported Plebeia to F the OCaml code extracted from the modules ported to F is linked with the unverified part of Plebeia. By this gradual porting process, we can obtain a working code from our partially verified implementation of Plebeia we confirmed that the binary passes all the unit tests of Plebeia. More specifically, we verified the following properties on the implementation of Plebeia (1) Each tree manipulating function preserves the invariants on the data structure of a Plebeia tree and satisfies the functional requirements as a nested key value store (2) Each function for serializing deserializing a Plebeia tree to from the low level storage is implemented correctly and (3) The hash function for a Plebeia tree is relatively collision resistant with respect to the cryptographic safety of the blake2b hash function. During porting Plebeia to F , we found a bug in an old version of Plebeia, which was overlooked by the tests bundled with the original implementation. To the best of our knowledge, this is the first work that verifies a production level implementation of a Merkle tree library by F .


A proxemics game between festival visitors and an industrial robot. With increased applications of collaborative robots (cobots) in industrial workplaces, behavioural effects of human cobot interactions need to be further investigated. This is of particular importance as nonverbal behaviours of collaboration partners in human robot teams significantly influence the experience of the human interaction partners and the success of the collaborative task. During the Ars Electronica 2020 Festival for Art, Technology and Society (Linz, Austria), we invited visitors to exploratively interact with an industrial robot, exhibiting restricted interaction capabilities extending and retracting its arm, depending on the movements of the volunteer. The movements of the arm were pre programmed and telecontrolled for safety reasons (which was not obvious to the participants). We recorded video data of these interactions and investigated general nonverbal behaviours of the humans interacting with the robot, as well as nonverbal behaviours of people in the audience. Our results showed that people were more interested in exploring the robot's action and perception capabilities than just reproducing the interaction game as introduced by the instructors. We also found that the majority of participants interacting with the robot approached it up to a distance which would be perceived as threatening or intimidating, if it were a human interaction partner. Regarding bystanders, we found examples where people made movements as if trying out variants of the current participant's behaviour.


Reviving Iterative Training with Mask Guidance for Interactive Segmentation. Recent works on click based interactive segmentation have demonstrated state of the art results by using various inference time optimization schemes. These methods are considerably more computationally expensive compared to feedforward approaches, as they require performing backward passes through a network during inference and are hard to deploy on mobile frameworks that usually support only forward passes. In this paper, we extensively evaluate various design choices for interactive segmentation and discover that new state of the art results can be obtained without any additional optimization schemes. Thus, we propose a simple feedforward model for click based interactive segmentation that employs the segmentation masks from previous steps. It allows not only to segment an entirely new object, but also to start with an external mask and correct it. When analyzing the performance of models trained on different datasets, we observe that the choice of a training dataset greatly impacts the quality of interactive segmentation. We find that the models trained on a combination of COCO and LVIS with diverse and high quality annotations show performance superior to all existing models. The code and trained models are available at https github.com saic vul ritm interactive segmentation.


Information Cocoons in Online Navigation. Social media and online navigation bring us enjoyable experience in accessing information, and simultaneously create information cocoons (ICs) in which we are unconsciously trapped with limited and biased information. We provide a formal definition of IC in the scenario of online navigation. Subsequently, by analyzing real recommendation networks extracted from Science, PNAS and Amazon websites, and testing mainstream algorithms in disparate recommender systems, we demonstrate that similarity based recommendation techniques result in ICs, which suppress the system navigability by hundreds of times. We further propose a flexible recommendation strategy that solves the IC induced problem and improves retrieval accuracy in navigation, demonstrated by simulations on real data and online experiments on the largest video website in China.


Ultra high bandwidth fiber optic data transmission with a single chip source. We report world record high data transmission over standard optical fiber from a single optical source. We achieve a line rate of 44.2 Terabits per second (Tb s) employing only the C band at 1550nm, resulting in a spectral efficiency of 10.4 bits s Hz. We use a new and powerful class of micro comb called soliton crystals that exhibit robust operation and stable generation as well as a high intrinsic efficiency that, together with an extremely low spacing of 48.9 GHz enables a very high coherent data modulation format of 64 QAM. We achieve error free transmission across 75 km of standard optical fiber in the lab and over a field trial with a metropolitan optical fiber network. This work demonstrates the ability of optical micro combs to exceed other approaches in performance for the most demanding practical optical communications applications.


A unified differential equation solver approach for separable convex optimization splitting, acceleration and nonergodic rate. This paper provides a self contained ordinary differential equation solver approach for linearly constrained separable convex optimization problems and presents several classes of new accelerated primal dual splitting methods. A novel dynamical system with built in time rescaling factors is first introduced and the exponential decay of a tailored Lyapunov function is established. Numerical discretizations of the continuous time model are considered to construct new algorithms for the original optimization problem and also analyzed via a unified discrete Lyapunov function. Specifically, those schemes lead to new proximal alternating direction methods of multipliers with linearizations and extrapolations, and accelerated nonergodic rates are proved respectively for convex and partially strong convex objectives.


Fair Representation Learning using Interpolation Enabled Disentanglement. With the growing interest in the machine learning community to solve real world problems, it has become crucial to uncover the hidden reasoning behind their decisions by focusing on the fairness and auditing the predictions made by these black box models. In this paper, we propose a novel method to address two key issues (a) Can we simultaneously learn fair disentangled representations while ensuring the utility of the learned representation for downstream tasks, and (b)Can we provide theoretical insights into when the proposed approach will be both fair and accurate. To address the former, we propose the method FRIED, Fair Representation learning using Interpolation Enabled Disentanglement. In our architecture, by imposing a critic based adversarial framework, we enforce the interpolated points in the latent space to be more realistic. This helps in capturing the data manifold effectively and enhances the utility of the learned representation for downstream prediction tasks. We address the latter question by developing a theory on fairness accuracy trade offs using classifier based conditional mutual information estimation. We demonstrate the effectiveness of FRIED on datasets of different modalities tabular, text, and image datasets. We observe that the representations learned by FRIED are overall fairer in comparison to existing baselines and also accurate for downstream prediction tasks. Additionally, we evaluate FRIED on a real world healthcare claims dataset where we conduct an expert aided model auditing study providing useful insights into opioid ad diction patterns.


Compact moduli of K3 surfaces with a nonsymplectic automorphism. We construct a modular compactification via stable slc pairs for the moduli spaces of K3 surfaces with a nonsymplectic group of automorphisms under the assumption that some combination of the fixed loci of automorphisms defines an effective big divisor, and prove that it is semitoroidal.


Identifying Physical Law of Hamiltonian Systems via Meta Learning. Hamiltonian mechanics is an effective tool to represent many physical processes with concise yet well generalized mathematical expressions. A well modeled Hamiltonian makes it easy for researchers to analyze and forecast many related phenomena that are governed by the same physical law. However, in general, identifying a functional or shared expression of the Hamiltonian is very difficult. It requires carefully designed experiments and the researcher's insight that comes from years of experience. We propose that meta learning algorithms can be potentially powerful data driven tools for identifying the physical law governing Hamiltonian systems without any mathematical assumptions on the representation, but with observations from a set of systems governed by the same physical law. We show that a well meta trained learner can identify the shared representation of the Hamiltonian by evaluating our method on several types of physical systems with various experimental settings.


Radiative and photon exchange corrections to New Physics contributions to energy levels in few electron ions. The influence of hypothetical new interactions beyond the Standard Model on atomic spectra has attracted recent interest. In the present work, interelectronic photon exchange corrections and radiative quantum electrodynamic corrections to the hypothetical contribution to the energy levels of few electron ions from a new interaction are calculated. The 1s , 2s and 2p 1 2 ground states of H like, Li like and B like ions are considered, as motivated by proposals to use isotope shift spectroscopy of few electron ions in order to set stringent constraints on hypothetical new interactions. It is shown that, for light Li like and B like ions, photon exchange corrections are comparable to or even larger, by up to several orders of magnitude, than the leading one electron contribution from the new interaction, when the latter is mediated by heavy bosons.


Uniqueness of compact ancient solutions to the higher dimensional Ricci flow. In this paper, we study the classification of kappa noncollapsed ancient solutions to n dimensional Ricci flow on S n , extending the result in 13 to higher dimensions. We prove that such a solution is either isometric to a family of shrinking round spheres, or the Type II ancient solution constructed by Perelman.


On Ramanujan type Congruences for Multiplicative Functions. The study of Ramanujan type congruences for functions specific to additive number theory has a long and rich history. Motivated by recent connections between divisor sums and overpartitions via congruences in arithmetic progressions, we investigate the existence and classification of Ramanujan type congruences for functions in multiplicative number theory.


On the Evolution of the MCTS Upper Confidence Bounds for Trees by Means of Evolutionary Algorithms in the Game of Carcassonne. Monte Carlo Tree Search (MCTS) is a sampling best first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two player based game Go, a game considered much harder than Chess and that until very recently was considered infeasible for Artificial Intelligence methods. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular selection mechanism that has proved to be reliable is based on the Upper Confidence Bounds for Trees, commonly referred as UCT. The UCT attempts to nicely balance exploration and exploitation by considering the values stored in the statistical tree of the MCTS. However, some tuning of the MCTS UCT is necessary for this to work well. In this work, we use Evolutionary Algorithms (EAs) to evolve mathematical expressions with the goal to substitute the UCT mathematical expression. We compare our proposed approach, called Evolution Strategy in MCTS (ES MCTS) against five variants of the MCTS UCT, three variants of the star minimax family of algorithms as well as a random controller in the Game of Carcassonne. We also use a variant of our proposed EA based controller, dubbed ES partially integrated in MCTS. We show how the ES MCTS controller, is able to outperform all these 10 intelligent controllers, including robust MCTS UCT controllers.


On a borderline between the NP hard and polynomial time solvable cases of the flow shop with job dependent storage requirements. The paper is concerned with the two machine flow shop, where each job requires an additional resource (referred to as storage space) from the start of its first operation till the end of its second operation. The storage requirement of a job is determined by the processing time of its first operation. At any point in time, the total consumption of this additional resource cannot exceed a given limit (referred to as the storage capacity). The goal is to minimise the makespan, i.e. to minimise the time needed for the completion of all jobs. This problem is NP hard in the strong sense. The paper analyses how the parameter a lower bound on the storage capacity specified in terms of the processing times, affects the computational complexity.


Self Driving Cars and Driver Alertness. Recent years have seen growing interest in the development of self driving vehicles that promise (or threaten) to replace human drivers with intelligent software. However, current self driving cars still require human supervision and prompt takeover of control when necessary. Poor alertness while controlling self driving cars could hinder the drivers' ability to intervene during unpredictable situations, thus increasing the risk of avoidable accidents. In this paper we examine the key factors that contribute to drivers' poor alertness, and the potential solutions that have been proposed to address them. Based on this examination we make some recommendations for various stakeholders, such as researchers, drivers, industry and policy makers.


On list chromatic numbers of 2 colorable hypergraphs. We give an upper bound on the list chromatic number of a 2 colorable hypergraph which generalizes the bound of Schauz on k partite k uniform hypergraphs. It makes sense for sparse hypergraphs in particular we show that a k uniform k regular hypergraph has the list chromatic number 2 for k geq 4 . Also we obtain both lower and upper bound on the list chromatic number of a complete s uniform 2 colorable hypergraph in the vein of Erd H o s Rubin Taylor theorem.


Towers of Looijenga pairs and asymptotics of ECH capacities. ECH capacities are rich obstructions to symplectic embeddings in 4 dimensions that have also been seen to arise in the context of algebraic positivity for (possibly singular) projective surfaces. We extend this connection to relate general convex toric domains on the symplectic side with towers of polarised toric surfaces on the algebraic side, and then use this perspective to show that the sub leading asymptotics of ECH capacities for all convex and concave toric domains are O(1) . We obtain sufficient criteria for when the sub leading asymptotics converge in this context, generalising results of Hutchings and of the author, and derive new obstructions to embeddings between toric domains of the same volume. We also propose two invariants to more precisely describe when convergence occurs in the toric case. Our methods are largely non toric in nature, and apply more widely to towers of polarised Looijenga pairs.


International Migration in Academia and Citation Performance An Analysis of German Affiliated Researchers by Gender and Discipline Using Scopus Publications 1996 2020. Germany has become a major country of immigration, as well as a research powerhouse in Europe. As Germany spends a higher fraction of its GDP on research and development than most countries with advanced economies, there is an expectation that Germany should be able to attract and retain international scholars who have high citation performance. Using an exhaustive set of over eight million Scopus publications, we analyze the trends in international migration to and from Germany among published researchers over the past 24 years. We assess changes in institutional affiliations for over one million researchers who have published with a German affiliation address at some point during the 1996 2020 period. We show that while Germany has been highly integrated into the global movement of researchers, with particularly strong ties to the US, the UK, and Switzerland, the country has been sending more published researchers abroad than it has attracted. While the balance has been largely negative over time, analyses disaggregated by gender, citation performance, and field of research show that compositional differences in migrant flows may help to alleviate persistent gender inequalities in selected fields.


Scale aware Automatic Augmentation for Object Detection. We propose Scale aware AutoAug to learn data augmentation policies for object detection. We define a new scale aware search space, where both image and box level augmentations are designed for maintaining scale invariance. Upon this search space, we propose a new search metric, termed Pareto Scale Balance, to facilitate search with high efficiency. In experiments, Scale aware AutoAug yields significant and consistent improvement on various object detectors (e.g., RetinaNet, Faster R CNN, Mask R CNN, and FCOS), even compared with strong multi scale training baselines. Our searched augmentation policies are transferable to other datasets and box level tasks beyond object detection (e.g., instance segmentation and keypoint estimation) to improve performance. The search cost is much less than previous automated augmentation approaches for object detection. It is notable that our searched policies have meaningful patterns, which intuitively provide valuable insight for human data augmentation design. Code and models will be available at https github.com Jia Research Lab SA AutoAug.


Network wide Multi step Traffic Volume Prediction using Graph Convolutional Gated Recurrent Neural Network. Accurate prediction of network wide traffic conditions is essential for intelligent transportation systems. In the last decade, machine learning techniques have been widely used for this task, resulting in state of the art performance. We propose a novel deep learning model, Graph Convolutional Gated Recurrent Neural Network (GCGRNN), to predict network wide, multi step traffic volume. GCGRNN can automatically capture spatial correlations between traffic sensors and temporal dependencies in historical traffic data. We have evaluated our model using two traffic datasets extracted from 150 sensors in Los Angeles, California, at the time resolutions one hour and 15 minutes, respectively. The results show that our model outperforms the other five benchmark models in terms of prediction accuracy. For instance, our model reduces MAE by 25.3 , RMSE by 29.2 , and MAPE by 20.2 , compared to the state of the art Diffusion Convolutional Recurrent Neural Network (DCRNN) model using the hourly dataset. Our model also achieves faster training than DCRNN by up to 52 . The data and implementation of GCGRNN can be found at https github.com leilin research GCGRNN.


GelTip Tactile Sensor for Dexterous Manipulation in Clutter. Tactile sensing is an essential capability for robots that carry out dexterous manipulation tasks. While cameras, Lidars and other remote sensors can assess a scene globally and instantly, tactile sensors can reduce their measurement uncertainties and gain information about the local physical interactions between the in contact objects and the robot, that are often not accessible via remote sensing. Tactile sensors can be grouped into two main categories electronic tactile skins and camera based optical tactile sensors. The former are slim and can be fitted to different body parts, whereas the latter assume a more prismatic shape and have much higher sensing resolutions, offering a good advantage for being used as robotic fingers or fingertips. One of such optical tactile sensors is our GelTip sensor that is shaped as a finger and can sense contacts on any location of its surface. As such, the GelTip sensor is able to detect contacts from all the directions, like a human finger. To capture these contacts, it uses a camera installed at its base to track the deformations of the opaque elastomer that covers its hollow, rigid and transparent body. Thanks to this design, a gripper equipped with GelTip sensors is capable of simultaneously monitoring contacts happening inside and outside its grasp closure. Experiments carried out using this sensor demonstrate how contacts can be localised, and more importantly, the advantages, and even possibly a necessity, of leveraging all around touch sensing in dexterous manipulation tasks in clutter where contacts may happen at any location of the finger. All the materials for the fabrication of the GelTip sensor can be found at https danfergo.github.io geltip


Probing the pH microenvironment of mesenchymal stromal cell cultures on additive manufactured scaffolds. Despite numerous advances in the field of tissue engineering and regenerative medicine, monitoring the formation of tissue regeneration and its metabolic variations during culture is still a challenge and mostly limited to bulk volumetric assays. Here, a simple method of adding capsules based optical sensors in cell seeded 3D scaffolds is presented and the potential of these sensors to monitor the pH changes in space and time during cell growth is demonstrated. It is shown that the pH decreased over time in the 3D scaffolds, with a more prominent decrease at the edges of the scaffolds. Moreover, the pH change is higher in 3D scaffolds compared to monolayered 2D cell cultures. The results suggest that this system, composed by capsules based optical sensors and 3D scaffolds with predefined geometry and pore architecture network, can be a suitable platform for monitoring pH variations during 3D cell growth and tissue formation. This is particularly relevant for the investigation of 3D cellular microenvironment alterations occurring both during physiological processes, such as tissue regeneration, and pathological processes, such as cancer evolution.


Phonology Recognition in American Sign Language. Inspired by recent developments in natural language processing, we propose a novel approach to sign language processing based on phonological properties validated by American Sign Language users. By taking advantage of datasets composed of phonological data and people speaking sign language, we use a pretrained deep model based on mesh reconstruction to extract the 3D coordinates of the signers keypoints. Then, we train standard statistical and deep machine learning models in order to assign phonological classes to each temporal sequence of coordinates. Our paper introduces the idea of exploiting the phonological properties manually assigned by sign language users to classify videos of people performing signs by regressing a 3D mesh. We establish a new baseline for this problem based on the statistical distribution of 725 different signs. Our best performing models achieve a micro averaged F1 score of 58 for the major location class and 70 for the sign type using statistical and deep learning algorithms, compared to their corresponding baselines of 35 and 39 .


MUSE Multi Scale Temporal Features Evolution for Knowledge Tracing. Transformer based knowledge tracing model is an extensively studied problem in the field of computer aided education. By integrating temporal features into the encoder decoder structure, transformers can processes the exercise information and student response information in a natural way. However, current state of the art transformer based variants still share two limitations. First, extremely long temporal features cannot well handled as the complexity of self attention mechanism is O(n2). Second, existing approaches track the knowledge drifts under fixed a window size, without considering different temporal ranges. To conquer these problems, we propose MUSE, which is equipped with multi scale temporal sensor unit, that takes either local or global temporal features into consideration. The proposed model is capable to capture the dynamic changes in users knowledge states at different temporal ranges, and provides an efficient and powerful way to combine local and global features to make predictions. Our method won the 5 th place over 3,395 teams in the Riiid AIEd Challenge 2020.


Motion of a rigid body in a compressible Fluid with Navier slip boundary condition. In this work, we study the motion of a rigid body in a bounded domain which is filled with a compressible isentropic fluid. We consider the Navier slip boundary condition at the interface as well as at the boundary of the domain. This is the first mathematical analysis of a compressible fluid rigid body system where Navier slip boundary conditions are considered. We prove existence of a weak solution of the fluid structure system up to collision.


Combining Pre trained Word Embeddings and Linguistic Features for Sequential Metaphor Identification. We tackle the problem of identifying metaphors in text, treated as a sequence tagging task. The pre trained word embeddings GloVe, ELMo and BERT have individually shown good performance on sequential metaphor identification. These embeddings are generated by different models, training targets and corpora, thus encoding different semantic and syntactic information. We show that leveraging GloVe, ELMo and feature based BERT based on a multi channel CNN and a Bidirectional LSTM model can significantly outperform any single word embedding method and the combination of the two embeddings. Incorporating linguistic features into our model can further improve model performance, yielding state of the art performance on three public metaphor datasets. We also provide in depth analysis on the effectiveness of leveraging multiple word embeddings, including analysing the spatial distribution of different embedding methods for metaphors and literals, and showing how well the embeddings complement each other in different genres and parts of speech.


First measurements of remoTES cryogenic calorimeters easy to fabricate particle detectors for a wide choice of target materials. Low temperature calorimeters based on a readout via transition edge sensors (TESs) and operated below 100 mK are well suited for rare event searches. We present first experimental results from two detector prototypes using a novel thermometer design denoted remoTES. This design facilitates the use of TESs in combination with absorber materials which, due to their physical and chemical properties, as e.g. hygroscopicity, low hardness and low melting point, prevent the direct deposition of the TES onto their surface. In a remoTES detector, the TES is fabricated onto a separate wafer. The absorber crystal is then equipped with a gold pad that transmits the phonon signal created from an interaction in the absorber to the thermometer via a gold bonding wire. With recent prototype detectors operated in an above ground R D facility, we achieve energy resolutions of sigma 87.8 eV for a silicon absorber and sigma 193.5 eV for an alpha TeO 2 absorber, respectively. RemoTES calorimeters offer besides the wider choice of absorber materials a simpler production process combined with a higher reproducibility for large detector arrays and an enhanced radiopurity standard, which is of particular interest for rare event searches.


Incremental Beam Manipulation for Natural Language Generation. The performance of natural language generation systems has improved substantially with modern neural networks. At test time they typically employ beam search to avoid locally optimal but globally suboptimal predictions. However, due to model errors, a larger beam size can lead to deteriorating performance according to the evaluation metric. For this reason, it is common to rerank the output of beam search, but this relies on beam search to produce a good set of hypotheses, which limits the potential gains. Other alternatives to beam search require changes to the training of the model, which restricts their applicability compared to beam search. This paper proposes incremental beam manipulation, i.e. reranking the hypotheses in the beam during decoding instead of only at the end. This way, hypotheses that are unlikely to lead to a good final output are discarded, and in their place hypotheses that would have been ignored will be considered instead. Applying incremental beam manipulation leads to an improvement of 1.93 and 5.82 BLEU points over vanilla beam search for the test sets of the E2E and WebNLG challenges respectively. The proposed method also outperformed a strong reranker by 1.04 BLEU points on the E2E challenge, while being on par with it on the WebNLG dataset.


Masking Host Identity on Internet Encrypted TLS SSL Handshake. Network middle boxes often classify the traffic flows on the Internet to perform traffic management or discriminate one traffic against the other. As the widespread adoption of HTTPS protocol has made it difficult to classify the traffic looking into the content field, one of the fields the middle boxes look for is Server Name Indicator (SNI), which goes in plain text. SNI field contains information about the host and can, in turn, reveal the type of traffic. This paper presents a method to mask the server host identity by encrypting the SNI. We develop a simple method that completes the SSL TLS connection establishment over two handshakes the first handshake establishes a secure channel without sharing SNI information, and the second handshake shares the encrypted SNI. Our method makes it mandatory for fronting servers to always accept the handshake request without the SNI and respond with a valid SSL certificate. As there is no modification in already proven SSL TLS encryption mechanism and processing of handshake messages, the new method enjoys all security benefits of existing secure channel establishment and needs no modification in existing routers middle boxes. Using customized client server over the live Internet, we demonstrate the feasibility of our method. Moreover, the impact analysis shows that the method adheres to almost all SSL TLS related Internet standards requirements.


On the robustness of certain norms. We study a family of norms defined for functions on an interval. These norms are obtained by taking the p norm of the Volterra operator applied to the function. The corresponding distances have been previously studied in the context of comparing probability measures, and special cases include the Earth Mover's Distance and Kolmogorov Metric. We study their properties for general signals, and show that they are robust to additive noise. We also show that the norm induced distance between a function and its perturbation is bounded by the size of the perturbation, and that the distance between one dimensional projections of a two dimensional function is bounded by the size of the difference in projection directions. The results are illustrated in numerical experiments.


What happens in Face during a facial expression? Using data mining techniques to analyze facial expression motion vectors. One of the most common problems encountered in human computer interaction is automatic facial expression recognition. Although it is easy for human observer to recognize facial expressions, automatic recognition remains difficult for machines. One of the methods that machines can recognize facial expression is analyzing the changes in face during facial expression presentation. In this paper, optical flow algorithm was used to extract deformation or motion vectors created in the face because of facial expressions. Then, these extracted motion vectors are used to be analyzed. Their positions and directions were exploited for automatic facial expression recognition using different data mining techniques. It means that by employing motion vector features used as our data, facial expressions were recognized. Some of the most state of the art classification algorithms such as C5.0, CRT, QUEST, CHAID, Deep Learning (DL), SVM and Discriminant algorithms were used to classify the extracted motion vectors. Using 10 fold cross validation, their performances were calculated. To compare their performance more precisely, the test was repeated 50 times. Meanwhile, the deformation of face was also analyzed in this research. For example, what exactly happened in each part of face when a person showed fear? Experimental results on Extended Cohen Kanade (CK ) facial expression dataset demonstrated that the best methods were DL, SVM and C5.0, with the accuracy of 95.3 , 92.8 and 90.2 respectively.


FC based shock dynamics solver with neural network localized artificial viscosity assignment. This paper presents a spectral scheme for the numerical solution of nonlinear conservation laws in non periodic domains under arbitrary boundary conditions. The approach relies on the use of the Fourier Continuation (FC) method for spectral representation of non periodic functions in conjunction with smooth localized artificial viscosity assignments produced by means of a Shock Detecting Neural Network (SDNN). Like previous shock capturing schemes and artificial viscosity techniques, the combined FC SDNN strategy effectively controls spurious oscillations in the proximity of discontinuities. Thanks to its use of a localized but smooth artificial viscosity term, whose support is restricted to a vicinity of flow discontinuity points, the algorithm enjoys spectral accuracy and low dissipation away from flow discontinuities, and, in such regions, it produces smooth numerical solutions as evidenced by an essential absence of spurious oscillations in level set lines. The FC SDNN viscosity assignment, which does not require use of problem dependent algorithmic parameters, induces a significantly lower overall dissipation than other methods, including the Fourier spectral versions of the previous entropy viscosity method. The character of the proposed algorithm is illustrated with a variety of numerical results for the linear advection, Burgers and Euler equations in one and two dimensional non periodic spatial domains.


User Oriented Smart General AI System under Causal Inference. General AI system solves a wide range of tasks with high performance in an automated fashion. The best general AI algorithm designed by one individual is different from that devised by another. The best performance records achieved by different users are also different. An inevitable component of general AI is tacit knowledge that depends upon user specific comprehension of task information and individual model design preferences that are related to user technical experiences. Tacit knowledge affects model performance but cannot be automatically optimized in general AI algorithms. In this paper, we propose User Oriented Smart General AI System under Causal Inference, abbreviated as UOGASuCI, where UOGAS represents User Oriented General AI System and uCI means under the framework of causal inference. User characteristics that have a significant influence upon tacit knowledge can be extracted from observed model training experiences of many users in external memory modules. Under the framework of causal inference, we manage to identify the optimal value of user characteristics that are connected with the best model performance designed by users. We make suggestions to users about how different user characteristics can improve the best model performance achieved by users. By recommending updating user characteristics associated with individualized tacit knowledge comprehension and technical preferences, UOGAS helps users design models with better performance.


Enhancement of drag and mixing in a dilute solution of rodlike polymers at low Reynolds numbers. We study the dynamics of a dilute solution of rigid rodlike polymers in a viscous fluid at low Reynolds number by means of numerical simulations of a simple rheological model. We show that the rotational dynamics of polymers destabilizes the laminar flow and causes the emergence of a turbulent like chaotic flow with a wide range of active scales. This regime displays an increased flow resistance, corresponding to a reduced mean flow at fixed external forcing, as well as an increased mixing efficiency. The latter effect is quantified by measuring the decay of the variance of a scalar field transported by the flow. By comparing the results of numerical simulations of the model in two and three dimensions, we show that the phenomena observed are qualitatively independent on the dimensionality of the space.


Modelling Brain Connectivity Networks by Graph Embedding for Dyslexia Diagnosis. Several methods have been developed to extract information from electroencephalograms (EEG). One of them is Phase Amplitude Coupling (PAC) which is a type of Cross Frequency Coupling (CFC) method, consisting in measure the synchronization of phase and amplitude for the different EEG bands and electrodes. This provides information regarding brain areas that are synchronously activated, and eventually, a marker of functional connectivity between these areas. In this work, intra and inter electrode PAC is computed obtaining the relationship among different electrodes used in EEG. The connectivity information is then treated as a graph in which the different nodes are the electrodes and the edges PAC values between them. These structures are embedded to create a feature vector that can be further used to classify multichannel EEG samples. The proposed method has been applied to classified EEG samples acquired using specific auditory stimuli in a task designed for dyslexia disorder diagnosis in seven years old children EEG's. The proposed method provides AUC values up to 0.73 and allows selecting the most discriminant electrodes and EEG bands.


A Torelli Type theorem for Nodal curves. The moduli space of Gieseker vector bundles is a compactification of moduli of vector bundles on a nodal curve. This moduli space has only normal crossing singularity and it provides a flat degeneration. We prove a Torelli type theorem for a nodal curve using the moduli space of stable Gieseker vector bundles of fixed rank (strictly greater than 1 ) and fixed degree such that rank and degree are co prime.


Quantitative Evaluation of SPH in TIG Spot Welding. While the application of the Smoothed Particle Hydrodynamics (SPH) method for the modeling of welding processes has become increasingly popular in recent years, little is yet known about the quantitative predictive capability of this method. We propose a novel SPH model for the simulation of the tungsten inert gas (TIG) spot welding process and conduct a thorough comparison between our SPH implementation and two Finite Element Method (FEM) based models. In order to be able to quantitatively compare the results of our SPH simulation method with grid based methods we additionally propose an improved particle to grid interpolation method based on linear least squares with an optional hole filling pass which accounts for missing particles. We show that SPH is able to yield excellent results, especially given the observed deviations between the investigated FEM methods and as such, we validate the accuracy of the method for an industrially relevant engineering application.


Variability in higher order structure of noise added to weighted networks. From spiking activity in neuronal networks to force chains in granular materials, the behavior of many real world systems depends on a network of both strong and weak interactions. These interactions give rise to complex and higher order system behaviors, and are encoded using data as the network's edges. However, distinguishing between true weak edges and low weight edges caused by noise remains a challenge. We address this problem by examining the higher order structure of noisy, weak edges added to model networks. We find that the structure of low weight, noisy edges varies according to the topology of the model network to which it is added. By investigating this variation more closely, we see that at least three qualitative classes of noise structure emerge. Furthermore, we observe that the structure of noisy edges contains enough model specific information to classify the model networks with moderate accuracy. Finally, we offer network generation rules that can drive different types of structure in added noisy edges. Our results demonstrate that noise does not present as a monolithic nuisance, but rather as a nuanced, topology dependent, and even useful entity in characterizing higher order network interactions. Hence, we provide an alternate approach to noise management by embracing its role in such interactions.


Kosp2e Korean Speech to English Translation Corpus. Most speech to text (S2T) translation studies use English speech as a source, which makes it difficult for non English speakers to take advantage of the S2T technologies. For some languages, this problem was tackled through corpus construction, but the farther linguistically from English or the more under resourced, this deficiency and underrepresentedness becomes more significant. In this paper, we introduce kosp2e (read as kospi'), a corpus that allows Korean speech to be translated into English text in an end to end manner. We adopt open license speech recognition corpus, translation corpus, and spoken language corpora to make our dataset freely available to the public, and check the performance through the pipeline and training based approaches. Using pipeline and various end to end schemes, we obtain the highest BLEU of 21.3 and 18.0 for each based on the English hypothesis, validating the feasibility of our data. We plan to supplement annotations for other target languages through community contributions in the future.


Monitoring Cumulative Cost Properties. This paper considers the problem of decentralized monitoring of a class of non functional properties (NFPs) with quantitative operators, namely cumulative cost properties. The decentralized monitoring of NFPs can be a non trivial task for several reasons (i) they are typically expressed at a high abstraction level where inter event dependencies are hidden, (ii) NFPs are difficult to be monitored in a decentralized way, and (iii) lack of effective decomposition techniques. We address these issues by providing a formal framework for decentralised monitoring of LTL formulas with quantitative operators. The presented framework employs the tableau construction and a formula unwinding technique (i.e., a transformation technique that preserves the semantics of the original formula) to split and distribute the input LTL formula and the corresponding quantitative constraint in a way such that monitoring can be performed in a decentralised manner. The employment of these techniques allows processes to detect early violations of monitored properties and perform some corrective or recovery actions. We demonstrate the effectiveness of the presented framework using a case study based on a Fischertechnik training model,a sorting line which sorts tokens based on their color into storage bins. The analysis of the case study shows the effectiveness of the presented framework not only in early detection of violations, but also in developing failure recovery plans that can help to avoid serious impact of failures on the performance of the system.


Manifold embedding data driven mechanics. This article introduces a new data driven approach that leverages a manifold embedding generated by the invertible neural network to improve the robustness, efficiency, and accuracy of the constitutive law free simulations with limited data. We achieve this by training a deep neural network to globally map data from the constitutive manifold onto a lower dimensional Euclidean vector space. As such, we establish the relation between the norm of the mapped Euclidean vector space and the metric of the manifold and lead to a more physically consistent notion of distance for the material data. This treatment in return allows us to bypass the expensive combinatorial optimization, which may significantly speed up the model free simulations when data are abundant and of high dimensions. Meanwhile, the learning of embedding also improves the robustness of the algorithm when the data is sparse or distributed unevenly in the parametric space. Numerical experiments are provided to demonstrate and measure the performance of the manifold embedding technique under different circumstances. Results obtained from the proposed method and those obtained via the classical energy norms are compared.


Medical Graphs in Patient Information Systems in Primary Care. Graphs are very effective tools in visualizing information and are used in many fields including the medical field. In most developing countries primary care, graphs are used to monitor child growth. These measures are therefore often displayed using line graphs, basing it on three indicators (stunting, underweight and wasting) based on the WHO 2006 Child Growth Standard. Most literature on information visualization of electronic health record data focuses on aggregate data visualization tools. This research therefore, was set out to provide such an overview of requirements for computerized graphs for individual patient data, implemented in a way that all kinds of medical graphs showing the development of medical measures over time can be displayed. This research was interpretive, using a user centric approach for data collection where interviews and web search was used to ensure that the graphs developed are fit the user requirements. This followed prototype development using one of the three free, open source software libraries for Android that were evaluated. The prototype was then used to refine the user requirements. The health workers interpreted the graphs developed flawlessly.


HSMA An O(N) electrostatics package implemented in LAMMPS. We implement two recently developed fast Coulomb solvers, HSMA3D J. Chem. Phys. 149 (8) (2018) 084111 and HSMA2D J. Chem. Phys. 152 (13) (2020) 134109 , into a new user package HSMA for molecular dynamics simulation engine LAMMPS. The HSMA package is designed for efficient and accurate modeling of electrostatic interactions in 3D and 2D periodic systems with dielectric effects at the O(N) cost. The implementation is hybrid MPI and OpenMP parallelized and compatible with existing LAMMPS functionalities. The vectorization technique following AVX512 instructions is adopted for acceleration. To establish the validity of our implementation, we have presented extensive comparisons to the widely used particle particle particle mesh (PPPM) algorithm in LAMMPS and other dielectric solvers. With the proper choice of algorithm parameters and parallelization setup, the package enables calculations of electrostatic interactions that outperform the standard PPPM in speed for a wide range of particle numbers.


Towards Automating Code Review Activities. Code reviews are popular in both industrial and open source projects. The benefits of code reviews are widely recognized and include better code quality and lower likelihood of introducing bugs. However, since code review is a manual activity it comes at the cost of spending developers' time on reviewing their teammates' code. Our goal is to make the first step towards partially automating the code review process, thus, possibly reducing the manual costs associated with it. We focus on both the contributor and the reviewer sides of the process, by training two different Deep Learning architectures. The first one learns code changes performed by developers during real code review activities, thus providing the contributor with a revised version of her code implementing code transformations usually recommended during code review before the code is even submitted for review. The second one automatically provides the reviewer commenting on a submitted code with the revised code implementing her comments expressed in natural language. The empirical evaluation of the two models shows that, on the contributor side, the trained model succeeds in replicating the code transformations applied during code reviews in up to 16 of cases. On the reviewer side, the model can correctly implement a comment provided in natural language in up to 31 of cases. While these results are encouraging, more research is needed to make these models usable by developers.


Approximation theorems for Pascali systems. Based on Runge theorem for generalized analytic vectors proved by Goldschmidt in 1979 we provide a Mergelyan type and a Carleman type approximation theorems for solutions of Pascali systems.