Projections of Tropical Fermat Weber Points. In the tropical projective torus, it is not guaranteed that the projection of a Fermat Weber point of a given data set is a Fermat Weber point of the projection of the data set. In this paper, we focus on the projection on the tropical triangle (the three point tropical convex hull), and we develop one algorithm (Algorithm 1) and its improved version (Algorithm 4), such that for a given data set in the tropical projective torus, these algorithms output a tropical triangle, on which the projection of a Fermat Weber point of the data set is a Fermat Weber point of the projection of the data set. We implement these algorithms in R and test how it works with random data sets. The experimental results show that, these algorithms can succeed with a much higher probability than choosing the tropical triangle randomly, the succeed rate of these two algorithms is stable while data sets are changing randomly, and Algorithm 4 can output the results much faster than Algorithm 1 averagely.


Incorporating Domain Knowledge into Deep Neural Networks. We present a survey of ways in which domain knowledge has been included when constructing models with neural networks. The inclusion of domain knowledge is of special interest not just to constructing scientific assistants, but also, many other areas that involve understanding data using human machine collaboration. In many such instances, machine based model construction may benefit significantly from being provided with human knowledge of the domain encoded in a sufficiently precise form. This paper examines two broad approaches to encode such knowledge as logical and numerical constraints and describes techniques and results obtained in several sub categories under each of these approaches.


A weak Galerkin mixed finite element method for the Stokes Darcy problem. In this paper, we propose a new numerical scheme for the coupled Stokes Darcy model with Beavers Joseph Saffman interface condition. We use the weak Galerkin method to discretize the Stokes equation and the mixed finite element method to the Darcy equation. A discrete inf sup condition is proved and optimal error estimates are also derived. Numerical experiments validate the theoretical analysis.


Automorphisms of products of toric varieties. We give an explicit description of the automorphism group of a product of complete toric varieties over an arbitrary field in terms of the respective automorphism groups of its components. More precisely, we prove that, up to permutation of isomorphic components, an automorphism of a product corresponds to a product of automorphisms of its components. We also reprove, in modern language, the classic result by Demazure describing the group scheme of automorphisms of a complete toric variety over an arbitrary field.


ArchABM an agent based simulator of human interaction with the built environment. CO 2 and viral load analysis for indoor air quality. Recent evidence suggests that SARS CoV 2, which is the virus causing a global pandemic in 2020, is predominantly transmitted via airborne aerosols in indoor environments. This calls for novel strategies when assessing and controlling a building's indoor air quality (IAQ). IAQ can generally be controlled by ventilation and or policies to regulate human building interaction. However, in a building, occupants use rooms in different ways, and it may not be obvious which measure or combination of measures leads to a cost and energy effective solution ensuring good IAQ across the entire building. Therefore, in this article, we introduce a novel agent based simulator, ArchABM, designed to assist in creating new or adapt existing buildings by estimating adequate room sizes, ventilation parameters and testing the effect of policies while taking into account IAQ as a result of complex human building interaction patterns. A recently published aerosol model was adapted to calculate time dependent carbon dioxide ( CO 2 ) and virus quanta concentrations in each room and inhaled CO 2 and virus quanta for each occupant over a day as a measure of physiological response. ArchABM is flexible regarding the aerosol model and the building layout due to its modular architecture, which allows implementing further models, any number and size of rooms, agents, and actions reflecting human building interaction patterns. We present a use case based on a real floor plan and working schedules adopted in our research center. This study demonstrates how advanced simulation tools can contribute to improving IAQ across a building, thereby ensuring a healthy indoor environment.


Evaluating Students Perspectives on ICT Readiness in Somali Higher Education towards Teaching Learning Acceptance. Along the rapid development of Information and communication technology (ICT) tools and growth of Internet access offer opportunities that facilitate teaching and learning activities in the context of higher education. However, the study of ICTs readiness and acceptance in Somalia higher education is meagre. This research aims to examine the current state of ICT readiness among university students and explores the factors that affect their readiness acceptance. It proposes an extended model, based on the Technology Acceptance Model (TAM), which explains how University students beliefs influence their readiness to accept ICT applications in their learning. Survey responses of 304 students from undergraduate and Graduate in Somalia higher education were collected and analyzed using structural equation modelling. The results of the data analysis demonstrated that the TAM explained university students readiness acceptance of ICT applications reasonably well. More specifically, perceived usefulness, Ease of Use, ICT Selfefficacy, Teaching Learning autonomy, Students Optimism and Availability of ICT infrastructure are robust predictors of Students ICT readiness acceptance. Results also showed that internet affordability, network speed and quality, innovativeness, discomfort and insecurity do not have a meaningful effect on perceived usefulness and Ease of Use towards ICT readiness acceptance. Through the empirical results, this study helped us understand why students choose to engage in ICT applications for their learning context. Keywords ICT readiness acceptance, Higher education,Teaching Learning, Technology Acceptance Model


Tryptophan containing proteins as label free nanothermometers. There remains a need for techniques to monitor thermal processes at high spatiotemporal resolution, with myriad potential applications in chemistry, biology, and engineering. Measurement of temperature from nanoscale molecular phenomena are particularly promising due to their general compatibility with biological systems. Among these phenomena, fluorescence polarization anisotropy is particularly attractive due to its high sensitivity to thermal and photophysical information, and its general utility with a wide spectrum of fluorophores. In this work, we propose that the measurement of the intrinsic fluorescence polarization anisotropy of tryptophan can be used to measure label free temperature at the nanoscale in a variety of tryptophan containing proteins. We present a theoretical model of the temperature sensitivity of fluorescence polarization in free tryptophan and tryptophan containing proteins, empirically explore these properties, and discuss the potential development of proteins as thermal memory sensors.


Tight Integration of Feature based Relocalization in Monocular Direct Visual Odometry. In this paper we propose a framework for integrating map based relocalization into online direct visual odometry. To achieve map based relocalization for direct methods, we integrate image features into Direct Sparse Odometry (DSO) and rely on feature matching to associate online visual odometry (VO) with a previously built map. The integration of the relocalization poses is threefold. Firstly, they are incorporated as pose priors in the direct image alignment of the front end tracking. Secondly, they are tightly integrated into the back end bundle adjustment. Thirdly, an online fusion module is further proposed to combine relative VO poses and global relocalization poses in a pose graph to estimate keyframe wise smooth and globally accurate poses. We evaluate our method on two multi weather datasets showing the benefits of integrating different handcrafted and learned features and demonstrating promising improvements on camera tracking accuracy.


ByT5 Towards a token free future with pre trained byte to byte models. Most widely used pre trained language models operate on sequences of tokens corresponding to word or subword units. By comparison, token free models that operate directly on raw text (bytes or characters) have many benefits they can process text in any language out of the box, they are more robust to noise, and they minimize technical debt by removing complex and error prone text preprocessing pipelines. Since byte or character sequences are longer than token sequences, past work on token free models has often introduced new model architectures designed to amortize the cost of operating directly on raw text. In this paper, we show that a standard Transformer architecture can be used with minimal modifications to process byte sequences. We characterize the trade offs in terms of parameter count, training FLOPs, and inference speed, and show that byte level models are competitive with their token level counterparts. We also demonstrate that byte level models are significantly more robust to noise and perform better on tasks that are sensitive to spelling and pronunciation. As part of our contribution, we release a new set of pre trained byte level Transformer models based on the T5 architecture, as well as all code and data used in our experiments.


Researcher or Crowd Member? Why not both! The Open Research Knowledge Graph for Applying and Communicating CrowdRE Research. In recent decades, there has been a major shift towards improved digital access to scholarly works. However, even now that these works are available in digital form, they remain document based, making it difficult to communicate the knowledge they contain. The next logical step is to extend these works with more flexible, fine grained, semantic, and context sensitive representations of scholarly knowledge. The Open Research Knowledge Graph (ORKG) is a platform that structures and interlinks scholarly knowledge, relying on crowdsourced contributions from researchers (as a crowd) to acquire, curate, publish, and process this knowledge. In this experience report, we consider the ORKG in the context of Crowd based Requirements Engineering (CrowdRE) from two perspectives (1) As CrowdRE researchers, we investigate how the ORKG practically applies CrowdRE techniques to involve scholars in its development to make it align better with their academic work. We determined that the ORKG readily provides social and financial incentives, feedback elicitation channels, and support for context and usage monitoring, but that there is improvement potential regarding automated user feedback analyses and a holistic CrowdRE approach. (2) As crowd members, we explore how the ORKG can be used to communicate scholarly knowledge about CrowdRE research. For this purpose, we curated qualitative and quantitative scholarly knowledge in the ORKG based on papers contained in two previously published systematic literature reviews (SLRs) on CrowdRE. This knowledge can be explored and compared interactively, and with more data than what the SLRs originally contained. Therefore, the ORKG improves access and communication of the scholarly knowledge about CrowdRE research. For both perspectives, we found the ORKG to be a useful multi tool for CrowdRE research.


Compound matrices in systems and control theory. The multiplicative and additive compounds of a matrix play an important role in several fields of mathematics including geometry, multi linear algebra, combinatorics, and the analysis of nonlinear time varying dynamical systems. There is a growing interest in applications of these compounds, and their generalizations, in systems and control theory. This tutorial paper provides a gentle introduction to these topics with an emphasis on the geometric interpretation of the compounds, and surveys some of their recent applications.


COVID 19 propagation by diffusion a two dimensional approach for Germany. Diffusion comes anytime and everywhere. If there is a gradient or a potential difference of a quantity a diffusion process happens and this ends if an equilibrium is reached only. The concentration of a species maybe such quantity, or the voltage. An electric currant will be driven by a voltage difference for example. In this COVID 19 pandemic one observes both regions with low incidence and other ones with high incidence. The local different people density could be a reason for that. In populous areas like big cities or congested urban areas higher COVID 19 incidences could be observed than in rural regions. The aim of this paper consists in the application of a diffusion concept to describe one possible issue of the the COVID 19 propagation. This will be discussed for the German situation based on the quite different incidence data for the different federal states of Germany.


Individual crop loads provide local control for collective food intake in ant colonies. Nutritional regulation by ants emerges from a distributed process food is collected by a small fraction of workers, stored within the crops of individuals, and spreads via local ant to ant interactions. The precise individual level underpinnings of this collective regulation have remained unclear mainly due to difficulties in measuring food within ants crops. Here we image fluorescent liquid food in individually tagged Camponotus sanctus ants, and track the real time food flow from foragers to their gradually satiating colonies. We show how the feedback between colony satiation level and food inflow is mediated by individual crop loads specifically, the crop loads of recipient ants control food flow rates, while those of foragers regulate the frequency of foraging trips. Interestingly, these effects do not rise from pure physical limitations of crop capacity. Our findings suggest that the emergence of food intake regulation does not require individual foragers to assess the global state of the colony.


Optimal gradient estimates for multi phase integrals. We prove sharp reverse H "older inequalities for minima of multi phase variational integrals and apply them to Calder 'on Zygmund estimates for nonhomogeneous problems.


Decomposition numbers for the principal Phi 2n block of mathrm Sp 4n (q) and mathrm SO 4n 1 (q) . We compute the decomposition numbers of the unipotent characters lying in the principal ell block of a finite group of Lie type B 2n (q) or C 2n (q) when q is an odd prime power and ell is an odd prime number such that the order of q mod ell is 2n . Along the way, we extend to these finite groups the results of cite DVV19 on the branching graph for Harish Chandra induction and restriction.


A Boundary Layer Preconditioner for Singularly Perturbed Convection Diffusion. Motivated by a wide range of real world problems whose solutions exhibit boundary and interior layers, the numerical analysis of discretizations of singularly perturbed differential equations is an established sub discipline within the study of the numerical approximation of solutions to differential equations. Consequently, much is known about how to accurately and stably discretize such equations on textit a priori adapted meshes, in order to properly resolve the layer structure present in their continuum solutions. However, despite being a key step in the numerical simulation process, much less is known about the efficient and accurate solution of the linear systems of equations corresponding to these discretizations. In this paper, we discuss problems associated with the application of direct solvers to these discretizations, and we propose a preconditioning strategy that is tuned to the matrix structure induced by using layer adapted meshes for convection diffusion equations, proving a strong condition number bound on the preconditioned system in one spatial dimension, and a weaker bound in two spatial dimensions. Numerical results confirm the efficiency of the resulting preconditioners in one and two dimensions, with time to solution of less than one second for representative problems on 1024 times 1024 meshes and up to 40 times speedup over standard sparse direct solvers.


Methods of Causal Inference in Physics Education Research. Finding good educational policies requires sound estimates of their potential effects. Methods for making such estimates, i.e. finding causal estimands, have made great progress in the last few decades. Nevertheless, serious errors in causal reasoning have been found previously in papers n a leading physics education journal, Physical Review Physics Education Research. Here we examine three more recent papers from that journal that present explicit methods of causal inference. The methods given include major errors, including in identifying causal mediation, choosing variables to control for, and imputing missing data.


MaskNet Introducing Feature Wise Multiplication to CTR Ranking Models by Instance Guided Mask. Click Through Rate(CTR) estimation has become one of the most fundamental tasks in many real world applications and it's important for ranking models to effectively capture complex high order features. Shallow feed forward network is widely used in many state of the art DNN models such as FNN, DeepFM and xDeepFM to implicitly capture high order feature interactions. However, some research has proved that addictive feature interaction, particular feed forward neural networks, is inefficient in capturing common feature interaction. To resolve this problem, we introduce specific multiplicative operation into DNN ranking system by proposing instance guided mask which performs element wise product both on the feature embedding and feed forward layers guided by input instance. We also turn the feed forward layer in DNN model into a mixture of addictive and multiplicative feature interactions by proposing MaskBlock in this paper. MaskBlock combines the layer normalization, instance guided mask, and feed forward layer and it is a basic building block to be used to design new ranking model under various configurations. The model consisting of MaskBlock is called MaskNet in this paper and two new MaskNet models are proposed to show the effectiveness of MaskBlock as basic building block for composing high performance ranking systems. The experiment results on three real world datasets demonstrate that our proposed MaskNet models outperform state of the art models such as DeepFM and xDeepFM significantly, which implies MaskBlock is an effective basic building unit for composing new high performance ranking systems.


validation method to improve behavioral flows on uml requirements analysis model by cross checking with state transition model. We propose a method to evaluate and improve the validity of required specifications by comparing models from different viewpoints. Inconsistencies are automatically extracted from the model in which the analyst defines the service procedure based on the initial requirement thereafter, the analyst automatically compares it with a state transition model from the same initial requirement that has been created by an evaluator who is different from the analyst. The identified inconsistencies are reported to the analyst to enable the improvement of the required specifications. We develop a tool for extraction and comparison and then discuss its effectiveness by applying the method to a requirements specification example.


Towards a Systematic Survey for Carbon Neutral Data Centers. Data centers are carbon intensive enterprises due to their massive energy consumption, and it is estimated that data center industry will account for 8 of global carbon emissions by 2030. However, both technological and policy instruments for reducing or even neutralizing data center carbon emissions have not been thoroughly investigated. To bridge this gap, this survey paper proposes a roadmap towards carbon neutral data centers that takes into account both policy instruments and technological methodologies. We begin by presenting the carbon footprint of data centers, as well as some insights into the major sources of carbon emissions. Following that, carbon neutrality plans for major global cloud providers are discussed to summarize current industrial efforts in this direction. In what follows, we introduce the carbon market as a policy instrument to explain how to offset data center carbon emissions in a cost efficient manner. On the technological front, we propose achieving carbon neutral data centers by increasing renewable energy penetration, improving energy efficiency, and boosting energy circulation simultaneously. A comprehensive review of existing technologies on these three topics is elaborated subsequently. Based on this, a multi pronged approach towards carbon neutrality is envisioned and a digital twin powered industrial artificial intelligence (AI) framework is proposed to make this solution a reality. Furthermore, three key scientific challenges for putting such a framework in place are discussed. Finally, several applications for this framework are presented to demonstrate its enormous potential.


The limit of the zero locus of the independence polynomial for bounded degree graphs. The goal of this paper is to accurately describe the maximal zero free region of the independence polynomial for graphs of bounded degree, for large degree bounds. In previous work with de Boer, Guerini and Regts it was demonstrated that this zero free region coincides with the normality region of the related occupation ratios. These ratios form a discrete semi group that is in a certain sense generated by finitely many rational maps. We will show that as the degree bound converges to infinity, the properly rescaled normality regions converge to a limit domain, which can be described as the maximal boundedness component of a semi group generated by infinitely many exponential maps. We prove that away from the real axis, this boundedness component avoids a neighborhood of the boundary of the limit cardioid, answering a recent question by Andreas Galanis. We also give an exact formula for the boundary of the boundedness component near the positive real boundary point.


Low Reynolds number aerodynamic characteristics of airfoils with piezocomposite trailing control surfaces. Morphing wings comprised of fixed leading sections with piezocomposite trailing control surfaces have emerged as a novel active control technique for unmanned aerial vehicles. However, the wake dynamics and aerodynamic performance of such hybrid airfoil configuration has not been thoroughly investigated. In this paper, direct numerical simulations of two dimensional flows over hybrid airfoils comprised of NACA 0012 leading sections with piezocomposite trailing control surfaces are performed at a fixed Reynolds number of 1000. The effects of length and camber of the trailing control surface on the laminar aerodynamic characteristics are studied over a wide range of angle of attack. It is shown that the flow behind the airfoil exhibits different features, including steady flow, periodic vortex shedding, and quasi periodic vortex shedding for different configurations. The transition between these wake states occurs at slightly smaller angles of attack compared to the nominal NACA 0012 airfoil. While the drag coefficient remains close to each other at a fixed angle of attack, the lift coefficient of the hybrid airfoil is positively affected by the length and camber of the trailing control surface. The mechanism of lift generation is examined by surface pressure distributions and a force element analysis. It is revealed that with increased camber of the trailing control surface, the flow on both the suction and pressure sides of the airfoil are modified in a beneficial way to enhance lift. Increasing the length ratio only significantly modifies the flow near the aft section on the pressure side. The results herein provide a laminar aerodynamic characterization of hybrid airfoils with trailing control surfaces, and could potentially aid the design of control techniques for next generation small unmanned aerial vehicles.


Do Answers to Boolean Questions Need Explanations? Yes. Existing datasets that contain boolean questions, such as BoolQ and TYDI QA , provide the user with a YES NO response to the question. However, a one word response is not sufficient for an explainable system. We promote explainability by releasing a new set of annotations marking the evidence in existing TyDi QA and BoolQ datasets. We show that our annotations can be used to train a model that extracts improved evidence spans compared to models that rely on existing resources. We confirm our findings with a user study which shows that our extracted evidence spans enhance the user experience. We also provide further insight into the challenges of answering boolean questions, such as passages containing conflicting YES and NO answers, and varying degrees of relevance of the predicted evidence.


Localizable locally determined measurable spaces with negligibles. We study measurable spaces equipped with a sigma ideal of negligible sets. We find conditions under which they admit a localizable locally determined version a kind of fiber space that describes locally their directions defined by a universal property in an appropriate category that we introduce. These methods allow to promote each measure space (X, mathcal A , mu) to a strictly localizable version ( hat X , hat mathcal A , hat mu ) , so that the dual of L 1(X, mathcal A , mu) is L infty( hat X , hat mathcal A , hat mu ) . Corresponding to this duality is a generalized Radon Nikod 'ym theorem. We also provide a characterization of the strictly localizable version in special cases that include integral geometric measures, when the negligibles are the purely unrectifiable sets in a given dimension.


LIDSNet A Lightweight on device Intent Detection model using Deep Siamese Network. Intent detection is a crucial task in any Natural Language Understanding (NLU) system and forms the foundation of a task oriented dialogue system. To build high quality real world conversational solutions for edge devices, there is a need for deploying intent detection model on device. This necessitates a light weight, fast, and accurate model that can perform efficiently in a resource constrained environment. To this end, we propose LIDSNet, a novel lightweight on device intent detection model, which accurately predicts the message intent by utilizing a Deep Siamese Network for learning better sentence representations. We use character level features to enrich the sentence level representations and empirically demonstrate the advantage of transfer learning by utilizing pre trained embeddings. Furthermore, to investigate the efficacy of the modules in our architecture, we conduct an ablation study and arrive at our optimal model. Experimental results prove that LIDSNet achieves state of the art competitive accuracy of 98.00 and 95.97 on SNIPS and ATIS public datasets respectively, with under 0.59M parameters. We further benchmark LIDSNet against fine tuned BERTs and show that our model is at least 41x lighter and 30x faster during inference than MobileBERT on Samsung Galaxy S20 device, justifying its efficiency on resource constrained edge devices.


On the Cauchy problem of dispersive Burgers type equations. We study the paralinearised weakly dispersive Burgers type equation partial t u partial x T u u T frac partial x u 2 u partial x D alpha 1 u 0, alpha in 1,2 , which contains the main non linear "worst interaction" terms, i.e low high interaction terms, of the usual weakly dispersive Burgers type equation partial t u u partial x u partial x D alpha 1 u 0, alpha in 1,2 , with u 0 in H s( mathbb D) , where mathbb D mathbb T text or mathbb R . Through a paradifferential complex Cole Hopf type gauge transform we introduce for the study of the flow map regularity of Gravity Capillary equation, we prove a new a priori estimate in H s( mathbb D) under the control of left Vert(1 left Vert u right Vert L infty x ) left Vert u right Vert W 2 alpha, infty x right Vert L 1 t , improving upon the usual hyperbolic control left Vert partial x u right Vert L 1 tL infty x . Thus we eliminate the "standard" wave breaking scenario in case of blow up as conjectured by J. C. Saut and C. Klein in their numerical study of the dispersive Burgers equation. For alpha in 2,3 we show that we can completely conjugate the paralinearised dispersive Burgers equation to a semi linear equation of the form partial tu partial x D alpha 1 u R infty(u), alpha in 2,3 , where R infty is a regularizing operator under the control of left Vert u right Vert L infty t C 2 alpha .


Polarimetric Sensitivity of Light Absorbing Carbonaceous Aerosols Over Ocean A Theoretical Assessment. Visible light absorbing carbonaceous aerosols within the boundary layer affect the radiance and polarization states of the radiation at the top of the atmosphere. Remote sensing from suborbital and satellite based platforms utilizes these radiance and polarization signals to retrieve the key properties of these aerosols. Recent retrieval algorithms have shown a progressive trend toward including multi angular and multi spectral polarimetric measurements to produce better retrieval accuracy in comparison to those using measurements based on a single viewing angle. Here, we perform a theoretical investigation of the top of atmosphere (TOA) radiance related reflectance factor (bidirectional reflectance factor (BRF)) and the two types of polarimetry related factors (polarized bidirectional reflectance factor (pBRF) and the degree of linear polarization (DoLP)) for different types of atmospheric light absorbing carbonaceous aerosols as a function of particle size distribution. We selected three polarimetric bands corresponding to those utilized by NASA Airborne Multiangle SpectroPolarimetric Imager (AirMSPI) near UV (470 nm), visible (660 nm), and near infrared (865 nm) for our simulations which were performed over ocean surface using the successive order of scattering (SOS) algorithm coupled to a Lorenz Mie aerosol optics model. The analysis of particle phase matrix elements indicates a close relationship between the angular dependencies of DoLP and associated phase matrix components at the shortest polarimetric band (470 nm). Using Jacobian analysis, we find that the radiance and polarimetry related reflectance factors of weakly light absorbing aerosols, such as brown carbon, are more sensitive to changes in particle size and imaginary refractive index in comparison with those of black carbon, which is strongly light absorbing.


DyGLIP A Dynamic Graph Model with Link Prediction for Accurate Multi Camera Multiple Object Tracking. Multi Camera Multiple Object Tracking (MC MOT) is a significant computer vision problem due to its emerging applicability in several real world applications. Despite a large number of existing works, solving the data association problem in any MC MOT pipeline is arguably one of the most challenging tasks. Developing a robust MC MOT system, however, is still highly challenging due to many practical issues such as inconsistent lighting conditions, varying object movement patterns, or the trajectory occlusions of the objects between the cameras. To address these problems, this work, therefore, proposes a new Dynamic Graph Model with Link Prediction (DyGLIP) approach to solve the data association task. Compared to existing methods, our new model offers several advantages, including better feature representations and the ability to recover from lost tracks during camera transitions. Moreover, our model works gracefully regardless of the overlapping ratios between the cameras. Experimental results show that we outperform existing MC MOT algorithms by a large margin on several practical datasets. Notably, our model works favorably on online settings but can be extended to an incremental approach for large scale datasets.


Relative Log Symplectic structure on a semi stable degeneration of moduli of Higgs bundles. In a recent paper cite 3 , a semi stable degeneration of moduli space of Higgs bundles on a curve has been constructed. In this paper, we show that there is a relative log symplectic form on this degeneration, whose restriction to the generic fibre is the classical symplectic form discovered by Hitchin. We compute the Poisson ranks at every point and describe the symplectic foliation on the closed fibre. We also show that the closed fibre, which is a variety with normal crossing singularities, acquires a structure of an algebraically completely integrable system.


Deployment of Elastic Virtual Hybrid Clusters Across Cloud Sites. Virtual clusters are widely used computing platforms than can be deployed in multiple cloud platforms. The ability to dynamically grow and shrink the number of nodes has paved the way for customised elastic computing both for High Performance Computing and High Throughput Computing workloads. However, elasticity is typically restricted to a single cloud site, thus hindering the ability to provision computational resources from multiple geographically distributed cloud sites. To this aim, this paper introduces an architecture of open source components that coherently deploy a virtual elastic cluster across multiple cloud sites to perform large scale computing. These hybrid virtual elastic clusters are automatically deployed and configured using an Infrastructure as Code (IaC) approach on a distributed hybrid testbed that spans different organizations, including on premises and public clouds, supporting automated tunneling of communications across the cluster nodes with advanced VPN topologies. The results indicate that cluster based computing of embarrassingly parallel jobs can benefit from hybrid virtual clusters that aggregate computing resources from multiple cloud back ends and bring them together into a dedicated, albeit virtual network. The work presented in this article has been partially funded by the European Union's (EU) Horizon 2020 research project DEEP Hybrid DataCloud (grant agreement No 777435).


PatchGraph In hand tactile tracking with learned surface normals. We address the problem of tracking 3D object poses from touch during in hand manipulations. Specifically, we look at tracking small objects using vision based tactile sensors that provide high dimensional tactile image measurements at the point of contact. While prior work has relied on a priori information about the object being localized, we remove this requirement. Our key insight is that an object is composed of several local surface patches, each informative enough to achieve reliable object tracking. Moreover, we can recover the geometry of this local patch online by extracting local surface normal information embedded in each tactile image. We propose a novel two stage approach. First, we learn a mapping from tactile images to surface normals using an image translation network. Second, we use these surface normals within a factor graph to both reconstruct a local patch map and use it to infer 3D object poses. We demonstrate reliable object tracking for over 100 contact sequences across unique shapes with four objects in simulation and two objects in the real world. Supplementary video https youtu.be FHks haOGY


Anomaly Aware Semantic Segmentation by Leveraging Synthetic Unknown Data. Anomaly awareness is an essential capability for safety critical applications such as autonomous driving. While recent progress of robotics and computer vision has enabled anomaly detection for image classification, anomaly detection on semantic segmentation is less explored. Conventional anomaly aware systems assuming other existing classes as out of distribution (pseudo unknown) classes for training a model will result in two drawbacks. (1) Unknown classes, which applications need to cope with, might not actually exist during training time. (2) Model performance would strongly rely on the class selection. Observing this, we propose a novel Synthetic Unknown Data Generation, intending to tackle the anomaly aware semantic segmentation task. We design a new Masked Gradient Update (MGU) module to generate auxiliary data along the boundary of in distribution data points. In addition, we modify the traditional cross entropy loss to emphasize the border data points. We reach the state of the art performance on two anomaly segmentation datasets. Ablation studies also demonstrate the effectiveness of proposed modules.


Characterizing and computing weight equitable partitions of graphs. Weight equitable partitions of graphs, which are a natural extension of the well known equitable partitions, have been shown to be a powerful tool to weaken the regularity assumption in several well known eigenvalue bounds. In this work we aim to further our algebraic and computational understanding of weight equitable partitions. We do so by showing several spectral properties and algebraic characterizations, and by providing a method to find coarse weight equitable partitions.


Higher dimensional generalization of the Benjamin Ono equation 2D case. We consider a higher dimensional version of the Benjamin Ono (HBO) equation in the 2D setting u t mathcal R 1 Delta u frac 1 2 (u 2) x 0, (x,y) in mathbb R 2 , which is L 2 critical, and investigate properties of solutions both analytically and numerically. For a generalized equation (fractional 2D gKdV) after deriving the Pohozaev identities, we obtain non existence conditions for solitary wave solutions, then prove uniform bounds in the energy space or conditional global existence, and investigate the radiation region, a specific wedge in the negative x direction. We then introduce our numerical approach in a general context, and apply it to obtain the ground state solution in the 2D critical HBO equation, then show that its mass is a threshold for global vs. finite time existing solutions, which is typical in the focusing (mass )critical dispersive equations. We also observe that globally existing solutions tend to disperse completely into the radiation in this nonlocal equation. The blow up solutions travel in the positive x direction with the rescaled ground state profile while also radiating dispersive oscillations into the radiative wedge. We conclude with examples of different interactions of two solitary wave solutions, including weak and strong interactions.


Enclosing the Sliding Surfaces of a Controlled Swing. When implementing a non continuous controller for a cyber physical system, it may happen that the evolution of the closed loop system is not anymore piecewise differentiable along the trajectory, mainly due to conditional statements inside the controller. This may lead to some unwanted chattering effects than may damage the system. This behavior is difficult to observe even in simulation. In this paper, we propose an interval approach to characterize the sliding surface which corresponds to the set of all states such that the state trajectory may jump indefinitely between two distinct behaviors. We show that the recent notion of thick sets will allows us to compute efficiently an outer approximation of the sliding surface of a given class of hybrid system taking into account all set membership uncertainties. An application to the verification of the controller of a child swing is considered to illustrate the principle of the approach.


NeurIPS 2020 EfficientQA Competition Systems, Analyses and Lessons Learned. We review the EfficientQA competition from NeurIPS 2020. The competition focused on open domain question answering (QA), where systems take natural language questions as input and return natural language answers. The aim of the competition was to build systems that can predict correct answers while also satisfying strict on disk memory budgets. These memory budgets were designed to encourage contestants to explore the trade off between storing retrieval corpora or the parameters of learned models. In this report, we describe the motivation and organization of the competition, review the best submissions, and analyze system predictions to inform a discussion of evaluation for open domain QA.


The Equidistant Dimension of Graphs. A subset S of vertices of a connected graph G is a distance equalizer set if for every two distinct vertices x, y in V (G) setminus S there is a vertex w in S such that the distances from x and y to w are the same. The equidistant dimension of G is the minimum cardinality of a distance equalizer set of G. This paper is devoted to introduce this parameter and explore its properties and applications to other mathematical problems, not necessarily in the context of graph theory. Concretely, we first establish some bounds concerning the order, the maximum degree, the clique number, and the independence number, and characterize all graphs attaining some extremal values. We then study the equidistant dimension of several families of graphs (complete and complete multipartite graphs, bistars, paths, cycles, and Johnson graphs), proving that, in the case of paths and cycles, this parameter is related with 3 AP free sets. Subsequently, we show the usefulness of distance equalizer sets for constructing doubly resolving sets.


Local discontinuous Galerkin method for the fractional diffusion equation with integral fractional Laplacian. In this paper, we provide a framework of designing the local discontinuous Galerkin scheme for integral fractional Laplacian ( Delta) s with s in(0,1) in two dimensions. We theoretically prove and numerically verify the numerical stability and convergence of the scheme with the convergence rate no worse than mathcal O (h k frac 1 2 ) .


Topological Invariant Means on Locally Compact Groups. Suppose G is an amenable locally compact group. If F gamma F gamma gamma in Gamma is a F o lner net for G , associate it with the net chi F gamma F gamma subset L 1(G) subset L infty (G) . Thus, every accumulation point of F gamma is a topological left invariant mean on G . The following are examples of results proved in the present thesis (1) There exists a F o lner net which has as its accumulation points a set of 2 2 kappa distinct topological left invariant means on G , where kappa is the smallest cardinality of a covering of G by compact subsets. (2) If G is unimodular and mu is a topological left invariant mean on G , there exists a F o lner net which has mu as its unique accumulation point. (3) Suppose L subset G is a lattice subgroup. There is a natural bijection of the left invariant means on L with the topological left invariant means on G if and only if G L is compact. (4) Every topological left invariant mean on G is also topological right invariant if and only if G has precompact conjugacy classes. These results lie at the intersection of functional analysis with general topology. Problems in this area can often be solved with standard tools when G is sigma compact or metrizable, but require more interesting arguments in the general case.


Head and Body Unified Detector and Graph Network for Person Search in Media. Person search in media has seen increasing potential in Internet applications, such as video clipping and character collection. This task is common but overlooked by previous person search works which focus on surveillance scenes. The media scenarios have some different challenges from surveillance scenes. For example, a person may change his clothes frequently. To alleviate this issue, this paper proposes a Unified Detector and Graph Network (UDGNet) for person search in media. UDGNet is the first person search framework to detect and re identify the human body and head simultaneously. Specifically, it first builds two branches based on a unified network to detect the human body and head, then the detected body and head are used for re identification. This dual task approach can significantly enhance discriminative learning. To tackle the cloth changing issue, UDGNet builds two graphs to explore reliable links among cloth changing samples and utilizes a graph network to learn better embeddings. This design effectively enhances the robustness of person search to cloth changing challenges. Besides, we demonstrate that UDGNet can be implemented with both anchor based and anchor free person search frameworks and further achieve performance improvement. This paper also contributes a large scale dataset for Person Search in Media (PSM), which provides both body and head annotations. It is by far the largest dataset for person search in media. Experiments show that UDGNet improves the anchor free model AlignPS by 12.1 in mAP. Meanwhile, it shows good generalization across surveillance and longterm scenarios. The dataset and code will be available at https github.com shuxjweb PSM.git.


A Novel 3D UNet Deep Learning Framework Based on High Dimensional Bilateral Grid for Edge Consistent Single Image Depth Estimation. The task of predicting smooth and edge consistent depth maps is notoriously difficult for single image depth estimation. This paper proposes a novel Bilateral Grid based 3D convolutional neural network, dubbed as 3DBG UNet, that parameterizes high dimensional feature space by encoding compact 3D bilateral grids with UNets and infers sharp geometric layout of the scene. Further, another novel 3DBGES UNet model is introduced that integrate 3DBG UNet for inferring an accurate depth map given a single color view. The 3DBGES UNet concatenates 3DBG UNet geometry map with the inception network edge accentuation map and a spatial object's boundary map obtained by leveraging semantic segmentation and train the UNet model with ResNet backbone. Both models are designed with a particular attention to explicitly account for edges or minute details. Preserving sharp discontinuities at depth edges is critical for many applications such as realistic integration of virtual objects in AR video or occlusion aware view synthesis for 3D display applications.The proposed depth prediction network achieves state of the art performance in both qualitative and quantitative evaluations on the challenging NYUv2 Depth data. The code and corresponding pre trained weights will be made publicly available.


Discrete time dependent wave equations I. Semiclassical analysis. In this paper we consider a semiclassical version of the wave equations with singular H " o lder time dependent propagation speeds on the lattice hbar mathbb Z n . We allow the propagation speed to vanish leading to the weakly hyperbolic nature of the equations. Curiously, very much contrary to the Euclidean case considered by Colombini, de Giorgi and Spagnolo 2 and by other authors, the Cauchy problem, in this case, is well posed in ell 2( hbar mathbb Z n ) . However, we also recover the well posedness results in the intersection of certain Gevrey and Sobolev spaces in the limit of the semiclassical parameter hbar to 0 .


Spectral geometry on manifolds with fibred boundary metrics II heat kernel asymptotics. In this paper we continue the analysis of spectral problems in the setting of complete manifolds with fibred boundary metrics, also referred to as phi metrics, as initiated in our previous work. We consider the Hodge Laplacian for a phi metric and construct the corresponding heat kernel as a polyhomogeneous conormal distribution on an appropriate manifold with corners. Our discussion is a generalization of an earlier work by Albin and Sher, and provides a fundamental first step towards analysis of Ray Singer torsion, eta invariants and index theorems in the setting.


Computing the Multicover Bifiltration. Given a finite set A subset mathbb R d , let Cov r,k denote the set of all points within distance r to at least k points of A . Allowing r and k to vary, we obtain a 2 parameter family of spaces that grow larger when r increases or k decreases, called the emph multicover bifiltration . Motivated by the problem of computing the homology of this bifiltration, we introduce two closely related combinatorial bifiltrations, one polyhedral and the other simplicial, which are both topologically equivalent to the multicover bifiltration and far smaller than a v Cech based model considered in prior work of Sheehy. Our polyhedral construction is a bifiltration of the rhomboid tiling of Edelsbrunner and Osang, and can be efficiently computed using a variant of an algorithm given by these authors. Using an implementation for dimension 2 and 3, we provide experimental results. Our simplicial construction is useful for understanding the polyhedral construction and proving its correctness.


Capturing the diversity of multilingual societies. Cultural diversity encoded within languages of the world is at risk, as many languages have become endangered in the last decades in a context of growing globalization. To preserve this diversity, it is first necessary to understand what drives language extinction, and which mechanisms might enable coexistence. Here, we study language shift mechanisms using theoretical and data driven perspectives. A large scale empirical analysis of multilingual societies using Twitter and census data yields a wide diversity of spatial patterns of language coexistence. It ranges from a mixing of language speakers to segregation with multilinguals on the boundaries of disjoint linguistic domains. To understand how these different states can emerge and, especially, become stable, we propose a model in which language coexistence is reached when learning the other language is facilitated and when bilinguals favor the use of the endangered language. Simulations carried out in a metapopulation framework highlight the importance of spatial interactions arising from people mobility to explain the stability of a mixed state or the presence of a boundary between two linguistic regions. Further, we find that the history of languages is critical to understand their present state.


Conditional Generation of Synthetic Geospatial Images from Pixel level and Feature level Inputs. Training robust supervised deep learning models for many geospatial applications of computer vision is difficult due to dearth of class balanced and diverse training data. Conversely, obtaining enough training data for many applications is financially prohibitive or may be infeasible, especially when the application involves modeling rare or extreme events. Synthetically generating data (and labels) using a generative model that can sample from a target distribution and exploit the multi scale nature of images can be an inexpensive solution to address scarcity of labeled data. Towards this goal, we present a deep conditional generative model, called VAE Info cGAN, that combines a Variational Autoencoder (VAE) with a conditional Information Maximizing Generative Adversarial Network (InfoGAN), for synthesizing semantically rich images simultaneously conditioned on a pixel level condition (PLC) and a macroscopic feature level condition (FLC). Dimensionally, the PLC can only vary in the channel dimension from the synthesized image and is meant to be a task specific input. The FLC is modeled as an attribute vector in the latent space of the generated image which controls the contributions of various characteristic attributes germane to the target distribution. Experiments on a GPS trajectories dataset show that the proposed model can accurately generate various forms of spatiotemporal aggregates across different geographic locations while conditioned only on a raster representation of the road network. The primary intended application of the VAE Info cGAN is synthetic data (and label) generation for targeted data augmentation for computer vision based modeling of problems relevant to geospatial analysis and remote sensing.


Active Learning for Sequence Tagging with Deep Pre trained Models and Bayesian Uncertainty Estimates. Annotating training data for sequence tagging of texts is usually very time consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to significantly reduce the necessary annotation budget. We are the first to thoroughly investigate this powerful combination for the sequence tagging task. We conduct an extensive empirical study of various Bayesian uncertainty estimation methods and Monte Carlo dropout options for deep pre trained models in the active learning framework and find the best combinations for different types of models. Besides, we also demonstrate that to acquire instances during active learning, a full size Transformer can be substituted with a distilled version, which yields better computational performance and reduces obstacles for applying deep active learning in practice.


Turbulent drag reduction of viscoelastic wormlike micellar gels. Long chained, viscoelastic surfactant solutions (VES) have been widely employed in the oil and gas industry, particularly in hydraulic fracturing and gravel packing operations, where turbulence is commonly reached due to high pumping rates. With this motivation, we experimentally investigate the turbulent duct flow of an under studied class of wormlike micellar solutions that forms a gel at room temperature. The fluid is characterized via rotational rheometry, and the turbulent velocity and Reynolds stress profiles are measured via Laser Doppler Anemometry (LDA). Three surfactant concentrations are investigated at increasing Reynolds numbers. The turbulent flow fields of water, and semi dilute solutions of partially hydrolyzed polyacrylamide (HPAM) and xanthan gum (XG) are used as comparisons. Our study reveals that the gel like structure of the wormlike micellar gel is mostly broken down during turbulent flow, especially in the near wall region where the results indicate the presence of a water layer. Turbulent flow at low concentrations of surfactant show a Newtonian like flow field throughout most of the duct, where the energy spectra shows a 5 3 power law scale with wavenumber, whereas higher concentrations lead to drag reduction and lower power spectral densities at large wavenumbers. A comparison of the flow of polymeric fluids and the wormlike micellar solutions at maximum drag reduction (MDR) shows comparable drag reduction effects, with a large decrease in Reynolds shear stresses, and increased turbulence anisotropy in the buffer layer due to the large streamwise fluctuations and near zero wall normal fluctuations. Additionally, the MDR regime was bounded by Virk's asymptote for both polymers and the micellar gel, which implies a similar mechanism of drag reduction at MDR.


On surjectivity of word maps on mathrm PSL 2 . Let w x k, y l , x m, y n be a non trivial double commutator word. We show that w is surjective on mathrm PSL 2(K) , where K is an algebraically closed field of characteristic 0 .


Droplet Splashing on Rough Surfaces. When a droplet hits a surface fast enough, droplet splashing can occur smaller secondary droplets detach from the main droplet during impact. While droplet splashing on smooth surfaces is by now well understood, the surface roughness also affects at which impact velocity a droplet splashes. In this study, the influence of the surface roughness on droplet splashing is investigated. By changing the root mean square roughness of the impacted surface, we show that the droplet splashing velocity is only affected when the droplet roughness is large enough to disrupt the spreading droplet lamella and change the droplet splashing mechanism from corona to prompt splashing. Finally, using Weber and Ohnesorge number scaling models, we also show that the measured splashing velocity for both water and ethanol on surfaces with different roughness and water ethanol mixtures collapse onto a single curve, showing that the droplet splashing velocity on rough surfaces scales with the Ohnesorge number defined with the surface roughness length scale.


StreamBlocks A compiler for heterogeneous dataflow computing (technical report). To increase performance and efficiency, systems use FPGAs as reconfigurable accelerators. A key challenge in designing these systems is partitioning computation between processors and an FPGA. An appropriate division of labor may be difficult to predict in advance and require experiments and measurements. When an investigation requires rewriting part of the system in a new language or with a new programming model, its high cost can retard the study of different configurations. A single language system with an appropriate programming model and compiler that targets both platforms simplifies this exploration to a simple recompile with new compiler directives. This work introduces StreamBlocks, an open source compiler and runtime that uses the CAL dataflow programming language to partition computations across heterogeneous (CPU accelerator) platforms. Because of the dataflow model's semantics and the CAL language, StreamBlocks can exploit both thread parallelism in multi core CPUs and the inherent parallelism of FPGAs. StreamBlocks supports exploring the design space with a profile guided tool that helps identify the best hardware software partitions.


Stress concentration factors for the Lam 'e system arising from composites. For two neighbouring stiff inclusions, the stress, which is the gradient of a solution to the Lam ' e system of linear elasticity, may exhibit singular behavior as the distance between these two inclusions becomes arbitrarily small. In this paper, a family of stress concentration factors, which determine whether the stress will blow up or not, are accurately constructed in the presence of the generalized m convex inclusions in all dimensions. We then use these stress concentration factors to establish the optimal upper and lower bounds on the stress blow up rates in any dimension and meanwhile give a precise asymptotic expression of the stress concentration for interfacial boundaries of inclusions with different principal curvatures in dimension three. Finally, the corresponding results for the perfect conductivity problem are also presented.


Bernhard Riemann 1861 revisited existence of flat coordinates for an arbitrary bilinear form. We generalize the celebrated results of Bernhard Riemann and Gaston Darboux we give necessary and sufficient conditions for a bilinear form to be flat. More precisely, we give explicit necessary and sufficient conditions for a tensor field of type (0,2) which is not necessary symmetric or skew symmetric, and is possibly degenerate, to have constant entries in a local coordinate system.


Modeling Ideological Agenda Setting and Framing in Polarized Online Groups with Graph Neural Networks and Structured Sparsity. The increasing polarization of online political discourse calls for computational tools that are able to automatically detect and monitor ideological divides in social media. Here, we introduce a minimally supervised method that directly leverages the network structure of online discussion forums, specifically Reddit, to detect polarized concepts. We model polarization along the dimensions of agenda setting and framing, drawing upon insights from moral psychology. The architecture we propose combines graph neural networks with structured sparsity and results in representations for concepts and subreddits that capture phenomena such as ideological radicalization and subreddit hijacking. We also create a new dataset of political discourse covering 12 years and more than 600 online groups with different ideologies.


Data augmentation to improve robustness of image captioning solutions. In this paper, we study the impact of motion blur, a common quality flaw in real world images, on a state of the art two stage image captioning solution, and notice a degradation in solution performance as blur intensity increases. We investigate techniques to improve the robustness of the solution to motion blur using training data augmentation at each or both stages of the solution, i.e., object detection and captioning, and observe improved results. In particular, augmenting both the stages reduces the CIDEr D degradation for high motion blur intensity from 68.7 to 11.7 on MS COCO dataset, and from 22.4 to 6.8 on Vizwiz dataset.


The best of both worlds combining population genetic and quantitative genetic models. Traits under migration selection balance are increasingly shown to exhibit complex patterns of genetic architecture, with allelic differences of varying magnitude. However, studying the influence of a large number of small allelic effects on the maintenance of spatial polymorphism is mathematically challenging, due to the high complexity of the systems that arise. Here we propose a new methodology that allows us to take into account the combined contributions of a major locus and of a quantitative background resulting from small effect loci, inherited according to the infinitesimal model. In a regime of small variance contributed by the quantitative loci, we found new arguments of convex analysis to justify that traits are concentrated around the major alleles effects according to a normal distribution, which leads to a slow fast analysis approach. By applying it to a symmetrical two patch model, we predict an undocumented phenomenon of loss of polymorphism at the major locus despite strong selection for local adaptation under some conditions, where the infinitesimal quantitative background slowly disrupts the fast established symmetrical polymorphism at the major locus, which is confirmed by individual based simulations. We also provide a comprehensive toolbox designed to describe how to apply our method to more complex population genetic models.


Prospects of SETI by small size optical telescopes. In the present manuscript we consider the possibility of SETI by the small size (with diameters less than 1 m) optical telescopes. Calculations are performed for parameters of a facility of Abastumani Astrophysical Observatory AZT 14, Cassegrain Reflector with a parabolic mirror. In particular, we show that the techno signatures of Type 2.x and Type 3.x civilizations might be detected. It is demonstrated that it is possible to detect as hot megastructures (up to 4000 K) built around main sequence stars and pulsars as well as von Neumann extraterrestrial probes.


Long time stability of the quantum hydrodynamic system on irrational tori. We consider the quantum hydrodynamic system on a d dimensional irrational torus with d 2,3 . We discuss the behaviour, over a "non trivial" time interval, of the H s Sobolev norms of solutions. More precisely we prove that, for generic irrational tori, the solutions, evolving from varepsilon small initial conditions, remain bounded in H s for a time scale of order O( varepsilon 1 1 (d 1) ) , which is strictly larger with respect to the time scale provided by local theory. We exploit a Madelung transformation to rewrite the system as a nonlinear Schr "odinger equation. We therefore implement a Birkhoff normal form procedure involving small divisors arising from three waves interactions. The main difficulty is to control the loss of derivatives coming from the exchange of energy between high Fourier modes.This is due to the irrationality of the torus which prevent to have "good separation" properties of the eigenvalues of the linearized operator at zero. The main steps of the proof are (i) to prove precise lower bounds on small divisors (ii) to construct a modified energy by means of a suitable emph high low frequencies analysis, which gives an emph a priori estimate on the solutions.


Settling the Bias and Variance of Meta Gradient Estimation for Meta Reinforcement Learning. In recent years, gradient based Meta RL (GMRL) methods have achieved remarkable successes in either discovering effective online hyperparameter for one single task (Xu et al., 2018) or learning good initialisation for multi task transfer learning (Finn et al., 2017). Despite the empirical successes, it is often neglected that computing meta gradients via vanilla backpropagation is ill defined. In this paper, we argue that the stochastic meta gradient estimation adopted by many existing MGRL methods are in fact biased the bias comes from two sources 1) the compositional bias that is inborn in the structure of compositional optimisation problems and 2) the bias of multi step Hessian estimation caused by direct automatic differentiation. To better understand the meta gradient biases, we perform the first of its kind study to quantify the amount for each of them. We start by providing a unifying derivation for existing GMRL algorithms, and then theoretically analyse both the bias and the variance of existing gradient estimation methods. On understanding the underlying principles of bias, we propose two mitigation solutions based on off policy correction and multi step Hessian estimation techniques. Comprehensive ablation studies have been conducted and results reveals (1) The existence of these two biases and how they influence the meta gradient estimation when combined with different estimator sample size step and learning rate. (2) The effectiveness of these mitigation approaches for meta gradient estimation and thereby the final return on two practical Meta RL algorithms LOLA DiCE and Meta gradient Reinforcement Learning.


Disentangling Semantic to visual Confusion for Zero shot Learning. Using generative models to synthesize visual features from semantic distribution is one of the most popular solutions to ZSL image classification in recent years. The triplet loss (TL) is popularly used to generate realistic visual distributions from semantics by automatically searching discriminative representations. However, the traditional TL cannot search reliable unseen disentangled representations due to the unavailability of unseen classes in ZSL. To alleviate this drawback, we propose in this work a multi modal triplet loss (MMTL) which utilizes multimodal information to search a disentangled representation space. As such, all classes can interplay which can benefit learning disentangled class representations in the searched space. Furthermore, we develop a novel model called Disentangling Class Representation Generative Adversarial Network (DCR GAN) focusing on exploiting the disentangled representations in training, feature synthesis, and final recognition stages. Benefiting from the disentangled representations, DCR GAN could fit a more realistic distribution over both seen and unseen features. Extensive experiments show that our proposed model can lead to superior performance to the state of the arts on four benchmark datasets. Our code is available at https github.com FouriYe DCRGAN TMM.


Learning to track environment state via predictive autoencoding. This work introduces a neural architecture for learning forward models of stochastic environments. The task is achieved solely through learning from temporal unstructured observations in the form of images. Once trained, the model allows for tracking of the environment state in the presence of noise or with new percepts arriving intermittently. Additionally, the state estimate can be propagated in observation blind mode, thus allowing for long term predictions. The network can output both expectation over future observations and samples from belief distribution. The resulting functionalities are similar to those of a Particle Filter (PF). The architecture is evaluated in an environment where we simulate objects moving. As the forward and sensor models are available, we implement a PF to gauge the quality of the models learnt from the data.


2nd Place Solution for VisDA 2021 Challenge Universally Domain Adaptive Image Recognition. The Visual Domain Adaptation (VisDA) 2021 Challenge calls for unsupervised domain adaptation (UDA) methods that can deal with both input distribution shift and label set variance between the source and target domains. In this report, we introduce a universal domain adaptation (UniDA) method by aggregating several popular feature extraction and domain adaptation schemes. First, we utilize VOLO, a Transformer based architecture with state of the art performance in several visual tasks, as the backbone to extract effective feature representations. Second, we modify the open set classifier of OVANet to recognize the unknown class with competitive accuracy and robustness. As shown in the leaderboard, our proposed UniDA method ranks the 2nd place with 48.56 ACC and 70.72 AUROC in the VisDA 2021 Challenge.


Graph less Neural Networks Teaching Old MLPs New Tricks via Distillation. Graph Neural Networks (GNNs) are popular for graph machine learning and have shown great results on wide node classification tasks. Yet, they are less popular for practical deployments in the industry owing to their scalability challenges incurred by data dependency. Namely, GNN inference depends on neighbor nodes multiple hops away from the target, and fetching them burdens latency constrained applications. Existing inference acceleration methods like pruning and quantization can speed up GNNs by reducing Multiplication and ACcumulation (MAC) operations, but the improvements are limited given the data dependency is not resolved. Conversely, multi layer perceptrons (MLPs) have no graph dependency and infer much faster than GNNs, even though they are less accurate than GNNs for node classification in general. Motivated by these complementary strengths and weaknesses, we bring GNNs and MLPs together via knowledge distillation (KD). Our work shows that the performance of MLPs can be improved by large margins with GNN KD. We call the distilled MLPs Graph less Neural Networks (GLNNs) as they have no inference graph dependency. We show that GLNNs with competitive accuracy infer faster than GNNs by 146X 273X and faster than other acceleration methods by 14X 27X. Under a production setting involving both transductive and inductive predictions across 7 datasets, GLNN accuracies improve over stand alone MLPs by 12.36 on average and match GNNs on 6 7 datasets. Comprehensive analysis shows when and why GLNNs can achieve competitive accuracies to GNNs and suggests GLNN as a handy choice for latency constrained applications.


Three dimensional bipedal model with zero energy cost walking. We study a three dimensional articulated rigid body biped model that possesses zero cost of transport walking gaits. Energy losses are avoided due to the complete elimination of the foot ground collisions by the concerted oscillatory motion of the model's parts. The model consists of two parts connected via a universal joint. It does not rely on any geometry altering mechanisms, massless parts or springs. Despite the model's simplicity, its collisionless gaits feature walking with finite speed, foot clearance and ground friction. The collisionless spectrum can be studied analytically in the small movement limit, revealing infinitely many periodic modes. The modes differ in the number of sagittal and coronal plane oscillations at different stages of the walking cycle. We focus on the mode with the minimal number of such oscillations, presenting its complete analytical solution. We then numerically evolve it toward a general non small movement solution. A general collisionless mode can be tuned by adjusting a single model parameter. Some of the presented results display a surprising degree of generality and universality.


DeepFakes Detecting Forged and Synthetic Media Content Using Machine Learning. The rapid advancement in deep learning makes the differentiation of authentic and manipulated facial images and video clips unprecedentedly harder. The underlying technology of manipulating facial appearances through deep generative approaches, enunciated as DeepFake that have emerged recently by promoting a vast number of malicious face manipulation applications. Subsequently, the need of other sort of techniques that can assess the integrity of digital visual content is indisputable to reduce the impact of the creations of DeepFake. A large body of research that are performed on DeepFake creation and detection create a scope of pushing each other beyond the current status. This study presents challenges, research trends, and directions related to DeepFake creation and detection techniques by reviewing the notable research in the DeepFake domain to facilitate the development of more robust approaches that could deal with the more advance DeepFake in the future.


Question Answering over Electronic Devices A New Benchmark Dataset and a Multi Task Learning based QA Framework. Answering questions asked from instructional corpora such as E manuals, recipe books, etc., has been far less studied than open domain factoid context based question answering. This can be primarily attributed to the absence of standard benchmark datasets. In this paper we meticulously create a large amount of data connected with E manuals and develop suitable algorithm to exploit it. We collect E Manual Corpus, a huge corpus of 307,957 E manuals and pretrain RoBERTa on this large corpus. We create various benchmark QA datasets which include question answer pairs curated by experts based upon two E manuals, real user questions from Community Question Answering Forum pertaining to E manuals etc. We introduce EMQAP (E Manual Question Answering Pipeline) that answers questions pertaining to electronics devices. Built upon the pretrained RoBERTa, it harbors a supervised multi task learning framework which efficiently performs the dual tasks of identifying the section in the E manual where the answer can be found and the exact answer span within that section. For E Manual annotated question answer pairs, we show an improvement of about 40 in ROUGE L F1 scores over the most competitive baseline. We perform a detailed ablation study and establish the versatility of EMQAP across different circumstances. The code and datasets are shared at https github.com abhi1nandy2 EMNLP 2021 Findings, and the corresponding project website is https sites.google.com view emanualqa home.


Reinforcement Learning Based Safe Decision Making for Highway Autonomous Driving. In this paper, we develop a safe decision making method for self driving cars in a multi lane, single agent setting. The proposed approach utilizes deep reinforcement learning (RL) to achieve a high level policy for safe tactical decision making. We address two major challenges that arise solely in autonomous navigation. First, the proposed algorithm ensures that collisions never happen, and therefore accelerate the learning process. Second, the proposed algorithm takes into account the unobservable states in the environment. These states appear mainly due to the unpredictable behavior of other agents, such as cars, and pedestrians, and make the Markov Decision Process (MDP) problematic when dealing with autonomous navigation. Simulations from a well known self driving car simulator demonstrate the applicability of the proposed method


Learning Reward Machines A Study in Partially Observable Reinforcement Learning. Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment where the optimal behaviour is defined with respect to a reward signal that the agent seeks to maximize. Reward machines (RMs) provide a structured, automata based representation of a reward function that enables an RL agent to decompose an RL problem into structured subproblems that can be efficiently learned via off policy learning. Here we show that RMs can be learned from experience, instead of being specified by the user, and that the resulting problem decomposition can be used to effectively solve partially observable RL problems. We pose the task of learning RMs as a discrete optimization problem where the objective is to find an RM that decomposes the problem into a set of subproblems such that the combination of their optimal memoryless policies is an optimal policy for the original problem. We show the effectiveness of this approach on three partially observable domains, where it significantly outperforms A3C, PPO, and ACER, and discuss its advantages, limitations, and broader potential.


Metrics and Design of an Instruction Roofline Model for AMD GPUs. Due to the recent announcement of the Frontier supercomputer, many scientific application developers are working to make their applications compatible with AMD architectures (CPU GPU), which means moving away from the traditional CPU and NVIDIA GPU systems. Due to the current limitations of profiling tools for AMD GPUs, this shift leaves a void in how to measure application performance on AMD GPUs. In this paper, we design an instruction roofline model for AMD GPUs using AMD's ROCProfiler and a benchmarking tool, BabelStream (the HIP implementation), as a way to measure an application's performance in instructions and memory transactions on new AMD hardware. Specifically, we create instruction roofline models for a case study scientific application, PIConGPU, an open source particle in cell (PIC) simulations application used for plasma and laser plasma physics on the NVIDIA V100, AMD Radeon Instinct MI60, and AMD Instinct MI100 GPUs. When looking at the performance of multiple kernels of interest in PIConGPU we find that although the AMD MI100 GPU achieves a similar, or better, execution time compared to the NVIDIA V100 GPU, profiling tool differences make comparing performance of these two architectures hard. When looking at execution time, GIPS, and instruction intensity, the AMD MI60 achieves the worst performance out of the three GPUs used in this work.


Privacy preserving methods for smart meter based network simulations. Smart meters are a key component of energy transition. The large amount of data collected in near real time allows grid operators to observe and simulate network states. However, privacy preserving rules forbid the use of such data for any applications other than network operation and billing. Smart meter measurements must be anonymised to transmit these sensitive data to a third party to perform network simulation and analysis. This work proposes two methods for data anonymisation that enable the use of raw active power measurements for network simulation and analysis. The first is based on an allocation of an externally sourced load database. The second consists of grouping smart meter data with similar electric characteristics, then performing a random permutation of the network load bus assignment. A benchmark of these two methods highlights that both provide similar results in bus voltage magnitude estimation concerning ground truth voltage.


NeuFENet Neural Finite Element Solutions with Theoretical Bounds for Parametric PDEs. We consider a mesh based approach for training a neural network to produce field predictions of solutions to parametric partial differential equations (PDEs). This approach contrasts current approaches for "neural PDE solvers" that employ collocation based methods to make point wise predictions of solutions to PDEs. This approach has the advantage of naturally enforcing different boundary conditions as well as ease of invoking well developed PDE theory including analysis of numerical stability and convergence to obtain capacity bounds for our proposed neural networks in discretized domains. We explore our mesh based strategy, called NeuFENet, using a weighted Galerkin loss function based on the Finite Element Method (FEM) on a parametric elliptic PDE. The weighted Galerkin loss (FEM loss) is similar to an energy functional that produces improved solutions, satisfies a priori mesh convergence, and can model Dirichlet and Neumann boundary conditions. We prove theoretically, and illustrate with experiments, convergence results analogous to mesh convergence analysis deployed in finite element solutions to PDEs. These results suggest that a mesh based neural network approach serves as a promising approach for solving parametric PDEs with theoretical bounds.


User, Robot, Deployer A New Model for Measuring Trust in HRI. There is an increasing interest in considering, implementing, and measuring trust in human robot interaction (HRI). Typically, this centres on influencing user trust within the framing of HRI as a dyadic interaction between robot and user. We propose this misses a key complexity a robot's trustworthiness may also be contingent on the user's relationship with, and opinion of, the individual or organisation deploying the robot. Our new HRI triad model (User, Robot, Deployer), offers novel predictions for considering and measuring trust more completely.


Semantically enriched spatial modelling of industrial indoor environments enabling location based services. This paper presents a concept for a software system called RAIL representing industrial indoor environments in a dynamic spatial model, aimed at easing development and provision of location based services. RAIL integrates data from different sensor modalities and additional contextual information through a unified interface. Approaches to environmental modelling from other domains are reviewed and analyzed for their suitability regarding the requirements for our target domains intralogistics and production. Subsequently a novel way of modelling data representing indoor space, and an architecture for the software system are proposed.


Memetic Scheme for Inverse Design Using an Exact Reanalysis of Method of Moments Models Part 2 Examples and Properties. Memetics for shape synthesis, introduced in Part 1, is examined on antenna design examples. It combines local and global techniques to accelerate convergence and to maintain robustness. Method of moments matrices are used to evaluate objective functions. By applying the Shermann Morrison Woodbury identity, the repetitively performed structural update is inversion free yet full wave in nature. The technique can easily be combined with additional features often required in practice, e.g., only a part of the structure is controllable or evaluation of an objective function is required in a subdomain only. The framework supports multi frequency and multi port optimization and offers many other advantages, such as an actual shape being known at every moment of the optimization. The performance of the method is assessed, including its convergence and computational cost.


On the asymptotics of the meromorphic 3D index. In their recent work, Garoufalidis and Kashaev extended the 3D index of an ideally triangulated 3 manifold with toroidal boundary to a well defined topological invariant which takes the form of a meromorphic function of 2 complex variables per boundary component and which depends additionally on a quantisation parameter q. In this paper, we study the asymptotics of this invariant as q approaches 1, developing a conjectural asymptotic approximation in the form of a sum of contributions associated to certain flat PSL(2,C) bundles on the manifold. Furthermore, we study the coefficients appearing in these contributions, which include the hyperbolic volume, the '1 loop invariant' of Dimofte and Garoufalidis, as well as a new topological invariant of 3 manifolds with torus boundary, which we call the 'beta invariant'. The technical heart of our analysis is the expression of the state integral of the Garoufalidis Kashaev invariant as an integral over a certain connected component of the space of circle valued angle structures. To explain the topological significance of this component, we develop a theory connecting circle valued angle structures to the obstruction theory for lifting a (boundary parabolic) PSL(2,C) representation of the fundamental group to a (boundary unipotent) SL(2,C) representation. We present strong theoretical and numerical evidence for the validity of our asymptotic approximations.


Multidimensional coupling A variationally consistent approach to fiber reinforced materials. A novel mathematical model for fiber reinforced materials is proposed. It is based on a 1 dimensional beam model for the thin fiber structures, a flexible and general 3 dimensional elasticity model for the matrix and an overlapping domain decomposition approach. From a computational point of view, this is motivated by the fact that matrix and fibers can easily meshed independently. Our main interest is in fiber reinforce polymers where the Young's modulus are quite different. Thus the modeling error from the overlapping approach is of no significance. The coupling conditions acknowledge both, the forces and the moments of the beam model and transfer them to the background material. A suitable static condensation procedure is applied to remove the beam balance equations. The condensed system then forms our starting point for a numerical approximation in terms of isogeometric analysis. The choice of our discrete basis functions of higher regularity is motivated by the fact, that as a result of the static condensation, we obtain second gradient terms in fiber direction. Eventually, a series of benchmark tests demonstrate the flexibility and robustness of the proposed methodology. As a proof of concept, we show that our new model is able to capture bending, torsion and shear dominated situations.


Instance weighted Central Similarity for Multi label Image Retrieval. Deep hashing has been widely applied to large scale image retrieval by encoding high dimensional data points into binary codes for efficient retrieval. Compared with pairwise triplet similarity based hash learning, central similarity based hashing can more efficiently capture the global data distribution. For multi label image retrieval, however, previous methods only use multiple hash centers with equal weights to generate one centroid as the learning target, which ignores the relationship between the weights of hash centers and the proportion of instance regions in the image. To address the above issue, we propose a two step alternative optimization approach, Instance weighted Central Similarity (ICS), to automatically learn the center weight corresponding to a hash code. Firstly, we apply the maximum entropy regularizer to prevent one hash center from dominating the loss function, and compute the center weights via projection gradient descent. Secondly, we update neural network parameters by standard back propagation with fixed center weights. More importantly, the learned center weights can well reflect the proportion of foreground instances in the image. Our method achieves the state of the art performance on the image retrieval benchmarks, and especially improves the mAP by 1.6 6.4 on the MS COCO dataset.


Quasifibrations in configuration Lie groupoids and orbifold braid groups. In 19 we studied a Fadell Neuwirth type fibration theorem for orbifolds, and gave a short exact sequence of fundamental groups of configuration Lie groupoids of Lie groupoids corresponding to the genus zero 2 dimensional orbifolds with cone points, and at least one puncture. In this paper we extend this work to all genus geq 1 , 2 dimensional orbifolds with cone points. As a consequence, we prove the Farrell Jones Isomorphism conjecture for the fundamental groups of the associated configuration Lie groupoids. This answers a substantial part of a question we posed in 18 , Problem . In 19 we also showed that for all global quotient type orbifolds, the fibration theorem does not hold. Here, we give some nontrivial examples of orbifolds where a Fadell Neuwirth type quasifibration theorem holds. Finally, we state an Asphericity conjecture and a Quasifibration conjecture for orbifolds.


Vestibular Drop Attacks and Meniere's Disease as Results of Otolithic Membrane Damage A Numerical Model. BACKGROUND Meniere's Disease (MD) is a condition of the inner ear with symptoms affecting both vestibular and hearing functions. Some patients with MD experience vestibular drop attacks (VDAs), which are violent falls caused by spurious vestibular signals from the utricle and or saccule. Recent surgical work has shown that patients who experience VDAs also show distrupted utricular otolithic membranes. OBJECTIVE The objective of this study is to determine if otolithic membrane damage alone is sufficient to induce spurious vestibular signals, thus potentially eliciting VDAs and the vestibular dysfunction seen in patients with MD. METHODS We use a previously developed numerical model to describe the nonlinear dynamics of an array of active, elastically coupled hair cells. We then reduce the coupling strength of a selected region of the membrane to model the effects of tissue damage. RESULTS As we reduce the coupling strength, we observe large and abrupt spikes in hair bundle position. As bundle displacements from the equilibrium position have been shown to lead to depolarization of the hair cell soma and hence trigger neural activity, this spontaneous activity could elicit false detection of a vestibular signal. CONCLUSIONS The results of this numerical model suggest that otolithic membrane damage alone may be sufficient to induce VDAs and the vestibular dysfunction seen in patients with MD. Future experimental work is needed to confirm these results in vitro.


VP GO a "light" action conditioned visual prediction model. Visual prediction models are a promising solution for visual based robotic grasping of cluttered, unknown soft objects. Previous models from the literature are computationally greedy, which limits reproducibility although some consider stochasticity in the prediction model, it is often too weak to catch the reality of robotics experiments involving grasping such objects. Furthermore, previous work focused on elementary movements that are not efficient to reason in terms of more complex semantic actions. To address these limitations, we propose VP GO, a light'' stochastic action conditioned visual prediction model. We propose a hierarchical decomposition of semantic grasping and manipulation actions into elementary end effector movements, to ensure compatibility with existing models and datasets for visual prediction of robotic actions such as RoboNet. We also record and release a new open dataset for visual prediction of object grasping, called PandaGrasp. Our model can be pre trained on RoboNet and fine tuned on PandaGrasp, and performs similarly to more complex models in terms of signal prediction metrics. Qualitatively, it outperforms when predicting the outcome of complex grasps performed by our robot.


Machine Vision based Sample Tube Localization for Mars Sample Return. A potential Mars Sample Return (MSR) architecture is being jointly studied by NASA and ESA. As currently envisioned, the MSR campaign consists of a series of 3 missions sample cache, fetch and return to Earth. In this paper, we focus on the fetch part of the MSR, and more specifically the problem of autonomously detecting and localizing sample tubes deposited on the Martian surface. Towards this end, we study two machine vision based approaches First, a geometry driven approach based on template matching that uses hard coded filters and a 3D shape model of the tube and second, a data driven approach based on convolutional neural networks (CNNs) and learned features. Furthermore, we present a large benchmark dataset of sample tube images, collected in representative outdoor environments and annotated with ground truth segmentation masks and locations. The dataset was acquired systematically across different terrain, illumination conditions and dust coverage and benchmarking was performed to study the feasibility of each approach, their relative strengths and weaknesses, and robustness in the presence of adverse environmental conditions.


Real time Forecasting of Dockless Scooter Sharing Demand A Context Aware Spatio Temporal Multi Graph Convolutional Network Approach. Real time demand forecasting for shared micromobility can greatly enhance its potential benefits and mitigate its adverse effects on urban mobility. The deep learning models provide researchers powerful tools to deal with the real time dockless scooter sharing demand prediction problem, but existing studies have not fully incorporated the features that are highly associated with the demand, such as weather conditions, demographic characteristics, and transportation supply. This paper proposes a novel deep learning model named Context Aware Spatio Temporal Multi Graph Convolutional Network (CA STMGCN) to forecast the real time spatiotemporal dockless scooter sharing demand. The proposed model applies a graph convolutional network (GCN) component that uses spatial adjacency graph, functional similarity graph, demographic similarity graph, and transportation supply similarity graph as input to extract spatial dependency and attach it to historical demand data. Then, we use a gated recurrent unit component to process the output of GCN and weather condition data to capture temporal dependency. A fully connected neural network layer is used to generate the final prediction. The proposed model is evaluated using the real world dockless scooter sharing demand data in Washington, D.C. The results show that CA STMGCN significantly outperforms all the selected benchmark models, and the most important model component is the weather information. The proposed model can help the operators develop optimal vehicle rebalancing schemes and guide cities to regulate the dockless scooter sharing usage.


Towards Multi Criteria Prioritization of Best Practices in Research Artifact Sharing. Research artifact sharing is known to strengthen the transparency of scientific studies. However, in the lack of common discipline specific guidelines for artifacts evaluation, subjective and conflicting expectations may happen and threaten artifact quality. In this paper, we discuss our preliminary ideas for a framework based on quality management principles (5W2H) that can aid in the establishment of common guidelines for artifact evaluation and sharing. Also, using the Analytic Hierarchy Process, we discuss how research communities could join efforts to aid the guidelines' adequacy to research priorities. These combined methodologies constitute a novelty for software engineering research which can foster research software sustainability.


Predicting Chemical Hazard across Taxa through Machine Learning. We applied machine learning methods to predict chemical hazards focusing on fish acute toxicity across taxa. We analyzed the relevance of taxonomy and experimental setup, showing that taking them into account can lead to considerable improvements in the classification performance. We quantified the gain obtained throught the introduction of taxonomic and experimental information, compared to classification based on chemical information alone. We used our approach with standard machine learning models (K nearest neighbors, random forests and deep neural networks), as well as the recently proposed Read Across Structure Activity Relationship (RASAR) models, which were very successful in predicting chemical hazards to mammals based on chemical similarity. We were able to obtain accuracies of over 93 on datasets where, due to noise in the data, the maximum achievable accuracy was expected to be below 96 . The best performances were obtained by random forests and RASAR models. We analyzed metrics to compare our results with animal test reproducibility, and despite most of our models "outperform animal test reproducibility" as measured through recently proposed metrics, we showed that the comparison between machine learning performance and animal test reproducibility should be addressed with particular care. While we focused on fish mortality, our approach, provided that the right data is available, is valid for any combination of chemicals, effects and taxa.


A preliminary result for generalized intersecting families. Intersecting families and blocking sets feature prominently in extremal combinatorics. We examine the following generalization of an intersecting family investigated by Hajnal, Rothschild, and others. If s geq 1 , k geq 2 , and u geq 1 are integers, then say that an s uniform family mathcal F is (k,u) intersecting if for all A 1, A 2, cdots, A k in mathcal F , A i cap A j geq u for some 1 leq i j leq k . In this note, we investigate the following parameter. If s , k , u , ell are integers satisfying s geq 1 , k geq 2 , 1 leq u leq s , and 2 leq ell k , then let N (u) k, ell (s) denote the smallest integer r , if it exists, such that any (k,u) intersecting s uniform family is the union of at most r families that are ( ell,u) intersecting. Using a Sunflower Lemma type argument, we prove that N (u) k, ell (s) always exists and that the following inequality always holds N (u) k, ell (s) leq bigg lceil dfrac k 1 ell 1 cdot s choose u bigg rceil


A generalization of the Picard theorem. We recall the notions of conformal and quasiconformal mappings textit in the sense of Gromov , extending the classical notions of conformal and quasiconformal mappings, and prove the following theorem. em If the mapping F mathbb R n to mathbb R 2 , where n geq 2 , quasiconformal in the sense of Gromov, omits more than one value on the plane mathbb R 2 , then it is a constant mapping.


Revisiting, Benchmarking and Exploring API Recommendation How Far Are We?. Application Programming Interfaces (APIs), which encapsulate the implementation of specific functions as interfaces, greatly improve the efficiency of modern software development. As numbers of APIs spring up nowadays, developers can hardly be familiar with all the APIs, and usually need to search for appropriate APIs for usage. So lots of efforts have been devoted to improving the API recommendation task. However, it has been increasingly difficult to gauge the performance of new models due to the lack of a uniform definition of the task and a standardized benchmark. For example, some studies regard the task as a code completion problem while others recommend relative APIs given natural language queries. To reduce the challenges and better facilitate future research, in this paper, we revisit the API recommendation task and aim at benchmarking the approaches. Specifically, the paper groups the approaches into two categories according to the task definition, i.e., query based API recommendation and code based API recommendation. We study 11 recently proposed approaches along with 4 widely used IDEs. One benchmark named as APIBench is then built for the two respective categories of approaches. Based on APIBench, we distill some actionable insights and challenges for API recommendation. We also achieve some implications and directions for improving the performance of recommending APIs, including data source selection, appropriate query reformulation, low resource setting, and cross domain adaptation.