Equi Lipschitz minimizing trajectories for non coercive, discontinuous, non convex Bolza controlled linear optimal control problems. This article deals with the Lipschitz regularity of the ''approximate minimizers for the Bolza type control functional of the form J t(y,u) int t T Lambda(s,y(s), u(s)) ,ds g(y(T)) among the pairs (y,u) satisfying a prescribed initial condition y(t) x , where the state y is absolutely continuous, the control u is summable and the dynamic is controlled linear of the form y' b(y)u . For b equiv 1 the above becomes a problem of the calculus of variations. The Lagrangian Lambda(s,y,u) is assumed to be either convex in the variable u on every half line from the origin (radial convexity in u ), or partial differentiable in the control variable and satisfies a local Lipschitz regularity on the time variable, named Condition (S). It is allowed to be extended valued, discontinuous in y or in u , and non convex in u . We assume a very mild growth condition, that is fulfilled if the Lagrangian is coercive as well as in some almost linear cases. The main result states that, given any admissible pair (y,u) , there exists a more convenient admissible pair ( overline y, overline u) for J t where overline u is bounded, overline y is Lipschitz, with bounds and ranks that are uniform with respect to t,x in the compact subsets of 0,T times mathbb R n . The result is new even in the superlinear case. As a consequence, there are minimizing sequences that are formed by pairs of equi Lipschitz trajectories and equi bounded controls. A new existence and regularity result follows without assuming any kind of Lipschitzianity in the state variable. We deduce, without any need of growth conditions, the nonoccurrence of the Lavrentiev phenomenon for a wide class of Lagrangians containing those that satisfy Condition (S), are bounded on bounded sets well'' inside the effective domain and are radially convex in the control variable.


Obtaining Calibrated Probabilities with Personalized Ranking Models. For personalized ranking models, the well calibrated probability of an item being preferred by a user has great practical value. While existing work shows promising results in image classification, probability calibration has not been much explored for personalized ranking. In this paper, we aim to estimate the calibrated probability of how likely a user will prefer an item. We investigate various parametric distributions and propose two parametric calibration methods, namely Gaussian calibration and Gamma calibration. Each proposed method can be seen as a post processing function that maps the ranking scores of pre trained models to well calibrated preference probabilities, without affecting the recommendation performance. We also design the unbiased empirical risk minimization framework that guides the calibration methods to learning of true preference probability from the biased user item interaction dataset. Extensive evaluations with various personalized ranking models on real world datasets show that both the proposed calibration methods and the unbiased empirical risk minimization significantly improve the calibration performance.


Sectors, Beams and Environmental Impact on the Performance of Commercial 5G mmWave Cells an Empirical Study. While the performance of mmWave links has been thoroughly investigated by simulations or testbeds, the behavior of this technology in real world commercial setups has not yet been thoroughly documented. In this paper, we address this gap and present the results of an empirical study to determine the actual performance of a commercial 5G mmWave cell through on field measurements. We evaluate the signal and beam coverage map of an operational network as well as the end to end communication performance of a 5G mmWave connection, considering various scenarios, including human body blockage effects, foliage caused and rain induced attenuation, and water surface effects. To the best of our knowledge, this paper is the first to report on a commercial deployment while not treating the radio as a black box. Measurement results are compared with 3GPP's statistical channel models for mmWave to check the possible gaps between simulated and actual performance. This measurement analysis provides valuable information for researchers and 5G verticals to fully understand how a 5G mmWave commercial access network operates in real world, under various operational conditions, with buildings, humans, trees, water surfaces, etc.


Integration of activation maps of epicardial veins in computational cardiac electrophysiology. In this work we address the issue of validating the monodomain equation used in combination with the Bueno Orovio ionic model for the prediction of the activation times in cardiac electro physiology of the left ventricle. To this aim, we consider our patients who suffered from Left Bundle Branch Block (LBBB). We use activation maps performed at the septum as input data for the model and maps at the epicardial veins for the validation. In particular, a first set (half) of the latter are used to estimate the conductivities of the patient and a second set (the remaining half) to compute the errors of the numerical simulations. We find an excellent agreement between measures and numerical results. Our validated computational tool could be used to accurately predict activation times at the epicardial veins with a short mapping, i.e. by using only a part (the most proximal) of the standard acquisition points, thus reducing the invasive procedure and exposure to radiation.


Defending against Backdoor Attacks in Natural Language Generation. The frustratingly fragile nature of neural network models make current natural language generation (NLG) systems prone to backdoor attacks and generate malicious sequences that could be sexist or offensive. Unfortunately, little effort has been invested to how backdoor attacks can affect current NLG models and how to defend against these attacks. In this work, we investigate this problem on two important NLG tasks, machine translation and dialogue generation. By giving a formal definition for backdoor attack and defense, and developing corresponding benchmarks, we design methods to attack NLG models, which achieve high attack success to ask NLG models to generate malicious sequences. To defend against these attacks, we propose to detect the attack trigger by examining the effect of deleting or replacing certain words on the generation outputs, which we find successful for certain types of attacks. We will discuss the limitation of this work, and hope this work can raise the awareness of backdoor risks concealed in deep NLG systems. (Code and data are available at https github.com ShannonAI backdoor nlg.)


Program Synthesis Guided Reinforcement Learning for Partially Observed Environments. A key challenge for reinforcement learning is solving long horizon planning problems. Recent work has leveraged programs to guide reinforcement learning in these settings. However, these approaches impose a high manual burden on the user since they must provide a guiding program for every new task. Partially observed environments further complicate the programming task because the program must implement a strategy that correctly, and ideally optimally, handles every possible configuration of the hidden regions of the environment. We propose a new approach, model predictive program synthesis (MPPS), that uses program synthesis to automatically generate the guiding programs. It trains a generative model to predict the unobserved portions of the world, and then synthesizes a program based on samples from this model in a way that is robust to its uncertainty. In our experiments, we show that our approach significantly outperforms non program guided approaches on a set of challenging benchmarks, including a 2D Minecraft inspired environment where the agent must complete a complex sequence of subtasks to achieve its goal, and achieves a similar performance as using handcrafted programs to guide the agent. Our results demonstrate that our approach can obtain the benefits of program guided reinforcement learning without requiring the user to provide a new guiding program for every new task.


Towards highly accurate calculations of parity violation in chiral molecules relativistic coupled cluster theory including QED effects. Parity violating energies E PV of the H 2X 2 X O, S, Se, Te, Po) molecules are reported, calculated as analytical expectation values at the relativistic coupled cluster singles and doubles (CCSD) level using property optimized basis sets. Radiative corrections to the E PV was investigated using effective QED potentials and found to reach a maximal value of 2.38 for H 2Po 2 . However, this result depends on the choice of effective self energy potential and may indicate limitations to their domain of validity.


A Fragile Points Method, with an interface debonding model, to simulate damage and fracture of U notched structures. Notched components are commonly used in engineering structures, where stress concentration may easily lead to crack initiation and development. The main goal of this work is to develop a simple numerical method to predict the structural strength and crack growth path of U notched specimens made of brittle materials. For this purpose, the Fragile Points Method (FPM), as previously proposed by the authors, has been augmented by an interface debonding model at the interfaces of the FPM domains, to simulate crack initiation and development. The formulations of FPM are based on a discontinuous Galerkin weak form where point based piece wise continuous polynomial test and trial functions are used instead of element based basis functions. In this work, the numerical fluxes introduced across interior interfaces between subdomains are postulated as the tractions acting on the interface derived from an interface damage model. The interface damage is triggered when the numerical flux reaches the interface strength, and the process of crack surface separation is governed by the fracture energy. In this way, arbitrary crack initiation and propagation can be naturally simulated without the need for knowing the fracture patch before hand. Additionally, a small penalty parameter is sufficient to enforce the weak form continuity condition before damage initiation, without causing problems such as artificial compliance and numerical ill conditioning. As validations, the proposed FPM method with the interface damage model is used to predict the structural strength and crack development from U notched structures made of brittle materials, which is useful but challenging in engineering structural design practices.


WLAN Log Based Superspreader Detection in the COVID 19 Pandemic. Identifying "superspreaders" of disease is a pressing concern for society during pandemics such as COVID 19. Superspreaders represent a group of people who have much more social contacts than others. The widespread deployment of WLAN infrastructure enables non invasive contact tracing via people's ubiquitous mobile devices. This technology offers promise for detecting superspreaders. In this paper, we propose a general framework for WLAN log based superspreader detection. In our framework, we first use WLAN logs to construct contact graphs by jointly considering human symmetric and asymmetric interactions. Next, we adopt three vertex centrality measurements over the contact graphs to generate three groups of superspreader candidates. Finally, we leverage SEIR simulation to determine groups of superspreaders among these candidates, who are the most critical individuals for the spread of disease based on the simulation results. We have implemented our framework and evaluate it over a WLAN dataset with 41 million log entries from a large scale university. Our evaluation shows superspreaders exist on university campuses. They change over the first few weeks of a semester, but stabilize throughout the rest of the term. The data also demonstrate that both symmetric and asymmetric contact tracing can discover superspreaders, but the latter performs better with daily contact graphs. Further, the evaluation shows no consistent differences among three vertex centrality measures for long term (i.e., weekly) contact graphs, which necessitates the inclusion of SEIR simulation in our framework. We believe our proposed framework and these results may provide timely guidance for public health administrators regarding effective testing, intervention, and vaccination policies.


Understanding and Evaluating Racial Biases in Image Captioning. Image captioning is an important task for benchmarking visual reasoning and for enabling accessibility for people with vision impairments. However, as in many machine learning settings, social biases can influence image captioning in undesirable ways. In this work, we study bias propagation pathways within image captioning, focusing specifically on the COCO dataset. Prior work has analyzed gender bias in captions using automatically derived gender labels here we examine racial and intersectional biases using manual annotations. Our first contribution is in annotating the perceived gender and skin color of 28,315 of the depicted people after obtaining IRB approval. Using these annotations, we compare racial biases present in both manual and automatically generated image captions. We demonstrate differences in caption performance, sentiment, and word choice between images of lighter versus darker skinned people. Further, we find the magnitude of these differences to be greater in modern captioning systems compared to older ones, thus leading to concerns that without proper consideration and mitigation these differences will only become increasingly prevalent. Code and data is available at https princetonvisualai.github.io imagecaptioning bias .


On the topological complexity of toral relatively hyperbolic groups. We prove that the topological complexity mathrm TC ( pi) equals mathrm cd ( pi times pi) for certain toral relatively hyperbolic groups pi .


Get Fooled for the Right Reason Improving Adversarial Robustness through a Teacher guided Curriculum Learning Approach. Current SOTA adversarially robust models are mostly based on adversarial training (AT) and differ only by some regularizers either at inner maximization or outer minimization steps. Being repetitive in nature during the inner maximization step, they take a huge time to train. We propose a non iterative method that enforces the following ideas during training. Attribution maps are more aligned to the actual object in the image for adversarially robust models compared to naturally trained models. Also, the allowed set of pixels to perturb an image (that changes model decision) should be restricted to the object pixels only, which reduces the attack strength by limiting the attack space. Our method achieves significant performance gains with a little extra effort (10 20 ) over existing AT models and outperforms all other methods in terms of adversarial as well as natural accuracy. We have performed extensive experimentation with CIFAR 10, CIFAR 100, and TinyImageNet datasets and reported results against many popular strong adversarial attacks to prove the effectiveness of our method.


An Index for Single Source All Destinations Distance Queries in Temporal Graphs. A typical task in temporal graphs analysis is answering single source all destination (SSAD) temporal distance queries. An SSAD query starting at a vertex v asks for the temporal distances, e.g., durations or earliest arrival times between v and all other vertices. We introduce an index to speed up SSAD temporal distance queries called Substream index. The indexing is based on the construction of k subgraphs and a mapping from the vertices to the subgraphs. Each subgraph contains the temporal edges sufficient to answer queries starting from any vertex mapped to the subgraph. We answer a query starting at a vertex v with a single pass over the edges of the subgraph. Our index supports dynamic updates, i.e., efficient insertion and deletion of temporal edges. Unfortunately, deciding if a Substream index of a given size exists is NP complete. However, we provide an efficient greedy approximation that constructs an index at most k delta times larger than an optimal index where delta , with 1 leq delta leq k , depends on the temporal and spatial structure of the graph. Moreover, we improve the running time of the approximation in three ways. First, we use an auxiliary index called Time Skip index to speed up the construction and queries by skipping edges that do not need to be considered. Next, we apply min hashing to avoid costly union operations. Finally, we use parallelization to take the parallel processing capabilities of modern processors into account. An extensive evaluation using real world temporal networks shows the efficiency and effectiveness of our indices, and query times are significantly improved for all data sets.


An Efficient Vectorization Scheme for Stencil Computation. Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization and tiling techniques, aiming at exploiting the in core data parallelism and data locality respectively. In this paper, the downsides of existing vectorization schemes are analyzed. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. Then we propose a novel transpose layout to preserve the data locality for tiling and reduce the data reorganization overhead for vectorization simultaneously. To further improve the data reuse at the register level, a time loop unroll and jam strategy is designed to perform multistep stencil computation along the time dimension. Experimental results on the AVX 2 and AVX 512 CPUs show that our approach obtains a competitive performance.


Universality of Weyl Unitaries. Weyl's unitary matrices, which were introduced in Weyl's 1927 paper on group theory and quantum mechanics, are p times p unitary matrices given by the diagonal matrix whose entries are the p th roots of unity and the cyclic shift matrix. Weyl's unitaries, which we denote by mathfrak u and mathfrak v , satisfy mathfrak u p mathfrak v p 1 p (the p times p identity matrix) and the commutation relation mathfrak u mathfrak v zeta mathfrak v mathfrak u , where zeta is a primitive p th root of unity. We prove that Weyl's unitary matrices are universal in the following sense if u and v are any d times d unitary matrices such that u p v p 1 d and u v zeta vu , then there exists a unital completely positive linear map phi mathcal M p( mathbb C) rightarrow mathcal M d( mathbb C) such that phi( mathfrak u) u and phi( mathfrak v) v . We also show, moreover, that any two pairs of p th order unitary matrices that satisfy the Weyl commutation relation are completely order equivalent. When p 2 , the Weyl matrices are two of the three Pauli matrices from quantum mechanics. It was recently shown that g tuples of Pauli Weyl Brauer unitaries are universal for all g tuples of anticommuting selfadjoint unitary matrices however, we show here that the analogous result fails for positive integers p 2 . Finally, we show that the Weyl matrices are extremal in their matrix range, using recent ideas from noncommutative convexity theory.


A doubly monotone flow for constant width bodies in mathbb R 3 . We introduce a flow in the space of constant width bodies in three dimensional Euclidean space that simultaneously increases the volume and decreases the circumradius of the shape as time increases. Starting from any initial constant width figure, we show that the flow exists for all positive times and converges to a closed ball as time tends to plus infinity. We also anticipate that this flow is interesting to study for negative times and that it would provide a mechanism to decrease the volume and increase the circumradius of a constant width body.


Neural Implicit Event Generator for Motion Tracking. We present a novel framework of motion tracking from event data using implicit expression. Our framework use pre trained event generation MLP named implicit event generator (IEG) and does motion tracking by updating its state (position and velocity) based on the difference between the observed event and generated event from the current state estimate. The difference is computed implicitly by the IEG. Unlike the conventional explicit approach, which requires dense computation to evaluate the difference, our implicit approach realizes efficient state update directly from sparse event data. Our sparse algorithm is especially suitable for mobile robotics applications where computational resources and battery life are limited. To verify the effectiveness of our method on real world data, we applied it to the AR marker tracking application. We have confirmed that our framework works well in real world environments in the presence of noise and background clutter.


Strongly singular convective elliptic equations in RN driven by a non homogeneous operator. Existence of a generalized solution to a strongly singular convective elliptic equation in the whole space is established. The differential operator, patterned after the (p,q) Laplacian, can be non homogeneous. The result is obtained by solving some regularized problems through fixed point theory, variational methods and compactness results, besides exploiting nonlinear regularity theory and comparison principles.


LENS Localization enhanced by NeRF synthesis. Neural Radiance Fields (NeRF) have recently demonstrated photo realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem we demonstrate improvement of camera pose regression thanks to an additional synthetic dataset rendered by the NeRF class of algorithm. To avoid spawning novel views in irrelevant places we selected virtual camera locations from NeRF internal representation of the 3D geometry of the scene. We further improved localization accuracy of pose regressors using synthesized realistic and geometry consistent images as data augmentation during training. At the time of publication, our approach improved state of the art with a 60 lower error on Cambridge Landmarks and 7 scenes datasets. Hence, the resulting accuracy becomes comparable to structure based methods, without any architecture modification or domain adaptation constraints. Since our method allows almost infinite generation of training data, we investigated limitations of camera pose regression depending on size and distribution of data used for training on public benchmarks. We concluded that pose regression accuracy is mostly bounded by relatively small and biased datasets rather than capacity of the pose regression model to solve the localization task.


On the variation of of bi periodic waves in the transverse direction. Bi periodic patterns of waves that propagate in the x direction with amplitude variation in the y direction are generated in a laboratory. The amplitude variation in the y direction is studied within the framework of the vector (vNLSE) and scalar (sNLSE) nonlinear Schrodinger equations using the uniform amplitude, Stokes like solution of the vNLSE and the Jacobi elliptic sine function solution of the sNLSE. The wavetrains are generated using the Stokes like solution of vNLSE however, a comparison of both predictions shows that while they both do a reasonably good job of predicting the observed amplitude variation in y, the comparison with the elliptic function solution of the sNLSE has significantly less error. Additionally, for agreement with the vNLSE solution, a third harmonic in y term from a Stokes type expansion of interacting, symmetric wavetrains must be included. There is no evidence of instability growth in the x direction, consistent with the work of Segur and colleagues, who showed that dissipation stabilizes the modulational instability. There is some extra amplitude variation in y, which is examined via a qualitative stability calculation that allows symmetry breaking in that direction.


A Characterisation of Smart Grid DoS Attacks. Traditional power grids are evolving to keep pace with the demands of the modern age. Smart grids contain integrated IT systems for better management and efficiency, but in doing so, also inherit a plethora of cyber security threats and vulnerabilities. Denial of Service (DoS) is one such threat. At the same time, the smart grid has particular characteristics (e.g. minimal delay tolerance), which can influence the nature of threats and so require special consideration. In this paper, we identify a set of possible smart grid specific DoS scenarios based on current research, and analyse them in the context of the grid components they target. Based on this, we propose a novel target based classification scheme and further characterise each scenario by qualitatively exploring it in the context of the underlying grid infrastructure. This culminates in a smart grid centric analysis of the threat to reveal the nature of DoS in this environment.


Development of Soft Tactile Sensor for Force Measurement and Position Detection. As more robots are implemented for contact rich tasks, tactile sensors are in increasing demand. For many circumstances, the contact is required to be compliant, and soft sensors are in need. This paper introduces a novelly designed soft sensor that can simultaneously estimate the contact force and contact location. Inspired by humans' skin, which contains multi layers of receptors, the designed tactile sensor has a dual layer structure. The first layer is made of a conductive fabric that is responsible for sensing the contact force. The second layer is composed of four small conductive rubbers that can detect the contact location. Signals from the two layers are firstly processed by Wheatstone bridges and amplifier circuits so that the measurement noises are eliminated, and the sensitivity is improved. An Arduino chip is used for processing the signal and analyzing the data. The contact force can be obtained by a pre trained model that maps from the voltage to force, and the contact location is estimated by the voltage signal from the conductive rubbers in the second layer. In addition, filtering methods are applied to eliminate the estimation noise. Finally, experiments are provided to show the accuracy and robustness of the sensor.


3D Siamese Voxel to BEV Tracker for Sparse Point Clouds. 3D object tracking in point clouds is still a challenging problem due to the sparsity of LiDAR points in dynamic environments. In this work, we propose a Siamese voxel to BEV tracker, which can significantly improve the tracking performance in sparse 3D point clouds. Specifically, it consists of a Siamese shape aware feature learning network and a voxel to BEV target localization network. The Siamese shape aware feature learning network can capture 3D shape information of the object to learn the discriminative features of the object so that the potential target from the background in sparse point clouds can be identified. To this end, we first perform template feature embedding to embed the template's feature into the potential target and then generate a dense 3D shape to characterize the shape information of the potential target. For localizing the tracked target, the voxel to BEV target localization network regresses the target's 2D center and the z axis center from the dense bird's eye view (BEV) feature map in an anchor free manner. Concretely, we compress the voxelized point cloud along z axis through max pooling to obtain a dense BEV feature map, where the regression of the 2D center and the z axis center can be performed more effectively. Extensive evaluation on the KITTI and nuScenes datasets shows that our method significantly outperforms the current state of the art methods by a large margin.


Facial structure of strongly convex sets generated by random samples. The K hull of a compact set A subset mathbb R d , where K subset mathbb R d is a fixed compact convex body, is the intersection of all translates of K that contain A . A set is called K strongly convex if it coincides with its K hull. We propose a general approach to the analysis of facial structure of K strongly convex sets, similar to the well developed theory for polytopes, by introducing the notion of k dimensional faces, for all k 0, dots,d 1 . We then apply our theory in the case when A Xi n is a sample of n points picked uniformly at random from K . We show that in this case the set of x in mathbb R d such that x K contains the sample Xi n , upon multiplying by n , converges in distribution to the zero cell of a certain Poisson hyperplane tessellation. From this results we deduce convergence in distribution of the corresponding f vector of the K hull of Xi n to a certain limiting random vector, without any normalisation, and also the convergence of all moments of the f vector.


About Face A Survey of Facial Recognition Evaluation. We survey over 100 face datasets constructed between 1976 to 2019 of 145 million images of over 17 million subjects from a range of sources, demographics and conditions. Our historical survey reveals that these datasets are contextually informed, shaped by changes in political motivations, technological capability and current norms. We discuss how such influences mask specific practices (some of which may actually be harmful or otherwise problematic) and make a case for the explicit communication of such details in order to establish a more grounded understanding of the technology's function in the real world.


Local spectral properties of typical contractions on ( ell p, ) , spaces. We study some local spectral properties of contraction operators on ell p , 1 p infty from a Baire category point of view, with respect to the Strong Operator Topology. In particular, we show that a typical contraction on ell p has Dunford's Property (C) but neither Bishop's Property ( beta) nor the Decomposition Property ( delta) , and is completely indecomposable. We also obtain some results regarding the asymptotic behavior of orbits of typical contractions on ell p .


Generalized multiscale feature extraction for remaining useful life prediction of bearings with generative adversarial networks. Bearing is a key component in industrial machinery and its failure may lead to unwanted downtime and economic loss. Hence, it is necessary to predict the remaining useful life (RUL) of bearings. Conventional data driven approaches of RUL prediction require expert domain knowledge for manual feature extraction and may suffer from data distribution discrepancy between training and test data. In this study, we propose a novel generalized multiscale feature extraction method with generative adversarial networks. The adversarial training learns the distribution of training data from different bearings and is introduced for health stage division and RUL prediction. To capture the sequence feature from a one dimensional vibration signal, we adapt a U Net architecture that reconstructs features to process them with multiscale layers in the generator of the adversarial network. To validate the proposed method, comprehensive experiments on two rotating machinery datasets have been conducted to predict the RUL. The experimental results show that the proposed feature extraction method can effectively predict the RUL and outperforms the conventional RUL prediction approaches based on deep neural networks. The implementation code is available at https github.com opensuh GMFE.


Technical Leverage in a Software Ecosystem Development Opportunities and Security Risks. In finance, leverage is the ratio between assets borrowed from others and one's own assets. A matching situation is present in software by using free open source software (FOSS) libraries a developer leverages on other people's code to multiply the offered functionalities with a much smaller own codebase. In finance as in software, leverage magnifies profits when returns from borrowing exceed costs of integration, but it may also magnify losses, in particular in the presence of security vulnerabilities. We aim to understand the level of technical leverage in the FOSS ecosystem and whether it can be a potential source of security vulnerabilities. Also, we introduce two metrics change distance and change direction to capture the amount and the evolution of the dependency on third party libraries. The application of the proposed metrics on 8494 distinct library versions from the FOSS Maven based Java libraries shows that small and medium libraries (less than 100KLoC) have disproportionately more leverage on FOSS dependencies in comparison to large libraries. We show that leverage pays off as leveraged libraries only add a 4 delay in the time interval between library releases while providing four times more code than their own. However, libraries with such leverage (i.e., 75 of libraries in our sample) also have 1.6 higher odds of being vulnerable in comparison to the libraries with lower leverage. We provide an online demo for computing the proposed metrics for real world software libraries available under the following URL https techleverage.eu .


Urban Fire Station Location Planning using Predicted Demand and Service Quality Index. In this article, we propose a systematic approach for fire station location planning. We develop machine learning models, based on Random Forest and Extreme Gradient Boosting, for demand prediction and utilize the models further to define a generalized index to measure quality of fire service in urban settings. Our model is built upon spatial data collected from multiple different sources. Efficacy of proper facility planning depends on choice of candidates where fire stations can be located along with existing stations, if any. Also, the travel time from these candidates to demand locations need to be taken care of to maintain fire safety standard. Here, we propose a travel time based clustering technique to identify suitable candidates. Finally, we develop an optimization problem to select best locations to install new fire stations. Our optimization problem is built upon maximum coverage problem, based on integer programming. We further develop a two stage stochastic optimization model to characterize the confidence in our decision outcome. We present a detailed experimental study of our proposed approach in collaboration with city of Victoria Fire Department, MN, USA. Our demand prediction model achieves true positive rate of 80 and false positive rate of 20 approximately. We aid Victoria Fire Department to select a location for a new fire station using our approach. We present detailed results on improvement statistics by locating a new facility, as suggested by our methodology, in the city of Victoria.


Extending a word property for twisted Coxeter systems. We prove two extensions of Hansson and Hultman's word property for certain analogues of reduced words associated to twisted involutions in Coxeter groups. Our first extension concerns the superset of such words in which terms with a natural commutativity property may be optionally primed. Our other extension involves variants of these words in which a defining minimal length condition is relaxed. In type A the sets considered are closely related to generating functions for Schur Q functions and K theoretic Schur P functions.


Understand and Improve Contrastive Learning Methods for Visual Representation A Review. Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A promising alternative, self supervised learning, as a type of unsupervised learning, has gained popularity because of its potential to learn effective data representations without manual labeling. Among self supervised learning algorithms, contrastive learning has achieved state of the art performance in several fields of research. This literature review aims to provide an up to date analysis of the efforts of researchers to understand the key components and the limitations of self supervised learning.


On the applicability of single spacecraft interferometry methods using electric field probes. When analyzing plasma waves, a key parameter to determine is the phase velocity. It enables us to, for example, compute wavelengths, wave potentials, and determine the energy of resonant particles. The phase velocity of a wave, observed by a single spacecraft equipped with electric field probes, can be determined using interferometry techniques. While several methods have been developed to do this, they have not been documented in detail. In this study, we use an analytical model to analyze and compare three interferometry methods applied on the probe geometry of the Magnetospheric Multiscale spacecraft. One method relies on measured probe potentials, whereas the other two use different E field measurements one by reconstructing the E field between two probes and the spacecraft, the other by constructing four pairwise parallel E field components in the spacecraft spin plane. We find that the potential method is sensitive both to how planar the wave is, and to spacecraft potential changes due to the wave. The E field methods are less affected by the spacecraft potential, and while the reconstructed E field method is applicable in some cases, the second E field method is almost always preferable. We conclude that the potential based interferometry method is useful when spacecraft potential effects are negligible and the signals of the different probes are very well correlated. The method using two pairs of parallel E fields is practically always preferable to the reconstructed E field method and produces the correct velocity in the spin plane, but it requires knowledge of the propagation direction to provide the full velocity.


Stable Sheaves on K3 Surfaces via Wall Crossing. We give a new proof of the following theorem moduli spaces of stable complexes on a complex projective K3 surface, with primitive Mukai vector and with respect to a generic Bridgeland stability condition, are hyperk " a hler varieties of mathrm K3 n type of expected dimension. We use derived equivalences, deformations and wall crossing for Bridgeland stability to reduce to the case of the Hilbert scheme of points.


Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models. Targeted syntactic evaluations have demonstrated the ability of language models to perform subject verb agreement given difficult contexts. To elucidate the mechanisms by which the models accomplish this behavior, this study applies causal mediation analysis to pre trained neural language models. We investigate the magnitude of models' preferences for grammatical inflections, as well as whether neurons process subject verb agreement similarly across sentences with different syntactic structures. We uncover similarities and differences across architectures and model sizes notably, that larger models do not necessarily learn stronger preferences. We also observe two distinct mechanisms for producing subject verb agreement depending on the syntactic structure of the input sentence. Finally, we find that language models rely on similar sets of neurons when given sentences with similar syntactic structure.


COPS Controlled Pruning Before Training Starts. State of the art deep neural network (DNN) pruning techniques, applied one shot before training starts, evaluate sparse architectures with the help of a single criterion called pruning score. Pruning weights based on a solitary score works well for some architectures and pruning rates but may also fail for other ones. As a common baseline for pruning scores, we introduce the notion of a generalized synaptic score (GSS). In this work we do not concentrate on a single pruning criterion, but provide a framework for combining arbitrary GSSs to create more powerful pruning strategies. These COmbined Pruning Scores (COPS) are obtained by solving a constrained optimization problem. Optimizing for more than one score prevents the sparse network to overly specialize on an individual task, thus COntrols Pruning before training Starts. The combinatorial optimization problem given by COPS is relaxed on a linear program (LP). This LP is solved analytically and determines a solution for COPS. Furthermore, an algorithm to compute it for two scores numerically is proposed and evaluated. Solving COPS in such a way has lower complexity than the best general LP solver. In our experiments we compared pruning with COPS against state of the art methods for different network architectures and image classification tasks and obtained improved results.


Deep DNA Storage Scalable and Robust DNA Storage via Coding Theory and Deep Learning. The concept of DNA storage was first suggested in 1959 by Richard Feynman who shared his vision regarding nanotechnology in the talk "There is plenty of room at the bottom". Later, towards the end of the 20 th century, the interest in storage solutions based on DNA molecules was increased as a result of the human genome project which in turn led to a significant progress in sequencing and assembly methods. DNA storage enjoys major advantages over the well established magnetic and optical storage solutions. As opposed to magnetic solutions, DNA storage does not require electrical supply to maintain data integrity and is superior to other storage solutions in both density and durability. Given the trends in cost decreases of DNA synthesis and sequencing, it is now acknowledged that within the next 10 15 years DNA storage may become a highly competitive archiving technology and probably later the main such technology. With that said, the current implementations of DNA based storage systems are very limited and are not fully optimized to address the unique pattern of errors which characterize the synthesis and sequencing processes. In this work, we propose a robust, efficient and scalable solution to implement DNA based storage systems. Our method deploys Deep Neural Networks (DNN) which reconstruct a sequence of letters based on imperfect cluster of copies generated by the synthesis and sequencing processes. A tailor made Error Correcting Code (ECC) is utilized to combat patterns of errors which occur during this process. Since our reconstruction method is adapted to imperfect clusters, our method overcomes the time bottleneck of the noisy DNA copies clustering process by allowing the use of a rapid and scalable pseudo clustering instead. Our architecture combines between convolutions and transformers blocks and is trained using synthetic data modelled after real data statistics.


Prediction of Separation Induced Transition on Thick Airfoil Using Nonlinear URANS Based Turbulence Model. Most of the turbulence models in practice are based on the assumption of a linear relation between Reynolds stresses and mean flow strain rates which generally provides a good approximation in case of attached and fully turbulent flows. A two dimensional numerical study has been carried out over NACA 0021 with k omega SST model with non linear correction at Re 120,000 for various angles of attack which experiences the formation of a laminar separation bubble (LSB). A correct prediction of LSB requires an accurate resolution of anisotropy in Reynolds stresses. For comparison with other linear models, the simulations are also performed with k kl omega, k omega SST and Spalart Allmaras. The performance of these models is assessed through aerodynamic lift, drag, pressure and friction coefficients. It is found that the non linear k omega SST and k kl omega transition model provide comparable quality of prediction in lift and drag coefficients (in spite of the fact that non linear k omega SST involves solving less number of transport equation than the transition model) as observed in the experiments whereas k omega SST and SA models under predict the drag coefficient value at low angle of attack due to inability to capture the separation induced transition. It is also observed that the location of laminar separation bubble is captured accurately when nonlinear or transition model is used as opposed to the SA or linear SST models, which lack in the ability to predict the same.


Line Segment Detection Using Transformers without Edges. In this paper, we present a joint end to end line segment detection algorithm using Transformers that is post processing and heuristics guided intermediate processing (edge junction region detection) free. Our method, named LinE segment TRansformers (LETR), takes advantages of having integrated tokenized queries, a self attention mechanism, and an encoding decoding strategy within Transformers by skipping standard heuristic designs for the edge element detection and perceptual grouping processes. We equip Transformers with a multi scale encoder decoder strategy to perform fine grained line segment detection under a direct endpoint distance loss. This loss term is particularly suitable for detecting geometric structures such as line segments that are not conveniently represented by the standard bounding box representations. The Transformers learn to gradually refine line segments through layers of self attention. In our experiments, we show state of the art results on Wireframe and YorkUrban benchmarks.


Reduced variance analysis of molecular dynamics simulations by linear combination of estimators. Building upon recent developments of force based estimators with a reduced variance for the computation of densities, radial distribution functions or local transport properties from molecular simulations, we show that the variance can be further reduced by considering optimal linear combinations of such estimators. This control variates approach, well known in Statistics and already used in other branches of computational Physics, has been comparatively much less exploited in molecular simulations. We illustrate this idea on the radial distribution function and the one dimensional density of a bulk and confined Lennard Jones fluid, where the optimal combination of estimators is determined for each distance or position, respectively. In addition to reducing the variance everywhere at virtually no additional cost, this approach cures an artefact of the initial force based estimators, namely small but non zero values of the quantities in regions where they should vanish. Beyond the examples considered here, the present work highlights more generally the underexplored potential of control variates to estimate observables from molecular simulations.


Efficient Error Correcting Code Mechanism for High Throughput Memristive Processing in Memory. Inefficient data transfer between computation and memory inspired emerging processing in memory (PIM) technologies. Many PIM solutions enable storage and processing using memristors in a crossbar array structure, with techniques such as memristor aided logic (MAGIC) used for computation. This approach provides highly paralleled logic computation with minimal data movement. However, memristors are vulnerable to soft errors and standard error correcting code (ECC) techniques are difficult to implement without moving data outside the memory. We propose a novel technique for efficient ECC implementation along diagonals to support reliable computation inside the memory without explicitly reading the data. Our evaluation demonstrates an improvement of over eight orders of magnitude in reliability (mean time to failure) for an increase of about 26 in computation latency.


Ensemble and Auxiliary Tasks for Data Efficient Deep Reinforcement Learning. Ensemble and auxiliary tasks are both well known to improve the performance of machine learning models when data is limited. However, the interaction between these two methods is not well studied, particularly in the context of deep reinforcement learning. In this paper, we study the effects of ensemble and auxiliary tasks when combined with the deep Q learning algorithm. We perform a case study on ATARI games under limited data constraint. Moreover, we derive a refined bias variance covariance decomposition to analyze the different ways of learning ensembles and using auxiliary tasks, and use the analysis to help provide some understanding of the case study. Our code is open source and available at https github.com NUS LID RENAULT.


A diffusion map based algorithm for gradient computation on manifolds and applications. We recover the Riemannian gradient of a given function defined on interior points of a Riemannian submanifold in the Euclidean space based on a sample of function evaluations at points in the submanifold. This approach is based on the estimates of the Laplace Beltrami operator proposed in the diffusion maps theory. The Riemannian gradient estimates do not involve differential terms. Analytical convergence results of the Riemannian gradient expansion are proved. We apply the Riemannian gradient estimate in a gradient based algorithm providing a derivative free optimization method. We test and validate several applications, including tomographic reconstruction from an unknown random angle distribution, and the sphere packing problem in dimensions 2 and 3.


Semi Supervised Adversarial Discriminative Domain Adaptation. Domain adaptation is a potential method to train a powerful deep neural network, which can handle the absence of labeled data. More precisely, domain adaptation solving the limitation called dataset bias or domain shift when the training dataset and testing dataset are extremely different. Adversarial adaptation method becoming popular among other domain adaptation methods. Relies on the idea of GAN, adversarial domain adaptation tries to minimize the distribution between training and testing datasets base on the adversarial object. However, some conventional adversarial domain adaptation methods cannot handle large domain shifts between two datasets or the generalization ability of these methods are inefficient. In this paper, we propose an improved adversarial domain adaptation method called Semi Supervised Adversarial Discriminative Domain Adaptation (SADDA), which can overcome the limitation of other domain adaptation. We also show that SADDA has better performance than other adversarial adaptation methods and illustrate the promise of our method on digit classification and emotion recognition problems.


A Distance Measure for Privacy preserving Process Mining based on Feature Learning. To enable process analysis based on an event log without compromising the privacy of individuals involved in process execution, a log may be anonymized. Such anonymization strives to transform a log so that it satisfies provable privacy guarantees, while largely maintaining its utility for process analysis. Existing techniques perform anonymization using simple, syntactic measures to identify suitable transformation operations. This way, the semantics of the activities referenced by the events in a trace are neglected, potentially leading to transformations in which events of unrelated activities are merged. To avoid this and incorporate the semantics of activities during anonymization, we propose to instead incorporate a distance measure based on feature learning. Specifically, we show how embeddings of events enable the definition of a distance measure for traces to guide event log anonymization. Our experiments with real world data indicate that anonymization using this measure, compared to a syntactic one, yields logs that are closer to the original log in various dimensions and, hence, have higher utility for process analysis.


ECO Edge Cloud Optimization of 5G applications. Centralized cloud computing with 100 milliseconds network latencies cannot meet the tens of milliseconds to sub millisecond response times required for emerging 5G applications like autonomous driving, smart manufacturing, tactile internet, and augmented or virtual reality. We describe a new, dynamic runtime that enables such applications to make effective use of a 5G network, computing at the edge of this network, and resources in the centralized cloud, at all times. Our runtime continuously monitors the interaction among the microservices, estimates the data produced and exchanged among the microservices, and uses a novel graph min cut algorithm to dynamically map the microservices to the edge or the cloud to satisfy application specific response times. Our runtime also handles temporary network partitions, and maintains data consistency across the distributed fabric by using microservice proxies to reduce WAN bandwidth by an order of magnitude, all in an it application specific manner by leveraging knowledge about the application's functions, latency critical pipelines and intermediate data. We illustrate the use of our runtime by successfully mapping two complex, representative real world video analytics applications to the AWS Verizon Wavelength edge cloud architecture, and improving application response times by 2x when compared with a static edge cloud implementation.


The size, multipartite Ramsey numbers for nK2 versus path path and cycle. For given graphs G 1, G 2, ldots, G n and any integer j , the size of the multipartite Ramsey number m j(G 1, G 2, ldots, G n) is the smallest positive integer t such that any n coloring of the edges of K j times t contains a monochromatic copy of G i in color i for some i , 1 leq i leq n , where K j times t denotes the complete multipartite graph having j classes with t vertices per each class. In this paper we compute the size of the multipartite Ramsey number m j(K 1,2 , P 4, nK 2) for any j,n geq 2 and m j(nK 2,C 7) , for any j leq4 and n geq 2 .


Bressoud's identities for even moduli. New companions and related positivity results. I revisit Bressoud's generalised Borwein conjecture. Making use of certain positivity preserving transformations for q binomial coefficients, I establish the truth of infinitely many new cases of the Bressoud conjecture. In addition, I prove new doubly bounded refinement of the Foda Quano identities. Finally, I discuss new companions to the Bressoud even moduli identities. In particular, all 10 mod 20 identities are derived.


Identifying Hijacked Reviews. Fake reviews and review manipulation are growing problems on online marketplaces globally. Review Hijacking is a new review manipulation tactic in which unethical sellers "hijack" an existing product page (usually one with many positive reviews), then update the product details like title, photo, and description with those of an entirely different product. With the earlier reviews still attached, the new item appears well reviewed. However, there are no public datasets of review hijacking and little is known in the literature about this tactic. Hence, this paper proposes a three part study (i) we propose a framework to generate synthetically labeled data for review hijacking by swapping products and reviews (ii) then, we evaluate the potential of both a Twin LSTM network and BERT sequence pair classifier to distinguish legitimate reviews from hijacked ones using this data and (iii) we then deploy the best performing model on a collection of 31K products (with 6.5 M reviews) in the original data, where we find 100s of previously unknown examples of review hijacking.


Tangles, relative character varieties, and holonomy perturbed traceless flat moduli spaces. We prove that the restriction map from the subspace of regular points of the holonomy perturbed SU(2) traceless flat moduli space of a tangle in a 3 manifold to the traceless flat moduli space of its boundary marked surface is a Lagrangian immersion. A key ingredient in our proof is the use of composition in the Weinstein category, combined with the fact that SU(2) holonomy perturbations in a cylinder induce Hamiltonian isotopies. In addition, we show that (S 2,4) , the 2 sphere with four marked points, is its own traceless flat SU(2) moduli space.


Thermal conductivity prediction of nanoparticle packed beds by using modified Johnson Kendall Roberts model. Nanoparticle packed beds (NPBs) have demonstrated the potential for thermal insulation, and further reducing thermal conductivity (k) requires a theoretical understanding of the thermal conduction in them. Till now, the theoretical models under the framework of effective medium approach (EMA) have been widely developed for the thermal conductivity (k) prediction of NPB. In these models, corresponding architecture parameters are usually evaluated by the classical Johnson Kendall Roberts (JKR) model. Unfortunately, the size effect is usually ignored in JKR model, resulting in the inferior ability to accurately predict the geometrical information of NPB. In this work, the modified JKR model including the size effect of Young's modulus is integrated in the EMA model for k prediction, and experimental results in Int. J. Heat Mass Tran., 2019, 129, 28 36 was further explained. As a result, the developed model illustrates the advantages on the prediction of solid phase thermal conductivity (k s), especially for the NPB with a low porosity. This work provides a modified JKR model to improve the accuracy of existing EMA model in the k prediction of NPB.


Nanoscale laser flash measurements of diffuson transport in amorphous Ge and Si. The thermal properties of amorphous materials have attracted significant attention due to their technological importance in electronic devices. Additionally, the disorder induced breakdown of the phonon gas model makes vibrational transport in amorphous materials a topic of fundamental interest. In the past few decades, theoretical concepts such as propagons, diffusons, and locons have emerged to describe different types of vibrational modes in disordered solids. But experiments can struggle to accurately determine which types of vibrational states carry the majority of the heat. In the present study, we use nanoscale laser flash measurements (front back time domain thermoreflectance) to investigate thermal transport mechanisms in amorphous Ge and amorphous Si thin films. We observe a nearly linear relationship between the amorphous film's thermal resistance and the film's thickness. The slope of the film's thermal resistance vs. thickness corresponds to a thickness independent thermal conductivity of 0.4 and 0.6 W (m K) for a Ge and a Si, respectively. This result reveals that the majority of heat currents in amorphous Si and Ge thin films prepared via RF sputtering at room temperature are carried by diffusons and or propagons with mean free paths less than a few nanometers.


Skeleton Graph Long Term 3D Motion Prediction From 2D Observations Using Deep Spatio Temporal Graph CNNs. Several applications such as autonomous driving, augmented reality and virtual reality require a precise prediction of the 3D human pose. Recently, a new problem was introduced in the field to predict the 3D human poses from observed 2D poses. We propose Skeleton Graph, a deep spatio temporal graph CNN model that predicts the future 3D skeleton poses in a single pass from the 2D ones. Unlike prior works, Skeleton Graph focuses on modeling the interaction between the skeleton joints by exploiting their spatial configuration. This is being achieved by formulating the problem as a graph structure while learning a suitable graph adjacency kernel. By the design, Skeleton Graph predicts the future 3D poses without divergence in the long term, unlike prior works. We also introduce a new metric that measures the divergence of predictions in the long term. Our results show an FDE improvement of at least 27 and an ADE of 4 on both the GTA IM and PROX datasets respectively in comparison with prior works. Also, we are 88 and 93 less divergence on the long term motion prediction in comparison with prior works on both GTA IM and PROX datasets. Code is available at https github.com abduallahmohamed Skeleton Graph.git


Question Aware Memory Network for Multi hop Question Answering in Human Robot Interaction. Knowledge graph question answering is an important technology in intelligent human robot interaction, which aims at automatically giving answer to human natural language question with the given knowledge graph. For the multi relation question with higher variety and complexity, the tokens of the question have different priority for the triples selection in the reasoning steps. Most existing models take the question as a whole and ignore the priority information in it. To solve this problem, we propose question aware memory network for multi hop question answering, named QA2MN, to update the attention on question timely in the reasoning process. In addition, we incorporate graph context information into knowledge graph embedding model to increase the ability to represent entities and relations. We use it to initialize the QA2MN model and fine tune it in the training process. We evaluate QA2MN on PathQuestion and WorldCup2014, two representative datasets for complex multi hop question answering. The result demonstrates that QA2MN achieves state of the art Hits 1 accuracy on the two datasets, which validates the effectiveness of our model.


A review of effects of climate change on Agriculture in Africa. Currently, agriculture in Africa contributes only a tenth to global Green House Gas (GHG) emissions from agriculture. Despite its relatively low contribution to GHG, a conundrum of "climate justice", adverse impacts of climate change disproportionately threaten Africa's agriculture, the Continent's main economic sector. Consequently, we seek to review the effects of climate change on Agriculture.


Hippocampal Spatial Mapping As Fast Graph Learning. The hippocampal formation is thought to learn spatial maps of environments, and in many models this learning process consists of forming a sensory association for each location in the environment. This is inefficient, akin to learning a large lookup table for each environment. Spatial maps can be learned much more efficiently if the maps instead consist of arrangements of sparse environment parts. In this work, I approach spatial mapping as a problem of learning graphs of environment parts. Each node in the learned graph, represented by hippocampal engram cells, is associated with feature information in lateral entorhinal cortex (LEC) and location information in medial entorhinal cortex (MEC) using empirically observed neuron types. Each edge in the graph represents the relation between two parts, and it is associated with coarse displacement information. This core idea of associating arbitrary information with nodes and edges is not inherently spatial, so this proposed fast relation graph learning algorithm can expand to incorporate many spatial and non spatial tasks.


Parallel Algorithms for Densest Subgraph Discovery Using Shared Memory Model. The problem of finding dense components of a graph is a widely explored area in data analysis, with diverse applications in fields and branches of study including community mining, spam detection, computer security and bioinformatics. This research project explores previously available algorithms in order to study them and identify potential modifications that could result in an improved version with considerable performance and efficiency leap. Furthermore, efforts were also steered towards devising a novel algorithm for the problem of densest subgraph discovery. This paper presents an improved implementation of a widely used densest subgraph discovery algorithm and a novel parallel algorithm which produces better results than a 2 approximation.


Third Party Risk Modelling and Assessment for Safe UAV Path Planning in Metropolitan Environments. Various applications of advanced air mobility (AAM) in urban environments facilitate our daily life and public services. As one of the key issues of realizing these applications autonomously, path planning problem has been studied with main objectives on minimizing travel distance, flight time and energy cost. However, AAM operations in metropolitan areas bring safety and society issues. Because most of AAM aircraft are unmanned aerial vehicles (UAVs) and they may fail to operate resulting in fatality risk, property damage risk and societal impacts (noise and privacy) to the public. To quantitatively assess these risks and mitigate them in planning phase, this paper proposes an integrated risk assessment model and develops a hybrid algorithm to solve the risk based 3D path planning problem. The integrated risk assessment method considers probability and severity models of UAV impact ground people and vehicle. By introducing gravity model, the population density and traffic density are estimated in a finer scale, which enables more accurate risk assessment. The 3D risk based path planning problem is first formulated as a special minimum cost flow problem. Then, a hybrid estimation of distribution algorithm (EDA) and risk based A (named as EDA RA ) algorithm is proposed to solve the problem. To improve computational efficiency, k means clustering method is incorporated into EDA RA to provide both global and local search heuristic information, which formed the EDA and fast risk based A algorithm we call EDA FRA . Case study results show that the risk assessment model can capture high risk areas and the generated risk map enables safe UAV path planning in urban complex environments.


Energy Aware Adaptive Offloading of Soft Real Time Jobs in Mobile Edge Clouds. We present a model for measuring the impact of offloading soft real time jobs over multi tier cloud infrastructures. The jobs originate in mobile devices and offloading strategies may choose to execute them locally, in neighbouring devices, in cloudlets or in infrastructure cloud servers. Within this specification, we put forward several such offloading strategies characterised by their differential use of the cloud tiers with the goal of optimizing execution time and or energy consumption. We implement an instance of the model using Jay, a software framework for adaptive computation offloading in hybrid edge clouds. The framework is modular and allows the model and the offloading strategies to be seamlessly implemented while providing the tools to make informed runtime offloading decisions based on system feedback, namely through a built in system profiler that gathers runtime information such as workload, energy consumption and available bandwidth for every participating device or server. The results show that offloading strategies sensitive to runtime conditions can effectively and dynamically adjust their offloading decisions to produce significant gains in terms of their target optimization functions, namely, execution time, energy consumption and fulfillment of job deadlines.


Background Aware Pooling and Noise Aware Loss for Weakly Supervised Semantic Segmentation. We address the problem of weakly supervised semantic segmentation (WSSS) using bounding box annotations. Although object bounding boxes are good indicators to segment corresponding objects, they do not specify object boundaries, making it hard to train convolutional neural networks (CNNs) for semantic segmentation. We find that background regions are perceptually consistent in part within an image, and this can be leveraged to discriminate foreground and background regions inside object bounding boxes. To implement this idea, we propose a novel pooling method, dubbed background aware pooling (BAP), that focuses more on aggregating foreground features inside the bounding boxes using attention maps. This allows to extract high quality pseudo segmentation labels to train CNNs for semantic segmentation, but the labels still contain noise especially at object boundaries. To address this problem, we also introduce a noise aware loss (NAL) that makes the networks less susceptible to incorrect labels. Experimental results demonstrate that learning with our pseudo labels already outperforms state of the art weakly and semi supervised methods on the PASCAL VOC 2012 dataset, and the NAL further boosts the performance.


Vertex and edge metric dimensions of cacti. In a graph G a vertex (resp. an edge) metric generator is a set of vertices S such that any pair of vertices (resp. edges) from G is distinguished by at least one vertex from S The cardinality of a smallest vertex (resp. edge) metric generator is the vertex (resp. edge) metric dimension of G In 19 we determined the vertex (resp. edge) metric dimension of unicyclic graphs and that it takes its value from two consecutive integers. Therein, several cycle configurations were introduced and the vertex (resp. edge) metric dimension takes the greater of the two consecutive values only if any of these configurations is present in the graph. In this paper we extend the result to cactus graphs i.e. graphs in which all cycles are pairwise edge disjoint. We do so by defining a unicyclic subgraph of G for every cycle of G and applying the already introduced approach for unicyclic graphs which involves the configurations. The obtained results enable us to prove the cycle rank conjecture for cacti. They also yield a simple upper bound on metric dimensions of cactus graphs and we conclude the paper by conjecturing that the same upper bound holds in general.


Pre trained Language Model based Ranking in Baidu Search. As the heart of a search engine, the ranking system plays a crucial role in satisfying users' information demands. More recently, neural rankers fine tuned from pre trained language models (PLMs) establish state of the art ranking effectiveness. However, it is nontrivial to directly apply these PLM based rankers to the large scale web search system due to the following challenging issues (1) the prohibitively expensive computations of massive neural PLMs, especially for long texts in the web document, prohibit their deployments in an online ranking system that demands extremely low latency (2) the discrepancy between existing ranking agnostic pre training objectives and the ad hoc retrieval scenarios that demand comprehensive relevance modeling is another main barrier for improving the online ranking system (3) a real world search engine typically involves a committee of ranking components, and thus the compatibility of the individually fine tuned ranking model is critical for a cooperative ranking system. In this work, we contribute a series of successfully applied techniques in tackling these exposed issues when deploying the state of the art Chinese pre trained language model, i.e., ERNIE, in the online search engine system. We first articulate a novel practice to cost efficiently summarize the web document and contextualize the resultant summary content with the query using a cheap yet powerful Pyramid ERNIE architecture. Then we endow an innovative paradigm to finely exploit the large scale noisy and biased post click behavioral data for relevance oriented pre training. We also propose a human anchored fine tuning strategy tailored for the online ranking system, aiming to stabilize the ranking signals across various online components. Extensive offline and online experimental results show that the proposed techniques significantly boost the search engine's performance.


Thinking Out of the Blocks Holochain for Distributed Security in IoT Healthcare. The Internet of Things (IoT) is an emerging and cognitive technology which connects a massive number of smart physical devices with virtual objects operating in diverse platforms through the internet. IoT is increasingly being implemented in distributed settings, making footprints in almost every sector of our life. Unfortunately, for healthcare systems, the entities connected to the IoT networks are exposed to an unprecedented level of security threats. Relying on a huge volume of sensitive and personal data, IoT healthcare systems are facing unique challenges in protecting data security and privacy. Although blockchain has posed to be the solution in this scenario thanks to its inherent distributed ledger technology (DLT), it suffers from major setbacks of increasing storage and computation requirements with the network size. This paper proposes a holochain based security and privacy preserving framework for IoT healthcare systems that overcomes these challenges and is particularly suited for resource constrained IoT scenarios. The performance and thorough security analyses demonstrate that a holochain based IoT healthcare system is significantly better compared to blockchain and other existing systems.


Well posedness for chemotaxis fluid models in arbitrary dimensions. We study the Cauchy problem for the chemotaxis Navier Stokes equations and the Keller Segel Navier Stokes system. Local in time and global in time solutions are constructed for low regularity data in 2 and higher dimensions under suitable conditions. Our initial data classes involve a new scale of function space, that is Y( rn) which collects divergence of vector fields with components in the square Campanato space mathscr L 2,N 2 ( rn) , N 2 (and can be identified with the homogeneous Besov space dot B 1 22 ( rn) when N 2 ) and are the largest available for small data global existence. Moreover, uniqueness criterion for global solutions is obtained under certain limiting conditions.


Comparison of nonlinear solvers within continuation method for steady state variably saturated groundwater flow modeling. Nonlinearity continuation method, applied to boundary value problems for steady state Richards equation, gradually approaches the solution through a series of intermediate problems. Originally, the Newton method with simple line search algorithm was used to solve the intermediate problems. In this paper, other solvers such as Picard and mixed Picard Newton methods are considered, combined with slightly modified line search approach. Numerical experiments are performed with advanced finite volume discretizations on model and real life problems.


Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self supervised Learning and Ray Tracing. Robust face reconstruction from monocular image in general lighting conditions is challenging. Methods combining deep neural network encoders with differentiable rendering have opened up the path for very fast monocular reconstruction of geometry, lighting and reflectance. They can also be trained in self supervised manner for increased robustness and better generalization. However, their differentiable rasterization based image formation models, as well as underlying scene parameterization, limit them to Lambertian face reflectance and to poor shape details. More recently, ray tracing was introduced for monocular face reconstruction within a classic optimization based framework and enables state of the art results. However optimization based approaches are inherently slow and lack robustness. In this paper, we build our work on the aforementioned approaches and propose a new method that greatly improves reconstruction quality and robustness in general scenes. We achieve this by combining a CNN encoder with a differentiable ray tracer, which enables us to base the reconstruction on much more advanced personalized diffuse and specular albedos, a more sophisticated illumination model and a plausible representation of self shadows. This enables to take a big leap forward in reconstruction quality of shape, appearance and lighting even in scenes with difficult illumination. With consistent face attributes reconstruction, our method leads to practical applications such as relighting and self shadows removal. Compared to state of the art methods, our results show improved accuracy and validity of the approach.


Derivations on algebras of one point compactification of affine semigroups. For any affine semigroup S the set S cup infty has a natural structure of semigroup, additionally if S is endowed with the discrete topology, the semigroup S cup infty can be studied as the one point compactification of S . In this article we study the derivations on the semigroup algebra mathbb C S cup infty in relation to the derivations on the semigroup algebra mathbb C S considering the metrizable topology on mathbb C S cup infty induced by the one point compactification topology of S cup infty .


A Simple and Fast Baseline for Tuning Large XGBoost Models. XGBoost, a scalable tree boosting algorithm, has proven effective for many prediction tasks of practical interest, especially using tabular datasets. Hyperparameter tuning can further improve the predictive performance, but unlike neural networks, full batch training of many models on large datasets can be time consuming. Owing to the discovery that (i) there is a strong linear relation between dataset size training time, (ii) XGBoost models satisfy the ranking hypothesis, and (iii) lower fidelity models can discover promising hyperparameter configurations, we show that uniform subsampling makes for a simple yet fast baseline to speed up the tuning of large XGBoost models using multi fidelity hyperparameter optimization with data subsets as the fidelity dimension. We demonstrate the effectiveness of this baseline on large scale tabular datasets ranging from 15 70 mathrm GB in size.


Quantifying COVID 19 enforced global changes in atmospheric pollutants using cloud computing based remote sensing. Global lockdowns in response to the COVID 19 pandemic have led to changes in the anthropogenic activities resulting in perceivable air quality improvements. Although several recent studies have analyzed these changes over different regions of the globe, these analyses have been constrained due to the usage of station based data which is mostly limited upto the metropolitan cities. Also, the quantifiable changes have been reported only for the developed and developing regions leaving the poor economies (e.g. Africa) due to the shortage of in situ data. Using a comprehensive set of high spatiotemporal resolution satellites and merged products of air pollutants, we analyze the air quality across the globe and quantify the improvement resulting from the suppressed anthropogenic activity during the lockdowns. In particular, we focus on megacities, capitals and cities with high standards of living to make the quantitative assessment. Our results offer valuable insights into the spatial distribution of changes in the air pollutants due to COVID 19 enforced lockdowns. Statistically significant reductions are observed over megacities with mean reduction by 19.74 , 7.38 and 49.9 in nitrogen dioxide (NO2), aerosol optical depth (AOD) and PM 2.5 concentrations. Google Earth Engine empowered cloud computing based remote sensing is used and the results provide a testbed for climate sensitivity experiments and validation of chemistry climate models. Additionally, Google Earth Engine based apps have been developed to visualize the changes in a real time fashion.


On sub grid scale modeling in a differentially heated cavity using coarse large eddy simulation. Two widely used sub grid scale models, the standard and the dynamic Smagorinsky models were tested in a simulation of the flow in a thermally driven 3D cavity at Rayleigh number of Ra 1E9. The main focus of the research is the response of the subgrid scale models to the coarse mesh and their ability to predict the flow in a thermally driven 3D cavity with the mesh resolution below generally accepted LES standards. The research is motivated by investigating a feasible modeling strategy for the particulate flow in the wall bounded side wall heated cavity. As URANS and hybrid RANS LES models fail to produce modeled energy due to laminarization, the alternative is LES applied on the coarse mesh. In a quantitative manner, first and second moment statistics are com pared against both reference LES and experimental databases from literature. For first moment statistics, both models globally predict the flow field well. However, for higher moments, the dynamic model outperforms the standard Smagorinsky model using the same mesh resolution. In a qualitative fashion, we report the contours of both temperature and velocity fields as well as the near wall turbulent coherent structures. Results of flow quantities are globally in very good agreement with both reference LES and experimental measurements at a fraction of the CPU power needed for conventional LES.


Sobolev estimates for fractional parabolic equations with space time non local operators. We obtain L p estimates for fractional parabolic equations with space time non local operators partial t alpha u Lu lambda u f quad mathrm in quad (0,T) times mathbb R d, where partial t alpha u is the Caputo fractional derivative of order alpha in (0,1 , lambda ge 0 , T in (0, infty) , and Lu(t,x) int mathbb R d bigg( u(t,x y) u(t,x) y cdot nabla xu(t,x) chi ( sigma) (y) bigg)K(t,x,y) ,dy is an integro differential operator in the spatial variables. Here we do not impose any regularity assumption on the kernel K with respect to t and y . We also derive a weighted mixed norm estimate for the equations with operators that are local in time, i.e., alpha 1 , which extend the previous results by using a quite different method.


Single Photon Source from a Nanoantenna Trapped Single Quantum Dot. Single photon sources with high brightness and subnanosecond lifetimes are key components for quantum technologies. Optical nanoantennas can enhance the emission properties of single quantum emitters, but this approach requires accurate nanoscale positioning of the source at the plasmonic hotspot. Here, we use plasmonic nanoantennas to simultaneously trap single colloidal quantum dots and enhance their photoluminescence. The nano optical trapping automatically locates the quantum emitter at the nanoantenna hotspot without further processing. Our dedicated nanoantenna design achieves a high trap stiffness of 0.6 fN nm mW for quantum dot trapping, together with a relatively low trapping power of 2 mW mu m 2 . The emission from the nanoantenna trapped single quantum dot shows 7x increased brightness, 50x reduced blinking, 2x shortened lifetime and a clear antibunching below 0.5 demonstrating true single photon emission. Combining nano optical tweezers with plasmonic enhancement is a promising route for quantum technologies and spectroscopy of single nano objects.


Pose Normalization of Indoor Mapping Datasets Partially Compliant to the Manhattan World Assumption. In this paper, we present a novel pose normalization method for indoor mapping point clouds and triangle meshes that is robust against large fractions of the indoor mapping geometries deviating from an ideal Manhattan World structure. In the case of building structures that contain multiple Manhattan World systems, the dominant Manhattan World structure supported by the largest fraction of geometries is determined and used for alignment. In a first step, a vertical alignment orienting a chosen axis to be orthogonal to horizontal floor and ceiling surfaces is conducted. Subsequently, a rotation around the resulting vertical axis is determined that aligns the dataset horizontally with the coordinate axes. The proposed method is evaluated quantitatively against several publicly available indoor mapping datasets. Our implementation of the proposed procedure along with code for reproducing the evaluation will be made available to the public upon acceptance for publication.


Hierarchical Graph Convolutional Variational AutoEncoding for Generative Modelling of Human Motion. Models of human motion commonly focus either on trajectory prediction or action classification but rarely both. The marked heterogeneity and intricate compositionality of human motion render each task vulnerable to the data degradation and distributional shift common to real world scenarios. A sufficiently expressive generative model of action could in theory enable data conditioning and distributional resilience within a unified framework applicable to both tasks. Here we propose a novel architecture based on hierarchical variational autoencoders and deep graph convolutional neural networks for generating a holistic model of action over multiple time scales. We show this Hierarchical Graph convolutional Variational Autoencoder (HG VAE) to be capable of generating coherent actions, detecting out of distribution data, and imputing missing data by gradient ascent on the model's posterior. Trained and evaluated on H3.6M and the largest collection of open source human motion data, AMASS, we show HG VAE can facilitate downstream discriminative learning better than baseline models.


Identifying Machine Paraphrased Plagiarism. Employing paraphrasing tools to conceal plagiarized text is a severe threat to academic integrity. To enable the detection of machine paraphrased text, we evaluate the effectiveness of five pre trained word embedding models combined with machine learning classifiers and state of the art neural language models. We analyze preprints of research papers, graduation theses, and Wikipedia articles, which we paraphrased using different configurations of the tools SpinBot and SpinnerChief. The best performing technique, Longformer, achieved an average F1 score of 80.99 (F1 99.68 for SpinBot and F1 71.64 for SpinnerChief cases), while human evaluators achieved F1 78.4 for SpinBot and F1 65.6 for SpinnerChief cases. We show that the automated classification alleviates shortcomings of widely used text matching systems, such as Turnitin and PlagScan. To facilitate future research, all data, code, and two web applications showcasing our contributions are openly available.


Mimicking the Oracle An Initial Phase Decorrelation Approach for Class Incremental Learning. Class Incremental Learning (CIL) aims at learning a multi class classifier in a phase by phase manner, in which only data of a subset of the classes are provided at each phase. Previous works mainly focus on mitigating forgetting in phases after the initial one. However, we find that improving CIL at its initial phase is also a promising direction. Specifically, we experimentally show that directly encouraging CIL Learner at the initial phase to output similar representations as the model jointly trained on all classes can greatly boost the CIL performance. Motivated by this, we study the difference between a na "ively trained initial phase model and the oracle model. Specifically, since one major difference between these two models is the number of training classes, we investigate how such difference affects the model representations. We find that, with fewer training classes, the data representations of each class lie in a long and narrow region with more training classes, the representations of each class scatter more uniformly. Inspired by this observation, we propose Class wise Decorrelation (CwD) that effectively regularizes representations of each class to scatter more uniformly, thus mimicking the model jointly trained with all classes (i.e., the oracle model). Our CwD is simple to implement and easy to plug into existing methods. Extensive experiments on various benchmark datasets show that CwD consistently and significantly improves the performance of existing state of the art methods by around 1 to 3 . Code will be released.


Algorithms for Interference Minimization in Future Wireless Network Decomposition. We propose a simple and fast method for providing a high quality solution for the sum interference minimization problem. As future networks are deployed in high density urban areas, improved clustering methods are needed to provide low interference network connectivity. The proposed algorithm applies straightforward similarity based clustering and optionally stable matchings to outperform state of the art algorithms. The running times of our algorithms are dominated by one matrix multiplication.


Density of Free Modules over Finite Chain Rings. In this paper we focus on modules over a finite chain ring mathcal R of size q s . We compute the density of free modules of mathcal R n , where we separately treat the asymptotics in n,q and s . In particular, we focus on two cases one where we fix the length of the module and one where we fix the rank of the module. In both cases, the density results can be bounded by the Andrews Gordon identities. We also study the asymptotic behaviour of modules generated by random matrices over mathcal R . Since linear codes over mathcal R are submodules of mathcal R n we get direct implications for coding theory. For example, we show that random codes achieve the Gilbert Varshamov bound with high probability.


Drug Target Interaction Prediction with Graph Attention networks. Motivation Predicting Drug Target Interaction (DTI) is a well studied topic in bioinformatics due to its relevance in the fields of proteomics and pharmaceutical research. Although many machine learning methods have been successfully applied in this task, few of them aim at leveraging the inherent heterogeneous graph structure in the DTI network to address the challenge. For better learning and interpreting the DTI topological structure and the similarity, it is desirable to have methods specifically for predicting interactions from the graph structure. Results We present an end to end framework, DTI GAT (Drug Target Interaction prediction with Graph Attention networks) for DTI predictions. DTI GAT incorporates a deep neural network architecture that operates on graph structured data with the attention mechanism, which leverages both the interaction patterns and the features of drug and protein sequences. DTI GAT facilitates the interpretation of the DTI topological structure by assigning different attention weights to each node with the self attention mechanism. Experimental evaluations show that DTI GAT outperforms various state of the art systems on the binary DTI prediction problem. Moreover, the independent study results further demonstrate that our model can be generalized better than other conventional methods. Availability The source code and all datasets are available at https github.com Haiyang W DTI GRAPH


Multilingual LAMA Investigating Knowledge in Multilingual Pretrained Language Models. Recently, it has been found that monolingual English language models can be used as knowledge bases. Instead of structural knowledge base queries, masked sentences such as "Paris is the capital of MASK " are used as probes. We translate the established benchmarks TREx and GoogleRE into 53 languages. Working with mBERT, we investigate three questions. (i) Can mBERT be used as a multilingual knowledge base? Most prior work only considers English. Extending research to multiple languages is important for diversity and accessibility. (ii) Is mBERT's performance as knowledge base language independent or does it vary from language to language? (iii) A multilingual model is trained on more text, e.g., mBERT is trained on 104 Wikipedias. Can mBERT leverage this for better performance? We find that using mBERT as a knowledge base yields varying performance across languages and pooling predictions across languages improves performance. Conversely, mBERT exhibits a language bias e.g., when queried in Italian, it tends to predict Italy as the country of origin.


Finding Geometric Representations of Apex Graphs is NP Hard. Planar graphs can be represented as intersection graphs of different types of geometric objects in the plane, e.g., circles (Koebe, 1936), line segments (Chalopin Gon c c alves, 2009), textsc L shapes (Gon c c alves et al, 2018). For general graphs, however, even deciding whether such representations exist is often NP hard. We consider apex graphs, i.e., graphs that can be made planar by removing one vertex from them. We show, somewhat surprisingly, that deciding whether geometric representations exist for apex graphs is NP hard. More precisely, we show that for every positive integer k , recognizing every graph class mathcal G which satisfies textsc PURE 2 DIR subseteq mathcal G subseteq textsc 1 STRING is NP hard, even when the input graphs are apex graphs of girth at least k . Here, PURE 2 DIR is the class of intersection graphs of axis parallel line segments (where intersections are allowed only between horizontal and vertical segments) and textsc 1 STRING is the class of intersection graphs of simple curves (where two curves share at most one point) in the plane. This partially answers an open question raised by Kratochv ' i l Pergel (2007). Most known NP hardness reductions for these problems are from variants of 3 SAT. We reduce from the textsc PLANAR HAMILTONIAN PATH COMPLETION problem, which uses the more intuitive notion of planarity. As a result, our proof is much simpler and encapsulates several classes of geometric graphs.


Effect of forward speed on the level crossing distribution of kinematic variables in multidirectional ocean waves. The influence of forward speed on stochastic free surface crossing, in a Gaussian wave field, is investigated. The case of a material point moving with a constant forward speed is considered the wave field is assumed stationary in time, and homogeneous in space. The focus is on up crossing events, which are defined as the material point crossing the free surface, into the water domain. The effect of the Doppler shift (induced by the forward speed) on the up crossing frequency, and the related conditional joint distribution of wave kinematic variables is analytically investigated. Some general trends are illustrated through different examples, where three kinds of wave direction distribution are considered unidirectional, short crested anisotropic, and isotropic. The way the developed approach may be used in the context of slamming on marine structures is briefly discussed.


Deformable Scintillation Dosimeter II Real Time Simultaneous Measurements of Dose and Tracking of Deformation Vector Fields. Anatomical motion and deformation pose challenges to the understanding of the delivered dose distribution during radiotherapy treatments. Hence, deformable image registration (DIR) algorithms are increasingly used to map contours and dose distributions from one image set to another. However, the lack of validation tools slows their clinical adoption, despite their commercial availability. This work presents a novel water equivalent deformable dosimeter that simultaneously measures the dose distribution and tracks deformation vector fields (DVF). The dosimeter in made of an array of 19 scintillating fiber detectors embedded in a cylindrical elastomer matrix. It is imaged by two pairs of stereoscopic cameras tracking the position and angulation of the scintillators, while measuring the dose. The resulting system provides a precision of 0.3 mm on DVF measurements. The dosimeter was irradiated with 5 times 3, 4 times 3 and 3 times 3 cm 2 6 MV photon beams in both fixed and deformed conditions. The measured DVF was compared to the one computed with a DIR algorithm (Plastimatch). The deviations between the computed and measured DVFs was below 1.5 mm. As for dose measurements, the dosimeter acquired the dose distribution in fixed and deformed conditions within 1 of the treatment planning system calculation and complementary dose validation using the Hyperscint dosimetry system. Using the demonstrated qualities of scintillating detectors, we developed a real time, water equivalent deformable dosimeter. Given it's sensor tracking position precision and dose measurements accuracy, the developed detector is a promising tools for the validation of DIR algorithms as well as dose distribution measurements under fixed and deformed conditions.


Amenable fusion algebraic actions of discrete quantum groups on compact quantum spaces. In this paper, we introduce actions of fusion algebras on unital C algebras, and define amenability for fusion algebraic actions. Motivated by S. Neshveyev et al.'s work, considering the co representation ring of a compact quantum group as a fusion algebra, we define the canonical fusion algebraic (for short, CFA) form of a discrete quantum group action on a compact quantum space. Furthermore, through the CFA form, we define FA amenability of discrete quantum group actions, and present some basic connections between FA amenable actions and amenable discrete quantum groups. As an application, thinking of a state on a unital C algebra as a "probability measure" on a compact quantum space, we show that amenability for a discrete quantum group is equivalent to both of FA amenability for an action of this discrete quantum group on a compact quantum space and the existence of this kind of "probability measure" that is FA invariant under this action.


Transience of symmetric non local Dirichlet forms. We establish transience criteria for symmetric non local Dirichlet forms on L 2( mathbb R d) in terms of the coefficient growth rates at infinity. Applying these criteria, we find a necessary and sufficient condition for recurrence of Dirichlet forms of symmetric stable like with unbounded degenerate coefficients. This condition indicates that both of the coefficient growth rates of small and big jump parts affect the sample path properties of the associated symmetric jump processes.


Forming Ensembles at Runtime A Machine Learning Approach. Smart system applications (SSAs) built on top of cyber physical and socio technical systems are increasingly composed of components that can work both autonomously and by cooperating with each other. Cooperating robots, fleets of cars and fleets of drones, emergency coordination systems are examples of SSAs. One approach to enable cooperation of SSAs is to form dynamic cooperation groups ensembles between components at runtime. Ensembles can be formed based on predefined rules that determine which components should be part of an ensemble based on their current state and the state of the environment (e.g., "group together 3 robots that are closer to the obstacle, their battery is sufficient and they would not be better used in another ensemble"). This is a computationally hard problem since all components are potential members of all possible ensembles at runtime. In our experience working with ensembles in several case studies the past years, using constraint programming to decide which ensembles should be formed does not scale for more than a limited number of components and ensembles. Also, the strict formulation in terms of hard soft constraints does not easily permit for runtime self adaptation via learning. This poses a serious limitation to the use of ensembles in large scale and partially uncertain SSAs. To tackle this problem, in this paper we propose to recast the ensemble formation problem as a classification problem and use machine learning to efficiently form ensembles at scale.