The Impact of User Location on Cookie Notices (Inside and Outside of the European Union). The web is global, but privacy laws differ by country. Which set of privacy rules do websites follow? We empirically study this question by detecting and analyzing cookie notices in an automated way. We crawl 1,500 European, American, and Canadian websites from each of 18 countries. We detect cookie notices on 40 percent of websites in our sample. We treat the presence or absence of cookie notices, as well as visual differences, as proxies for differences in privacy rules. Using a series of regression models, we find that the website's Top Level Domain explains a substantial portion of the variance in cookie notice metrics, but the user's vantage point does not. This suggests that websites follow one set of privacy rules for all their users. There is one exception to this finding cookie notices differ when accessing .com domains from inside versus outside of the EU. We highlight ways in which future research could build on our preliminary findings.


Support Set Based Cross Supervision for Video Grounding. Current approaches for video grounding propose kinds of complex architectures to capture the video text relations, and have achieved impressive improvements. However, it is hard to learn the complicated multi modal relations by only architecture designing in fact. In this paper, we introduce a novel Support set Based Cross Supervision (Sscs) module which can improve existing methods during training phase without extra inference cost. The proposed Sscs module contains two main components, i.e., discriminative contrastive objective and generative caption objective. The contrastive objective aims to learn effective representations by contrastive learning, while the caption objective can train a powerful video encoder supervised by texts. Due to the co existence of some visual entities in both ground truth and background intervals, i.e., mutual exclusion, naively contrastive learning is unsuitable to video grounding. We address the problem by boosting the cross supervision with the support set concept, which collects visual information from the whole video and eliminates the mutual exclusion of entities. Combined with the original objectives, Sscs can enhance the abilities of multi modal relation modeling for existing approaches. We extensively evaluate Sscs on three challenging datasets, and show that our method can improve current state of the art methods by large margins, especially 6.35 in terms of R1 0.5 on Charades STA.


Auditing for Discrimination in Algorithms Delivering Job Ads. Ad platforms such as Facebook, Google and LinkedIn promise value for advertisers through their targeted advertising. However, multiple studies have shown that ad delivery on such platforms can be skewed by gender or race due to hidden algorithmic optimization by the platforms, even when not requested by the advertisers. Building on prior work measuring skew in ad delivery, we develop a new methodology for black box auditing of algorithms for discrimination in the delivery of job advertisements. Our first contribution is to identify the distinction between skew in ad delivery due to protected categories such as gender or race, from skew due to differences in qualification among people in the targeted audience. This distinction is important in U.S. law, where ads may be targeted based on qualifications, but not on protected categories. Second, we develop an auditing methodology that distinguishes between skew explainable by differences in qualifications from other factors, such as the ad platform's optimization for engagement or training its algorithms on biased data. Our method controls for job qualification by comparing ad delivery of two concurrent ads for similar jobs, but for a pair of companies with different de facto gender distributions of employees. We describe the careful statistical tests that establish evidence of non qualification skew in the results. Third, we apply our proposed methodology to two prominent targeted advertising platforms for job ads Facebook and LinkedIn. We confirm skew by gender in ad delivery on Facebook, and show that it cannot be justified by differences in qualifications. We fail to find skew in ad delivery on LinkedIn. Finally, we suggest improvements to ad platform practices that could make external auditing of their algorithms in the public interest more feasible and accurate.


A survey on spectral conditions for some extremal graph problems. This survey is two fold. We first report new progress on the spectral extremal results on the Tur ' a n type problems in graph theory. More precisely, we shall summarize the spectral Tur ' a n function in terms of the adjacency spectral radius and the signless Laplacian spectral radius for various graphs. For instance, the complete graphs, general graphs with chromatic number at least three, complete bipartite graphs, odd cycles, even cycles, color critical graphs and intersecting triangles. The second goal is to conclude some recent results of the spectral conditions on some graphical properties. By a unified method, we present some sufficient conditions based on the adjacency spectral radius and the signless Laplacian spectral radius for a graph to be Hamiltonian, k Hamiltonian, k edge Hamiltonian, traceable, k path coverable, k connected, k edge connected, Hamilton connected, perfect matching and beta deficient.


CoProtector Protect Open Source Code against Unauthorized Training Usage with Data Poisoning. Github Copilot, trained on billions of lines of public code, has recently become the buzzword in the computer science research and practice community. Although it is designed to help developers implement safe and effective code with powerful intelligence, practitioners and researchers raise concerns about its ethical and security problems, e.g., should the copyleft licensed code be freely leveraged or insecure code be considered for training in the first place? These problems pose a significant impact on Copilot and other similar products that aim to learn knowledge from large scale open source code through deep learning models, which are inevitably on the rise with the fast development of artificial intelligence. To mitigate such impacts, we argue that there is a need to invent effective mechanisms for protecting open source code from being exploited by deep learning models. Here, we design and implement a prototype, CoProtector, which utilizes data poisoning techniques to arm source code repositories for defending against such exploits. Our large scale experiments empirically show that CoProtector is effective in achieving its purpose, significantly reducing the performance of Copilot like deep learning models while being able to stably reveal the secretly embedded watermark backdoors.


Fiber Convex Bodies. In this paper we study the fiber body, that is the extension of the notion of fiber polytopes for more general convex bodies. After giving an overview of the properties of the fiber body, we focus on three particular classes of convex bodies. First we describe the strict convexity of the fiber body of the so called puffed polytopes. Then we provide an explicit equation for the support function of the fiber body of some smooth convex bodies. Finally we give a formula that allows to compute the fiber body of a zonoid with a particular focus on the so called discotopes. Throughout the paper we illustrate our results with detailed examples.


Two maps on affine type A crystals and Hecke algebras. We use the crystal isomorphisms of the Fock space to describe two maps on partitions and multipartitions which naturally appear in the crystal basis theory for quantum groups in affine type A and in the representation theory of Hecke algebras of type G(l, l, n).


A General Theory of Pointlike Sets. We introduce a general unifying framework for the investigation of pointlike sets. The pointlike functors are considered as distinguished elements of a certain lattice of subfunctors of the power semigroup functor in particular, we exhibit the pointlike functors as the fixed points of a closure operator induced by an antitone Galois connection between this lattice of functors and the lattice of pseudovarieties. Notably, this provides a characterization of pointlikes which does not mention relational morphisms. Along the way, we formalize various common heuristics and themes in the study of pointlike sets. As an application, we provide a general method for transferring lower bounds for pointlikes along a large class of continuous operators on the lattice of pseudovarieties.


A Survey of Toxic Comment Classification Methods. While in real life everyone behaves themselves at least to some extent, it is much more difficult to expect people to behave themselves on the internet, because there are few checks or consequences for posting something toxic to others. Yet, for people on the other side, toxic texts often lead to serious psychological consequences. Detecting such toxic texts is challenging. In this paper, we attempt to build a toxicity detector using machine learning methods including CNN, Naive Bayes model, as well as LSTM. While there has been numerous groundwork laid by others, we aim to build models that provide higher accuracy than the predecessors. We produced very high accuracy models using LSTM and CNN, and compared them to the go to solutions in language processing, the Naive Bayes model. A word embedding approach is also applied to empower the accuracy of our models.


Roman Domination of the Comet, Double Comet, and Comb Graphs. One of the well known measurements of vulnerability in graph theory is domination. There are many kinds of dominating and relative types of sets in graphs. However, we are going to focus on Roman domination, which is a type of domination that came up with an article by Ian Stewart. The Roman domination numbers of the comet, double comet, and comb graphs are given in this paper.


ACOA Chronological Analysis of the Exhibition of Artistic Works. We are currently prioritizing home activities, avoiding human contact, and carrying out external activities mostly by necessity. Therefore, and due to the loss of adhesion to cultural events on the part of the population, the cultural digital transformation process has been boosted, aiming to reach interested communities through digital media. The ACOA platform supports the organization of multiple sources of information related to creative processes behind complex artworks and their trajectories over time. This information is of great interest to conservators and curators, as well as to the general public, as it allows to document changes in the artwork, from the moment it was conceived by the artist, until its most recent exhibition. This platform houses a chronological evolution of the work, through the contextual dissemination of associated multimedia content. Works by the Portuguese artist Ana Vieira (1940 2016) were chosen as case studies for the implementation of the platform.


GPU Semiring Primitives for Sparse Neighborhood Methods. High performance primitives for mathematical operations on sparse vectors must deal with the challenges of skewed degree distributions and limits on memory consumption that are typically not issues in dense operations. We demonstrate that a sparse semiring primitive can be flexible enough to support a wide range of critical distance measures while maintaining performance and memory efficiency on the GPU. We further show that this primitive is a foundational component for enabling many neighborhood based information retrieval and machine learning algorithms to accept sparse input. To our knowledge, this is the first work aiming to unify the computation of several critical distance measures on the GPU under a single flexible design paradigm and we hope that it provides a good baseline for future research in this area. Our implementation is fully open source and publicly available as part of the RAFT library of GPU accelerated machine learning primitives (https github.com rapidsai raft).


Explainable AI for B5G 6G Technical Aspects, Use Cases, and Research Challenges. When 5G began its commercialisation journey around 2020, the discussion on the vision of 6G also surfaced. Researchers expect 6G to have higher bandwidth, coverage, reliability, energy efficiency, lower latency, and, more importantly, an integrated "human centric" network system powered by artificial intelligence (AI). Such a 6G network will lead to an excessive number of automated decisions made every second. These decisions can range widely, from network resource allocation to collision avoidance for self driving cars. However, the risk of losing control over decision making may increase due to high speed data intensive AI decision making beyond designers and users' comprehension. The promising explainable AI (XAI) methods can mitigate such risks by enhancing the transparency of the black box AI decision making process. This survey paper highlights the need for XAI towards the upcoming 6G age in every aspect, including 6G technologies (e.g., intelligent radio, zero touch network management) and 6G use cases (e.g., industry 5.0). Moreover, we summarised the lessons learned from the recent attempts and outlined important research challenges in applying XAI for building 6G systems. This research aligns with goals 9, 11, 16, and 17 of the United Nations Sustainable Development Goals (UN SDG), promoting innovation and building infrastructure, sustainable and inclusive human settlement, advancing justice and strong institutions, and fostering partnership at the global level.


Recovery Guarantees for Time varying Pairwise Comparison Matrices with Non transitivity. Pairwise comparison matrices have received substantial attention in a variety of applications, especially in rank aggregation, the task of flattening items into a one dimensional (and thus transitive) ranking. However, non transitive preference cycles can arise in practice due to the fact that making a decision often requires a complex evaluation of multiple factors. In some applications, it may be important to identify and preserve information about the inherent non transitivity, either in the pairwise comparison data itself or in the latent feature space. In this work, we develop structured models for non transitive pairwise comparison matrices that can be exploited to recover such matrices from incomplete noisy data and thus allow the detection of non transitivity. Considering that individuals' tastes and items' latent features may change over time, we formulate time varying pairwise comparison matrix recovery as a dynamic skew symmetric matrix recovery problem by modeling changes in the low rank factors of the pairwise comparison matrix. We provide theoretical guarantees for the recovery and numerically test the proposed theory with both synthetic and real world data.


The Neural Network shifted Proper Orthogonal Decomposition a Machine Learning Approach for Non linear Reduction of Hyperbolic Equations. Models with dominant advection always posed a difficult challenge for projection based reduced order modelling. Many methodologies that have recently been proposed are based on the pre processing of the full order solutions to accelerate the Kolmogorov N width decay thereby obtaining smaller linear subspaces with improved accuracy. These methods however must rely on the knowledge of the characteristic speeds in phase space of the solution, limiting their range of applicability to problems with explicit functional form for the advection field. In this work we approach the problem of automatically detecting the correct pre processing transformation in a statistical learning framework by implementing a deep learning architecture. The purely data driven method allowed us to generalise the existing approaches of linear subspace manipulation to non linear hyperbolic problems with unknown advection fields. The proposed algorithm has been validated against simple test cases to benchmark its performances and later successfully applied to a multiphase simulation.


Steiner Configurations ideals containment and colouring. Given a homogeneous ideal I subseteq k x 0, dots,x n , the Containment problem studies the relation between symbolic and regular powers of I , that is, it asks for which pair m, r in mathbb N , I (m) subseteq I r holds. In the last years, several conjectures have been posed on this problem, creating an active area of current interests and ongoing investigations. In this paper, we investigated the Stable Harbourne Conjecture and the Stable Harbourne Huneke Conjecture and we show that they hold for the defining ideal of a Complement of a Steiner configuration of points in mathbb P n k . We can also show that the ideal of a Complement of a Steiner Configuration of points has expected resurgence, that is, its resurgence is strictly less than its big height, and it also satisfies Chudnovsky and Demailly's Conjectures. Moreover, given a hypergraph H , we also study the relation between its colourability and the failure of the containment problem for the cover ideal associated to H . We apply these results in the case that H is a Steiner System.


Concurrent Realizability on Conjunctive Structures. The point of this work is to explore axiomatisations of concurrent computation using the technology of proof theory and realizability. To deal with this problem, we redefine the Concurrent Realizability of Beffara using as realizers a pi calculus with global fusions. We define a variant of the Conjunctive Structures of 'E Miquey as a general structure where belong realizers and truth values from realizability. As for Secuential Realizability, we encode the realizers into the algebraic structure by means of a combinatory presentation, following the work of Honda Yoshida. In this first work we restricted to work with the pi calculus without replication and its corresponding type system is the multiplicative linear logic (MLL).


Full Spin Wave Scaled Finite Element Stochastic Micromagnetism Mesh Independent FUSSS LLG Simulations of Ferromagnetic Resonance and Reversal. In this paper, we address the problem that standard stochastic Landau Lifshitz Gilbert (sLLG) simulations typically produce results that show unphysical mesh size dependence. The root cause of this problem is that the effects of spin wave fluctuations are ignored in sLLG. We propose to represent the effect of these fluctuations by a "FUll Spinwave Scaled Stochastic LLG", or FUSSS LLG method. In FUSSS LLG, the intrinsic parameters of the sLLG simulations are first scaled by scaling factors that integrate out the spin wave fluctuations up to the mesh size, and the sLLG simulation is then performed with these scaled parameters. We developed FUSSS LLG by studying the Ferromagnetic Resonance (FMR) in Nd 2 Fe 14 B cubes. The nominal scaling greatly reduced the mesh size dependence relative to sLLG. We further discovered that adjusting one scaling exponent by less than 10 delivered fully mesh size independent results for the FMR peak. We then performed three tests and validations of our FUSSS LLG with this modified scaling. 1) We studied the same FMR but with magnetostatic fields included. 2) We simulated the total magnetization of the Nd 2 Fe 14 B cube. 3) We studied the effective, temperature and sweeping rate dependent coercive field of the cubes. In all three cases we found that FUSSS LLG delivered essentially mesh size independent results, which tracked the theoretical expectations better than unscaled sLLG. Motivated by these successful validations, we propose that FUSSS LLG provides marked, qualitative progress towards accurate, high precision modeling of micromagnetics in hard, permanent magnets.


ViPNAS Efficient Video Pose Estimation via Neural Architecture Search. Human pose estimation has achieved significant progress in recent years. However, most of the recent methods focus on improving accuracy using complicated models and ignoring real time efficiency. To achieve a better trade off between accuracy and efficiency, we propose a novel neural architecture search (NAS) method, termed ViPNAS, to search networks in both spatial and temporal levels for fast online video pose estimation. In the spatial level, we carefully design the search space with five different dimensions including network depth, width, kernel size, group number, and attentions. In the temporal level, we search from a series of temporal feature fusions to optimize the total accuracy and speed across multiple video frames. To the best of our knowledge, we are the first to search for the temporal feature fusion and automatic computation allocation in videos. Extensive experiments demonstrate the effectiveness of our approach on the challenging COCO2017 and PoseTrack2018 datasets. Our discovered model family, S ViPNAS and T ViPNAS, achieve significantly higher inference speed (CPU real time) without sacrificing the accuracy compared to the previous state of the art methods.


Embedding based Product Retrieval in Taobao Search. Nowadays, the product search service of e commerce platforms has become a vital shopping channel in people's life. The retrieval phase of products determines the search system's quality and gradually attracts researchers' attention. Retrieving the most relevant products from a large scale corpus while preserving personalized user characteristics remains an open question. Recent approaches in this domain have mainly focused on embedding based retrieval (EBR) systems. However, after a long period of practice on Taobao, we find that the performance of the EBR system is dramatically degraded due to its (1) low relevance with a given query and (2) discrepancy between the training and inference phases. Therefore, we propose a novel and practical embedding based product retrieval model, named Multi Grained Deep Semantic Product Retrieval (MGDSPR). Specifically, we first identify the inconsistency between the training and inference stages, and then use the softmax cross entropy loss as the training objective, which achieves better performance and faster convergence. Two efficient methods are further proposed to improve retrieval relevance, including smoothing noisy training data and generating relevance improving hard negative samples without requiring extra knowledge and training procedures. We evaluate MGDSPR on Taobao Product Search with significant metrics gains observed in offline experiments and online A B tests. MGDSPR has been successfully deployed to the existing multi channel retrieval system in Taobao Search. We also introduce the online deployment scheme and share practical lessons of our retrieval system to contribute to the community.


Marginally unstable discrete time linear switched systems with highly irregular trajectory growth. We investigate the uniform stability properties of discrete time linear switched systems subject to arbitrary switching, focusing on the "marginally unstable" regime in which the system is not Lyapunov stable but in which trajectories cannot escape to infinity at exponential speed. For a discrete linear system of this type without switching the fastest growing trajectory must grow as an exact polynomial function of time, and a significant body of prior research has focused on investigating how far this intuitive picture can be extended from systems without switching to cases where switching is present. In this note we give an example of a family of discrete linear switched systems in three dimensions, with two switching states, for which this intuition fails badly for a generic member of this family the maximal rate of uniform growth of escaping trajectories can be made arbitrarily slow along one subsequence of times and yet also faster than any prescribed slower than linear function along a complementary subsequence of times. Using this construction we give new counterexamples to a conjecture of Chitour, Mason and Sigalotti and obtain a negative answer to a related question of Jungers, Protasov and Blondel. Our examples have the additional feature that marginal stability and marginal instability are densely intermingled in the same parameter space.


physics.chem-ph physics.atom-ph physics.med-ph physics.optics

Ultra sensitive multi species spectroscopic breath analysis for real time health monitoring and diagnostics. Breath analysis enables rapid, non invasive diagnostics, as well as long term monitoring, of human health through the identification and quantification of exhaled biomarkers. Here, for the first time, we demonstrate the remarkable capabilities of mid infrared (mid IR) cavity enhanced direct frequency comb spectroscopy (CE DFCS) applied to breath analysis. We simultaneously detect and monitor as a function of time four breath biomarkers CH 3 OH, CH 4 , H 2 O and HDO as well as illustrating the feasibility of detecting at least six more (H 2 CO, C 2 H 6 , OCS, C 2 H 4 , CS 2 and NH 3 ) without modifications to the experimental apparatus. We achieve ultra high detection sensitivity at the parts per trillion level. This is made possible by the combination of the broadband spectral coverage of a frequency comb, the high spectral resolution afforded by the individual comb teeth, and the sensitivity enhancement resulting from a high finesse cavity. Exploiting recent advances in frequency comb, optical coating, and photodetector technologies, we can access a large variety of biomarkers with strong carbon hydrogen bond spectral signatures in the mid IR.


A Deep Learning based Multimodal Depth Aware Dynamic Hand Gesture Recognition System. The dynamic hand gesture recognition task has seen studies on various unimodal and multimodal methods. Previously, researchers have explored depth and 2D skeleton based multimodal fusion CRNNs (Convolutional Recurrent Neural Networks) but have had limitations in getting expected recognition results. In this paper, we revisit this approach to hand gesture recognition and suggest several improvements. We observe that raw depth images possess low contrast in the hand regions of interest (ROI). They do not highlight important fine details, such as finger orientation, overlap between the finger and palm, or overlap between multiple fingers. We thus propose quantizing the depth values into several discrete regions, to create a higher contrast between several key parts of the hand. In addition, we suggest several ways to tackle the high variance problem in existing multimodal fusion CRNN architectures. We evaluate our method on two benchmarks the DHG 14 28 dataset and the SHREC'17 track dataset. Our approach shows a significant improvement in accuracy and parameter efficiency over previous similar multimodal methods, with a comparable result to the state of the art.


The p primary subgroups of the cohomology of BPU n in dimensions less than 2p 5 . Let PU n the projective unitary group of rank n and BPU n its classifying space. For an odd prime p , we extend previous results to a compete description of H s(BPU n mathbb Z ) (p) for s 2p 5 by showing that the p primary subgroups of H s(BPU n mathbb Z ) are trivial for s 2p 3 and s 2p 4 .


Convergence of Restricted Additive Schwarz with impedance transmission conditions for discretised Helmholtz problems. The Restricted Additive Schwarz method with impedance transmission conditions, also known as the Optimised Restricted Additive Schwarz (ORAS) method, is a simple overlapping one level parallel domain decomposition method, which has been successfully used as an iterative solver and as a preconditioner for discretized Helmholtz boundary value problems. In this paper, we give, for the first time, a convergence analysis for ORAS as an iterative solver and also as a preconditioner for nodal finite element Helmholtz systems of any polynomial order. The analysis starts by showing (for general domain decompositions) that ORAS as an unconventional finite element approximation of a classical parallel iterative Schwarz method, formulated at the PDE (non discrete) level. This non discrete Schwarz method was recently analysed in Gong, Gander, Graham, Lafontaine, Spence, arXiv 2106.05218 , and the present paper gives a corresponding discrete version of this analysis. In particular, for domain decompositions in strips in 2 d, we show that, when the mesh size is small enough, ORAS inherits the convergence properties of the Schwarz method, independent of polynomial order. The proof relies on characterising the ORAS iteration in terms of discrete impedance to impedance maps', which we prove (via a novel weighted finite element error analysis) converge as h rightarrow 0 in the operator norm to their non discrete counterparts.


Comment on arXiv 2008.08305 "Scallop Theorem and Swimming at the Mesoscale" by M. Hubert, O. Trosman, Y. Collard, A. Sukhov, J. Harting, N. Vandewalle, and A. S. Smith, Phys. Rev. Letters vc 126 , 224501 (2021). The expression for the mean swimming velocity of the Oseen two sphere model derived in the Letter arXiv 2008.08305 is compared with an exact one derived earlier, as well as one derived in first harmonic approximation. The latter is found to be a very accurate approximation to the exact result.


The finite time blow up of the Yang Mills flow. In this paper, we shall prove that, on a non flat Riemannian vector bundle over a compact Riemannian manifold, the smooth solution of the Yang Mills flow will blow up in finite time if the energy of the initial connection is small enough. We also consider the finite time blow up for the Yang Mills flow with the initial curvature near the harmonic form. Furthermore, when E is a holomorphic vector bundle over a compact K "ahler manifold, then E will admit a projective flat structure if the trace free part of Chern curvature is small enough.


Analysis of reliability systems via Gini type index. Different strategies of reliability theory for the analysis of coherent systems have been studied by various researchers. Here, the Gini type index is utilized as an applicable tool for the study and comparison of the ageing properties of complex systems. A new stochastic order in terms of Gini type index is introduced to compare the speed of ageing of components and systems. The parallel series and series parallel systems with shared components are studied by their corresponding Gini type indexes. Also, the generalization of Gini type index for the multidimensional case is discussed, and is used to compare components lifetimes properties in the presence of other dependent components. It is shown that the ageing properties of a component lifetime can differ when the other components are working or have already failed. Numerous illustrative examples are given for better intuition of Gini type and generalized Gini type indexes throughout the paper.


The Word is Mightier than the Label Learning without Pointillistic Labels using Data Programming. Most advanced supervised Machine Learning (ML) models rely on vast amounts of point by point labelled training examples. Hand labelling vast amounts of data may be tedious, expensive, and error prone. Recently, some studies have explored the use of diverse sources of weak supervision to produce competitive end model classifiers. In this paper, we survey recent work on weak supervision, and in particular, we investigate the Data Programming (DP) framework. Taking a set of potentially noisy heuristics as input, DP assigns denoised probabilistic labels to each data point in a dataset using a probabilistic graphical model of heuristics. We analyze the math fundamentals behind DP and demonstrate the power of it by applying it on two real world text classification tasks. Furthermore, we compare DP with pointillistic active and semi supervised learning techniques traditionally applied in data sparse settings.


Car drivers' privacy concerns and trust perceptions. Modern cars are evolving in many ways. Technologies such as infotainment systems and companion mobile applications collect a variety of personal data from drivers to enhance the user experience. This paper investigates the extent to which car drivers understand the implications for their privacy, including that car manufacturers must treat that data in compliance with the relevant regulations. It does so by distilling out drivers' concerns on privacy and relating them to their perceptions of trust on car cyber security. A questionnaire is designed for such purposes to collect answers from a set of 1101 participants, so that the results are statistically relevant. In short, privacy concerns are modest, perhaps because there still is insufficient general awareness on the personal data that are involved, both for in vehicle treatment and for transmission over the Internet. Trust perceptions on cyber security are modest too (lower than those on car safety), a surprising contradiction to our research hypothesis that privacy concerns and trust perceptions on car cyber security are opponent. We interpret this as a clear demand for information and awareness building campaigns for car drivers, as well as for technical cyber security and privacy measures that are truly considerate of the human factor.


An Overview of Energy Optimal Impedance Control of Cooperative Robot Manipulators. An impedance based control scheme is introduced for cooperative manipulators grasping a rigid load. The position and orientation of the load are to be maintained close to a desired trajectory, trading off tracking accuracy by low energy consumption and maintaining stability. To this end, the augmented dynamics of the robots, their actuators and the load is formed, and an impedance control is adopted. A virtual control strategy is used to decouple torque control from actuator control. An optimization problem is then formulated using energy balance equations. The optimization finds the damping and stiffness gains of the impedance relation such that the energy consumption is minimized. Furthermore, L2 stability techniques are used to allow for time varying damping and stiffness in the desired impedance. A numerical example is provided to demonstrate the results.


Two phase segmentation for intensity inhomogeneous images by the Allen Cahn Local Binary Fitting Model. This paper proposes a new variational model by integrating the Allen Cahn term with a local binary fitting energy term for segmenting images with intensity inhomogeneity and noise. An inhomogeneous graph Laplacian initialization method (IGLIM) is developed to give the initial contour for two phase image segmentation problems. To solve the Allen Cahn equation derived from the variational model, we adopt the exponential time differencing (ETD) method for temporal discretization, and the central finite difference method for spatial discretization. The energy stability of proposed numerical schemes can be proved. Experiments on various images demonstrate the necessity and superiority of proper initialization and verify the capability of our model for two phase segmentation of images with intensity inhomogeneity and noise.


Elementary planes in the Apollonian orbifold. In this paper, we study the topological behavior of elementary planes in the Apollonian orbifold M A , whose limit set is the classical Apollonian gasket. The existence of these elementary planes leads to the following failure of equidistribution there exists a sequence of closed geodesic planes in M A limiting only on a finite union of closed geodesic planes. This contrasts with other acylindrical hyperbolic 3 manifolds analyzed in MMO1, arXiv 1802.03853, arXiv 1802.04423 . On the other hand, we show that certain rigidity still holds the area of an elementary plane in M A is uniformly bounded above, and the union of all elementary planes is closed. This is achieved by obtaining a complete list of elementary planes in M A , indexed by their intersection with the convex core boundary. The key idea is to recover information on a closed geodesic plane in M A from its boundary data requiring the plane to be elementary in turn puts restrictions on these data.


BOLD Dataset and Metrics for Measuring Biases in Open Ended Language Generation. Recent advances in deep learning techniques have enabled machines to generate cohesive open ended text when prompted with a sequence of words as context. While these models now empower many downstream applications from conversation bots to automatic storytelling, they have been shown to generate texts that exhibit social biases. To systematically study and benchmark social biases in open ended language generation, we introduce the Bias in Open Ended Language Generation Dataset (BOLD), a large scale dataset that consists of 23,679 English text generation prompts for bias benchmarking across five domains profession, gender, race, religion, and political ideology. We also propose new automated metrics for toxicity, psycholinguistic norms, and text gender polarity to measure social biases in open ended text generation from multiple angles. An examination of text generated from three popular language models reveals that the majority of these models exhibit a larger social bias than human written Wikipedia text across all domains. With these results we highlight the need to benchmark biases in open ended language generation and caution users of language generation models on downstream tasks to be cognizant of these embedded prejudices.


Novel Deep Learning Architecture for Heart Disease Prediction using Convolutional Neural Network. Healthcare is one of the most important aspects of human life. Heart disease is known to be one of the deadliest diseases which is hampering the lives of many people around the world. Heart disease must be detected early so the loss of lives can be prevented. The availability of large scale data for medical diagnosis has helped developed complex machine learning and deep learning based models for automated early diagnosis of heart diseases. The classical approaches have been limited in terms of not generalizing well to new data which have not been seen in the training set. This is indicated by a large gap in training and test accuracies. This paper proposes a novel deep learning architecture using a 1D convolutional neural network for classification between healthy and non healthy persons to overcome the limitations of classical approaches. Various clinical parameters are used for assessing the risk profile in the patients which helps in early diagnosis. Various techniques are used to avoid overfitting in the proposed network. The proposed network achieves over 97 training accuracy and 96 test accuracy on the dataset. The accuracy of the model is compared in detail with other classification algorithms using various performance parameters which proves the effectiveness of the proposed architecture.


Shapley Explanation Networks. Shapley values have become one of the most popular feature attribution explanation methods. However, most prior work has focused on post hoc Shapley explanations, which can be computationally demanding due to its exponential time complexity and preclude model regularization based on Shapley explanations during training. Thus, we propose to incorporate Shapley values themselves as latent representations in deep models thereby making Shapley explanations first class citizens in the modeling paradigm. This intrinsic explanation approach enables layer wise explanations, explanation regularization of the model during training, and fast explanation computation at test time. We define the Shapley transform that transforms the input into a Shapley representation given a specific function. We operationalize the Shapley transform as a neural network module and construct both shallow and deep networks, called ShapNets, by composing Shapley modules. We prove that our Shallow ShapNets compute the exact Shapley values and our Deep ShapNets maintain the missingness and accuracy properties of Shapley values. We demonstrate on synthetic and real world datasets that our ShapNets enable layer wise Shapley explanations, novel Shapley regularizations during training, and fast computation while maintaining reasonable performance. Code is available at https github.com inouye lab ShapleyExplanationNetworks.


AdaTag Multi Attribute Value Extraction from Product Profiles with Adaptive Decoding. Automatic extraction of product attribute values is an important enabling technology in e Commerce platforms. This task is usually modeled using sequence labeling architectures, with several extensions to handle multi attribute extraction. One line of previous work constructs attribute specific models, through separate decoders or entirely separate models. However, this approach constrains knowledge sharing across different attributes. Other contributions use a single multi attribute model, with different techniques to embed attribute information. But sharing the entire network parameters across all attributes can limit the model's capacity to capture attribute specific characteristics. In this paper we present AdaTag, which uses adaptive decoding to handle extraction. We parameterize the decoder with pretrained attribute embeddings, through a hypernetwork and a Mixture of Experts (MoE) module. This allows for separate, but semantically correlated, decoders to be generated on the fly for different attributes. This approach facilitates knowledge sharing, while maintaining the specificity of each attribute. Our experiments on a real world e Commerce dataset show marked improvements over previous methods.


On Krein Milman theorem for the space of sofic representations. Denote by Sof(G) the space of sofic representations of a countable group G . This space is known by a result of the second author, to have a convex like structure. We show that, in this space, minimal faces are extreme points. We then construct uncountable many extreme points for Sof( mathbb F 2) and show that there exists a decreasing chain of closed faces with empty intersection. Finally we construct a strangely looking sofic representation in Sof( mathbb F 2) that we believe it is outside of the closure of the convex hull of extreme points.


Paraconsistent Foundations for Quantum Probability. It is argued that a fuzzy version of 4 truth valued paraconsistent logic (with truth values corresponding to True, False, Both and Neither) can be approximately isomorphically mapped into the complex number algebra of quantum probabilities. I.e., p bits (paraconsistent bits) can be transformed into close approximations of qubits. The approximation error can be made arbitrarily small, at least in a formal sense, and can be related to the degree of irreducible "evidential error" assumed to plague an observer's observations. This logical correspondence manifests itself in program space via an approximate mapping between probabilistic and quantum types in programming languages.


Uniform resolvent estimates for critical magnetic Schr "odinger operators in 2D. We study the L p L q type uniform resolvent estimates for 2D Schr "odinger operators in scaling critical magnetic fields, involving the Aharonov Bohm model as a main example. As an application, we prove localization estimates for the eigenvalue of some non self adjoint zero order perturbations of the magnetic Hamiltonian.


Canonical Saliency Maps Decoding Deep Face Models. As Deep Neural Network models for face processing tasks approach human like performance, their deployment in critical applications such as law enforcement and access control has seen an upswing, where any failure may have far reaching consequences. We need methods to build trust in deployed systems by making their working as transparent as possible. Existing visualization algorithms are designed for object recognition and do not give insightful results when applied to the face domain. In this work, we present 'Canonical Saliency Maps', a new method that highlights relevant facial areas by projecting saliency maps onto a canonical face model. We present two kinds of Canonical Saliency Maps image level maps and model level maps. Image level maps highlight facial features responsible for the decision made by a deep face model on a given image, thus helping to understand how a DNN made a prediction on the image. Model level maps provide an understanding of what the entire DNN model focuses on in each task and thus can be used to detect biases in the model. Our qualitative and quantitative results show the usefulness of the proposed canonical saliency maps, which can be used on any deep face model regardless of the architecture.


Instability of degenerate solitons for nonlinear Schr "odinger equations with derivative. We consider the following nonlinear Schr " o dinger equation with derivative begin equation iu t u xx i u 2 u x b u 4u , quad (t,x) in mathbb R times mathbb R , b in mathbb R . end equation If b 0 , this equation is a gauge equivalent form of the well known derivative nonlinear Schr " o dinger (DNLS) equation. The soliton profile of DNLS satisfies a certain double power elliptic equation with cubic quintic nonlinearities. The quintic nonlinearity in our equation only affects the coefficient in front of the quintic term in the elliptic equation, so in this sense the additional nonlinearity is natural as a perturbation preserving soliton profiles of DNLS. When b ge 0 , the equation has degenerate solitons whose momentum and energy are zero, and if b 0 , they are algebraic solitons. Inspired from the works on instability theory of the L 2 critical generalized KdV equation, we study the instability of degenerate solitons in a qualitative way, and when b 0 , we obtain a large set of initial data yielding the instability. The arguments except one step in our proof work for the case b 0 in exactly the same way, which is a small step towards understanding the dynamics around algebraic solitons of the DNLS equation.


Conservative iterative methods for implicit discretizations of conservation laws. Conservation properties of iterative methods applied to implicit finite volume discretizations of nonlinear conservation laws are analyzed. It is shown that any consistent multistep or Runge Kutta method is globally conservative. Further, it is shown that Newton's method, Krylov subspace methods and pseudo time iterations are globally conservative while the Jacobi and Gauss Seidel methods are not in general. If pseudo time iterations using an explicit Runge Kutta method are applied to a locally conservative discretization, then the resulting scheme is also locally conservative. However, the corresponding numerical flux can be inconsistent with the conservation law. We prove an extension of the Lax Wendroff theorem, which reveals that numerical solutions based on these methods converge to weak solutions of a modified conservation law where the flux function is multiplied by a particular constant. This constant depends on the choice of Runge Kutta method but is independent of both the conservation law and the discretization. Consistency is maintained by ensuring that this constant equals unity and a strategy for achieving this is presented. Experiments show that this strategy improves the convergence rate of the pseudo time iterations.


De Morgan clones and four valued logics. We study clones on a four element set related to the clone mathsf DMA of all term functions of the sub directly irreducible four element De Morgan algebra mathbf DM 4 . We find generating sets for the clones of all functions preserving the subalgebras of mathbf DM 4 , the auto morphisms of mathbf DM 4 , the truth order and the information order on mathbf DM 4 , as well as clones defined by conjunctions of these conditions. We identify the covers of mathsf DMA in the lattice of four valued clones and describe the lattice of clones above mathsf DMA which contain the discriminator function. Finally, observing that each clone above mathsf DMA defines an expansion of the four valued Belnap Dunn logic, we classify these clones by their metalogical properties, specifically by their position within the Leibniz and Frege hierarchies of abstract algebraic logic.


Trustworthy Multimodal Regression with Mixture of Normal inverse Gamma Distributions. Multimodal regression is a fundamental task, which integrates the information from different sources to improve the performance of follow up applications. However, existing methods mainly focus on improving the performance and often ignore the confidence of prediction for diverse situations. In this study, we are devoted to trustworthy multimodal regression which is critical in cost sensitive domains. To this end, we introduce a novel Mixture of Normal Inverse Gamma distributions (MoNIG) algorithm, which efficiently estimates uncertainty in principle for adaptive integration of different modalities and produces a trustworthy regression result. Our model can be dynamically aware of uncertainty for each modality, and also robust for corrupted modalities. Furthermore, the proposed MoNIG ensures explicitly representation of (modality specific global) epistemic and aleatoric uncertainties, respectively. Experimental results on both synthetic and different real world data demonstrate the effectiveness and trustworthiness of our method on various multimodal regression tasks (e.g., temperature prediction for superconductivity, relative location prediction for CT slices, and multimodal sentiment analysis).


byteSteady Fast Classification Using Byte Level n Gram Embeddings. This article introduces byteSteady a fast model for classification using byte level n gram embeddings. byteSteady assumes that each input comes as a sequence of bytes. A representation vector is produced using the averaged embedding vectors of byte level n grams, with a pre defined set of n. The hashing trick is used to reduce the number of embedding vectors. This input representation vector is then fed into a linear classifier. A straightforward application of byteSteady is text classification. We also apply byteSteady to one type of non language data DNA sequences for gene classification. For both problems we achieved competitive classification results against strong baselines, suggesting that byteSteady can be applied to both language and non language data. Furthermore, we find that simple compression using Huffman coding does not significantly impact the results, which offers an accuracy speed trade off previously unexplored in machine learning.


Network Pruning That Matters A Case Study on Retraining Variants. Network pruning is an effective method to reduce the computational expense of over parameterized neural networks for deployment on low resource systems. Recent state of the art techniques for retraining pruned networks such as weight rewinding and learning rate rewinding have been shown to outperform the traditional fine tuning technique in recovering the lost accuracy (Renda et al., 2020), but so far it is unclear what accounts for such performance. In this work, we conduct extensive experiments to verify and analyze the uncanny effectiveness of learning rate rewinding. We find that the reason behind the success of learning rate rewinding is the usage of a large learning rate. Similar phenomenon can be observed in other learning rate schedules that involve large learning rates, e.g., the 1 cycle learning rate schedule (Smith et al., 2019). By leveraging the right learning rate schedule in retraining, we demonstrate a counter intuitive phenomenon in that randomly pruned networks could even achieve better performance than methodically pruned networks (fine tuned with the conventional approach). Our results emphasize the cruciality of the learning rate schedule in pruned network retraining a detail often overlooked by practitioners during the implementation of network pruning. One sentence Summary We study the effective of different retraining mechanisms while doing pruning


Joint Triplet Autoencoder for Histopathological Colon Cancer Nuclei Retrieval. Deep learning has shown a great improvement in the performance of visual tasks. Image retrieval is the task of extracting the visually similar images from a database for a query image. The feature matching is performed to rank the images. Various hand designed features have been derived in past to represent the images. Nowadays, the power of deep learning is being utilized for automatic feature learning from data in the field of biomedical image analysis. Autoencoder and Siamese networks are two deep learning models to learn the latent space (i.e., features or embedding). Autoencoder works based on the reconstruction of the image from latent space. Siamese network utilizes the triplets to learn the intra class similarity and inter class dissimilarity. Moreover, Autoencoder is unsupervised, whereas Siamese network is supervised. We propose a Joint Triplet Autoencoder Network (JTANet) by facilitating the triplet learning in autoencoder framework. A joint supervised learning for Siamese network and unsupervised learning for Autoencoder is performed. Moreover, the Encoder network of Autoencoder is shared with Siamese network and referred as the Siamcoder network. The features are extracted by using the trained Siamcoder network for retrieval purpose. The experiments are performed over Histopathological Routine Colon Cancer dataset. We have observed the promising performance using the proposed JTANet model against the Autoencoder and Siamese models for colon cancer nuclei retrieval in histopathological images.


Recurrence along Depth Deep Convolutional Neural Networks with Recurrent Layer Aggregation. This paper introduces a concept of layer aggregation to describe how information from previous layers can be reused to better extract features at the current layer. While DenseNet is a typical example of the layer aggregation mechanism, its redundancy has been commonly criticized in the literature. This motivates us to propose a very light weighted module, called recurrent layer aggregation (RLA), by making use of the sequential structure of layers in a deep CNN. Our RLA module is compatible with many mainstream deep CNNs, including ResNets, Xception and MobileNetV2, and its effectiveness is verified by our extensive experiments on image classification, object detection and instance segmentation tasks. Specifically, improvements can be uniformly observed on CIFAR, ImageNet and MS COCO datasets, and the corresponding RLA Nets can surprisingly boost the performances by 2 3 on the object detection task. This evidences the power of our RLA module in helping main CNNs better learn structural information in images.


Computational Intelligence Approach to Improve the Classification Accuracy of Brain Neoplasm in MRI Data. Automatic detection of brain neoplasm in Magnetic Resonance Imaging (MRI) is gaining importance in many medical diagnostic applications. This report presents two improvements for brain neoplasm detection in MRI data an advanced preprocessing technique is proposed to improve the area of interest in MRI data and a hybrid technique using Convolutional Neural Network (CNN) for feature extraction followed by Support Vector Machine (SVM) for classification. The learning algorithm for SVM is modified with the addition of cost function to minimize false positive prediction addressing the errors in MRI data diagnosis. The proposed approach can effectively detect the presence of neoplasm and also predict whether it is cancerous (malignant) or non cancerous (benign). To check the effectiveness of the proposed preprocessing technique, it is inspected visually and evaluated using training performance metrics. A comparison study between the proposed classification technique and the existing techniques was performed. The result showed that the proposed approach outperformed in terms of accuracy and can handle errors in classification better than the existing approaches.


Intel Optane DCPMM and Serverless Computing. This report describes 1) how we use Intel's Optane DCPMM in the memory Mode. We investigate the the scalability of applications on a single Optane machine, using Subgraph counting as memory intensive graph problem. We test with various input graph and subtemplate sizes to determine its performance for different memory and CPU loads, as well as a comparison of performance on a single node Optane with a distributed set of nodes in a cluster using MPI. 2) We investigate the end to end execution delays in serverless computing and study concurrent function executions with cold starts. In future work, we will show that persistent memory machines may significantly improve concurrent function invocations in serverless computing including Amazon Lambda, Microsoft Azure Functions, Google Cloud Functions and IBM Cloud Functions (Apache OpenWhisk).


Blow up and scattering for the 1D NLS with point nonlinearity above the mass energy threshold. In this paper, we study the nonlinear Schr "odinger equation with focusing point nonlinearity in dimension one. First, we establish a scattering criterion for the equation based on Kenig Merle's compactness rigidity argument. Then we prove the energy scattering below and above the mass energy threshold. We also describe the dynamics of solutions with data at the ground state threshold. Finally, we prove a blow up criteria for the equation with initial data with arbitrarily large energy.


Clockwork Variational Autoencoders. Deep learning has enabled algorithms to generate realistic images. However, accurately predicting long video sequences requires understanding long term dependencies and remains an open challenge. While existing video prediction models succeed at generating sharp images, they tend to fail at accurately predicting far into the future. We introduce the Clockwork VAE (CW VAE), a video prediction model that leverages a hierarchy of latent sequences, where higher levels tick at slower intervals. We demonstrate the benefits of both hierarchical latents and temporal abstraction on 4 diverse video prediction datasets with sequences of up to 1000 frames, where CW VAE outperforms top video prediction models. Additionally, we propose a Minecraft benchmark for long term video prediction. We conduct several experiments to gain insights into CW VAE and confirm that slower levels learn to represent objects that change more slowly in the video, and faster levels learn to represent faster objects.


Capacity Scalability of Line Networks with Batched Codes. The capacity of line networks with buffer size constraints is an open, but practically important problem. In this paper, we consider line networks formed by discrete memoryless channels, and study the achievable rate of batched codes, which include several existing coding schemes studied in literature for line networks as special cases. A batched code has an outer code and an inner code. The outer code encodes the information messages into batches, each of which is a group of coded symbols, while the inner code performs recoding on the symbols belonging to the same batch at all nodes that forwarding a batch. Batched codes enable us to impose various block length and buffer size constraints by tuning coding parameters. Using a technique that captures the communication bottleneck of line networks, we derive upper bounds on the achievable rates of batched codes as functions of line network length for several coding parameter sets. We also discuss specific recoding schemes that can achieve rates of the same order of the line network length for these coding parameter sets. Our results shed light on how to design large multi hop network communications in practical scenarios using a unified coding framework instead of the traditional layered approach.


The regularity problem for degenerate elliptic operators in weighted spaces. We study the solvability of the regularity problem for degenerate elliptic operators in the block case for data in weighted spaces. More precisely, let L w be a degenerate elliptic operator with degeneracy given by a fixed weight w in A 2(dx) in mathbb R n , and consider the associated block second order degenerate elliptic problem in the upper half space mathbb R n 1 . We obtain non tangential bounds for the full gradient of the solution of the block case operator given by the Poisson semigroup in terms of the gradient of the boundary data. All this is done in the spaces L p(vdw) where v is a Muckenhoupt weight with respect to the underlying natural weighted space ( mathbb R n, wdx) . We recover earlier results in the non degenerate case (when w equiv 1 , and with or without weight v ). Our strategy is also different and more direct thanks in particular to recent observations on change of angles in weighted square function estimates and non tangential maximal functions. Our method gives as a consequence the (unweighted) L 2(dx) solvability of the regularity problem for the block operator mathbb L alpha u(x,t) x alpha mathrm div x big( x alpha ,A(x) nabla x u(x,t) big) partial t 2 u(x,t) for any complex valued uniformly elliptic matrix A and for all epsilon alpha frac 2 ,n n 2 , where epsilon depends just on the dimension and the ellipticity constants of A .


A spectral independence view on hardspheres via block dynamics. The hard sphere model is one of the most extensively studied models in statistical physics. It describes the continuous distribution of spherical particles, governed by hard core interactions. An important quantity of this model is the normalizing factor of this distribution, called the partition function. We propose a Markov chain Monte Carlo algorithm for approximating the grand canonical partition function of the hard sphere model in d dimensions. Up to a fugacity of lambda text e 2 d , the runtime of our algorithm is polynomial in the volume of the system. This covers the entire known real valued regime for the uniqueness of the Gibbs measure. Key to our approach is to define a discretization that closely approximates the partition function of the continuous model. This results in a discrete hard core instance that is exponential in the size of the initial hard sphere model. Our approximation bound follows directly from the correlation decay threshold of an infinite regular tree with degree equal to the maximum degree of our discretization. To cope with the exponential blow up of the discrete instance we use clique dynamics, a Markov chain that was recently introduced in the setting of abstract polymer models. We prove rapid mixing of clique dynamics up to the tree threshold of the univariate hard core model. This is achieved by relating clique dynamics to block dynamics and adapting the spectral expansion method, which was recently used to bound the mixing time of Glauber dynamics within the same parameter regime.


Test Time Detection of Backdoor Triggers for Poisoned Deep Neural Networks. Backdoor (Trojan) attacks are emerging threats against deep neural networks (DNN). A DNN being attacked will predict to an attacker desired target class whenever a test sample from any source class is embedded with a backdoor pattern while correctly classifying clean (attack free) test samples. Existing backdoor defenses have shown success in detecting whether a DNN is attacked and in reverse engineering the backdoor pattern in a "post training" regime the defender has access to the DNN to be inspected and a small, clean dataset collected independently, but has no access to the (possibly poisoned) training set of the DNN. However, these defenses neither catch culprits in the act of triggering the backdoor mapping, nor mitigate the backdoor attack at test time. In this paper, we propose an "in flight" defense against backdoor attacks on image classification that 1) detects use of a backdoor trigger at test time and 2) infers the class of origin (source class) for a detected trigger example. The effectiveness of our defense is demonstrated experimentally against different strong backdoor attacks.


Reverse Engineering the Neural Tangent Kernel. The development of methods to guide the design of neural networks is an important open challenge for deep learning theory. As a paradigm for principled neural architecture design, we propose the translation of high performing kernels, which are better understood and amenable to first principles design, into equivalent network architectures, which have superior efficiency, flexibility, and feature learning. To this end, we constructively prove that, with just an appropriate choice of activation function, any positive semidefinite dot product kernel can be realized as either the conjugate or neural tangent kernel of a fully connected neural network with only one hidden layer. We verify our construction numerically and demonstrate its utility as a design tool for finite fully connected networks in several experiments.


Topological Regularization for Dense Prediction. Dense prediction tasks such as depth perception and semantic segmentation are important applications in computer vision that have a concrete topological description in terms of partitioning an image into connected components or estimating a function with a small number of local extrema corresponding to objects in the image. We develop a form of topological regularization based on persistent homology that can be used in dense prediction tasks with these topological descriptions. Experimental results show that the output topology can also appear in the internal activations of trained neural networks which allows for a novel use of topological regularization to the internal states of neural networks during training, reducing the computational cost of the regularization. We demonstrate that this topological regularization of internal activations leads to improved convergence and test benchmarks on several problems and architectures.


Sustainable AI Environmental Implications, Challenges and Opportunities. This paper explores the environmental impact of the super linear growth trends for AI from a holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the carbon footprint of AI computing by examining the model development cycle across industry scale machine learning use cases and, at the same time, considering the life cycle of system hardware. Taking a step further, we capture the operational and manufacturing carbon footprint of AI computing and present an end to end analysis for what and how hardware software design and at scale optimization can help reduce the overall carbon footprint of AI. Based on the industry experience and lessons learned, we share the key challenges and chart out important development directions across the many dimensions of AI. We hope the key messages and insights presented in this paper can inspire the community to advance the field of AI in an environmentally responsible manner.


Training Neural Networks for Solving 1 D Optimal Piecewise Linear Approximation. Recently, the interpretability of deep learning has attracted a lot of attention. A plethora of methods have attempted to explain neural networks by feature visualization, saliency maps, model distillation, and so on. However, it is hard for these methods to reveal the intrinsic properties of neural networks. In this work, we studied the 1 D optimal piecewise linear approximation (PWLA) problem, and associated it with a designed neural network, named lattice neural network (LNN). We asked four essential questions as following (1) What are the characters of the optimal solution of the PWLA problem? (2) Can an LNN converge to the global optimum? (3) Can an LNN converge to the local optimum? (4) Can an LNN solve the PWLA problem? Our main contributions are that we propose the theorems to characterize the optimal solution of the PWLA problem and present the LNN method for solving it. We evaluated the proposed LNNs on approximation tasks, forged an empirical method to improve the performance of LNNs. The experiments verified that our LNN method is competitive with the start of the art method.


Enhanced Preconditioner for JOREK MHD Solver. The JOREK extended magneto hydrodynamic (MHD) code is a widely used simulation code for studying the non linear dynamics of large scale instabilities in divertor tokamak plasmas. Due to the large scale separation intrinsic to these phenomena both in space and time, the computational costs for simulations in realistic geometry and with realistic parameters can be very high, motivating the investment of considerable effort for optimization. In this article, a set of developments regarding the JOREK solver and preconditioner is described, which lead to overall significant benefits for large production simulations. This comprises in particular enhanced convergence in highly non linear scenarios and a general reduction of memory consumption and computational costs. The developments include faster construction of preconditioner matrices, a domain decomposition of preconditioning matrices for solver libraries that can handle distributed matrices, interfaces for additional solver libraries, an option to use matrix compression methods, and the implementation of a complex solver interface for the preconditioner. The most significant development presented consists in a generalization of the physics based preconditioner to "mode groups", which allows to account for the dominant interactions between toroidal Fourier modes in highly non linear simulations. At the cost of a moderate increase of memory consumption, the technique can strongly enhance convergence in suitable cases allowing to use significantly larger time steps. For all developments, benchmarks based on typical simulation cases demonstrate the resulting improvements.


Viewpoint Invariant Dense Matching for Visual Geolocalization. In this paper we propose a novel method for image matching based on dense local features and tailored for visual geolocalization. Dense local features matching is robust against changes in illumination and occlusions, but not against viewpoint shifts which are a fundamental aspect of geolocalization. Our method, called GeoWarp, directly embeds invariance to viewpoint shifts in the process of extracting dense features. This is achieved via a trainable module which learns from the data an invariance that is meaningful for the task of recognizing places. We also devise a new self supervised loss and two new weakly supervised losses to train this module using only unlabeled data and weak labels. GeoWarp is implemented efficiently as a re ranking method that can be easily embedded into pre existing visual geolocalization pipelines. Experimental validation on standard geolocalization benchmarks demonstrates that GeoWarp boosts the accuracy of state of the art retrieval architectures. The code and trained models are available at https github.com gmberton geo warp


EDAssistant Supporting Exploratory Data Analysis in Computational Notebooks with In Situ Code Search and Recommendation. Using computational notebooks (e.g., Jupyter Notebook), data scientists rationalize their exploratory data analysis (EDA) based on their prior experience and external knowledge such as online examples. For novices or data scientists who lack specific knowledge about the dataset or problem to investigate, effectively obtaining and understanding the external information is critical to carry out EDA. This paper presents EDAssistant, a JupyterLab extension that supports EDA with in situ search of example notebooks and recommendation of useful APIs, powered by novel interactive visualization of search results. The code search and recommendation are enabled by state of the art machine learning models, trained on a large corpus of EDA notebooks collected online. A user study is conducted to investigate both EDAssistant and data scientists' current practice (i.e., using external search engines). The results demonstrate the effectiveness and usefulness of EDAssistant, and participants appreciated its smooth and in context support of EDA. We also report several design implications regarding code recommendation tools.


A Note On Non Isolated Real Singularities and Links. For analytic map germs f ( mathbb R n, 0) to ( mathbb R , 0) having an isolated critical value in the origin with dim V(f) 0 and satisfying the transversality property of D.B. Massey we show that for c 0 a large enough constant, and k a large enough natural number the local Milnor L e fibers of f and of the isolated singularity g f c( sum i 1 n x i 2) k satisfies the following. There exists a homotopy equivalence between the negative Milnor L e fiber of f , to which a cobordism between its boundary and the link of f has been adjoined, and the negative Milnor L e fiber of g .


Model based Decision Making with Imagination for Autonomous Parking. Autonomous parking technology is a key concept within autonomous driving research. This paper will propose an imaginative autonomous parking algorithm to solve issues concerned with parking. The proposed algorithm consists of three parts an imaginative model for anticipating results before parking, an improved rapid exploring random tree (RRT) for planning a feasible trajectory from a given start point to a parking lot, and a path smoothing module for optimizing the efficiency of parking tasks. Our algorithm is based on a real kinematic vehicle model which makes it more suitable for algorithm application on real autonomous cars. Furthermore, due to the introduction of the imagination mechanism, the processing speed of our algorithm is ten times faster than that of traditional methods, permitting the realization of real time planning simultaneously. In order to evaluate the algorithm's effectiveness, we have compared our algorithm with traditional RRT, within three different parking scenarios. Ultimately, results show that our algorithm is more stable than traditional RRT and performs better in terms of efficiency and quality.


Optical Magnetic Multipolar Resonances in Large Dynamic Metamolecules. Dynamic metamolecules (DMMs) are composed of a dielectric core made of hydrogel surrounded by randomly packed plasmonic beads that can display magnetic resonances when excited by light at optical frequencies. Their optical properties can be controlled by controlling their core diameter through temperature variations. We have recently shown that DMMs display strong optical magnetism, including magnetic dipole and magnetic quadrupole resonances, offering significant potential for novel applications. Here, we use a T matrix approach to characterize the magnetic multipole resonance modes of model metamolecules and explore their presence in experimental data. We show that high order multipole resonances become prominent as the bead size and the overall structure sizes are increased, and when the the inter bead gap is decreased. In this limit, mode mixing among high order magnetic multipole modes also become significant, particularly in the directional scattering spectra. We discuss trends in magnetic scattering observed in both experiments and simulations, and provide suggestions for experimental design and verification of high order optical magnetic resonances in the forward or backward scattering spectra. In addition, angular scattering of higher order magnetic modes can display Fano like interference patterns that should be experimentally detectable.


Controlling Text Edition by Changing Answers of Specific Questions. In this paper, we introduce the new task of controllable text edition, in which we take as input a long text, a question, and a target answer, and the output is a minimally modified text, so that it fits the target answer. This task is very important in many situations, such as changing some conditions, consequences, or properties in a legal document, or changing some key information of an event in a news text. This is very challenging, as it is hard to obtain a parallel corpus for training, and we need to first find all text positions that should be changed and then decide how to change them. We constructed the new dataset WikiBioCTE for this task based on the existing dataset WikiBio (originally created for table to text generation). We use WikiBioCTE for training, and manually labeled a test set for testing. We also propose novel evaluation metrics and a novel method for solving the new task. Experimental results on the test set show that our proposed method is a good fit for this novel NLP task.


FAST FPGA based Subgraph Matching on Massive Graphs. Subgraph matching is a basic operation widely used in many applications. However, due to its NP hardness and the explosive growth of graph data, it is challenging to compute subgraph matching, especially in large graphs. In this paper, we aim at scaling up subgraph matching on a single machine using FPGAs. Specifically, we propose a CPU FPGA co designed framework. On the CPU side, we first develop a novel auxiliary data structure called candidate search tree (CST) which serves as a complete search space of subgraph matching. CST can be partitioned and fully loaded into FPGAs' on chip memory. Then, a workload estimation technique is proposed to balance the load between the CPU and FPGA. On the FPGA side, we design and implement the first FPGA based subgraph matching algorithm, called FAST. To take full advantage of the pipeline mechanism on FPGAs, task parallelism optimization and task generator separation strategy are proposed for FAST, achieving massive parallelism. Moreover, we carefully develop a BRAM only matching process to fully utilize FPGA's on chip memory, which avoids the expensive intermediate data transfer between FPGA's BRAM and DRAM. Comprehensive experiments show that FAST achieves up to 462.0x and 150.0x speedup compared with the state of the art algorithm DAF and CECI, respectively. In addition, FAST is the only algorithm that can handle the billion scale graph using one machine in our experiments.


Strong one sided density without uniform density. In this paper we give an example of a closed, strongly one sided dense set which is not of uniform density type. We also show that there is a set of uniform density type which is not of strong uniform density type.


Spectral theory of spin substitutions. We introduce qubit substitutions in mathbb Z m , which have non rectangular domains based on an endomorphism Q of mathbb Z m and a set mathcal D of coset representatives of mathbb Z m Q mathbb Z m . We then focus on a specific family of qubit substitutions which we call spin substitutions, whose combinatorial definition requires a finite abelian group G as its spin group. We investigate the spectral theory of the underlying subshift ( Sigma, mathbb Z m) . Under certain assumptions, we show that it is measure theoretically isomorphic to a group extension of an m dimensional odometer, which induces a complete decomposition of the function space L 2 ( Sigma, mu) . This enables one to use group characters in widehat G to derive substitutive factors and carry out a spectral analysis on specific subspaces. We provide general sufficient criteria for the existence of pure point, absolutely continuous and singular continuous spectral measures, together with some bounds on their spectral multiplicity.


Approximate trace reconstruction of random strings from a constant number of traces. In the trace reconstruction problem, the goal is to reconstruct an unknown string x of length n from multiple traces obtained by passing x through the deletion channel. In the relaxed problem of approximate trace reconstruction, the goal is to reconstruct an approximation widehat x of x which is close (within epsilon n ) to x in edit distance. We show that for most strings x , this is possible with high probability using only a constant number of traces. Crucially, this constant does not grow with n , and only depends on the deletion probability and epsilon .


Design of the third generation lead based neutron spallation target for the neutron time of flight facility at CERN. The neutron time of flight (n TOF) facility at the European Laboratory for Particle Physics (CERN) is a pulsed white spectrum neutron spallation source producing neutrons for two experimental areas the Experimental Area 1 (EAR1), located 185 m horizontally from the target, and the Experimental Area 2 (EAR2), located 20 m above the target. The target, based on pure lead, is impacted by a high intensity 20 GeV c pulsed proton beam. The facility was conceived to study neutron nucleus interactions for neutron kinetic energies between a few meV to several GeV, with applications of interest for nuclear astrophysics, nuclear technology, and medical research. After the second generation target reached the end of its lifetime, the facility underwent a major upgrade during CERN's Long Shutdown 2 (LS2, 2019 2021), which included the installation of the new third generation neutron target. The first and second generation targets were based on water cooled massive lead blocks and were designed focusing on EAR1, since EAR2 was built later. The new target is cooled by nitrogen gas to avoid erosion corrosion and contamination of cooling water with radioactive lead spallation products. Moreover, the new design is optimized also for the vertical flight path and EAR2. This paper presents an overview of the target design focused on both physics and thermo mechanical performance, and includes a description of the nitrogen cooling circuit and radiation protection studies.


Ramsey number of 1 subdivisions of transitive tournaments. The study of problems concerning subdivisions of graphs has a rich history in extremal combinatorics. Confirming a conjecture of Burr and Erd H o s, Alon proved in 1994 that subdivided graphs have linear Ramsey numbers. Later, Alon, Krivelevich and Sudakov showed that every n vertex graph with at least varepsilon n 2 edges contains a 1 subdivision of the complete graph on c varepsilon sqrt n vertices, resolving another old conjecture of Erd H o s. In this paper we consider the directed analogue of these problems and show that every tournament on at least (2 o(1))k 2 vertices contains the 1 subdivision of a transitive tournament on k vertices. This is optimal up to a multiplicative factor of 4 and confirms a conjecture of Gir ao, Popielarz and Snyder.


The path missing and path free complexes of a directed graph. We study the homotopy type and other properties of two simplicial complexes arising from a directed graph G (V, E) with two chosen vertices s and t the path free complex , consisting of all subsets F subseteq E that contain no path from s to t , and the path missing complex , its Alexander dual.


Fast algorithms for solving the Hamilton Cycle problem with high probability. We study the Hamilton cycle problem with input a random graph G G(n,p) in two settings. In the first one, G is given to us in the form of randomly ordered adjacency lists while in the second one we are given the adjacency matrix of G. In each of the settings we give a deterministic algorithm that w.h.p. either it finds a Hamilton cycle or it returns a certificate that such a cycle does not exists, for p 0. The running times of our algorithms are w.h.p. O(n) and O(n p) respectively each being best possible in its own setting.


Factorization properties for unbounded local positive maps. In this paper we present some factorization properties for unbounded local positive maps. We show that an unbounded local positive map phi on the minimal tensor product of the locally C ast algebras mathcal A and C ast ( mathcal D mathcal E ), where mathcal D mathcal E is a Fr ' e chet quantized domain, that is dominated by varphi otimes id is of the forma psi otimes id, where psi is an unbounded local positive map dominated by varphi . As an application of this result, we show that given a local positive map varphi mathcal A rightarrow mathcal B , the local positive map varphi otimes id M n left( mathbb C right) is local decomposable for some n geq 2 if and only if varphi is a local CP map. Also, we show that an unbounded local CCP map phi on the minimal tensor product of the unital locally C ast algebras mathcal A and mathcal B , that is dominated by varphi otimes psi is of the forma varphi otimes widetilde psi , where widetilde psi is an unbounded local CCP map dominated by psi , whenever varphi is pure.


Moments of the superdiffusive elephant random walk with general step distribution. We consider the elephant random walk with general step distribution. We calculate the first four moments of the limiting distribution of the position rescaled by n alpha in the superdiffusive regime where alpha is the memory parameter. This extends the results obtained by Bercu.


Fine Tuning Pretrained Language Models With Label Attention for Biomedical Text Classification. The massive scale and growth of textual biomedical data have made its indexing and classification increasingly important. However, existing research on this topic mainly utilized convolutional and recurrent neural networks, which generally achieve inferior performance than the novel transformers. On the other hand, systems that apply transformers only focus on the target documents, overlooking the rich semantic information that label descriptions contain. To address this gap, we develop a transformer based biomedical text classifier that considers label information. The system achieves this with a label attention module incorporated into the fine tuning process of pretrained language models (PTMs). Our results on two public medical datasets show that the proposed fine tuning scheme outperforms the vanilla PTMs and state of the art models.


Principal eigenvalue problem for infinity Laplacian in metric spaces. This paper is concerned with the Dirichlet eigenvalue problem associated to the infty Laplacian in metric spaces. We establish a direct PDE approach to find the principal eigenvalue and eigenfunctions in a proper geodesic space without assuming any measure structure. We provide an appropriate notion of solutions to the infty eigenvalue problem and show the existence of solutions by adapting Perron's method. Our method is different from the standard limit process via the variational eigenvalue formulation for p Laplacian in the Euclidean space. Several concrete examples are given in the case of finite metric graphs. We also prove the uniqueness of eigenfunctions up to a multiplicative factor in this special case.


The numerical solutions of linear semi discrete evolution problems on the half line using the Unified Transform Method. We discuss a semi discrete analogue of the Unified Transform Method, introduced by A. S. Fokas, to solve initial boundary value problems for linear evolution partial differential equations of constant coefficients. The semi discrete method is applied to various spacial discretizations of several first and second order linear equations on the half line x geq 0 , producing the exact solution for the semi discrete problem, given appropriate initial and boundary data. We additionally show how the Unified Transform Method treats derivative boundary conditions and ghost points introduced by the choice of discretization stencil. We consider the continuum limit of the semi discrete solutions and provide several numerical examples.


Multivariate Analytic Combinatorics for Cost Constrained Channels and Subsequence Enumeration. Analytic combinatorics in several variables is a powerful tool for deriving the asymptotic behavior of combinatorial quantities by analyzing multivariate generating functions. We study information theoretic questions about sequences in a discrete noiseless channel under cost and forbidden substring constraints. Our main contributions involve the relationship between the graph structure of the channel and the singularities of the bivariate generating function whose coefficients are the number of sequences satisfying the constraints. We combine these new results with methods from multivariate analytic combinatorics to solve questions in many application areas. For example, we determine the optimal coded synthesis rate for DNA data storage when the synthesis supersequence is any periodic string. This follows from a precise characterization of the number of subsequences of an arbitrary periodic strings. Along the way, we provide a new proof of the equivalence of the combinatorial and probabilistic definitions of the cost constrained capacity, and we show that the cost constrained channel capacity is determined by a cost dependent singularity, generalizing Shannon's classical result for unconstrained capacity.


Torsion pairs and recollements of extriangulated categories. In this article, we prove that if ( mathcal A , mathcal B, mathcal C) is a recollement of extriangulated categories, then torsion pairs in mathcal A and mathcal C can induce torsion pairs in mathcal B , and the converse holds under natural assumptions. Besides, we give mild conditions on a cluster tilting subcategory on the middle category of a recollement of extriangulated categories, for the corresponding abelian quotients to form a recollement of abelian categories.


Ontology driven Knowledge Graph for Android Malware. We present MalONT2.0 an ontology for malware threat intelligence cite rastogi2020malont . New classes (attack patterns, infrastructural resources to enable attacks, malware analysis to incorporate static analysis, and dynamic analysis of binaries) and relations have been added following a broadened scope of core competency questions. MalONT2.0 allows researchers to extensively capture all requisite classes and relations that gather semantic and syntactic characteristics of an android malware attack. This ontology forms the basis for the malware threat intelligence knowledge graph, MalKG, which we exemplify using three different, non overlapping demonstrations. Malware features have been extracted from CTI reports on android threat intelligence shared on the Internet and written in the form of unstructured text. Some of these sources are blogs, threat intelligence reports, tweets, and news articles. The smallest unit of information that captures malware features is written as triples comprising head and tail entities, each connected with a relation. In the poster and demonstration, we discuss MalONT2.0, MalKG, as well as the dynamically growing knowledge graph, TINKER.


Detecting Fake Points of Interest from Location Data. The pervasiveness of GPS enabled mobile devices and the widespread use of location based services have resulted in the generation of massive amounts of geo tagged data. In recent times, the data analysis now has access to more sources, including reviews, news, and images, which also raises questions about the reliability of Point of Interest (POI) data sources. While previous research attempted to detect fake POI data through various security mechanisms, the current work attempts to capture the fake POI data in a much simpler way. The proposed work is focused on supervised learning methods and their capability to find hidden patterns in location based data. The ground truth labels are obtained through real world data, and the fake data is generated using an API, so we get a dataset with both the real and fake labels on the location data. The objective is to predict the truth about a POI using the Multi Layer Perceptron (MLP) method. In the proposed work, MLP based on data classification technique is used to classify location data accurately. The proposed method is compared with traditional classification and robust and recent deep neural methods. The results show that the proposed method is better than the baseline methods.


Approximating Sumset Size. Given a subset A of the n dimensional Boolean hypercube mathbb F 2 n , the sumset A A is the set a a' a, a' in A where addition is in mathbb F 2 n . Sumsets play an important role in additive combinatorics, where they feature in many central results of the field. The main result of this paper is a sublinear time algorithm for the problem of sumset size estimation. In more detail, our algorithm is given oracle access to (the indicator function of) an arbitrary A subseteq mathbb F 2 n and an accuracy parameter epsilon 0 , and with high probability it outputs a value 0 leq v leq 1 that is pm epsilon close to mathrm Vol (A' A') for some perturbation A' subseteq A of A satisfying mathrm Vol (A setminus A') leq epsilon. It is easy to see that without the relaxation of dealing with A' rather than A , any algorithm for estimating mathrm Vol (A A) to any nontrivial accuracy must make 2 Omega(n) queries. In contrast, we give an algorithm whose query complexity depends only on epsilon and is completely independent of the ambient dimension n .


Dose response functions and surrogate models for exploring social contagion in the Copenhagen Networks Study. Spreading dynamics and complex contagion processes on networks are important mechanisms underlying the emergence of critical transitions, tipping points and other nonlinear phenomena in complex human and natural systems. Increasing amounts of temporal network data are now becoming available to study such spreading processes of behaviours, opinions, ideas, diseases and innovations to test hypotheses regarding their specific properties. To this end, we here present a methodology based on dose response functions and hypothesis testing using surrogate data models that randomise most aspects of the empirical data while conserving certain structures relevant to contagion, group or homophily dynamics. We demonstrate this methodology for synthetic temporal network data of spreading processes generated by the adaptive voter model. Furthermore, we apply it to empirical temporal network data from the Copenhagen Networks Study. This data set provides a physically close contact network between several hundreds of university students participating in the study over the course of three months. We study the potential spreading dynamics of the health related behaviour "regularly going to the fitness studio" on this network. Based on a hierarchy of surrogate data models, we find that our method neither provides significant evidence for an influence of a dose response type network spreading process in this data set, nor significant evidence for homophily. The empirical dynamics in exercise behaviour are likely better described by individual features such as the disposition towards the behaviour, and the persistence to maintain it, as well as external influences affecting the whole group, and the non trivial network structure. The proposed methodology is generic and promising also for applications to other temporal network data sets and traits of interest.


The exterior product and homology of Hom Lie algebras. In this article, we use the theory of (non abelian) exterior product of Hom Lie algebras to prove the Hopf formula for these algebras. As an application, we construct an eight term sequence in the homology of Hom Lie algebras. We also investigate the capability property of Hom Lie algebras via the exterior product.


Allocation of Fungible Resources via a Fast, Scalable Price Discovery Method. We consider the problem of assigning or allocating resources to a set of jobs. We consider the case when the resources are fungible, that is, the job can be done with any mix of the resources, but with different efficiencies. In our formulation we maximize a total utility subject to a given limit on the resource usage, which is a convex optimization problem and so is tractable. In this paper we develop a custom, parallelizable algorithm for solving the resource allocation problem that scales to large problems, with millions of jobs. Our algorithm is based on the dual problem, in which the dual variables associated with the resource usage limit can be interpreted as resource prices. Our method updates the resource prices in each iteration, ultimately discovering the optimal resource prices, from which an optimal allocation is obtained. We provide an open source implementation of our method, which can solve problems with millions of jobs in a few seconds on CPU, and under a second on a GPU our software can solve smaller problems in milliseconds. On large problems, our implementation is up to three orders of magnitude faster than a commerical solver for convex optimization.


The effects of Vadasz term, anisotropy and rotation on bi disperse convection. The onset of thermal convection in a uniformly rotating and horizontally isotropic bi disperse porous medium, taking into account the Vadasz term, is investigated. Via linear instability analysis, it has been proven that the Vadasz term allows the onset of convection via an oscillatory state but does not affect convection via a stationary motion.


An FPGA Based Fully Pipelined Bilateral Grid for Real Time Image Denoising. The bilateral filter (BF) is widely used in image processing because it can perform denoising while preserving edges. It has disadvantages in that it is nonlinear, and its computational complexity and hardware resources are directly proportional to its window size. Thus far, several approximation methods and hardware implementations have been proposed to solve these problems. However, processing large scale and high resolution images in real time under severe hardware resource constraints remains a challenge. This paper proposes a real time image denoising system that uses an FPGA based on the bilateral grid (BG). In the BG, a 2D image consisting of x and y axes is projected onto a 3D space called a "grid," which consists of axes that correlate to the x component, y component, and intensity value of the input image. This grid is then blurred using the Gaussian filter, and the output image is generated by interpolating the grid. Although it is possible to change the window size in the BF, it is impossible to change it on the input image in the BG. This makes it difficult to associate the BG with the BF and to obtain the property of suppressing the increase in hardware resources when the window radius is enlarged. This study demonstrates that a BG with a variable sized window can be realized by introducing the window radius parameter wherein the window radius on the grid is always 1. We then implement this BG on an FPGA in a fully pipelined manner. Further, we verify that our design suppresses the increase in hardware resources even when the window size is enlarged and outperforms the existing designs in terms of computation speed and hardware resources.