Evaluating Multilingual Text Encoders for Unsupervised Cross Lingual Retrieval. Pretrained multilingual text encoders based on neural Transformer architectures, such as multilingual BERT (mBERT) and XLM, have achieved strong performance on a myriad of language understanding tasks. Consequently, they have been adopted as a go to paradigm for multilingual and cross lingual representation learning and transfer, rendering cross lingual word embeddings (CLWEs) effectively obsolete. However, questions remain to which extent this finding generalizes 1) to unsupervised settings and 2) for ad hoc cross lingual IR (CLIR) tasks. Therefore, in this work we present a systematic empirical study focused on the suitability of the state of the art multilingual encoders for cross lingual document and sentence retrieval tasks across a large number of language pairs. In contrast to supervised language understanding, our results indicate that for unsupervised document level CLIR a setup with no relevance judgments for IR specific fine tuning pretrained encoders fail to significantly outperform models based on CLWEs. For sentence level CLIR, we demonstrate that state of the art performance can be achieved. However, the peak performance is not met using the general purpose multilingual text encoders off the shelf', but rather relying on their variants that have been further specialized for sentence understanding tasks.


Efficient Sparse Artificial Neural Networks. The brain, as the source of inspiration for Artificial Neural Networks (ANN), is based on a sparse structure. This sparse structure helps the brain to consume less energy, learn easier and generalize patterns better than any other ANN. In this paper, two evolutionary methods for adopting sparsity to ANNs are proposed. In the proposed methods, the sparse structure of a network as well as the values of its parameters are trained and updated during the learning process. The simulation results show that these two methods have better accuracy and faster convergence while they need fewer training samples compared to their sparse and non sparse counterparts. Furthermore, the proposed methods significantly improve the generalization power and reduce the number of parameters. For example, the sparsification of the ResNet47 network by exploiting our proposed methods for the image classification of ImageNet dataset uses 40 fewer parameters while the top 1 accuracy of the model improves by 12 and 5 compared to the dense network and their sparse counterpart, respectively. As another example, the proposed methods for the CIFAR10 dataset converge to their final structure 7 times faster than its sparse counterpart, while the final accuracy increases by 6 .


Relationship between the Mandelbrot Algorithm and the Platonic Solids. This paper focuses on the dynamics of the eight tridimensional principal slices of the tricomplex Mandelbrot set the Tetrabrot, the Arrowheadbrot, the Mousebrot, the Turtlebrot, the Hourglassbrot, the Metabrot, the Airbrot (octahedron) and the Firebrot (tetrahedron). In particular, we establish a geometrical classification of these 3D slices using the properties of some specific sets that correspond to projections of the bicomplex Mandelbrot set on various two dimensional vector subspaces, and we prove that the Firebrot is a regular tetrahedron. Finally, we construct the so called "Stella octangula" as a tricomplex dynamical system composed of the union of the Firebrot and its dual, and after defining the idempotent 3D slices of mathcal M 3 , we show that one of them corresponds to a third Platonic solid the cube.


Cybersecurity in Robotics Challenges, Quantitative Modeling, and Practice. Robotics is becoming more and more ubiquitous, but the pressure to bring systems to market occasionally goes at the cost of neglecting security mechanisms during the development, deployment or while in production. As a result, contemporary robotic systems are vulnerable to diverse attack patterns, and an a posteriori hardening is at least challenging, if not impossible at all. This book aims to stipulate the inclusion of security in robotics from the earliest design phases onward and with a special focus on the cost benefit tradeoff that can otherwise be an inhibitor for the fast development of affordable systems. We advocate quantitative methods of security management and design, covering vulnerability scoring systems tailored to robotic systems, and accounting for the highly distributed nature of robots as an interplay of potentially very many components. A powerful quantitative approach to model based security is offered by game theory, providing a rich spectrum of techniques to optimize security against various kinds of attacks. Such a multi perspective view on security is necessary to address the heterogeneity and complexity of robotic systems. This book is intended as an accessible starter for the theoretician and practitioner working in the field.


DC Loc Accurate Automotive Radar Based Metric Localization with Explicit Doppler Compensation. Automotive mmWave radar has been widely used in the automotive industry due to its small size, low cost, and complementary advantages to optical sensors (e.g., cameras, LiDAR, etc.) in adverse weathers, e.g., fog, raining, and snowing. On the other side, its large wavelength also poses fundamental challenges to perceive the environment. Recent advances have made breakthroughs on its inherent drawbacks, i.e., the multipath reflection and the sparsity of mmWave radar's point clouds. However, the frequency modulated continuous wave modulation of radar signals makes it more sensitive to vehicles' mobility than optical sensors. This work focuses on the problem of frequency shift, i.e., the Doppler effect distorts the radar ranging measurements and its knock on effect on metric localization. We propose a new radar based metric localization framework, termed DC Loc, which can obtain more accurate location estimation by restoring the Doppler distortion. Specifically, we first design a new algorithm that explicitly compensates the Doppler distortion of radar scans and then model the measurement uncertainty of the Doppler compensated point cloud to further optimize the metric localization. Extensive experiments using the public nuScenes dataset and CARLA simulator demonstrate that our method outperforms the state of the art approach by 25.2 and 5.6 improvements in terms of translation and rotation errors, respectively.


Fair AutoML. We present an end to end automated machine learning system to find machine learning models not only with good prediction accuracy but also fair. The system is desirable for the following reasons. (1) Comparing to traditional AutoML systems, this system incorporates fairness assessment and unfairness mitigation organically, which makes it possible to quantify fairness of the machine learning models tried and mitigate their unfairness when necessary. (2) The system is designed to have a good anytime fair' performance, such as accuracy of a model satisfying necessary fairness constraints. To achieve it, the system includes a strategy to dynamically decide when and on which models to conduct unfairness mitigation according to the prediction accuracy, fairness and the resource consumption on the fly. (3) The system is flexible to use. It can be used together with most of the existing fairness metrics and unfairness mitigation methods.


FixMyPose Pose Correctional Captioning and Retrieval. Interest in physical therapy and individual exercises such as yoga dance has increased alongside the well being trend. However, such exercises are hard to follow without expert guidance (which is impossible to scale for personalized feedback to every trainee remotely). Thus, automated pose correction systems are required more than ever, and we introduce a new captioning dataset named FixMyPose to address this need. We collect descriptions of correcting a "current" pose to look like a "target" pose (in both English and Hindi). The collected descriptions have interesting linguistic properties such as egocentric relations to environment objects, analogous references, etc., requiring an understanding of spatial relations and commonsense knowledge about postures. Further, to avoid ML biases, we maintain a balance across characters with diverse demographics, who perform a variety of movements in several interior environments (e.g., homes, offices). From our dataset, we introduce the pose correctional captioning task and its reverse target pose retrieval task. During the correctional captioning task, models must generate descriptions of how to move from the current to target pose image, whereas in the retrieval task, models should select the correct target pose given the initial pose and correctional description. We present strong cross attention baseline models (uni multimodal, RL, multilingual) and also show that our baselines are competitive with other models when evaluated on other image difference datasets. We also propose new task specific metrics (object match, body part match, direction match) and conduct human evaluation for more reliable evaluation, and we demonstrate a large human model performance gap suggesting room for promising future work. To verify the sim to real transfer of our FixMyPose dataset, we collect a set of real images and show promising performance on these images.


A Public Ground Truth Dataset for Handwritten Circuit Diagram Images. The development of digitization methods for line drawings (especially in the area of electrical engineering) relies on the availability of publicly available training and evaluation data. This paper presents such an image set along with annotations. The dataset consists of 1152 images of 144 circuits by 12 drafters and 48 563 annotations. Each of these images depicts an electrical circuit diagram, taken by consumer grade cameras under varying lighting conditions and perspectives. A variety of different pencil types and surface materials has been used. For each image, all individual electrical components are annotated with bounding boxes and one out of 45 class labels. In order to simplify a graph extraction process, different helper symbols like junction points and crossovers are introduced, while texts are annotated as well. The geometric and taxonomic problems arising from this task as well as the classes themselves and statistics of their appearances are stated. The performance of a standard Faster RCNN on the dataset is provided as an object detection baseline.


Covering three tori with cubes. Let mu( varepsilon) be the minimum number of cubes of side varepsilon needed to cover the unit three torus mathbb R mathbb Z 3 . We prove new lower and upper bounds for mu( varepsilon) and find the exact value for all varepsilon geq frac 7 15 and all varepsilon in left frac 1 r 1 (r 2 r 1) , frac r 2 1 r 3 r 1 right) for any integer r geq 2 .


Noised Consistency Training for Text Summarization. Neural abstractive summarization methods often require large quantities of labeled training data. However, labeling large amounts of summarization data is often prohibitive due to time, financial, and expertise constraints, which has limited the usefulness of summarization systems to practical applications. In this paper, we argue that this limitation can be overcome by a semi supervised approach consistency training which is to leverage large amounts of unlabeled data to improve the performance of supervised learning over a small corpus. The consistency regularization semi supervised learning can regularize model predictions to be invariant to small noise applied to input articles. By adding noised unlabeled corpus to help regularize consistency training, this framework obtains comparative performance without using the full dataset. In particular, we have verified that leveraging large amounts of unlabeled data decently improves the performance of supervised learning over an insufficient labeled dataset.


Spiraling of sub Riemannian geodesics around the Reeb flow in the 3D contact case. We consider a closed three dimensional contact sub Riemannian manifold. The objective of this note is to provide a precise description of the sub Riemannian geodesics with large initial momenta we prove that they "spiral around the Reeb orbits", not only in the phase space but also in the configuration space. Our analysis is based on a normal form along any Reeb orbit due to Melrose.


The threshold strategy for spectrally negative Levy processes and a terminal value at creeping ruin in the objective function. In this paper, a dividend optimization problem with a terminal value at creeping ruin for Levy risk models has been investigated. We consider an insurance company whose surplus process evolves as a spectrally negative Levy process with a Gaussian part and its objective function is given by cumulative discounted dividend payments and a terminal value at creeping ruin. In views of identities from fluctuation theory, under the restriction on the negative terminal value, we show that the threshold strategy turns out to be the optimal one with threshold level at zero over an admissible class with restricted dividend rates. Furthermore, some sufficient conditions for the positive one also have been given.


Towards a classification of entanglements of Galois representations attached to elliptic curves. Let E mathbb Q be an elliptic curve, let overline mathbb Q be a fixed algebraic closure of mathbb Q , and let G mathbb Q text Gal ( overline mathbb Q mathbb Q ) be the absolute Galois group of mathbb Q . The action of G mathbb Q on the adelic Tate module of E induces the adelic Galois representation rho E colon G mathbb Q to text GL (2, widehat mathbb Z ). The goal of this paper is to explain how the image of rho E can be smaller than expected. To this end, we offer a group theoretic categorization of different ways in which an entanglement between division fields can be explained and prove several results on elliptic curves (and more generally, principally polarized abelian varieties) over mathbb Q where the entanglement occurs over an abelian extension.


An Effective Non Autoregressive Model for Spoken Language Understanding. Spoken Language Understanding (SLU), a core component of the task oriented dialogue system, expects a shorter inference latency due to the impatience of humans. Non autoregressive SLU models clearly increase the inference speed but suffer uncoordinated slot problems caused by the lack of sequential dependency information among each slot chunk. To gap this shortcoming, in this paper, we propose a novel non autoregressive SLU model named Layered Refine Transformer, which contains a Slot Label Generation (SLG) task and a Layered Refine Mechanism (LRM). SLG is defined as generating the next slot label with the token sequence and generated slot labels. With SLG, the non autoregressive model can efficiently obtain dependency information during training and spend no extra time in inference. LRM predicts the preliminary SLU results from Transformer's middle states and utilizes them to guide the final prediction. Experiments on two public datasets indicate that our model significantly improves SLU performance (1.5 on Overall accuracy) while substantially speed up (more than 10 times) the inference process over the state of the art baseline.


Braid graphs in simply laced triangle free Coxeter systems are cubical graphs. Any two reduced expressions for the same Coxeter group element are related by a sequence of commutation and braid moves. We say that two reduced expressions are braid equivalent if they are related via a sequence of braid moves, and the corresponding equivalence classes are called braid classes. Each braid class can be encoded in terms of a braid graph in a natural way. In this paper, we study the structure of braid graphs in simply laced Coxeter systems. We prove that every reduced expression has a unique factorization as a product of so called links, which in turn induces a decomposition of the braid graph into a box product of the braid graphs for each link factor. When the Coxeter graph has no three cycles, we use the decomposition to prove that braid graphs are cubical by constructing an embedding of the braid graph into a hypercube graph whose image is an induced subgraph of the hypercube. For a special class of links, called Fibonacci links, we prove that this embedding is an isometry from the corresponding braid graph to a Fibonacci cube graph.


EdgeML Towards Network Accelerated Federated Learning over Wireless Edge. Federated learning (FL) is a distributed machine learning technology for next generation AI systems that allows a number of workers, i.e., edge devices, collaboratively learn a shared global model while keeping their data locally to prevent privacy leakage. Enabling FL over wireless multi hop networks can democratize AI and make it accessible in a cost effective manner. However, the noisy bandwidth limited multi hop wireless connections can lead to delayed and nomadic model updates, which significantly slows down the FL convergence speed. To address such challenges, this paper aims to accelerate FL convergence over wireless edge by optimizing the multi hop federated networking performance. In particular, the FL convergence optimization problem is formulated as a Markov decision process (MDP). To solve such MDP, multi agent reinforcement learning (MA RL) algorithms along with domain specific action space refining schemes are developed, which online learn the delay minimum forwarding paths to minimize the model exchange latency between the edge devices (i.e., workers) and the remote server. To validate the proposed solutions, FedEdge is developed and implemented, which is the first experimental framework in the literature for FL over multi hop wireless edge computing networks. FedEdge allows us to fast prototype, deploy, and evaluate novel FL algorithms along with RL based system optimization methods in real wireless devices. Moreover, a physical experimental testbed is implemented by customizing the widely adopted Linux wireless routers and ML computing nodes.Finally, our experimentation results on the testbed show that the proposed network accelerated FL system can practically and significantly improve FL convergence speed, compared to the FL system empowered by the production grade commercially available wireless networking protocol, BATMAN Adv.


Neural network tokamak equilibria with incompressible flows. We present several numerical solutions to a generalized Grad Shafranov equation (GGSE), which governs axisymmetric plasma equilibria with incompressible flows of arbitrary direction, using fully connected, feed forward, deep neural networks, also known as multi layer perceptrons. Such artificial neural network (ANNs) are trained to approximate tokamak relevant equilibria upon minimizing the GGSE mean squared residual in the plasma volume and the poloidal flux function on the plasma boundary. Solutions for the Solovev and the general linearizing ansatz for the free functions involved in the GGSE are obtained and benchmarked against known analytic solutions. We also construct a non linear equilibrium incorporating characteristics relevant to the high confinement mode. In our numerical experiments it was observed that changing the radial distribution of the training points has a surprisingly small effect on the accuracy of the trained solution. In particular it is shown that localizing the training points at the plasma edge results in ANN solutions that describe quite accurately the entire magnetic configuration, thus demonstrating the interpolation capabilities of the ANNs.


Dynamic Weighted Learning for Unsupervised Domain Adaptation. Unsupervised domain adaptation (UDA) aims to improve the classification performance on an unlabeled target domain by leveraging information from a fully labeled source domain. Recent approaches explore domain invariant and class discriminant representations to tackle this task. These methods, however, ignore the interaction between domain alignment learning and class discrimination learning. As a result, the missing or inadequate tradeoff between domain alignment and class discrimination are prone to the problem of negative transfer. In this paper, we propose Dynamic Weighted Learning (DWL) to avoid the discriminability vanishing problem caused by excessive alignment learning and domain misalignment problem caused by excessive discriminant learning. Technically, DWL dynamically weights the learning losses of alignment and discriminability by introducing the degree of alignment and discriminability. Besides, the problem of sample imbalance across domains is first considered in our work, and we solve the problem by weighing the samples to guarantee information balance across domains. Extensive experiments demonstrate that DWL has an excellent performance in several benchmark datasets.


The covering numbers of rings. A cover of an associative (not necessarily commutative nor unital) ring R is a collection of proper subrings of R whose set theoretic union equals R . If such a cover exists, then the covering number sigma(R) of R is the cardinality of a minimal cover, and a ring R is called sigma elementary if sigma(R) sigma(R I) for every nonzero two sided ideal I of R . If R is a ring with unity, then we define the unital covering number sigma u(R) to be the size of a minimal cover of R by subrings that contain 1 R (if such a cover exists), and R is sigma u elementary if sigma u(R) sigma u(R I) for every nonzero two sided ideal of R . In this paper, we classify all sigma elementary unital rings and determine their covering numbers. Building on this classification, we are further able to classify all sigma u elementary rings and prove sigma u(R) sigma(R) for every sigma u elementary ring R . We also prove that, if R is a ring without unity with a finite cover, then there exists a unital ring R' such that sigma(R) sigma u(R') , which in turn provides a complete list of all integers that are the covering number of a ring. Moreover, if mathscr E (N) m m le N, sigma(R) m text for some ring R , then we show that mathscr E (N) Theta(N log(N)) , which proves that almost all integers are not covering numbers of a ring.


GIFdroid Automated Replay of Visual Bug Reports for Android Apps. Bug reports are vital for software maintenance that allow users to inform developers of the problems encountered while using software. However, it is difficult for non technical users to write clear descriptions about the bug occurrence. Therefore, more and more users begin to record the screen for reporting bugs as it is easy to be created and contains detailed procedures triggering the bug. But it is still tedious and time consuming for developers to reproduce the bug due to the length and unclear actions within the recording. To overcome these issues, we propose GIFdroid, a light weight approach to automatically replay the execution trace from visual bug reports. GIFdroid adopts image processing techniques to extract the keyframes from the recording, map them to states in GUI Transitions Graph, and generate the execution trace of those states to trigger the bug. Our automated experiments and user study demonstrate its accuracy, efficiency, and usefulness of the approach.


Geometry and combinatorics via right angled Artin groups. We survey the relationship between the combinatorics and geometry of graphs and the algebraic structure of right angled Artin groups. We concentrate on the defining graph of the right angled Artin group and on the extension graph associated to the right angled Artin group. Additionally, we discuss connections to geometric group theory and complexity theory. The final version of this survey will appear in "In the tradition of Thurston, vol. II", ed. K. Ohshika and A. Papadopoulos.


Impact of detecting clinical trial elements in exploration of COVID 19 literature. The COVID 19 pandemic has driven ever greater demand for tools which enable efficient exploration of biomedical literature. Although semi structured information resulting from concept recognition and detection of the defining elements of clinical trials (e.g. PICO criteria) has been commonly used to support literature search, the contributions of this abstraction remain poorly understood, especially in relation to text based retrieval. In this study, we compare the results retrieved by a standard search engine with those filtered using clinically relevant concepts and their relations. With analysis based on the annotations from the TREC COVID shared task, we obtain quantitative as well as qualitative insights into characteristics of relational and concept based literature exploration. Most importantly, we find that the relational concept selection filters the original retrieved collection in a way that decreases the proportion of unjudged documents and increases the precision, which means that the user is likely to be exposed to a larger number of relevant documents.


From Complexity Measurement to Holistic Quality Evaluation for Automotive Software Development. In recent years, the role and the importance of software in the automotive domain have changed dramatically. Being able to systematically evaluate and manage software quality is becoming even more crucial. In practice, however, we still find a largely static approach for measuring software quality based on a predefined list of complexity metrics with static thresholds to fulfill. We propose using a more flexible framework instead, which systematically derives measures and evaluation rules based on the goals and context of a development project.


Supercritical percolation on graphs of polynomial growth. We consider Bernoulli percolation on transitive graphs of polynomial growth. In the subcritical regime ( p p c ), it is well known that the connection probabilities decay exponentially fast. In the present paper, we study the supercritical phase ( p p c ) and prove the exponential decay of the truncated connection probabilities (probabilities that two points are connected by an open path, but not to infinity). This sharpness result was established by CCN87 on mathbb Z d and uses the difficult slab result of Grimmett and Marstrand. However, the techniques used there are very specific to the hypercubic lattices and do not extend to more general geometries. In this paper, we develop new robust techniques based on the recent progress in the theory of sharp thresholds and the sprinkling method of Benjamini and Tassion. On mathbb Z d , these methods lead to a completely new proof of the slab result of Grimmett and Marstrand.


H Transformer 1D Fast One Dimensional Hierarchical Attention for Sequences. We describe an efficient hierarchical method to compute attention in the Transformer architecture. The proposed attention mechanism exploits a matrix structure similar to the Hierarchical Matrix (H Matrix) developed by the numerical analysis community, and has linear run time and memory complexity. We perform extensive experiments to show that the inductive bias embodied by our hierarchical attention is effective in capturing the hierarchical structure in the sequences typical for natural language and vision tasks. Our method is superior to alternative sub quadratic proposals by over 6 points on average on the Long Range Arena benchmark. It also sets a new SOTA test perplexity on One Billion Word dataset with 5x fewer model parameters than that of the previous best Transformer based models.


Symmetric positive solutions to nonlinear Choquard equations with potentials. Existence results for a class of Choquard equations with potentials are established. The potential has a limit at infinity and it is taken invariant under the action of a closed subgroup of linear isometries of mathbb R N . As a consequence, the positive solution found will be invariant under the same action. Power nonlinearities with exponent greater or equal than two or less than two will be handled. Our results include the physical case.


A Picture May Be Worth a Hundred Words for Visual Question Answering. How far can we go with textual representations for understanding pictures? In image understanding, it is essential to use concise but detailed image representations. Deep visual features extracted by vision models, such as Faster R CNN, are prevailing used in multiple tasks, and especially in visual question answering (VQA). However, conventional deep visual features may struggle to convey all the details in an image as we humans do. Meanwhile, with recent language models' progress, descriptive text may be an alternative to this problem. This paper delves into the effectiveness of textual representations for image understanding in the specific context of VQA. We propose to take description question pairs as input, instead of deep visual features, and fed them into a language only Transformer model, simplifying the process and the computational cost. We also experiment with data augmentation techniques to increase the diversity in the training set and avoid learning statistical bias. Extensive evaluations have shown that textual representations require only about a hundred words to compete with deep visual features on both VQA 2.0 and VQA CP v2.


Schemes of Finite Expansion and Universally Closed Curves. In algebraic geometry there is a well known categorical equivalence between the category of normal proper integral curves over a field k and the category of finitely generated field extensions of k of transcendence degree 1 . In this paper we generalize this equivalence to the category of normal quasi compact universally closed separated integral k schemes of dimension 1 and the category of field extensions of k of transcendence degree 1 . Our key technique are morphisms of finite expansion which can be considered as relaxation of morphisms of finite type. Since the schemes in the generalized category have many properties similar to normal proper integral curves, we call them normal integral universally closed curves over k .


Quantitative and Stream Extensions of Answer Set Programming. Answer Set Programming has separately been extended with constraints, to the streaming domain, and with capabilities to reason over the quantities associated with answer sets. We propose the introduction and analysis of a general framework that incorporates all three directions of extension by exploiting the strengths of Here and There Logic and Weighted Logic.


Identifying Non Control Security Critical Data in Program Binaries with a Deep Neural Model. As control flow protection methods get widely deployed it is difficult for attackers to corrupt control data to build attacks. Instead, data oriented exploits, which modify non control data for malicious goals, have been demonstrated to be possible and powerful. To defend against data oriented exploits, the first fundamental step is to identify non control, security critical data. However, previous works mainly rely on tedious human efforts to identify critical data, which cannot handle large applications nor easily port to new programs. In this work, we investigate the application of deep learning to critical data identification. This work provides non intuitive understanding about (a) why straightforward ways of applying deep learning would fail, and (b) how deep learning should be applied in identifying critical data. Based on our insights, we have discovered a non intuitive method which combines Tree LSTM models and a novel structure of data flow tree to effectively identify critical data from execution traces. The evaluation results show that our method can achieve 87.47 accuracy and a F1 score of 0.9123, which significantly outperforms the baselines. To the best of our knowledge, this is the first work using a deep neural model to identify critical data in program binaries.


Homotopy functoriality for Khovanov spectra. We prove that the Khovanov spectra associated to links and tangles are functorial up to homotopy and sign.


A 4 dimensional light bulb theorem for disks. We give a 4 dimensional light bulb theorem for properly embedded disks, generalizing recent work of Gabai and Kosanovic Teichner in certain contexts, and extending the 4 dimensional light bulb theorem for 2 spheres due to Gabai and Schneiderman Teichner. In particular, we provide conditions under which a pair of disks properly embedded in a 4 manifold X (with boundary) are smoothly isotopic rel boundary, if these disks (i) are homotopic rel boundary and (ii) share a common dual in the interior of X. We also provide a new geometric interpretation of the Dax invariant, to aid in its computation.


Weakly integral fusion categories of low dimensions. In this paper, we prove that fusion categories of Frobenius Perron dimensions 84 and 90 are either solvable or group theoretical. Together with the results in the literature, we obtain that every weakly integral fusion category of Frobenius Perron dimension less than 120 is either solvable or group theoretical. This implies that the answer to the question posed by Etingof, Nikshych and Ostrik in cite etingof2011weakly is negative for weakly integral fusion categories of Frobenius Perron dimension less than 120 .


Numerical investigation of Mach number consistent Roe solvers for the Euler equations of gas dynamics. While traditional approaches to prevent the carbuncle phenomenon in gas dynamics simulations increase the viscosity on entropy and shear waves near shocks, it was quite recently suggested to instead decrease the viscosity on the acoustic waves for low Mach numbers. The goal is to achieve what, in this paper, we call Mach number consistency for all waves, the numerical viscosity decreases with the same order of the Mach number when the Mach number tends to zero. We take the simple approach that was used for the proof of concept together with the simple model for the increased numerical viscosity on linear waves and investigate the possibilities of combining both in an adaptive manner while locally maintaining Mach number consistency.


Tracking Normalized Network Traffic Entropy to Detect DDoS Attacks in P4. Distributed Denial of Service (DDoS) attacks represent a persistent threat to modern telecommunications networks detecting and counteracting them is still a crucial unresolved challenge for network operators. DDoS attack detection is usually carried out in one or more central nodes that collect significant amounts of monitoring data from networking devices, potentially creating issues related to network overload or delay in detection. The dawn of programmable data planes in Software Defined Networks can help mitigate this issue, opening the door to the detection of DDoS attacks directly in the data plane of the switches. However, the most widely adopted data plane programming language, namely P4, lacks supporting many arithmetic operations, therefore, some of the advanced network monitoring functionalities needed for DDoS detection cannot be straightforwardly implemented in P4. This work overcomes such a limitation and presents two novel strategies for flow cardinality and for normalized network traffic entropy estimation that only use P4 supported operations and guarantee a low relative error. Additionally, based on these contributions, we propose a DDoS detection strategy relying on variations of the normalized network traffic entropy. Results show that it has comparable or higher detection accuracy than state of the art solutions, yet being simpler and entirely executed in the data plane.


Actionable Models Unsupervised Offline Reinforcement Learning of Robotic Skills. We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling robot learning by reusing past robotic data. In particular, we propose the objective of learning a functional understanding of the environment by learning to reach any goal state in a given dataset. We employ goal conditioned Q learning with hindsight relabeling and develop several techniques that enable training in a particularly challenging offline setting. We find that our method can operate on high dimensional camera images and learn a variety of skills on real robots that generalize to previously unseen scenes and objects. We also show that our method can learn to reach long horizon goals across multiple episodes through goal chaining, and learn rich representations that can help with downstream tasks through pre training or auxiliary objectives. The videos of our experiments can be found at https actionable models.github.io


Canonical Representations for Direct Generation of Strategies in High level Petri Games (Full Version). Petri games are a multi player game model for the synthesis problem in distributed systems, i.e., the automatic generation of local controllers. The model represents causal memory of the players, which are tokens on a Petri net and divided into two teams the controllable system and the uncontrollable environment. For one environment player and a bounded number of system players, the problem of solving Petri games can be reduced to that of solving B "uchi games. High level Petri games are a concise representation of ordinary Petri games. Symmetries, derived from a high level representation, can be exploited to significantly reduce the state space in the corresponding B "uchi game. We present a new construction for solving high level Petri games. It involves the definition of a unique, canonical representation of the reduced B "uchi game. This allows us to translate a strategy in the B "uchi game directly into a strategy in the Petri game. An implementation applied on six structurally different benchmark families shows in most cases a performance increase for larger state spaces.


Coherence of absolute integral closures. We prove that the absolute integral closure R of an equicharacteristic zero noetherian complete local domain R is not coherent, provided dim(R) geq 2 . As a corollary, we give an elementary proof of the mixed characteristic version of the result due to Asgharzadeh and extend it to dimension 3 . Furthermore, we apply the methods of Aberbach and Hochster used to prove the positive characteristic version of this result to study F coherent rings and our work naturally suggests a mixed characteristic analogue of a result of Smith.


Compactness and Guessing Principles in the Radin Extensions. We investigate the interaction between compactness principles and guessing principles in the Radin forcing extensions. In particular, we show that in any Radin forcing extension with respect to a measure sequence on kappa , if kappa is weakly compact, then diamondsuit( kappa) holds. This provides contrast with a well known theorem of Woodin, who showed that in a certain Radin extension over a suitably prepared ground model relative to the existence of large cardinals, the diamond principle fails at a strongly inaccessible Mahlo cardinal. Refining the analysis of the Radin extensions, we consistently demonstrate a scenario where a compactness principle, stronger than the diagonal stationary reflection principle, holds yet the diamond principle fails at a strongly inaccessible cardinal, improving a result from cite BN19 .


The Integrated List of Agile Practices A Tertiary Study. Context Companies adapt agile methods, practices or artifacts for their use in practice since more than two decades. This adaptions result in a wide variety of described agile practices. For instance, the Agile Alliance lists 75 different practices in its Agile Glossary. This situation may lead to misunderstandings, as agile practices with similar names can be interpreted and used differently. Objective This paper synthesize an integrated list of agile practices, both from primary and secondary sources. Method We performed a tertiary study to identify existing overviews and lists of agile practices in the literature. We identified 876 studies, of which 37 were included. Results The results of our paper show that certain agile practices are listed and used more often in existing studies. Our integrated list of agile practices comprises 38 entries structured in five categories. Contribution The high number of agile practices and thus, the wide variety increased steadily over the past decades due to the adaption of agile methods. Based on our findings, we present a comprehensive overview of agile practices. The research community benefits from our integrated list of agile practices as a potential basis for future research. Also, practitioners benefit from our findings, as the structured overview of agile practices provides the opportunity to select or adapt practices for their specific needs.


Collaborative Unsupervised Visual Representation Learning from Decentralized Data. Unsupervised representation learning has achieved outstanding performances using centralized data available on the Internet. However, the increasing awareness of privacy protection limits sharing of decentralized unlabeled image data that grows explosively in multiple parties (e.g., mobile phones and cameras). As such, a natural problem is how to leverage these data to learn visual representations for downstream tasks while preserving data privacy. To address this problem, we propose a novel federated unsupervised learning framework, FedU. In this framework, each party trains models from unlabeled data independently using contrastive learning with an online network and a target network. Then, a central server aggregates trained models and updates clients' models with the aggregated model. It preserves data privacy as each party only has access to its raw data. Decentralized data among multiple parties are normally non independent and identically distributed (non IID), leading to performance degradation. To tackle this challenge, we propose two simple but effective methods 1) We design the communication protocol to upload only the encoders of online networks for server aggregation and update them with the aggregated encoder 2) We introduce a new module to dynamically decide how to update predictors based on the divergence caused by non IID. The predictor is the other component of the online network. Extensive experiments and ablations demonstrate the effectiveness and significance of FedU. It outperforms training with only one party by over 5 and other methods by over 14 in linear and semi supervised evaluation on non IID data.


Gomory Hu Tree in Subcubic Time. In 1961, Gomory and Hu showed that the max flow values of all n choose 2 pairs of vertices in an undirected graph can be computed using only n 1 calls to any max flow algorithm, and succinctly represented them in a tree (called the Gomory Hu tree later). Even assuming a linear time max flow algorithm, this yields a running time of O(mn) for this problem with current max flow algorithms, the running time is tilde O (mn n 5 2 ) . We break this 60 year old barrier by giving an tilde O (n 2 ) time algorithm for the Gomory Hu tree problem, already with current max flow algorithms. For unweighted graphs, our techniques show equivalence (up to poly logarithmic factors in running time) between Gomory Hu tree (i.e., all pairs max flow values) and a single pair max flow.


A Longitudinal Multi modal Dataset for Dementia Monitoring and Diagnosis. Dementia is a family of neurogenerative conditions affecting memory and cognition in an increasing number of individuals in our globally aging population. Automated analysis of language, speech and paralinguistic indicators have been gaining popularity as potential indicators of cognitive decline. Here we propose a novel longitudinal multi modal dataset collected from people with mild dementia and age matched controls over a period of several months in a natural setting. The multi modal data consists of spoken conversations, a subset of which are transcribed, as well as typed and written thoughts and associated extra linguistic information such as pen strokes and keystrokes. We describe the dataset in detail and proceed to focus on a task using the speech modality. The latter involves distinguishing controls from people with dementia by exploiting the longitudinal nature of the data. Our experiments showed significant differences in how the speech varied from session to session in the control and dementia groups.


Heights and quantitative arithmetic on stacky curves. In this paper we investigate a family of algebraic stacks, the so called stacky curves, in the context of the general theory of heights on algebraic stacks due to Ellenberg, Satriano, and Zureick Brown. We first give an elementary construction of a height which is seen to be dual to theirs. Next we count rational points having bounded E S ZB height on a particular stacky curve, answering a question of Ellenberg, Satriano, and Zureick Brown. We then show that when the Euler characteristic of stacky curves is non positive, that the E S ZB height coming from the anti canonical divisor class fails to have the Northcott property. Next we prove a generalized version of a conjecture of Vojta, applied to stacky curves with negative Euler characteristic and coarse space mathbb P 1 , is equivalent to the abc conjecture. Finally, we prove that in the negative characteristic case the purely "stacky" part of the E S ZB height exhibits the Northcott property.


Dynamical Tropicalisation. We analyse the dynamics of the pullback of the map z longmapsto z m on the complex tori and toric varieties. We will observe that tropical objects naturally appear in the limit, and review several theorems in tropical geometry.


Decision forest voting scheme for classification of rare classes in network intrusion detection. In this paper, Bayesian based aggregation of decision trees in an ensemble (decision forest) is investigated. The focus is laid on multi class classification with number of samples significantly skewed toward one of the classes. The algorithm leverages out of bag datasets to estimate prediction errors of individual trees, which are then used in accordance with the Bayes rule to refine the decision of the ensemble. The algorithm takes prevalence of individual classes into account and does not require setting of any additional parameters related to class weights or decision score thresholds. Evaluation is based on publicly available datasets as well as on an proprietary dataset comprising network traffic telemetry from hundreds of enterprise networks with over a million of users overall. The aim is to increase the detection capabilities of an operating malware detection system. While we were able to keep precision of the system higher than 94 , that is only 6 out of 100 detections shown to the network administrator are false alarms, we were able to achieve increase of approximately 7 in the number of detections. The algorithm effectively handles large amounts of data, and can be used in conjunction with most of the state of the art algorithms used to train decision forests.


Orbits of vectors in some representations. II. Let Phi be a root system of type A l or D l . Let K be a field of characteristic not 2 . Let delta be the maximal root of Phi and set Phi 0 alpha in Phi delta perp alpha . We describe orbits of the group G text rm sc ( Phi 0, K) acting on the set langle e alpha angle( alpha, delta) pi 3 rangle .


SynthBio A Case Study in Human AI Collaborative Curation of Text Datasets. NLP researchers need more, higher quality text datasets. Human labeled datasets are expensive to collect, while datasets collected via automatic retrieval from the web such as WikiBio are noisy and can include undesired biases. Moreover, data sourced from the web is often included in datasets used to pretrain models, leading to inadvertent cross contamination of training and test sets. In this work we introduce a novel method for efficient dataset curation we use a large language model to provide seed generations to human raters, thereby changing dataset authoring from a writing task to an editing task. We use our method to curate SynthBio a new evaluation set for WikiBio composed of structured attribute lists describing fictional individuals, mapped to natural language biographies. We show that our dataset of fictional biographies is less noisy than WikiBio, and also more balanced with respect to gender and nationality.


Mesh Convolutional Autoencoder for Semi Regular Meshes of Different Sizes. The analysis of deforming 3D surface meshes is accelerated by autoencoders since the low dimensional embeddings can be used to visualize underlying dynamics. But, state of the art mesh convolutional autoencoders require a fixed connectivity of all input meshes handled by the autoencoder. This is due to either the use of spectral convolutional layers or mesh dependent pooling operations. Therefore, the types of datasets that one can study are limited and the learned knowledge cannot be transferred to other datasets that exhibit similar behavior. To address this, we transform the discretization of the surfaces to semi regular meshes that have a locally regular connectivity and whose meshing is hierarchical. This allows us to apply the same spatial convolutional filters to the local neighborhoods and to define a pooling operator that can be applied to every semi regular mesh. We apply the same mesh autoencoder to different datasets and our reconstruction error is more than 50 lower than the error from state of the art models, which have to be trained for every mesh separately. Additionally, we visualize the underlying dynamics of unseen mesh sequences with an autoencoder trained on different classes of meshes.


ACNet Approaching and Centralizing Network for Zero Shot Sketch Based Image Retrieval. The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch based image retrieval ( underline SBIR ). The zero shot sketch based image retrieval ( underline ZS SBIR ) is more generic and practical but poses an even greater challenge because of the additional knowledge gap between the seen and unseen categories. To simultaneously mitigate both gaps, we propose an textbf A pproaching and textbf C entralizing textbf Net work (termed textbf ACNet '') to jointly optimize sketch to photo synthesis and the image retrieval. The retrieval module guides the synthesis module to generate large amounts of diverse photo like images which gradually approach the photo domain, and thus better serve the retrieval module than ever to learn domain agnostic representations and category agnostic common knowledge for generalizing to unseen categories. These diverse images generated with retrieval guidance can effectively alleviate the overfitting problem troubling concrete category specific training samples with high gradients. We also discover the use of proxy based NormSoftmax loss is effective in the zero shot setting because its centralizing effect can stabilize our joint training and promote the generalization ability to unseen categories. Our approach is simple yet effective, which achieves state of the art performance on two widely used ZS SBIR datasets and surpasses previous methods by a large margin.


Iterative Human and Automated Identification of Wildlife Images. Camera trapping is increasingly used to monitor wildlife, but this technology typically requires extensive data annotation. Recently, deep learning has significantly advanced automatic wildlife recognition. However, current methods are hampered by a dependence on large static data sets when wildlife data is intrinsically dynamic and involves long tailed distributions. These two drawbacks can be overcome through a hybrid combination of machine learning and humans in the loop. Our proposed iterative human and automated identification approach is capable of learning from wildlife imagery data with a long tailed distribution. Additionally, it includes self updating learning that facilitates capturing the community dynamics of rapidly changing natural systems. Extensive experiments show that our approach can achieve a 90 accuracy employing only 20 of the human annotations of existing approaches. Our synergistic collaboration of humans and machines transforms deep learning from a relatively inefficient post annotation tool to a collaborative on going annotation tool that vastly relieves the burden of human annotation and enables efficient and constant model updates.


Synthesizing Invariant Barrier Certificates via Difference of Convex Programming. A barrier certificate often serves as an inductive invariant that isolates an unsafe region from the reachable set of states, and hence is widely used in proving safety of hybrid systems possibly over the infinite time horizon. We present a novel condition on barrier certificates, termed the invariant barrier certificate condition, that witnesses unbounded time safety of differential dynamical systems. The proposed condition is by far the least conservative one on barrier certificates, and can be shown as the weakest possible one to attain inductive invariance. We show that discharging the invariant barrier certificate condition thereby synthesizing invariant barrier certificates can be encoded as solving an optimization problem subject to bilinear matrix inequalities (BMIs). We further propose a synthesis algorithm based on difference of convex programming, which approaches a local optimum of the BMI problem via solving a series of convex optimization problems. This algorithm is incorporated in a branch and bound framework that searches for the global optimum in a divide and conquer fashion. We present a weak completeness result of our method, in the sense that a barrier certificate is guaranteed to be found (under some mild assumptions) whenever there exists an inductive invariant (in the form of a given template) that suffices to certify safety of the system. Experimental results on benchmark examples demonstrate the effectiveness and efficiency of our approach.


Spherical twists and the center of autoequivalence groups of K3 surfaces. Homological mirror symmetry predicts that there is a relation between autoequivalence groups of derived categories of coherent sheaves on Calabi Yau varieties, and the symplectic mapping class groups of symplectic manifolds. In this paper, as an analogue of Dehn twists for mapping class groups of closed oriented real surfaces, we study spherical twists for derived categories of algebraic varieties. We introduce the intersection number and relate it to group theoretic properties of spherical twists. As an application, we compute the center of autoequivalence groups of derived categories of K3 surfaces.


Manas Mining Software Repositories to Assist AutoML. Today deep learning is widely used for building software. A software engineering problem with deep learning is that finding an appropriate convolutional neural network (CNN) model for the task can be a challenge for developers. Recent work on AutoML, more precisely neural architecture search (NAS), embodied by tools like Auto Keras aims to solve this problem by essentially viewing it as a search problem where the starting point is a default CNN model, and mutation of this CNN model allows exploration of the space of CNN models to find a CNN model that will work best for the problem. These works have had significant success in producing high accuracy CNN models. There are two problems, however. First, NAS can be very costly, often taking several hours to complete. Second, CNN models produced by NAS can be very complex that makes it harder to understand them and costlier to train them. We propose a novel approach for NAS, where instead of starting from a default CNN model, the initial model is selected from a repository of models extracted from GitHub. The intuition being that developers solving a similar problem may have developed a better starting point compared to the default model. We also analyze common layer patterns of CNN models in the wild to understand changes that the developers make to improve their models. Our approach uses commonly occurring changes as mutation operators in NAS. We have extended Auto Keras to implement our approach. Our evaluation using 8 top voted problems from Kaggle for tasks including image classification and image regression shows that given the same search time, without loss of accuracy, Manas produces models with 42.9 to 99.6 fewer number of parameters than Auto Keras' models. Benchmarked on GPU, Manas' models train 30.3 to 641.6 faster than Auto Keras' models.


Learning Interpretation with Explainable Knowledge Distillation. Knowledge Distillation (KD) has been considered as a key solution in model compression and acceleration in recent years. In KD, a small student model is generally trained from a large teacher model by minimizing the divergence between the probabilistic outputs of the two. However, as demonstrated in our experiments, existing KD methods might not transfer critical explainable knowledge of the teacher to the student, i.e. the explanations of predictions made by the two models are not consistent. In this paper, we propose a novel explainable knowledge distillation model, called XDistillation, through which both the performance the explanations' information are transferred from the teacher model to the student model. The XDistillation model leverages the idea of convolutional autoencoders to approximate the teacher explanations. Our experiments shows that models trained by XDistillation outperform those trained by conventional KD methods not only in term of predictive accuracy but also faithfulness to the teacher models.


A local dynamic model for large eddy simulation. This paper proposes a local dynamic model for large eddy simulation (LES) without averaging in homogeneous directions. It is demonstrated that the widely used dynamic Smagorinsky model (DSM) has a singular dynamic model constant if it is used without averaging. The singularity can cause exceedingly large local values of the dynamic model constant. If these large values are not mitigated by application of averaging, they can amplify discretization errors and impair the stability of simulations. To improve the local applicability of the DSM, the singularity is removed by replacing the resolved rate of strain tensors in the Smagorinsky model with the resolved velocity gradient tensor. These replacements result in the new dynamic gradient Smagorinsky model (DGSM). Results of simulations of three canonical turbulent flows (decaying homogeneous isotropic turbulence, a temporal mixing layer, and turbulent channel flow) are presented to demonstrate the potential of this model. The DGSM provides improved stability compared to the local DSM, and does not require averaging for stability at time step sizes that are typically used for a static locally consistent LES model. Results obtained with the DGSM are generally as accurate as results obtained with the DSM, while the DGSM has lower computational complexity. Moreover, the DGSM is easy to implement and does not require any homogeneous direction in space or time. It is thus anticipated that the model has a high potential for the simulation of complex flows.


Multifunctional antibiotic and zinc containing mesoporous bioactive glass scaffolds to fight bone infection. Bone regeneration is a clinical challenge that requires multiple approaches. Sometimes, it also includes the development of new osteogenic and antibacterial biomaterials to treat the occurrence of possible infection processes derived from surgery. This study evaluates the antibacterial properties of meso macroporous scaffolds coated with gelatin and based on a bioactive glass and after being doped with 4 ZnO (4ZN GE) and loaded with saturated and minimally inhibitory concentrations of one of the antibiotics levofloxacin (LEVO), vancomycin (VANCO), rifampicin (RIFAM) or gentamicin (GENTA). After the physicochemical characterization of the materials, inorganic ion and antibiotic release studies were performed from the scaffolds. In addition, molecular modeling allowed the determination of electrostatic potential density maps and hydrogen bonds of the antibiotics and the glass matrix. In vitro antibacterial studies (in plankton, inhibition halos and biofilm destruction) with S. aureus and E. coli as model bacteria showed a synergistic effect of zinc ions and antibiotics. The effect was especially noticeable in planktonic cultures of S. aureus with 4ZN GE scaffolds loaded with VANCO, LEVO or RIFAM and in cultures of E. coli with LEVO or GENTA. Furthermore, S. aureus biofilms were completely destroyed by 4ZN GE scaffolds loaded with VANCO, LEVO or RIFAM and total destruction of E. coli biofilm was achieved with 4ZN GE scaffolds loaded with GENTA or LEVO. This approach could be an important step in the fight against microbial resistance and provide much needed options for the treatment of bone infection.


Particle dynamics governed by radiation losses in extreme field current sheets. Particles moving in current sheets under extreme conditions, such as those in the vicinity of pulsars or those predicted on upcoming multipetawatt laser facilities, may be subject to significant radiation losses. We present an analysis of particle motion in fields of a relativistic neutral electron positron current sheet in the case when radiative effects must be accounted for. In the Landau Lifshitz radiation reaction force model, when quantum effects are negligible, an analytical solution for particle trajectories is derived. Based on this solution, for the case when quantum effects are significant an averaged quantum solution in the semiclassical approach is obtained. The applicability region of the solutions is determined and analytical trajectories are found to be in good agreement with those of numerical simulations with account for radiative effects. Based on these results we gain new insights into current sheet phenomena expected on upcoming laser facilities.


Optimal control of a population dynamics model with hysteresis. This paper addresses a nonlinear partial differential control system arising in population dynamics. The system consist of three diffusion equations describing the evolutions of three biological species prey, predator, and food for the prey or vegetation. The equation for the food density incorporates a hysteresis operator of generalized stop type accounting for underlying hysteresis effects occurring in the dynamical process. We study the problem of minimization of a given integral cost functional over solutions of the above system. The set valued mapping defining the control constraint is state dependent and its values are nonconvex as is the cost integrand as a function of the control variable. Some relaxation type results for the minimization problem are obtained and the existence of a nearly optimal solution is established.


Neural Network Gaussian Processes by Increasing Depth. Recent years have witnessed an increasing interest in the correspondence between infinitely wide networks and Gaussian processes. Despite the effectiveness and elegance of the current neural network Gaussian process theory, to the best of our knowledge, all the neural network Gaussian processes are essentially induced by increasing width. However, in the era of deep learning, what concerns us more regarding a neural network is its depth as well as how depth impacts the behaviors of a network. Inspired by a width depth symmetry consideration, we use a shortcut network to show that increasing the depth of a neural network can also give rise to a Gaussian process, which is a valuable addition to the existing theory and contributes to revealing the true picture of deep learning. Beyond the proposed Gaussian process by depth, we theoretically characterize its uniform tightness property and the smallest eigenvalue of its associated kernel. These characterizations can not only enhance our understanding of the proposed depth induced Gaussian processes but also pave the way for future applications. Lastly, we examine the performance of the proposed Gaussian process by regression experiments on two real world data sets.


Weisfeiler Leman for Group Isomorphism Action Compatibility. In this paper, we show that the constant dimensional Weisfeiler Leman algorithm for groups (Brachter Schweitzer, LICS 2020) serves as a unifying isomorphism test for several families of groups that were previously shown to be in mathsf P by multiple methods. This includes coprime extensions where the normal Hall subgroup is Abelian and the complement is O(1) generated (Qiao, Sarma, Tang, STACS 2011), and groups with no Abelian normal subgroups (Babai, Codenotti, Qiao, ICALP 2012). In both of these cases, the previous strategy involved identifying key group theoretic structure that could then be leveraged algorithmically, resulting in different algorithms for each family. A common theme among these is that the group theoretic structure is mostly about the action of one group on another. Our main contribution is to show that a single, combinatorial algorithm (Weisfeiler Leman) can identify those same group theoretic structures in polynomial time. We also derive consequences for the parallel complexity of testing isomorphism in these families. In particular, we show that constant dimensional Weisfeiler Leman only requires a constant number of rounds to identify groups in the above classes. Combining this result with the parallel Weisfeiler Leman implementation of Grohe Verbitsky for graphs (ICALP 2006), this puts isomorphism testing for each of these families of groups into mathsf TC 0 . However, we show that count free Weisfeiler Leman is not strong enough to put isomorphism testing even for Abelian groups into mathsf AC 0 .


Universally Optimal Distributed Shortest Paths and Transshipment via Graph Based L1 Oblivious Routing. We provide universally optimal distributed graph algorithms for (1 varepsilon) approximate shortest path problems including shortest path tree and transshipment. The universal optimality of our algorithms guarantees that, on any n node network G , our algorithm completes in T cdot n o(1) rounds whenever a T round algorithm exists for G . This includes D cdot n o(1) round algorithms for any planar or excluded minor network. Our algorithms never require more than ( sqrt n D) cdot n o(1) rounds, resulting in the first sub linear round distributed algorithm for transshipment. The key technical contribution leading to these results is the first efficient n o(1) competitive linear ell 1 oblivious routing operator that does not require the use of ell 1 embeddings. Our construction is simple, solely based on low diameter decompositions, and in contrast to all known constructions directly produces an oblivious flow instead of just an approximation of the optimal flow cost. This also has the benefit of simplifying the interaction with Sherman's multiplicative weight framework SODA'17 in the distributed setting and its subsequent rounding procedures.


Identifying tax evasion in Mexico with tools from network science and machine learning. Mexico has kept electronic records of all taxable transactions since 2014. Anonymized data collected by the Mexican federal government comprises more than 80 million contributors (individuals and companies) and almost 7 billion monthly aggregations of invoices among contributors between January 2015 and December 2018. This data includes a list of almost ten thousand contributors already identified as tax evaders, due to their activities fabricating invoices for non existing products or services so that recipients can evade taxes. Harnessing this extensive dataset, we build monthly and yearly temporal networks where nodes are contributors and directed links are invoices produced in a given time slice. Exploring the properties of the network neighborhoods around tax evaders, we show that their interaction patterns differ from those of the majority of contributors. In particular, invoicing loops between tax evaders and their clients are over represented. With this insight, we use two machine learning methods to classify other contributors as suspects of tax evasion deep neural networks and random forests. We train each method with a portion of the tax evader list and test it with the rest, obtaining more than 0.9 accuracy with both methods. By using the complete dataset of contributors, each method classifies more than 100 thousand suspects of tax evasion, with more than 40 thousand suspects classified by both methods. We further reduce the number of suspects by focusing on those with a short network distance from known tax evaders. We thus obtain a list of highly suspicious contributors sorted by the amount of evaded tax, valuable information for the authorities to further investigate illegal tax activity in Mexico. With our methods, we estimate previously undetected tax evasion in the order of 10 billion USD per year by about 10 thousand contributors.


Triangle Centrality. Triangle centrality is introduced for finding important vertices in a graph based on the concentration of triangles surrounding each vertex. An important vertex in triangle centrality is at the center of many triangles, and therefore it may be in many triangles or none at all. We give optimal algorithms that compute triangle centrality in O(m sqrt m ) time and O(m n) space. Using fast matrix multiplication it takes n omega o(1) time where omega is the matrix product exponent. On a Concurrent Read Exclusive Write (CREW) Parallel Random Access Memory (PRAM) machine, we give a near work optimal algorithm that takes O( log n) time using O(m sqrt m ) CREW PRAM processors. In MapReduce, we show it takes four rounds using O(m sqrt m ) communication bits, and is therefore optimal. We also give a deterministic algorithm to find the triangle neighborhood and triangle count of each vertex in O(m sqrt m ) time and O(m n) space. Our empirical results demonstrate that triangle centrality uniquely identified central vertices thirty percent of the time in comparison to five other well known centrality measures, while being asymptotically faster to compute on sparse graphs than all but the most trivial of these other measures.


Note on a problem of Nathanson related to the varphi Sidon set. Let varphi (x 1 , ldots, x h ) c 1 x 1 cdots c h x h be a linear form with coefficients in a field mathbf F , and let V be a vector space over mathbf F . A nonempty subset A of V is a varphi Sidon set if varphi left(a 1 , ldots, a h right) varphi left(a 1 prime , ldots, a h prime right) implies left(a 1 , ldots, a h right) left(a 1 prime , ldots, a h prime right) for all h tuples left(a 1 , ldots, a h right) in A h and left(a 1 prime , ldots, a h prime right) in A h . We call A a polynomial perturbation of B if for some r 0 and positive integer k 0 , a k b k k r holds for all integers k geq k 0 . In this paper, for a given set B , we prove that there exists a varphi Sidon set A of integers that is a polynomial perturbation of B . This gives an affirmative answer to a recent problem of Nathanson. Some other results are also proved.


Scalable adaptive cubic regularization methods. Adaptive cubic regularization (ARC) methods for unconstrained optimization compute steps from linear systems involving a shifted Hessian in the spirit of the Levenberg Marquardt and trust region methods. The standard approach consists in performing an iterative search for the shift akin to solving the secular equation in trust region methods. Such search requires computing the Cholesky factorization of a tentative shifted Hessian at each iteration, which limits the size of problems that can be reasonably considered. We propose a scalable implementation of ARC named ARCqK in which we solve a set of shifted systems concurrently by way of an appropriate modification of the Lanczos formulation of the conjugate gradient (CG) method. At each iteration of ARCqK to solve a problem with n variables, a range of m n shift parameters is selected. The computational overhead in CG beyond the Lanczos process is thirteen scalar operations to update five vectors of length m and two n vector updates for each value of the shift. The CG variant only requires one Hessian vector product and one dot product per iteration, independently of the number of shift parameters. Solves corresponding to inadequate shift parameters are interrupted early. All shifted systems are solved inexactly. Such modest cost makes our implementation scalable and appropriate for large scale problems. We provide a new analysis of the inexact ARC method including its worst case evaluation complexity, global and asymptotic convergence. We describe our implementation and provide preliminary numerical observations that confirm that for problems of size at least 100, our implementation of ARCqK is more efficient than a classic Steihaug Toint trust region method. Finally, we generalize our convergence results to inexact Hessians and nonlinear least squares problems.


K PLUG Knowledge injected Pre trained Language Model for Natural Language Understanding and Generation in E Commerce. Existing pre trained language models (PLMs) have demonstrated the effectiveness of self supervised learning for a broad range of natural language processing (NLP) tasks. However, most of them are not explicitly aware of domain specific knowledge, which is essential for downstream tasks in many domains, such as tasks in e commerce scenarios. In this paper, we propose K PLUG, a knowledge injected pre trained language model based on the encoder decoder transformer that can be transferred to both natural language understanding and generation tasks. We verify our method in a diverse range of e commerce scenarios that require domain specific knowledge. Specifically, we propose five knowledge aware self supervised pre training objectives to formulate the learning of domain specific knowledge, including e commerce domain specific knowledge bases, aspects of product entities, categories of product entities, and unique selling propositions of product entities. K PLUG achieves new state of the art results on a suite of domain specific NLP tasks, including product knowledge base completion, abstractive product summarization, and multi turn dialogue, significantly outperforms baselines across the board, which demonstrates that the proposed method effectively learns a diverse set of domain specific knowledge for both language understanding and generation tasks.


Phoebe A Learning based Checkpoint Optimizer. Easy to use programming interfaces paired with cloud scale processing engines have enabled big data system users to author arbitrarily complex analytical jobs over massive volumes of data. However, as the complexity and scale of analytical jobs increase, they encounter a number of unforeseen problems, hotspots with large intermediate data on temporary storage, longer job recovery time after failures, and worse query optimizer estimates being examples of issues that we are facing at Microsoft. To address these issues, we propose Phoebe, an efficient learning based checkpoint optimizer. Given a set of constraints and an objective function at compile time, Phoebe is able to determine the decomposition of job plans, and the optimal set of checkpoints to preserve their outputs to durable global storage. Phoebe consists of three machine learning predictors and one optimization module. For each stage of a job, Phoebe makes accurate predictions for (1) the execution time, (2) the output size, and (3) the start end time taking into account the inter stage dependencies. Using these predictions, we formulate checkpoint optimization as an integer programming problem and propose a scalable heuristic algorithm that meets the latency requirement of the production environment. We demonstrate the effectiveness of Phoebe in production workloads, and show that we can free the temporary storage on hotspots by more than 70 and restart failed jobs 68 faster on average with minimum performance impact. Phoebe also illustrates that adding multiple sets of checkpoints is not cost efficient, which dramatically reduces the complexity of the optimization.


Disaggregating and Consolidating Network Functionalities with SuperNIC. Resource disaggregation has gained huge popularity in recent years. Existing works demonstrate how to disaggregate compute, memory, and storage resources. We, for the first time, demonstrate how to disaggregate network resources by proposing a network resource pool that consists of a new hardware based network device called SuperNIC. Each SuperNIC consolidates network functionalities from multiple endpoints by fairly sharing limited hardware resources, and it achieves its performance goals by an auto scaled, highly parallel data plane and a scalable control plane. We prototyped SuperNIC with FPGA and demonstrate its performance and cost benefits with real network functions and customized disaggregated applications.


SegDiff Image Segmentation with Diffusion Probabilistic Models. Diffusion Probabilistic Methods are employed for state of the art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end to end, without relying on a pre trained backbone. The information in the input image and in the current estimation of the segmentation map is merged by summing the output of two encoders. Additional encoding layers and a decoder are then used to iteratively refine the segmentation map using a diffusion model. Since the diffusion model is probabilistic, it is applied multiple times and the results are merged into a final segmentation map. The new method obtains state of the art results on the Cityscapes validation set, the Vaihingen building segmentation benchmark, and the MoNuSeg dataset.


Partial Quantum Coherence, Ultrashort Electron Pulse Statistics, and a Plasmon Enhanced Nanotip Emitter Based on Metallized Optical Fibers. The present dissertation covers two related research projects. The first topic was initiated with the ultimate goal of observing quantum degeneracy in ultrashort free electron pulses. This constitutes a thorough theoretical analysis of the problem involving partial quantum coherence and spin polarization of the source in light of a path integral treatment of the phenomenon of matter wave diffraction in time. Subsequently, results of a trailblazing experiment, to be superseded by a Hanbury Brown Twiss type conclusive test of free fermion antibunching with electrons, is reported. In this experiment, the statistical distribution of the emitted electrons is studied taking advantage of a double detector coincidence detection technique. The utilized electron emitters are ultrafast photoemission tungsten nanotip needle sources which are known to procure large spatial coherence lengths. The emission statistics is found to be sub Poissonian. The second project involves introduction and full characterization of a novel laser driven electron nanotip emitter based on metallized fiber optic tapers in which the emission mechanism is found to be assisted by surface plasmon resonance excitation as predicted prior to the design of such sources. It is shown that gold coated fiber optic nanotips can emit electrons using both low power continuous wave lasers as well as femtosecond pulsed lasers tuned to or near the surface plasmon resonance excitation wavelength of the system. The final chapter entails a proposal of a spin polarized electron photoemitter based on the spin Hall effect for which such a fiber optic nanotip source is exploited.


An accurate algorithm for calibration free wavelength modulation spectroscopy based on even order harmonics. This paper proposes an accurate algorithm to implement calibration free wavelength modulation spectroscopy based on even order harmonics. The proposed algorithm, analytically deduced from a much more accurate Voigt function model, enabling not only speedy measurement down to milliseconds, but also a general suitability for various degrees of line shape broadening. The proposed method is validated by condition controlled experiment, indicating calculation of gas temperature with the relative error less than 2.4 in the experiments.


Impact of h index on authors ranking An improvement to the h index for lower ranked author. In academia, the research performance of a faculty is either evaluated by the number of publications or the number of citations. Most of the time h index is widely used during the hiring process or the faculty performance evaluation. The calculation of the h index is shown in various databases however, there is no systematic evidence about the differences between them. Here we analyze the publication records of 385 authors from Monash University (Australia) to investigate (i) the impact of different databases like Scopus and WoS on the ranking of authors within a discipline, and (ii) to complement the h index, named h c , by adding the weight of the highest cited paper to the h index of the authors. The results show the positive impact of h c on the lower ranked authors in every discipline. Also, Scopus provides an overall better ranking than WoS however, the ranking varies among Scopus and WoS for disciplines.


Rapid feasibility assessment of components formed through hot stamping A deep learning approach. The novel non isothermal Hot Forming and cold die Quenching (HFQ) process can enable the cost effective production of complex shaped, high strength aluminium alloy panel components. However, the unfamiliarity of designing for the new process prevents its widescale adoption in industrial settings. Recent research efforts focus on the development of advanced material models for finite element simulations, used to assess the feasibility of new component designs for the HFQ process. However, FE simulations take place late in design processes, require forming process expertise and are unsuitable for early stage design explorations. To address these limitations, this study presents a novel application of a Convolutional Neural Network (CNN) based surrogate as a means of rapid manufacturing feasibility assessment for components to be formed using the HFQ process. A diverse dataset containing variations in component geometry, blank shapes, and processing parameters, together with corresponding physical fields is generated and used to train the model. The results show that near indistinguishable full field predictions are obtained in real time from the model when compared with HFQ simulations. This technique provides an invaluable tool to aid component design and decision making at the onset of a design process for complex shaped components formed under HFQ conditions.


The modification of turbulent thermal wind balance by non traditional effects. The meridional component of the earth's rotation is often neglected in geophysical contexts. This is referred to as the traditional approximation' and is justified by the typically small vertical velocity and aspect ratio of such problems. Ocean fronts are regions of strong horizontal buoyancy gradient and are associated with strong vertical transport of tracers and nutrients. Given these comparatively large vertical velocities, non traditional rotation may play a role in governing frontal dynamics. Here the effects of non traditional rotation on a front in turbulent thermal wind balance are considered using an asymptotic approach. Solutions are presented for a general horizontal buoyancy profile and examined in the simple case of a straight front. Non traditional effects are found to depend strongly on the direction of the front and may lead to the generation of jets and the modification of the frontal circulation and vertical transport.


Trusted And Confidential Program Analysis. We develop the concept of Trusted and Confidential Program Analysis (TCPA) which enables program certification to be used where previously there was insufficient trust. Imagine a scenario where a producer may not be trusted to certify its own software (perhaps by a foreign regulator), and the producer is unwilling to release its sources and detailed design to any external body. We present a protocol that can, using trusted computing based on encrypted sources, create certification via which all can trust the delivered object code without revealing the unencrypted sources to any party. Furthermore, we describe a realization of TCPA with trusted execution environments (TEE) that enables general and efficient computation. We have implemented the TCPA protocol in a system called TCWasm for web assembly architectures. In our evaluation with 33 benchmark cases, TCWasm managed to finish the analysis with relatively slight overheads.


A Note on Global Optimization for Max Plus Linear Systems. This note further addresses the global optimization problem for max plus linear systems considered in Automatica 119 (2020) 109104 . Firstly, the operations between infinity elemens and real numbers involved in the formulas of solving global optimization problems are explained explicitly. Secondly, the formula of the greatest lower bound and the criterion of solvability of globally optimal solutions are simplified. Thirdly, the criterion of uniqueness of globally optimal solutions and the set of all globally optimal solutions are presented.


The role of plasma molecule interactions on power and particle balance during detachment on the TCV tokamak. This paper shows experimental results from the TCV tokamak that indicate plasma molecule interactions involving D 2 and possibly D play an important role as sinks of energy (through hydrogenic radiation as well as dissociation) and particles during divertor detachment if low target temperatures ( 3 eV) are achieved. Both molecular activated recombination (MAR) and ion source reduction due to a power limitation effect are shown to be important in reducing the ion target flux during a density ramp. In contrast, the electron ion recombination (EIR) ion sink is too small to play an important role in reducing the ion target flux. MAR or EIR do not occur during N 2 seeding induced detachment as the target temperatures are not sufficiently low. The impact of D 2 is shown to be underestimated in present (vibrationally unresolved) SOLPS ITER simulations, which could result from an underestimated D 2 D rightarrow D 2 D rate. The converged SOLPS ITER simulations are post processed with alternative reaction rates, resulting in considerable contributions of D 2 to particle and power losses as well as dissociation below the D 2 dissociation area. Those findings are in quantitative agreement with the experimental results.


A Low cost Robot with Autonomous Recharge and Navigation for Weed Control in Fields with Narrow Row Spacing. Modern herbicide application in agricultural settings typically relies on either large scale sprayers that dispense herbicide over crops and weeds alike or portable sprayers that require labor intensive manual operation. The former method results in overuse of herbicide and reduction in crop yield while the latter is often untenable in large scale operations. This paper presents the first fully autonomous robot for weed management for row crops capable of computer vision based navigation, weed detection, complete field coverage, and automatic recharge for under 400. The target application is autonomous inter row weed control in crop fields, e.g. flax and canola, where the spacing between croplines is as small as one foot. The proposed robot is small enough to pass between croplines at all stages of plant growth while detecting weeds and spraying herbicide. A recharging system incorporates newly designed robotic hardware, a ramp, a robotic charging arm, and a mobile charging station. An integrated vision algorithm is employed to assist with charger alignment effectively. Combined, they enable the robot to work continuously in the field without access to electricity. In addition, a color based contour algorithm combined with preprocessing techniques is applied for robust navigation relying on the input from the onboard monocular camera. Incorporating such compact robots into farms could help automate weed control, even during late stages of growth, and reduce herbicide use by targeting weeds with precision. The robotic platform is field tested in the flaxseed fields of North Dakota.


A vanishing theorem for the canonical blow ups of Grassmann manifolds. Let mathcal T s,p,n be the canonical blow up of the Grassmann manifold G(p,n) constructed by blowing up the Pl "ucker coordinate subspaces associated with the parameter s . We prove that the higher cohomology groups of the tangent bundle of mathcal T s,p,n vanish. As an application, mathcal T s,p,n is locally rigid in the sense of Kodaira Spencer.


On Generating Lagrangian Cuts for Two Stage Stochastic Integer Programs. We investigate new methods for generating Lagrangian cuts to solve two stage stochastic integer programs. Lagrangian cuts can be added to a Benders reformulation, and are derived from solving single scenario integer programming subproblems identical to those used in the nonanticipative Lagrangian dual of a stochastic integer program. While Lagrangian cuts have the potential to significantly strengthen the Benders relaxation, generating Lagrangian cuts can be computationally demanding. We investigate new techniques for generating Lagrangian cuts with the goal of obtaining methods that provide significant improvements to the Benders relaxation quickly. Computational results demonstrate that our proposed method improves the Benders relaxation significantly faster than previous methods for generating Lagrangian cuts and, when used within a branch and cut algorithm, significantly reduces the size of the search tree for three classes of test problems.


Geofreebie A Location Based Freecycling App to Support Forced Migrant Resettlement. Germany has witnessed an influx of forced migrants in recent years. Promoting social interaction with the local community is key to supporting the resettlement of these newcomers. Location based freecycling services present important benefits due to freecycling's potential to bolster social engagement and location based services' ability to adapt to the user's context. Yet, their potential to support forced migrants' resettlement is yet to be examined. We conducted needs assessment interviews with 11 participants in Muenster, Germany. We analyzed the interview results to develop user requirements for location based freecycling services. We then implemented a subset of the user requirements as a prototype mobile app called Geofreebie. The evaluation of the app with 22 participants showed that Geofreebie offered two key advantages for forced migrants' resettlement it increased the size of their social network, and created a sense of community on their side. These findings can benefit researchers and developers of location based services to support forced migrant resettlement.


Learning to Cut by Watching Movies. Video content creation keeps growing at an incredible pace yet, creating engaging stories remains challenging and requires non trivial video editing expertise. Many video editing components are astonishingly hard to automate primarily due to the lack of raw video materials. This paper focuses on a new task for computational video editing, namely the task of raking cut plausibility. Our key idea is to leverage content that has already been edited to learn fine grained audiovisual patterns that trigger cuts. To do this, we first collected a data source of more than 10K videos, from which we extract more than 255K cuts. We devise a model that learns to discriminate between real and artificial cuts via contrastive learning. We set up a new task and a set of baselines to benchmark video cut generation. We observe that our proposed model outperforms the baselines by large margins. To demonstrate our model in real world applications, we conduct human studies in a collection of unedited videos. The results show that our model does a better job at cutting than random and alternative baselines.


A Continuous Family of Non Monotonic Toral Mixing Maps. We establish the mixing property for a family of Lebesgue measure preserving toral maps composed of two piecewise linear shears, the first of which is non monotonic. The maps serve as a basic model for the stretching and folding' action in laminar fluid mixing, in particular flows where boundary conditions give rise to non monotonic flow profiles. The family can be viewed as the parameter space between two well known systems, Arnold's Cat Map and a map due to Cerbelli and Giona, both of which possess finite Markov partitions and straightforward to prove mixing properties. However, no such finite Markov partitions appear to exist for the present family, so establishing mixing properties requires a different approach. In particular we follow a scheme of Katok and Strelcyn, proving strong mixing properties with respect to the Lebesgue measure on two open parameter spaces. Finally we comment on the challenges in extending these mixing windows and the potential for using the same approach to prove mixing properties in similar systems.


Examining the Social Context of Alcohol Drinking in Young Adults with Smartphone Sensing. According to prior work, the type of relationship between the person consuming alcohol and others in the surrounding (friends, family, spouse, etc.), and the number of those people (alone, with one person, with a group, etc.) are related to many aspects of alcohol consumption, such as the drinking amount, location, motives, and mood. Even though the social context is recognized as an important aspect that influences the drinking behavior of young adults in alcohol research, relatively little work has been conducted in smartphone sensing research on this topic. In this study, we analyze the weekend nightlife drinking behavior of 241 young adults in Switzerland, using a dataset consisting of self reports and passive smartphone sensing data over a period of three months. Using multiple statistical analyses, we show that features from modalities such as accelerometer, location, application usage, bluetooth, and proximity could be informative about different social contexts of drinking. We define and evaluate seven social context inference tasks using smartphone sensing data, obtaining accuracies of the range 75 86 in four two class and three three class inferences. Further, we discuss the possibility of identifying the sex composition of a group of friends using smartphone sensor data with accuracies over 70 . The results are encouraging towards (a) supporting future interventions on alcohol consumption that incorporate users' social context more meaningfully, and (b) reducing the need for user self reports when creating drink logs.


Toward a Secure Crowdsourced Location Tracking System. Low energy Bluetooth devices have become ubiquitous and widely used for different applications. Among these, Bluetooth trackers are becoming popular as they allow users to track the location of their physical objects. To do so, Bluetooth trackers are often built in within other commercial products connected to a larger crowdsourced tracking system. Such a system, however, can pose a threat to the security and privacy of the users, for instance, by revealing the location of a user's valuable object. In this paper, we introduce a set of security properties and investigate the state of commercial crowdsourced tracking systems, which present common design flaws that make them insecure. Leveraging the results of our investigation, we propose a new design for a secure crowdsourced tracking system (SECrow), which allows devices to leverage the benefits of the crowdsourced model without sacrificing security and privacy. Our preliminary evaluation shows that SECrow is a practical, secure, and effective crowdsourced tracking solution


Multimodal Fake News Detection. Over the last years, there has been an unprecedented proliferation of fake news. As a consequence, we are more susceptible to the pernicious impact that misinformation and disinformation spreading can have in different segments of our society. Thus, the development of tools for automatic detection of fake news plays and important role in the prevention of its negative effects. Most attempts to detect and classify false content focus only on using textual information. Multimodal approaches are less frequent and they typically classify news either as true or fake. In this work, we perform a fine grained classification of fake news on the Fakeddit dataset, using both unimodal and multimodal approaches. Our experiments show that the multimodal approach based on a Convolutional Neural Network (CNN) architecture combining text and image data achieves the best results, with an accuracy of 87 . Some fake news categories such as Manipulated content, Satire or False connection strongly benefit from the use of images. Using images also improves the results of the other categories, but with less impact. Regarding the unimodal approaches using only text, Bidirectional Encoder Representations from Transformers (BERT) is the best model with an accuracy of 78 . Therefore, exploiting both text and image data significantly improves the performance of fake news detection.


An Image Forensic Technique Based on JPEG Ghosts. The unprecedented growth in the easy availability of photo editing tools has endangered the power of digital images.An image was supposed to be worth more than a thousand words,but now this can be said only if it can be authenticated orthe integrity of the image can be proved to be intact. In thispaper, we propose a digital image forensic technique for JPEG images. It can detect any forgery in the image if the forged portion called a ghost image is having a compression quality different from that of the cover image. It is based on resaving the JPEG image at different JPEG qualities, and the detection of the forged portion is maximum when it is saved at the same JPEG quality as the cover image. Also, we can precisely predictthe JPEG quality of the cover image by analyzing the similarity using Structural Similarity Index Measure (SSIM) or the energyof the images. The first maxima in SSIM or the first minima inenergy correspond to the cover image JPEG quality. We created adataset for varying JPEG compression qualities of the ghost and the cover images and validated the scalability of the experimental results.We also, experimented with varied attack scenarios, e.g. high quality ghost image embedded in low quality of cover image,low quality ghost image embedded in high quality of cover image,and ghost image and cover image both at the same quality.The proposed method is able to localize the tampered portions accurately even for forgeries as small as 10x10 sized pixel blocks.Our technique is also robust against other attack scenarios like copy move forgery, inserting text into image, rescaling (zoom out zoom in) ghost image and then pasting on cover image.