Unpacking Human Teachers' Intentions For Natural Interactive Task Learning. Interactive Task Learning (ITL) is an emerging research agenda that studies the design of complex intelligent robots that can acquire new knowledge through natural human teacher robot learner interactions. ITL methods are particularly useful for designing intelligent robots whose behavior can be adapted by humans collaborating with them. Various research communities are contributing methods for ITL and a large subset of this research is emph robot centered with a focus on developing algorithms that can learn online, quickly. This paper studies the ITL problem from a emph human centered perspective to provide guidance for robot design so that human teachers can naturally teach ITL robots. In this paper, we present 1) a qualitative bidirectional analysis of an interactive teaching study (N 10) through which we characterize various aspects of actions intended and executed by human teachers when teaching a robot 2) an in depth discussion of the teaching approach employed by two participants to understand the need for personal adaptation to individual teaching styles and 3) requirements for ITL robot design based on our analyses and informed by a computational theory of collaborative interactions, SharedPlans.


Agile Islands in a Waterfall Environment Requirements Engineering Challenges and Strategies in Automotive. Context motivation Driven by the need for faster time to market and reduced development lead time, large scale systems engineering companies are adopting agile methods in their organizations. This agile transformation is challenging and it is common that adoption starts bottom up with agile software teams within the context of traditional company structures. Question Problem This creates the challenge of agile teams working within a document centric and plan driven (or waterfall) environment. While it may be desirable to take the best of both worlds, it is not clear how that can be achieved especially with respect to managing requirements in large scale systems. Principal ideas Results This paper presents an exploratory case study at an automotive company, focusing on two departments of a large scale systems company that is in the process of company wide agile adoption. Contribution We present challenges related to requirements engineering that agile teams face while working within a larger plan driven context and propose potential strategies to mitigate the challenges. Challenges relate to, e.g., development teams not being aware of the high level requirement and dealing with flexibility of writing user stories. We found that strategies for overcoming most of these challenges are still lacking and thus call for more research.


A biophysical network model reveals the link between deficient inhibitory cognitive control and major neurotransmitter and neural connectivity hypotheses in schizophrenia. We address a biophysical network dynamical model to study how the modulation of dopamine (DA) activity and related N methyl d aspartate (NMDA) glutamate receptor activity as well as the emerging Pre Frontal Cortex (PFC) functional connectivity network (FCN) affect inhibitory cognitive function in schizophrenia in an antisaccade task. The values of the model parameters and the topology of the PFC FCN were estimated by minimizing the differences between simulations and the observed distributions of reaction times (RT) during the performance of the antisaccade task in 30 patients with schizophrenia and 30 healthy controls. We show that the proposed model approximates remarkably well the predicted prefrontal cortical DA hypo activity and the related NMDA receptor hypo function as well as the FCN dysconnection pattern that are considered as the major etio pathological hypotheses to explain cognitive deficits in schizophrenia.


Highly Efficient Memory Failure Prediction using Mcelog based Data Mining and Machine Learning. In the data center, unexpected downtime caused by memory failures can lead to a decline in the stability of the server and even the entire information technology infrastructure, which harms the business. Therefore, whether the memory failure can be accurately predicted in advance has become one of the most important issues to be studied in the data center. However, for the memory failure prediction in the production system, it is necessary to solve technical problems such as huge data noise and extreme imbalance between positive and negative samples, and at the same time ensure the long term stability of the algorithm. This paper compares and summarizes some commonly used skills and the improvement they can bring. The single model we proposed won the top 14th in the 2nd Alibaba Cloud AIOps Competition belonging to the 25th PAKDD conference. It takes only 30 minutes to pass the online test, while most of the other contestants' solution need more than 3 hours. Codes has been open source to https www.github.com ycd2016 acaioc2.


Reconstructing magnetic deflections from sets of proton images using differential evolution. Proton imaging is a powerful technique for imaging electromagnetic fields within an experimental volume, in which spatial variations in proton fluence are a result of deflections to proton trajectories due to interaction with the fields. When deflections are large, proton trajectories can overlap, and this nonlinearity creates regions of greatly increased proton fluence on the image, known as caustics. The formation of caustics has been a persistent barrier to reconstructing the underlying fields from proton images. We have developed a new method for reconstructing the path integrated magnetic fields which begins to address the problem posed by caustics. Our method uses multiple proton images of the same object, each image at a different energy, to fill in the information gaps and provide some uniqueness when reconstructing caustic features. We use a differential evolution algorithm to iteratively estimate the underlying deflection function which accurately reproduces the observed proton fluence at multiple proton energies simultaneously. We test this reconstruction method using synthetic proton images generated for three different, cylindrically symmetric field geometries at various field amplitudes and levels of proton statistics, and present reconstruction results from a set of experimental images. The method we propose requires no assumption of deflection linearity and can reliably solve for fields underlying linear, nonlinear, and caustic proton image features for the selected geometries, and is shown to be fairly robust to noise in the input proton intensity.


Does a Face Mask Protect my Privacy? Deep Learning to Predict Protected Attributes from Masked Face Images. Contactless and efficient systems are implemented rapidly to advocate preventive methods in the fight against the COVID 19 pandemic. Despite the positive benefits of such systems, there is potential for exploitation by invading user privacy. In this work, we analyse the privacy invasiveness of face biometric systems by predicting privacy sensitive soft biometrics using masked face images. We train and apply a CNN based on the ResNet 50 architecture with 20,003 synthetic masked images and measure the privacy invasiveness. Despite the popular belief of the privacy benefits of wearing a mask among people, we show that there is no significant difference to privacy invasiveness when a mask is worn. In our experiments we were able to accurately predict sex (94.7 ),race (83.1 ) and age (MAE 6.21 and RMSE 8.33) from masked face images. Our proposed approach can serve as a baseline utility to evaluate the privacy invasiveness of artificial intelligence systems that make use of privacy sensitive information. We open source all contributions for re producibility and broader use by the research community.


Memory Based Semantic Parsing. We present a memory based model for context dependent semantic parsing. Previous approaches focus on enabling the decoder to copy or modify the parse from the previous utterance, assuming there is a dependency between the current and previous parses. In this work, we propose to represent contextual information using an external memory. We learn a context memory controller that manages the memory by maintaining the cumulative meaning of sequential user utterances. We evaluate our approach on three semantic parsing benchmarks. Experimental results show that our model can better process context dependent information and demonstrates improved performance without using task specific decoders.


Robust Convergence in Federated Learning through Label wise Clustering. Non IID dataset and heterogeneous environment of the local clients are regarded as a major issue in Federated Learning (FL), causing a downturn in the convergence without achieving satisfactory performance. In this paper, we propose a novel Label wise clustering algorithm that guarantees the trainability among geographically dispersed heterogeneous local clients, by selecting only the local models trained with a dataset that approximates into uniformly distributed class labels, which is likely to obtain faster minimization of the loss and increment the accuracy among the FL network. Through conducting experiments on the suggested six common non IID scenarios, we empirically show that the vanilla FL aggregation model is incapable of gaining robust convergence generating biased pre trained local models and drifting the local weights to mislead the trainability in the worst case. Moreover, we quantitatively estimate the expected performance of the local models before training, which offers a global server to select the optimal clients, saving additional computational costs. Ultimately, in order to gain resolution of the non convergence in such non IID situations, we design clustering algorithms based on local input class labels, accommodating the diversity and assorting clients that could lead the overall system to attain the swift convergence as global training continues. Our paper shows that proposed Label wise clustering demonstrates prompt and robust convergence compared to other FL algorithms when local training datasets are non IID or coexist with IID through multiple experiments.


Fast Ensemble Learning Using Adversarially Generated Restricted Boltzmann Machines. Machine Learning has been applied in a wide range of tasks throughout the last years, ranging from image classification to autonomous driving and natural language processing. Restricted Boltzmann Machine (RBM) has received recent attention and relies on an energy based structure to model data probability distributions. Notwithstanding, such a technique is susceptible to adversarial manipulation, i.e., slightly or profoundly modified data. An alternative to overcome the adversarial problem lies in the Generative Adversarial Networks (GAN), capable of modeling data distributions and generating adversarial data that resemble the original ones. Therefore, this work proposes to artificially generate RBMs using Adversarial Learning, where pre trained weight matrices serve as the GAN inputs. Furthermore, it proposes to sample copious amounts of matrices and combine them into ensembles, alleviating the burden of training new models'. Experimental results demonstrate the suitability of the proposed approach under image reconstruction and image classification tasks, and describe how artificial based ensembles are alternatives to pre training vast amounts of RBMs.


DiNNO Distributed Neural Network Optimization for Multi Robot Collaborative Learning. We present a distributed algorithm that enables a group of robots to collaboratively optimize the parameters of a deep neural network model while communicating over a mesh network. Each robot only has access to its own data and maintains its own version of the neural network, but eventually learns a model that is as good as if it had been trained on all the data centrally. No robot sends raw data over the wireless network, preserving data privacy and ensuring efficient use of wireless bandwidth. At each iteration, each robot approximately optimizes an augmented Lagrangian function, then communicates the resulting weights to its neighbors, updates dual variables, and repeats. Eventually, all robots' local network weights reach a consensus. For convex objective functions, we prove this consensus is a global optimum. We compare our algorithm to two existing distributed deep neural network training algorithms in (i) an MNIST image classification task, (ii) a multi robot implicit mapping task, and (iii) a multi robot reinforcement learning task. In all of our experiments our method out performed baselines, and was able to achieve validation loss equivalent to centrally trained models. See href https msl.stanford.edu projects dist nn train https msl.stanford.edu projects dist nn train for videos and a link to our GitHub repository.


Towards Network Traffic Monitoring Using Deep Transfer Learning. Network traffic is growing at an outpaced speed globally. The modern network infrastructure makes classic network intrusion detection methods inefficient to classify an inflow of vast network traffic. This paper aims to present a modern approach towards building a network intrusion detection system (NIDS) by using various deep learning methods. To further improve our proposed scheme and make it effective in real world settings, we use deep transfer learning techniques where we transfer the knowledge learned by our model in a source domain with plentiful computational and data resources to a target domain with sparse availability of both the resources. Our proposed method achieved 98.30 classification accuracy score in the source domain and an improved 98.43 classification accuracy score in the target domain with a boost in the classification speed using UNSW 15 dataset. This study demonstrates that deep transfer learning techniques make it possible to construct large deep learning models to perform network classification, which can be deployed in the real world target domains where they can maintain their classification performance and improve their classification speed despite the limited accessibility of resources.


The Hopf Lax formula for multiobjective costs with non constant discount via set optimization. The minimization of a multiobjective Lagrangian with non constant discount is studied. The problem is embedded into a set valued framework and a corresponding definition of the value function is given. Bellman's optimality principle and Hopf Lax formula are derived. The value function is shown to be a solution of a set valued Hamilton Jacobi equation.


Conditioning of a Hybrid High Order scheme on meshes with small faces. We conduct a condition number analysis of a Hybrid High Order (HHO) scheme for the Poisson problem. We find the condition number of the statically condensed system to be independent of the number of faces in each element, or the relative size between an element and its faces. The dependence of the condition number on the polynomial degree is tracked. Next, we consider HHO schemes on cut background meshes, which are commonly used in unfitted discretisations. It is well known that the linear systems obtained on these meshes can be arbitrarily ill conditioned due to the presence of sliver cut and small cut elements. We show that the condition number arising from HHO schemes on such meshes is not as negatively effected as those arising from conforming methods. We describe how the condition number can be improved by aggregating ill conditioned elements with their neighbours.


Happy MitM Fun and Toys in Every Bluetooth Device. Bluetooth pairing establishes trust on first use between two devices by creating a shared key. Similar to certificate warnings in TLS, the Bluetooth specification requires warning users upon issues with this key, because this can indicate ongoing Machine in the Middle (MitM) attacks. This paper uncovers that none of the major Bluetooth stacks warns users, which violates the specification. Clear warnings would protect users from recently published and potential future security issues in Bluetooth authentication and encryption.


Towards real time assessment of earthfill dams via Model Order Reduction. The use of Internet of Things (IoT) technologies is becoming a preferred solution for the assessment of tailings dams' safety. Real time sensor monitoring proves to be a key tool for reducing the risk related to these ever evolving earth fill structures, that exhibit a high rate of sudden and hazardous failures. In order to optimally exploit real time embankment monitoring, one major hindrance has to be overcome the creation of a supporting numerical model for stability analysis, with rapid enough response to perform data assimilation in real time. A model should be built, such that its response can be obtained faster than the physical evolution of the analyzed phenomenon. In this work, Reduced Order Modelling (ROM) is used to boost computational efficiency in solving the coupled hydro mechanical system of equations governing the problem. The Reduced Basis method is applied to the coupled hydro mechanical equations that govern the groundwater flow, that are made non linear as a result of considering an unsaturated soil. The resulting model's performance is assessed by solving a 2D and a 3D problem relevant to tailings dams' safety. The ROM technique achieves a speedup of 3 to 15 times with respect to the full order model (FOM) while maintaining high levels of accuracy.


Finite rotating and translating vortex sheets. We consider the rotating and translating equilibria of open finite vortex sheets with endpoints in two dimensional potential flows. New results are obtained concerning the stability of these equilibrium configurations which complement analogous results known for unbounded, periodic and circular vortex sheets. First, we show that the rotating and translating equilibria of finite vortex sheets are linearly unstable. However, while in the first case unstable perturbations grow exponentially fast in time, the growth of such perturbations in the second case is algebraic. In both cases the growth rates are increasing functions of the wavenumbers of the perturbations. Remarkably, these stability results are obtained entirely with analytical computations. Second, we obtain and analyze equations describing the time evolution of a straight vortex sheet in linear external fields. Third, it is demonstrated that the results concerning the linear stability analysis of the rotating sheet are consistent with the infinite aspect ratio limit of the stability results known for Kirchhoff's ellipse (Love 1893 Mitchell Rossi 2008) and that the solutions we obtained accounting for the presence of external fields are also consistent with the infinite aspect ratio limits of the analogous solutions known for vortex patches.


Towards Practical Learned Indexing. Latest research proposes to replace existing index structures with learned models. However, current learned indexes tend to have many hyperparameters, often do not provide any error guarantees, and are expensive to build. We introduce Practical Learned Index (PLEX). PLEX only has a single hyperparameter epsilon (maximum prediction error) and offers a better trade off between build and lookup time than state of the art approaches. Similar to RadixSpline, PLEX consists of a spline and a (multi level) radix layer. It first builds a spline satisfying the given epsilon and then performs an ad hoc analysis of the distribution of spline points to quickly tune the radix layer.


AI enabled Automation for Completeness Checking of Privacy Policies. Technological advances in information sharing have raised concerns about data protection. Privacy policies contain privacy related requirements about how the personal data of individuals will be handled by an organization or a software system (e.g., a web service or an app). In Europe, privacy policies are subject to compliance with the General Data Protection Regulation (GDPR). A prerequisite for GDPR compliance checking is to verify whether the content of a privacy policy is complete according to the provisions of GDPR. Incomplete privacy policies might result in large fines on violating organization as well as incomplete privacy related software specifications. Manual completeness checking is both time consuming and error prone. In this paper, we propose AI based automation for the completeness checking of privacy policies. Through systematic qualitative methods, we first build two artifacts to characterize the privacy related provisions of GDPR, namely a conceptual model and a set of completeness criteria. Then, we develop an automated solution on top of these artifacts by leveraging a combination of natural language processing and supervised machine learning. Specifically, we identify the GDPR relevant information content in privacy policies and subsequently check them against the completeness criteria. To evaluate our approach, we collected 234 real privacy policies from the fund industry. Over a set of 48 unseen privacy policies, our approach detected 300 of the total of 334 violations of some completeness criteria correctly, while producing 23 false positives. The approach thus has a precision of 92.9 and recall of 89.8 . Compared to a baseline that applies keyword search only, our approach results in an improvement of 24.5 in precision and 38 in recall.


Decoupled Dialogue Modeling and Semantic Parsing for Multi Turn Text to SQL. Recently, Text to SQL for multi turn dialogue has attracted great interest. Here, the user input of the current turn is parsed into the corresponding SQL query of the appropriate database, given all previous dialogue history. Current approaches mostly employ end to end models and consequently face two challenges. First, dialogue history modeling and Text to SQL parsing are implicitly combined, hence it is hard to carry out interpretable analysis and obtain targeted improvement. Second, SQL annotation of multi turn dialogue is very expensive, leading to training data sparsity. In this paper, we propose a novel decoupled multi turn Text to SQL framework, where an utterance rewrite model first explicitly solves completion of dialogue context, and then a single turn Text to SQL parser follows. A dual learning approach is also proposed for the utterance rewrite model to address the data sparsity problem. Compared with end to end approaches, the proposed decoupled method can achieve excellent performance without any annotated in domain data. With just a few annotated rewrite cases, the decoupled method outperforms the released state of the art end to end models on both SParC and CoSQL datasets.


GeoChemFoam Direct modelling of multiphase reactive transport in real pore geometries with equilibrium reactions. We present the novel numerical model GeoChemFoam, a multiphase reactive transport solver for simulations on complex pore geometries, including microfluidic devices and micro CT images. The geochemical model includes bulk and surface equilibrium reactions. Multiphase flow is solved using the Volume Of Fluid method and the transport of species is solved using the Continuous Species Transfer method. The reactive transport equations are solved using a sequential Operator Splitting method, with the transport step solved using our OpenFOAM based Computational Fluid Dynamics toolbox, and the reaction step solved using Phreeqc, the US geological survey's geochemical solver. The model is validated by comparison with analytical solutions in 1D and 2D geometries. We then applied the model to simulate multiphase reactive transport in two test pore geometries a 3D pore cavity and a 3D micro CT image of Bentheimer sandstone. In each case, we show the pore scale simulation results can be used to develop upscaled models that are significantly more accurate than standard macro scale equilibrium models.


Learning Spatiotemporal Occupancy Grid Maps for Lifelong Navigation in Dynamic Scenes. We present a novel method for generating, predicting, and using Spatiotemporal Occupancy Grid Maps (SOGM), which embed future information of dynamic scenes. Our automated generation process creates groundtruth SOGMs from previous navigation data. We build on prior work to annotate lidar points based on their dynamic properties, which are then projected on time stamped 2D grids SOGMs. We design a 3D 2D feedforward architecture, trained to predict the future time steps of SOGMs, given 3D lidar frames as input. Our pipeline is entirely self supervised, thus enabling lifelong learning for robots. The network is composed of a 3D back end that extracts rich features and enables the semantic segmentation of the lidar frames, and a 2D front end that predicts the future information embedded in the SOGMs within planning. We also design a navigation pipeline that uses these predicted SOGMs. We provide both quantitative and qualitative insights into the predictions and validate our choices of network design with a comparison to the state of the art and ablation studies.


SQLRepair Identifying and Repairing Mistakes in Student Authored SQL Queries. Computer science educators seek to understand the types of mistakes that students make when learning a new (programming) language so that they can help students avoid those mistakes in the future. While educators know what mistakes students regularly make in languages such as C and Python, students struggle with SQL and regularly make mistakes when working with it. We present an analysis of mistakes that students made when first working with SQL, classify the types of errors introduced, and provide suggestions on how to avoid them going forward. In addition, we present an automated tool, SQLRepair, that is capable of repairing errors introduced by undergraduate programmers when writing SQL queries. Our results show that students find repairs produced by our tool comparable in understandability to queries written by themselves or by other students, suggesting that SQL repair tools may be useful in an educational context. We also provide to the community a benchmark of SQL queries written by the students in our study that we used for evaluation of SQLRepair.


On the convolutions of sums of multiple zeta( star) values of height one. In this paper, we investigate the sums of mutliple zeta( star) values of height one Z pm (n) sum a b n ( pm 1) b zeta( 1 a,b 2) , Z pm star (n) sum a b n ( pm 1) b zeta star ( 1 a,b 2) . In particular, we prove that the weighted sum sum substack 0 leq m leq p m rm even sum mid boldsymbol alpha mid p 3 2 alpha m 1 1 zeta( alpha 0, alpha 1, ldots, alpha m, alpha m 1 1) can be evaluated through the convolution of Z (m) and Z (n) with m n p .


Maximum Likelihood Spectrum Decomposition for Isotope Identification and Quantification. A spectral decomposition method has been implemented to identify and quantify isotopic source terms in high resolution gamma ray spectroscopy in static geometry and shielding scenarios. Monte Carlo simulations were used to build the response matrix of a shielded high purity germanium detector monitoring an effluent stream with a Marinelli configuration. The decomposition technique was applied to a series of calibration spectra taken with the detector using a multi nuclide standard. These results are compared to decay corrected values from the calibration certificate. For most nuclei in the standard ( 241 Am, 109 Cd, 137 Cs, and 60 Co) the deviations from the certificate values were generally no more than 6 with a few outliers as high as 10 . For 57 Co, the radionuclide with the lowest activity, the deviations from the standard reached as high as 25 , driven by the meager statistics in the calibration spectra. Additionally, a complete treatment of error propagation for the technique is presented.


Detection of Insider Threats using Artificial Intelligence and Visualisation. Insider threats are one of the most damaging risk factors for the IT systems and infrastructure of a company or an organization identification of insider threats has prompted the interest of the world academic research community, with several solutions having been proposed to alleviate their potential impact. For the implementation of the experimental stage described in this study, the Convolutional Neural Network (from now on CNN) algorithm was used and implemented via the Google TensorFlow program, which was trained to identify potential threats from images produced by the available dataset. From the examination of the images that were produced and with the help of Machine Learning, the question of whether the activity of each user is classified as malicious or not for the Information System was answered.


Modelling vortex ring growth in the wake of a translating cone. Vortex rings have the ability to transport fluid over long distances. They are usually produced by ejecting a volume of fluid through a circular orifice or nozzle. When the volume and velocity of the ejected fluid are known, the vortex' circulation, impulse, and energy can be estimated by the slug flow model. Vortex rings also form in the wake of accelerating axisymmetric bodies. In this configuration, the volume and velocity of the fluid that is injected into the vortex is not known a priori. Here, we present two models to predict the growth of the vortex behind disks or cones. The first model uses conformal mapping and assumes that all vorticity generated ends up in the vortex. The vortex circulation is determined by imposing the Kutta condition at the tip of the disk. The position of the vortex is integrated from an approximation of its velocity, given by Fraenkel. The model predicts well the maximum circulation of the vortex, but does not predict the tail shedding observed experimentally. A second model is based on an axisymmetric version of the discrete vortex method. The shear layer formed at the tip of the cone is discretised by point vortices, which roll up into a coherent vortex ring. The model accurately captures the temporal evolution of the circulation and the non dimensional energy. The detrainment of vorticity from the vortex, through the process of tail shedding, is qualitatively captured by the model but remains quantitatively sensitive to the numerical parameters.


Securing Federated Learning A Covert Communication based Approach. Federated Learning Networks (FLNs) have been envisaged as a promising paradigm to collaboratively train models among mobile devices without exposing their local privacy data. Due to the need for frequent model updates and communications, FLNs are vulnerable to various attacks (e.g., eavesdropping attacks, inference attacks, poisoning attacks, and backdoor attacks). Balancing privacy protection with efficient distributed model training is a key challenge for FLNs. Existing countermeasures incur high computation costs and are only designed for specific attacks on FLNs. In this paper, we bridge this gap by proposing the Covert Communication based Federated Learning (CCFL) approach. Based on the emerging communication security technique of covert communication which hides the existence of wireless communication activities, CCFL can degrade attackers' capability of extracting useful information from the FLN training protocol, which is a fundamental step for most existing attacks, and thereby holistically enhances the privacy of FLNs. We experimentally evaluate CCFL extensively under real world settings in which the FL latency is optimized under given security requirements. Numerical results demonstrate the significant effectiveness of the proposed approach in terms of both training efficiency and communication security.


Proposition d'approches de d 'eploiement des unit 'es de bord de route dans les r 'eseaux v 'ehiculaires. Road Side Units (RSUs) have a crucial role in maintaining Vehicular Ad hoc Networks (VANETs) connectivity and coverage, especially, for applications gathering or disseminating non safety information. In big cities with complex road network topology, a huge number of costly RSUs must be deployed to collect data gathered by all moving vehicles. In this respect, several research works focusing on RSUs deployment have been proposed. The thriving challenge would be to (i) reduce the deployment cost by minimizing as far as possible the number of used RSUs and (ii) to maximize the coverage ratio. In this thesis, we introduce a spatio temporal RSU deployment framework including three methods namely SPaCov SPaCov , HeSPic and MIP. SPaCov starts by mining frequent mobility patterns of moving vehicles from their trajectories then it computes the best RSU locations that cover the extracted patterns. Nonetheless, SPaCov extracts the frequent mobility patterns as well as the rare ones to enhance the coverage ratio. HeSiC is a budget constrained spatio temporal coverage method that aims to maximize the coverage ratio subject to a budget constraint, which is defined in terms of RSUs number. MIP is a spatio temporal coverage method that aims to finding representative transactions from the sequential database and computing coverage. Performed simulations highlight the efficiency and the effectiveness of the proposed RSU deployment framework in terms of coverage ratio, deployment cost, network latency and overhead.


Exploring the Role of Machine Learning in Scientific Workflows Opportunities and Challenges. In this survey, we discuss the challenges of executing scientific workflows as well as existing Machine Learning (ML) techniques to alleviate those challenges. We provide the context and motivation for applying ML to each step of the execution of these workflows. Furthermore, we provide recommendations on how to extend ML techniques to unresolved challenges in the execution of scientific workflows. Moreover, we discuss the possibility of using ML techniques for in situ operations. We explore the challenges of in situ workflows and provide suggestions for improving the performance of their execution using ML techniques.


Does MAML Only Work via Feature Re use? A Data Centric Perspective. Recent work has suggested that a good embedding is all we need to solve many few shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta Learning (MAML) also works via this same method by learning a good embedding. These observations highlight our lack of understanding of what meta learning algorithms are doing and when they work. In this work, we provide empirical results that shed some light on how meta learned MAML representations function. In particular, we identify three interesting properties 1) In contrast to previous work, we show that it is possible to define a family of synthetic benchmarks that result in a low degree of feature re use suggesting that current few shot learning benchmarks might not have the properties needed for the success of meta learning algorithms 2) meta overfitting occurs when the number of classes (or concepts) are finite, and this issue disappears once the task has an unbounded number of concepts (e.g., online learning) 3) more adaptation at meta test time with MAML does not necessarily result in a significant representation change or even an improvement in meta test performance even when training on our proposed synthetic benchmarks. Finally, we suggest that to understand meta learning algorithms better, we must go beyond tracking only absolute performance and, in addition, formally quantify the degree of meta learning and track both metrics together. Reporting results in future work this way will help us identify the sources of meta overfitting more accurately and help us design more flexible meta learning algorithms that learn beyond fixed feature re use. Finally, we conjecture the core challenge of re thinking meta learning is in the design of few shot learning data sets and benchmarks rather than in the algorithms, as suggested by previous work.


Resolution Exchange with Tunneling for Enhanced Sampling of Protein Landscapes. Simulations of protein folding and protein association happen on timescales that are orders of magnitude larger than what can typically be covered in all atom molecular dynamics simulations. Use of low resolution models alleviates this problem but may reduce the accuracy of the simulations. We introduce a replica exchange based multiscale sampling technique that combines the faster sampling in coarse grained simulations with the potentially higher accuracy of all atom simulations. After testing the efficiency of our Resolution Exchange with Tunneling (ResET) in simulations of the Trp cage protein, an often used model to evaluate sampling techniques in protein simulations, we use our approach to compare the landscape of wild type and A2T mutant Abeta 1 42 peptides. Our results suggest a mechanism by that the mutation of a small hydrophobic Alanine (A) into a bulky polar Threonine (T) may interfere with the self assembly of Abeta fibrils.


Thermally Regenerative Flow Batteries with pH Neutral Electrolytes for Harvesting Low Grade Heat. Harvesting waste heat with temperatures lower than 100 oC can improve system efficiency and reduce greenhouse gas emissions, yet it has been a longstanding and challenging task. Electrochemical methods for harvesting low grade heat have attracted research interest in recent years due to the relatively high effective temperature coefficient of the electrolytes ( 1 mV K) compared with the thermopower of traditional thermoelectric devices. Comparing with other electrochemical devices such as temperature variation based thermally regenerative electrochemical cycle and temperature difference based thermogalvanic cells, the thermally regenerative flow battery (TRFB) has the advantages of providing a continuous power output, decoupling the heat source and heat sink and recuperating heat, and compatible with stacking for scaling up. However, TRFB suffers from the issue of stable operation due to the challenge of pH matching between catholyte and anolyte solutions with desirable temperature coefficients. In this work, we demonstrate a PH neutral TRFB based on KI KI3 and K3Fe(CN)6 K4Fe(CN)6 as the catholyte and anolyte, respectively, with a cell temperature coefficient of 1.9 mV K and a power density of 9 uW cm2. This work also presents a comprehensive model with a coupled analysis of mass transfer and reaction kinetics in a porous electrode that can accurately capture the flow rate dependence of power density and energy conversion efficiency. We estimate that the efficiency of the pH neutral TRFB can reach 11 of the Carnot efficiency at the maximum power output with a temperature difference of 37 K. Via analysis, we identify that the mass transfer overpotential inside the porous electrode and the resistance of the ion exchange membrane are the two major factors limiting the efficiency and power density, pointing to directions for future improvements.


Messing Up 3D Virtual Environments Transferable Adversarial 3D Objects. In the last few years, the scientific community showed a remarkable and increasing interest towards 3D Virtual Environments, training and testing Machine Learning based models in realistic virtual worlds. On one hand, these environments could also become a mean to study the weaknesses of Machine Learning algorithms, or to simulate training settings that allow Machine Learning models to gain robustness to 3D adversarial attacks. On the other hand, their growing popularity might also attract those that aim at creating adversarial conditions to invalidate the benchmarking process, especially in the case of public environments that allow the contribution from a large community of people. Most of the existing Adversarial Machine Learning approaches are focused on static images, and little work has been done in studying how to deal with 3D environments and how a 3D object should be altered to fool a classifier that observes it. In this paper, we study how to craft adversarial 3D objects by altering their textures, using a tool chain composed of easily accessible elements. We show that it is possible, and indeed simple, to create adversarial objects using off the shelf limited surrogate renderers that can compute gradients with respect to the parameters of the rendering process, and, to a certain extent, to transfer the attacks to more advanced 3D engines. We propose a saliency based attack that intersects the two classes of renderers in order to focus the alteration to those texture elements that are estimated to be effective in the target engine, evaluating its impact in popular neural classifiers.


Finding Colorful Paths in Temporal Graphs. The problem of finding paths in temporal graphs has been recently considered due to its many applications. In this paper we consider a variant of the problem that, given a vertex colored temporal graph, asks for a path whose vertices have distinct colors and include the maximum number of colors. We study the approximation complexity of the problem and we provide an inapproximability lower bound. Then we present a heuristic for the problem and an experimental evaluation of our heuristic, both on synthetic and real world graphs.


Randomized Dimensionality Reduction for Facility Location and Single Linkage Clustering. Random dimensionality reduction is a versatile tool for speeding up algorithms for high dimensional problems. We study its application to two clustering problems the facility location problem, and the single linkage hierarchical clustering problem, which is equivalent to computing the minimum spanning tree. We show that if we project the input pointset X onto a random d O(d X) dimensional subspace (where d X is the doubling dimension of X ), then the optimum facility location cost in the projected space approximates the original cost up to a constant factor. We show an analogous statement for minimum spanning tree, but with the dimension d having an extra log log n term and the approximation factor being arbitrarily close to 1 . Furthermore, we extend these results to approximating solutions instead of just their costs. Lastly, we provide experimental results to validate the quality of solutions and the speedup due to the dimensionality reduction. Unlike several previous papers studying this approach in the context of k means and k medians, our dimension bound does not depend on the number of clusters but only on the intrinsic dimensionality of X .


Hate Towards the Political Opponent A Twitter Corpus Study of the 2020 US Elections on the Basis of Offensive Speech and Stance Detection. The 2020 US Elections have been, more than ever before, characterized by social media campaigns and mutual accusations. We investigate in this paper if this manifests also in online communication of the supporters of the candidates Biden and Trump, by uttering hateful and offensive communication. We formulate an annotation task, in which we join the tasks of hateful offensive speech detection and stance detection, and annotate 3000 Tweets from the campaign period, if they express a particular stance towards a candidate. Next to the established classes of favorable and against, we add mixed and neutral stances and also annotate if a candidate is mentioned without an opinion expression. Further, we annotate if the tweet is written in an offensive style. This enables us to analyze if supporters of Joe Biden and the Democratic Party communicate differently than supporters of Donald Trump and the Republican Party. A BERT baseline classifier shows that the detection if somebody is a supporter of a candidate can be performed with high quality (.89 F1 for Trump and .91 F1 for Biden), while the detection that somebody expresses to be against a candidate is more challenging (.79 F1 and .64 F1, respectively). The automatic detection of hate offensive speech remains challenging (with .53 F1). Our corpus is publicly available and constitutes a novel resource for computational modelling of offensive language under consideration of stances.


Multiaccurate Proxies for Downstream Fairness. We study the problem of training a model that must obey demographic fairness conditions when the sensitive features are not available at training time in other words, how can we train a model to be fair by race when we don't have data about race? We adopt a fairness pipeline perspective, in which an "upstream" learner that does have access to the sensitive features will learn a proxy model for these features from the other attributes. The goal of the proxy is to allow a general "downstream" learner with minimal assumptions on their prediction task to be able to use the proxy to train a model that is fair with respect to the true sensitive features. We show that obeying multiaccuracy constraints with respect to the downstream model class suffices for this purpose, provide sample and oracle efficient algorithms and generalization bounds for learning such proxies, and conduct an experimental evaluation. In general, multiaccuracy is much easier to satisfy than classification accuracy, and can be satisfied even when the sensitive features are hard to predict.


Planning of Power Grasps Using Infinite Program Under Complementary Constraints. We propose an optimization based approach to plan power grasps. Central to our method is a reformulation of grasp planning as an infinite program under complementary constraints (IPCC), which allows contacts to happen between arbitrary pairs of points on the object and the robot gripper. We show that IPCC can be reduced to a conventional finite dimensional nonlinear program (NLP) using a kernel integral relaxation. Moreover, the values and Jacobian matrices of the kernel integral can be evaluated efficiently using a modified Fast Multipole Method (FMM). We further guarantee that the planned grasps are collision free using primal barrier penalties. We demonstrate the effectiveness, robustness, and efficiency of our grasp planner on a row of challenging 3D objects and high DOF grippers, such as Barrett Hand and Shadow Hand, where our method achieves superior grasp qualities over competitors.


A Review of Formal Methods applied to Machine Learning. We review state of the art formal methods applied to the emerging field of the verification of machine learning systems. Formal methods can provide rigorous correctness guarantees on hardware and software systems. Thanks to the availability of mature tools, their use is well established in the industry, and in particular to check safety critical applications as they undergo a stringent certification process. As machine learning is becoming more popular, machine learned components are now considered for inclusion in critical systems. This raises the question of their safety and their verification. Yet, established formal methods are limited to classic, i.e. non machine learned software. Applying formal methods to verify systems that include machine learning has only been considered recently and poses novel challenges in soundness, precision, and scalability. We first recall established formal methods and their current use in an exemplar safety critical field, avionic software, with a focus on abstract interpretation based techniques as they provide a high level of scalability. This provides a golden standard and sets high expectations for machine learning verification. We then provide a comprehensive and detailed review of the formal methods developed so far for machine learning, highlighting their strengths and limitations. The large majority of them verify trained neural networks and employ either SMT, optimization, or abstract interpretation techniques. We also discuss methods for support vector machines and decision tree ensembles, as well as methods targeting training and data preparation, which are critical but often neglected aspects of machine learning. Finally, we offer perspectives for future research directions towards the formal verification of machine learning systems.


Segregation, integration and balance of large scale resting brain networks configure different cognitive abilities. Diverse cognitive processes set different demands on locally segregated and globally integrated brain activity. However, it remains unclear how resting brains configure their functional organization to balance the demands on network segregation and integration to best serve cognition. Here, we use an eigenmode based approach to identify hierarchical modules in functional brain networks, and quantify the functional balance between network segregation and integration. In a large sample of healthy young adults (n 991), we combine the whole brain resting state functional magnetic resonance imaging (fMRI) data with a mean filed model on the structural network derived from diffusion tensor imaging and demonstrate that resting brain networks are on average close to a balanced state. This state allows for a balanced time dwelling at segregated and integrated configurations, and highly flexible switching between them. Furthermore, we employ structural equation modelling to estimate general and domain specific cognitive phenotypes from nine tasks, and demonstrate that network segregation, integration and their balance in resting brains predict individual differences in diverse cognitive phenotypes. More specifically, stronger integration is associated with better general cognitive ability, stronger segregation fosters crystallized intelligence and processing speed, and individual's tendency towards balance supports better memory. Our findings provide a comprehensive and deep understanding of the brain's functioning principles in supporting diverse functional demands and cognitive abilities, and advance modern network neuroscience theories of human cognition.


Trojan Source Invisible Vulnerabilities. We present a new type of attack in which source code is maliciously encoded so that it appears different to a compiler and to the human eye. This attack exploits subtleties in text encoding standards such as Unicode to produce source code whose tokens are logically encoded in a different order from the one in which they are displayed, leading to vulnerabilities that cannot be perceived directly by human code reviewers. 'Trojan Source' attacks, as we call them, pose an immediate threat both to first party software and of supply chain compromise across the industry. We present working examples of Trojan Source attacks in C, C , C , JavaScript, Java, Rust, Go, and Python. We propose definitive compiler level defenses, and describe other mitigating controls that can be deployed in editors, repositories, and build pipelines while compilers are upgraded to block this attack.


A Dual Attention Neural Network for Pun Location and Using Pun Gloss Pairs for Interpretation. Pun location is to identify the punning word (usually a word or a phrase that makes the text ambiguous) in a given short text, and pun interpretation is to find out two different meanings of the punning word. Most previous studies adopt limited word senses obtained by WSD(Word Sense Disambiguation) technique or pronunciation information in isolation to address pun location. For the task of pun interpretation, related work pays attention to various WSD algorithms. In this paper, a model called DANN (Dual Attentive Neural Network) is proposed for pun location, effectively integrates word senses and pronunciation with context information to address two kinds of pun at the same time. Furthermore, we treat pun interpretation as a classification task and construct pungloss pairs as processing data to solve this task. Experiments on the two benchmark datasets show that our proposed methods achieve new state of the art results. Our source code is available in the public code repository.


How Big Are Peoples' Computer Files? File Size Distributions Among User managed Collections. Improving file management interfaces and optimising system performance requires current data about users' digital collections and particularly about the file size distributions of such collections. However, prior works have examined only the sizes of system files and users' work files in varied contexts, and there has been no such study since 2013 it therefore remains unclear how today's file sizes are distributed, particularly personal files, and further if distributions differ among the major operating systems or common occupations. Here we examine such differences among 49 million files in 348 user collections. We find that the average file size has grown more than ten fold since the mid 2000s, though most files are still under 8 MB, and that there are demographic and technological influences in the size distributions. We discuss the implications for user interfaces, system optimisation, and PIM research.


Note on the Goldbach Conjecture and Landau Siegel Zeros. We generalize the work of Fei, Bhowmik and Halupczok, and Jia relating the Goldbach conjecture to real zeros of Dirichlet L functions.


Sentiment Progression based Searching and Indexing of Literary Textual Artefacts. Literary artefacts are generally indexed and searched based on titles, meta data and keywords over the years. This searching and indexing works well when user reader already knows about that particular creative textual artefact or document. This indexing and search hardly takes into account interest and emotional makeup of readers and its mapping to books. When a person is looking for a literary textual artefact, he she might be looking for not only information but also to seek the joy of reading. In case of literary artefacts, progression of emotions across the key events could prove to be the key for indexing and searching. In this paper, we establish clusters among literary artefacts based on computational relationships among sentiment progressions using intelligent text analysis. We have created a database of 1076 English titles 20 Marathi titles and also used database http www.cs.cmu.edu dbamman booksummaries.html with 16559 titles and their summaries. We have proposed Sentiment Progression based Indexing for searching and recommending books. This can be used to create personalized clusters of book titles of interest to readers. The analysis clearly suggests better searching and indexing when we are targeting book lovers looking for a particular type of book or creative artefact. This indexing and searching can find many real life applications for recommending books.


A Novel Variable K Pseudonym Scheme Applied to 5G Anonymous Access Authentication. Anonymous access authentication schemes provide users with massive application services while protecting the privacy of users' identities. The identity protection schemes in 3G and 4G are not suitable for 5G anonymous access authentication due to complex computation and pseudonym asynchrony. In this paper, we consider mobile devices with limited resources in the 5G network and propose an anonymous access authentication scheme without the Public Key Infrastructure. The anonymous access authentication scheme provides users with variable shard pseudonyms to protect users' identities asynchronously. With the variable shared pseudonym, our scheme can ensure user anonymity and resist the mark attack, a novel attack aimed at the basic k pseudonym scheme. Finally, we analyze the scheme with BAN logic analysis and verify the user anonymity.


Densely Nested Top Down Flows for Salient Object Detection. With the goal of identifying pixel wise salient object regions from each input image, salient object detection (SOD) has been receiving great attention in recent years. One kind of mainstream SOD methods is formed by a bottom up feature encoding procedure and a top down information decoding procedure. While numerous approaches have explored the bottom up feature extraction for this task, the design on top down flows still remains under studied. To this end, this paper revisits the role of top down modeling in salient object detection and designs a novel densely nested top down flows (DNTDF) based framework. In every stage of DNTDF, features from higher levels are read in via the progressive compression shortcut paths (PCSP). The notable characteristics of our proposed method are as follows. 1) The propagation of high level features which usually have relatively strong semantic information is enhanced in the decoding procedure 2) With the help of PCSP, the gradient vanishing issues caused by non linear operations in top down information flows can be alleviated 3) Thanks to the full exploration of high level features, the decoding process of our method is relatively memory efficient compared against those of existing methods. Integrating DNTDF with EfficientNet, we construct a highly light weighted SOD model, with very low computational complexity. To demonstrate the effectiveness of the proposed model, comprehensive experiments are conducted on six widely used benchmark datasets. The comparisons to the most state of the art methods as well as the carefully designed baseline models verify our insights on the top down flow modeling for SOD. The code of this paper is available at https github.com new stone object DNTD.


Study of transport process and discharge structure of inductively coupled electronegative plasmas via fluid model and analytic theory collaboration. The discharge structure of inductively coupled plasma is studied via fluid simulation and analytic theory collaboration. At low pressure, the discharge is stratified by the double layer, which is modelled as dipole moment. The parabolic profile is formed in the discharge core when recombination loss is negligible and both the electron and anions are the Boltzmann balanced. At increasing the pressure, the main characteristics, i.e., parabolic, elliptic and flat topped profile, are experienced, predicted by the simulation and analytics. Self coagulation is accompanied at all considered pressures. It is more a chemistry process and provides new means of constricting plasma. At its influence, electron density deviates from the Boltzmann equilibrium. For satisfying the neutrality of bulk plasma, the ambi polar self coagulation mechanism is suggested. At high pressure, the self coagulation to coil scheme causes the mass point behavior in the plasma. Minor cations re self coagulate at certain conditions and the correlation with the celestial bodies formation is hypothesized.


Interpretable Image Classification with Differentiable Prototypes Assignment. We introduce ProtoPool, an interpretable image classification model with a pool of prototypes shared by the classes. The training is more straightforward than in the existing methods because it does not require the pruning stage. It is obtained by introducing a fully differentiable assignment of prototypes to particular classes. Moreover, we introduce a novel focal similarity function to focus the model on the rare foreground features. We show that ProtoPool obtains state of the art accuracy on the CUB 200 2011 and the Stanford Cars datasets, substantially reducing the number of prototypes. We provide a theoretical analysis of the method and a user study to show that our prototypes are more distinctive than those obtained with competitive methods.


6G from Densification to Diversification. The 5G system has finally begun commercialization, and now is the time to start discussing the road map for the 6G system. While the 5G system was designed with a focus on discovering new service types for high speed, low latency, and massive connective services, the evolution of the network interface for 6G should be considered with an eye toward supporting these complicated communication environments. As machine driven data traffic continues to increase exponentially, 6G must be able to support a series of connection methods that did not previously exist. In departure from base station oriented cell densification, network diversification is necessary if we are to satisfy the comprehensive requirements of end terminals for diverse applications. In this article, we predict what will drive 6G and look at what key requirements should be considered in 6G. We then diversify four types of network architectures according to link characteristics, communication ranges, and target services. The four types of networks play complementary roles while at the same time collaborating across the entire 6G network. Lastly, we call attention to key technologies and challenges in the air, network, and assistive technologies that will have to be addressed when designing the 6G system.


Arbitrary order of convergence for Riesz fractional derivative via central difference method. We propose a novel method to compute a finite difference stencil for Riesz derivative for artibitrary speed of convergence. This method is based on applying a pre filter to the Gr "unwald Letnikov type central difference stencil. The filter is obtained by solving for the inverse of a symmetric Vandemonde matrix and exploiting the relationship between the Taylor's series coefficients and fast Fourier transform. The filter costs O left(N 2 right) operations to evaluate for O left(h N right) of convergence, where h is the sampling distance. The higher convergence speed should more than offset the overhead with the requirement of the number of nodal points for a desired error tolerance significantly reduced. The benefit of progressive generation of the stencil coefficients for adaptive grid size for dynamic problems with the Gr "unwald Letnikov type difference scheme is also kept because of the application of filtering. The higher convergence rate is verified through numerical experiments.


Fluctuations of two dimensional stochastic heat equation and KPZ equation in subcritical regime for general initial conditions. The solution of Kardar Parisi Zhang equation (KPZ equation) is solved formally via Cole Hopf transformation h log u , where u is the solution of multiplicative stochastic heat equation(SHE). In earlier works by Chatterjee and Dunlap, Caravenna, Sun, and Zygouras, and Gu, they consider the solution of two dimensional KPZ equation via the solution u varepsilon of SHE with flat initial condition and with noise which is mollified in space on scale in varepsilon and its strength is weakened as beta varepsilon hat beta sqrt frac 2 pi varepsilon log varepsilon , and they prove that when hat beta in (0,1) , frac 1 beta varepsilon ( log u varepsilon mathbb E log u varepsilon ) converges in distribution to a solution of Edward Wilkinson model as a random field. In this paper, we consider a stochastic heat equation u varepsilon with general initial condition u 0 and its transformation F(u varepsilon) for F in a class of functions mathfrak F , which contains F(x) x p ( 0 p leq 1 ) and F(x) log x . Then, we prove that frac 1 beta varepsilon (F(u varepsilon(t,x)) mathbb E F(u varepsilon(t,x)) ) converges in distribution to Gaussian random variables jointly in finitely many F in mathfrak F , t , and u 0 . In particular, we obtain the fluctuations of solutions of stochastic heat equations and KPZ equations jointly converge to solutions of SPDEs which depends on u 0 . Our main tools are It o's formula, the martingale central limit theorem, and the homogenization argument as in the works by Cosco and the authors. To this end, we also prove the local limit theorem for the partition function of intermediate 2d directed polymers


Take More Positives An Empirical Study of Contrastive Learing in Unsupervised Person Re Identification. Unsupervised person re identification (re ID) aims at closing the performance gap to supervised methods. These methods build reliable relationship between data points while learning representations. However, we empirically show that the reason why they are successful is not only their label generation mechanisms, but also their unexplored designs. By studying two unsupervised person re ID methods in a cross method way, we point out a hard negative problem is handled implicitly by their designs of data augmentations and PK sampler respectively. In this paper, we find another simple solution for the problem, i.e., taking more positives during training, by which we generate pseudo labels and update models in an iterative manner. Based on our findings, we propose a contrastive learning method without a memory back for unsupervised person re ID. Our method works well on benchmark datasets and outperforms the state of the art methods. Code will be made available.


A shape theorem for exploding sandpiles. We study scaling limits of exploding Abelian sandpiles using ideas from percolation and front propagation in random media. We establish sufficient conditions under which a limit shape exists and show via a family of counterexamples that convergence may not occur in general. A corollary of our proof is a simple criteria for determining if a sandpile is explosive this strengthens a result of Fey, Levine, and Peres (2010).


Entropy Optimal Algorithms for Multiple Choice Secretary. In this paper, we study the problem for the entropy of both admissible and optimal distributions of permutations to the multiple choice secretary problem. In particular, we construct a distribution with entropy Theta( log log n) such that a deterministic threshold based algorithm gives a nearly optimal competitive ratio 1 O( log k k 1 3 ) for k O(( log n) 3 14 ) . Our error is simultaneously nearly optimal and with optimal entropy Theta( log log n) . Our result improves in two ways the previous best construction by Kesselheim, Kleinberg and Niazadeh (KKN) STOC'15 whose competitive ratio is 1 O(1 k 1 3 ) o(1) . First, our solution works for an exponentially larger range of parameters k , as in the work of KKN k O(( log log log n) epsilon ) . Second, our algorithm is a simple deterministic single threshold algorithm (only drawing a permutation from a stochastic uniform distribution), while the algorithm in KKN uses additional randomness. We also prove a new corresponding lower bound for entropy of optimal solutions to the k secretary problem, matching the entropy of our algorithm. We further show the strength of our techniques by obtaining fine grained results for optimal distributions of permutations for the classic secretary problem. For optimal entropy Theta( log log n) , we precisely characterize the success probability of uniform distributions that is below, and close to, 1 e , and construct such distributions in polynomial time. We prove even higher entropy Theta( log(n)) suffices for a success probability above 1 e , but, no uniform probability distribution with small support and entropy strictly less than log (n) can have success probability above 1 e . For maximum entropy Theta(n log(n)) , improving upon a result of Samuels from 1981, we find the precise formula for the optimal success probability of any secretary algorithm.


On the Number of Incidences when Avoiding the Klan. We prove a bound of O( k (n m) log d 1 ) on the number of incidences between n points and m axis parallel boxes in mathbb R d , if no k boxes contain k common points. That is, the incidence graph between the points and the boxes does not contain K k,k as a subgraph. This new bound improves over previous work by a factor of log d n , for d 2 . We also study other variants of the problem. For halfspaces, using shallow cuttings, we get a near linear bound in two and three dimensions. Finally, we present near linear bound for the case of shapes in the plane with low union complexity (e.g. fat triangles).


Optimal transport in full waveform inversion Analysis and practice of the multidimensional Kantorovich Rubinstein norm. In the last ten years, full waveform inversion has emerged as a robust and efficient high resolution velocity model building tool for seismic imaging, with the unique ability to recover complex subsurface structures. Originally based on a data fitting process using a least squares cost function, it suffered from high sensitivity to cycle skipping and was therefore of poor efficiency in handling large time shifts between observed and modelled seismic events. To tackle this problem, a common practice is to start the inversion using the low temporal frequencies of the data and selecting diving wave events. Complementary to this, the use of other cost functions has been investigated. Among these, cost functions based on optimal transport appeared appealing to possibly handle large time shifts between seismic events. Several strategies inspired by optimal transport have been proposed, taking into account the specificities of seismic data. Among them, the approach based on the Kantorovich Rubinstein norm offers the possibility of the direct use of seismic data and an efficient numerical implementation allowing for a multidimensional (data coordinate space) application. We present here an analysis of the Kantorovich Rubinstein norm, discussing its theoretical and practical aspects. A key component of our analysis is the back propagated adjoint source. We highlight its piecewise linearity, analyze its frequency content and amplitude balancing. We also emphasize the benefit of having a multidimensional implementation. Furthermore, we give practical rules for setting the tuning parameters of the numerical implementation. Our set of synthetic and field data examples demonstrate the improvements brought by the use of the Kantorovich Rubinstein norm over least squares full waveform inversion, and highlight the improvements brought by the multidimensional approach over the one dimensional one.


Temperature dependent extensions of the Cahn Hilliard equation. The Cahn Hilliard equation is a fundamental model that describes phase separation processes of binary mixtures. In this paper we focus on the dynamics of these binary media, when the underlying temperature is not constant. The aim of this paper is twofold. We first derive two distinct models that extend the classical Cahn Hilliard equation with an evolutionary equation for the absolute temperature. Secondly, we analyse the local well posedness of classical solutions for one of these systems. Our modelling introduces the systems of PDEs by means of a general and unified formalism. This formalism couples standard principles of mechanics together with the main laws of thermodynamics. Our work highlights how certain assumptions on the transport of the temperature effect the overall physics of the systems. The variety of these thermodynamically consistent models opens the question of which one should be more appropriate. Our analysis shows that one of the derived models might be more desirable to the well posedness theory of classical solutions, a property that might be natural as a selection criteria.


Small Changes Make Big Differences Improving Multi turn Response Selection in Dialogue Systems via Fine Grained Contrastive Learning. Retrieve based dialogue response selection aims to find a proper response from a candidate set given a multi turn context. Pre trained language models (PLMs) based methods have yielded significant improvements on this task. The sequence representation plays a key role in the learning of matching degree between the dialogue context and the response. However, we observe that different context response pairs sharing the same context always have a greater similarity in the sequence representations calculated by PLMs, which makes it hard to distinguish positive responses from negative ones. Motivated by this, we propose a novel textbf F ine textbf G rained textbf C ontrastive (FGC) learning method for the response selection task based on PLMs. This FGC learning strategy helps PLMs to generate more distinguishable matching representations of each dialogue at fine grains, and further make better predictions on choosing positive responses. Empirical studies on two benchmark datasets demonstrate that the proposed FGC learning method can generally and significantly improve the model performance of existing PLM based matching models.


In flight Novelty Detection with Convolutional Neural Networks. Gas turbine engines are complex machines that typically generate a vast amount of data, and require careful monitoring to allow for cost effective preventative maintenance. In aerospace applications, returning all measured data to ground is prohibitively expensive, often causing useful, high value, data to be discarded. The ability to detect, prioritise, and return useful data in real time is therefore vital. This paper proposes that system output measurements, described by a convolutional neural network model of normality, are prioritised in real time for the attention of preventative maintenance decision makers. Due to the complexity of gas turbine engine time varying behaviours, deriving accurate physical models is difficult, and often leads to models with low prediction accuracy and incompatibility with real time execution. Data driven modelling is a desirable alternative producing high accuracy, asset specific models without the need for derivation from first principles. We present a data driven system for online detection and prioritisation of anomalous data. Biased data assessment deriving from novel operating conditions is avoided by uncertainty management integrated into the deep neural predictive model. Testing is performed on real and synthetic data, showing sensitivity to both real and synthetic faults. The system is capable of running in real time on low power embedded hardware and is currently in deployment on the Rolls Royce Pearl 15 engine flight trials.


Two color coherent control in photoemission from gold needle tips. We demonstrate coherent control of photoemission from a gold needle tip using a two color laser field. The relative phase between a fundamental field and its second harmonic imprints a strong modulation on the emitted photocurrent with up to 96.5 contrast. The contrast as a function of the second harmonic intensity can be described by three interfering quantum pathways. Increasing the bias voltage applied to the tip reduces the maximum achievable contrast and modifies the weights of the involved pathways. Simulations based on the time dependent Schr "odinger equation reproduce the characteristic cooperative signal and its dependence on the second harmonic intensity, which further confirms the involvement of three emission pathways.


LasHeR A Large scale High diversity Benchmark for RGBT Tracking. RGBT tracking receives a surge of interest in the computer vision community, but this research field lacks a large scale and high diversity benchmark dataset, which is essential for both the training of deep RGBT trackers and the comprehensive evaluation of RGBT tracking methods. To this end, we present a Large scale High diversity benchmark for RGBT tracking (LasHeR) in this work. LasHeR consists of 1224 visible and thermal infrared video pairs with more than 730K frame pairs in total. Each frame pair is spatially aligned and manually annotated with a bounding box, making the dataset well and densely annotated. LasHeR is highly diverse capturing from a broad range of object categories, camera viewpoints, scene complexities and environmental factors across seasons, weathers, day and night. We conduct a comprehensive performance evaluation of 12 RGBT tracking algorithms on the LasHeR dataset and present detailed analysis to clarify the research room in RGBT tracking. In addition, we release the unaligned version of LasHeR to attract the research interest for alignment free RGBT tracking, which is a more practical task in real world applications. The datasets and evaluation protocols are available at https github.com BUGPLEASEOUT LasHeR.


GENder IT An Annotated English Italian Parallel Challenge Set for Cross Linguistic Natural Gender Phenomena. Languages differ in terms of the absence or presence of gender features, the number of gender classes and whether and where gender features are explicitly marked. These cross linguistic differences can lead to ambiguities that are difficult to resolve, especially for sentence level MT systems. The identification of ambiguity and its subsequent resolution is a challenging task for which currently there aren't any specific resources or challenge sets available. In this paper, we introduce gENder IT, an English Italian challenge set focusing on the resolution of natural gender phenomena by providing word level gender tags on the English source side and multiple gender alternative translations, where needed, on the Italian target side.


On the Latent Holes of VAEs for Text Generation. In this paper, we provide the first focused study on the discontinuities (aka. holes) in the latent space of Variational Auto Encoders (VAEs), a phenomenon which has been shown to have a detrimental effect on model capacity. When investigating latent holes, existing works are exclusively centred around the encoder network and they merely explore the existence of holes. We tackle these limitations by proposing a highly efficient Tree based Decoder Centric (TDC) algorithm for latent hole identification, with a focal point on the text domain. In contrast to past studies, our approach pays attention to the decoder network, as a decoder has a direct impact on the model's output quality. Furthermore, we provide, for the first time, in depth empirical analysis of the latent hole phenomenon, investigating several important aspects such as how the holes impact VAE algorithms' performance on text generation, and how the holes are distributed in the latent space.


Adjacency Energy of Hypergraphs. In this paper, we define and obtain several properties of the (adjacency) energy of a hypergraph. In particular, bounds for this energy are obtained as functions of structural and spectral parameters, such as Zagreb index and spectral radius. We also study how the energy of a hypergraph varies when a vertex edge is removed or when an edge is divied. In addition, we solved the extremal problem energy for the class of hyperstars, and show that the energy of a hypergraph is never an odd number.


Censorship of Online Encyclopedias Implications for NLP Models. While artificial intelligence provides the backbone for many tools people use around the world, recent work has brought to attention that the algorithms powering AI are not free of politics, stereotypes, and bias. While most work in this area has focused on the ways in which AI can exacerbate existing inequalities and discrimination, very little work has studied how governments actively shape training data. We describe how censorship has affected the development of Wikipedia corpuses, text data which are regularly used for pre trained inputs into NLP algorithms. We show that word embeddings trained on Baidu Baike, an online Chinese encyclopedia, have very different associations between adjectives and a range of concepts about democracy, freedom, collective action, equality, and people and historical events in China than its regularly blocked but uncensored counterpart Chinese language Wikipedia. We examine the implications of these discrepancies by studying their use in downstream AI applications. Our paper shows how government repression, censorship, and self censorship may impact training data and the applications that draw from them.


Cost constrained Minimal Steiner Tree Enumeration by Binary Decision Diagram. The Steiner tree enumeration problem is a well known problem that asks for enumerating Steiner trees. Numerous theoretical works proposed algorithms for the problem and analyzed their complexity, but there are no practical algorithms and experimental studies. In this paper, we study the Steiner tree enumeration problem practically. We define a problem cost constrained minimal Steiner tree enumeration problem, which enumerates minimal Steiner trees with costs not larger than a given threshold. To solve the problem, we propose a binary decision diagram (BDD) based algorithm. The BDD based algorithm constructs a BDD that compactly represents the set of minimal Steiner trees and then traverses the BDD for enumeration. We develop a novel it frontier based algorithm to efficiently construct BDDs. Our BDD traverse algorithm prunes Steiner trees with costs larger than the threshold. We also extend our algorithm by preprocessing the given graph and controlling the number of generated Steiner trees in order to reduce the memory and computation costs. The extension makes our algorithm scalable by generating a subset of the minimal Steiner trees. We validate that our algorithm can enumerate Steiner trees in real world graphs more efficiently than existing methods.


Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks. Backdoor attacks are a kind of emergent security threat in deep learning. When a deep neural model is injected with a backdoor, it will behave normally on standard inputs but give adversary specified predictions once the input contains specific backdoor triggers. Current textual backdoor attacks have poor attack performance in some tough situations. In this paper, we find two simple tricks that can make existing textual backdoor attacks much more harmful. The first trick is to add an extra training task to distinguish poisoned and clean data during the training of the victim model, and the second one is to use all the clean training data rather than remove the original clean data corresponding to the poisoned data. These two tricks are universally applicable to different attack models. We conduct experiments in three tough situations including clean data fine tuning, low poisoning rate, and label consistent attacks. Experimental results show that the two tricks can significantly improve attack performance. This paper exhibits the great potential harmfulness of backdoor attacks. All the code and data will be made public to facilitate further research.


Uncertainty aware Incremental Learning for Multi organ Segmentation. Most existing approaches to train a unified multi organ segmentation model from several single organ datasets require simultaneously access multiple datasets during training. In the real scenarios, due to privacy and ethics concerns, the training data of the organs of interest may not be publicly available. To this end, we investigate a data free incremental organ segmentation scenario and propose a novel incremental training framework to solve it. We use the pretrained model instead of its own training data for privacy protection. Specifically, given a pretrained K organ segmentation model and a new single organ dataset, we train a unified K 1 organ segmentation model without accessing any data belonging to the previous training stages. Our approach consists of two parts the background label alignment strategy and the uncertainty aware guidance strategy. The first part is used for knowledge transfer from the pretained model to the training model. The second part is used to extract the uncertainty information from the pretrained model to guide the whole knowledge transfer process. By combing these two strategies, more reliable information is extracted from the pretrained model without original training data. Experiments on multiple publicly available pretrained models and a multi organ dataset MOBA have demonstrated the effectiveness of our framework.


Trade Based LDPC Codes. LDPC codes based on multiple edge protographs potentially have larger minimum distances compared to their counterparts, single edge protographs. However, considering different features of their Tanner graph, such as short cycles, girth and other graphical structures, is harder than for Tanner graphs from single edge protographs. In this paper, we provide a novel approach to construct the parity check matrix of an LDPC code which is based on trades obtained from block designs. We employ our method to construct two important categories of LDPC codes quasi cyclic (QC) LDPC and spatially coupled LDPC (SC LDPC) codes. We use those trade based matrices to define base matrices of multiple edge protographs. The construction of exponent matrices corresponding to these base matrices has less complexity compared to the ones proposed in the literature. We prove that these base matrices result in QC LDPC codes with smaller lower bounds on the lifting degree than existing ones. There are three categories of SC LDPC codes periodic, time invariant and time varying. Constructing the parity check matrix of the third one is more difficult because of the time dependency in the parity check matrix. We use a trade based matrix to obtain the parity check matrix of a time varying SC LDPC code in which each downwards row displacement of the trade based matrix yields syndrome matrices of a particular time. Combining the different row shifts the whole parity check matrix is obtained. Our proposed method to construct parity check and base matrices from trade designs is applicable to any type of super simple directed block designs. We apply our technique to directed designs with smallest defining sets containing at least half of the blocks. To demonstrate the significance of our contribution, we provide a number of numerical and simulation results.


Quadratic forms in 8 prime variables. We give an asymptotic for the number of prime solutions to Q(x 1, dots, x 8) N , subject to a mild non degeneracy condition on the homogeneous quadratic form Q . The argument initially proceeds via the circle method, but this does not suffice by itself. To obtain a nontrivial bound on certain averages of exponential sums, we interpret these sums as matrix coefficients for the Weil representation of the symplectic group operatorname Sp 8( mathbf Z q mathbf Z ) . Averages of such matrix coefficients are then bounded using an amplification argument and a convergence result for convolutions of measures, which reduces matters to understanding the action of certain 12 dimensional subgroups in the Weil representation. Sufficient understanding can be gained by using the basic represention theory of operatorname SL 2(k) , k a finite field.


Attention Enhanced Neural Network Models for Turbulence Simulation. Deep neural network models have shown a great potential in accelerating the simulation of fluid dynamic systems. Once trained, these models can make inference within seconds, thus can be extremely efficient. However, they suffer from a generalization problem when the flow becomes chaotic and turbulent. One of the most important reasons is that, existing models lack the mechanism to handle the unique characteristic of turbulent flow multi scale flow structures are non uniformly distributed and strongly nonequilibrium. In this work, we address this issue with the concept of visual attention intuitively, we expect the attention module to capture the nonequilibrium of turbulence by automatically adjusting weights on different regions. We benchmark the performance improvement with a state of the art neural network model, the Fourier Neural Operator (FNO), on two dimensional (2D) turbulence prediction task. Numerical experiments show that the attention enhanced neural network model can generalize well on higher Reynolds numbers flow, and can accurately reconstruct a variety of statistics and instantaneous spatial structures of turbulence. The attention mechanism provides 40 error reduction with 1 increase of parameters, at the same level of computational cost.


A new elastoplastic damage model with the correction of stress triaxiality and Lode angle. The classic elastoplastic damage constitutive model neglects the effects of loading histories. But in fact, more and more experiments results show that the states of stress can significantly affect the response of metals not only in the plasticity but also in the damage evolution. This paper presents an elasto plastic fully coupled ductile damage constitutive model which considers the corrections of the metal plasticity and the damage evolution through the states of stress. The stress triaxiality and the Lode angle are frequently used to characterize the state of stress. The correction of metal plasticity is achieved by applying a new flow stress model associated with the stress triaxiality and Lode angle. A stress state parameter which depends on the function of stress triaxiality and Lode angle is also proposed. In order to calibrate the damage evolution, the stress state parameter is introduced into the Chaboche damage model. The experiment results of aluminium 2024 T351 are used to validate the proposed constitutive model.


SWAD Domain Generalization by Seeking Flat Minima. Domain generalization (DG) methods aim to achieve generalizability to an unseen target domain by using only training data from the source domains. Although a variety of DG methods have been proposed, a recent study shows that under a fair evaluation protocol, called DomainBed, the simple empirical risk minimization (ERM) approach works comparable to or even outperforms previous methods. Unfortunately, simply solving ERM on a complex, non convex loss function can easily lead to sub optimal generalizability by seeking sharp minima. In this paper, we theoretically show that finding flat minima results in a smaller domain generalization gap. We also propose a simple yet effective method, named Stochastic Weight Averaging Densely (SWAD), to find flat minima. SWAD finds flatter minima and suffers less from overfitting than does the vanilla SWA by a dense and overfit aware stochastic weight sampling strategy. SWAD shows state of the art performances on five DG benchmarks, namely PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet, with consistent and large margins of 1.6 averagely on out of domain accuracy. We also compare SWAD with conventional generalization methods, such as data augmentation and consistency regularization methods, to verify that the remarkable performance improvements are originated from by seeking flat minima, not from better in domain generalizability. Last but not least, SWAD is readily adaptable to existing DG methods without modification the combination of SWAD and an existing DG method further improves DG performances. Source code is available at https github.com khanrc swad.


Optimal measure transportation with respect to non traditional costs. We study optimal mass transport problems between two measures with respect to a non traditional cost function, i.e. a cost c which can attain the value infty . We define the notion of c compatibility and strong c compatibility of two measures, and prove that if there is a finite cost plan between the measures then the measures must be c compatible, and if in addition the two measures are strongly c compatible, then there is an optimal plan concentrated on a c subgradient of a c class function. This function is the so called potential of the plan. We give two proofs of this theorem, under slightly different assumptions. In the first we utilize the notion of c path boundedness, showing that strong c compatibility implies a strong connectivity result for a directed graph associated with an optimal map. Strong connectivity of the graph implies that the c cyclic monotonicity of the support set (which follows from classical reasoning) guarantees its c path boundedness, implying, in turn, the existence of a potential. We also give a constructive proof, in the case when one of the measures is discrete. This approach adopts a new notion of Hall polytopes', which we introduce and study in depth, to which we apply a version of Brouwer's fixed point theorem to prove the existence of a potential in this case.


Interpreting Attributions and Interactions of Adversarial Attacks. This paper aims to explain adversarial attacks in terms of how adversarial perturbations contribute to the attacking task. We estimate attributions of different image regions to the decrease of the attacking cost based on the Shapley value. We define and quantify interactions among adversarial perturbation pixels, and decompose the entire perturbation map into relatively independent perturbation components. The decomposition of the perturbation map shows that adversarially trained DNNs have more perturbation components in the foreground than normally trained DNNs. Moreover, compared to the normally trained DNN, the adversarially trained DNN have more components which mainly decrease the score of the true category. Above analyses provide new insights into the understanding of adversarial attacks.


Billiards in right triangles and orbit closures in genus zero strata. The orbit closure of the unfolding of every rational right and isosceles triangle is computed and the asymptotic number of periodic billiard trajectories in these triangles is deduced. This follows by classifying all orbit closures of rank at least two in hyperelliptic components of strata of Abelian and quadratic differentials. Additionally, given a fixed set of angles, the orbit closure of the unfolding of all unit area rational parallelograms, isosceles trapezoids, and right trapezoids outside of a discrete set is determined.


Multimodal Few Shot Learning with Frozen Language Models. When trained at sufficient scale, auto regressive language models exhibit the notable ability to learn a new language task after being prompted with just a few examples. Here, we present a simple, yet effective, approach for transferring this few shot learning ability to a multimodal setting (vision and language). Using aligned image and caption data, we train a vision encoder to represent each image as a sequence of continuous embeddings, such that a pre trained, frozen language model prompted with this prefix generates the appropriate caption. The resulting system is a multimodal few shot learner, with the surprising ability to learn a variety of new tasks when conditioned on examples, represented as a sequence of multiple interleaved image and text embeddings. We demonstrate that it can rapidly learn words for new objects and novel visual categories, do visual question answering with only a handful of examples, and make use of outside knowledge, by measuring a single model on a variety of established and new benchmarks.


Self supervision for health insurance claims data a Covid 19 use case. In this work, we modify and apply self supervision techniques to the domain of medical health insurance claims. We model patients' healthcare claims history analogous to free text narratives, and introduce pre trained prior knowledge', later utilized for patient outcome predictions on a challenging task predicting Covid 19 hospitalization, given a patient's pre Covid 19 insurance claims history. Results suggest that pre training on insurance claims not only produces better prediction performance, but, more importantly, improves the model's clinical trustworthiness' and model stability reliability.


Independent sets of generators of prime power order. A subset X of a finite group G is said to be prime power independent if each element in X has prime power order and there is no proper subset Y of X with langle Y, Phi(G) rangle langle X, Phi(G) rangle , where Phi(G) is the Frattini subgroup of G . A group G is mathcal B pp if all prime power independent generating sets for G have the same cardinality. We prove that, if G is mathcal B pp , then G is solvable. Pivoting on some recent results of Krempa and Stocka, this yields a complete classification of mathcal B pp groups.


UMIC An Unreferenced Metric for Image Captioning via Contrastive Learning. Despite the success of various text generation metrics such as BERTScore, it is still difficult to evaluate the image captions without enough reference captions due to the diversity of the descriptions. In this paper, we introduce a new metric UMIC, an Unreferenced Metric for Image Captioning which does not require reference captions to evaluate image captions. Based on Vision and Language BERT, we train UMIC to discriminate negative captions via contrastive learning. Also, we observe critical problems of the previous benchmark dataset (i.e., human annotations) on image captioning metric, and introduce a new collection of human annotations on the generated captions. We validate UMIC on four datasets, including our new dataset, and show that UMIC has a higher correlation than all previous metrics that require multiple references. We release the benchmark dataset and pre trained models to compute the UMIC.


On the Renyi Differential Privacy of the Shuffle Model. The central question studied in this paper is Renyi Differential Privacy (RDP) guarantees for general discrete local mechanisms in the shuffle privacy model. In the shuffle model, each of the n clients randomizes its response using a local differentially private (LDP) mechanism and the untrusted server only receives a random permutation (shuffle) of the client responses without association to each client. The principal result in this paper is the first non trivial RDP guarantee for general discrete local randomization mechanisms in the shuffled privacy model, and we develop new analysis techniques for deriving our results which could be of independent interest. In applications, such an RDP guarantee is most useful when we use it for composing several private interactions. We numerically demonstrate that, for important regimes, with composition our bound yields an improvement in privacy guarantee by a factor of 8 times over the state of the art approximate Differential Privacy (DP) guarantee (with standard composition) for shuffled models. Moreover, combining with Poisson subsampling, our result leads to at least 10 times improvement over subsampled approximate DP with standard composition.


Representing Syntax and Composition with Geometric Transformations. The exploitation of syntactic graphs (SyGs) as a word's context has been shown to be beneficial for distributional semantic models (DSMs), both at the level of individual word representations and in deriving phrasal representations via composition. However, notwithstanding the potential performance benefit, the syntactically aware DSMs proposed to date have huge numbers of parameters (compared to conventional DSMs) and suffer from data sparsity. Furthermore, the encoding of the SyG links (i.e., the syntactic relations) has been largely limited to linear maps. The knowledge graphs' literature, on the other hand, has proposed light weight models employing different geometric transformations (GTs) to encode edges in a knowledge graph (KG). Our work explores the possibility of adopting this family of models to encode SyGs. Furthermore, we investigate which GT better encodes syntactic relations, so that these representations can be used to enhance phrase level composition via syntactic contextualisation.