GAN MDF A Method for Multi fidelity Data Fusion in Digital Twins. The Internet of Things (IoT) collects real time data of physical systems, such as smart factory, intelligent robot and healtcare system, and provide necessary support for digital twins. Depending on the quality and accuracy, these multi source data are divided into different fidelity levels. High fidelity (HF) responses describe the system of interest accurately but are computed costly. In contrast, low fidelity (LF) responses have a low computational cost but could not meet the required accuracy. Multi fidelity data fusion (MDF) methods aims to use massive LF samples and small amounts of HF samples to develop an accurate and efficient model for describing the system with a reasonable computation burden. In this paper, we propose a novel generative adversarial network for MDF in digital twins (GAN MDF). The generator of GAN MDF is composed of two sub networks one extracts the LF features from an input and the other integrates the input and the extracted LF features to form the input of the subsequent discriminator. The discriminator of GAN MDF identifies whether the generator output is a real sample generated from HF model. To enhance the stability of GAN MDF's training, we also introduce the supervised loss trick to refine the generator weights during each iteration of the adversarial training. Compared with the state of the art methods, the proposed GAN MDF has the following advantages 1) it performs well in the case of either nested or unnested sample structure 2) there is no specific assumption on the data distribution and 3) it has high robustness even when very few HF samples are provided. The experimental results also support the validity of GAN MDF.


Smooth orbit equivalence of multidimensional Borel flows. Free Borel mathbb R d flows are smoothly equivalent if there is a Borel bijection between the phase spaces that maps orbits onto orbits and is a C infty smooth orientation preserving diffeomorphism between orbits. We show that all free non tame Borel mathbb R d flows are smoothly equivalent in every dimension d ge 2 . This answers a question of B. Miller and C. Rosendal.


Quantifying and Localizing Private Information Leakage from Neural Network Gradients. Empirical attacks on collaborative learning show that the gradients of deep neural networks can not only disclose private latent attributes of the training data but also be used to reconstruct the original data. While prior works tried to quantify the privacy risk stemming from gradients, these measures do not establish a theoretically grounded understanding of gradient leakages, do not generalize across attackers, and can fail to fully explain what is observed through empirical attacks in practice. In this paper, we introduce theoretically motivated measures to quantify information leakages in both attack dependent and attack independent manners. Specifically, we present an adaptation of the mathcal V information, which generalizes the empirical attack success rate and allows quantifying the amount of information that can leak from any chosen family of attack models. We then propose attack independent measures, that only require the shared gradients, for quantifying both original and latent information leakages. Our empirical results, on six datasets and four popular models, reveal that gradients of the first layers contain the highest amount of original information, while the (fully connected) classifier layers placed after the (convolutional) feature extractor layers contain the highest latent information. Further, we show how techniques such as gradient aggregation during training can mitigate information leakages. Our work paves the way for better defenses such as layer based protection or strong aggregation.


Congruence modulo 4 for Andrews' integer partition with even parts below odd parts. We find and prove a class of congruences modulo 4 for Andrews' partition with certain ternary quadratic form. We also discuss distribution of overline mathcal EO (n) and further prove that overline mathcal EO (n) equiv0 pmod4 for almost all n . This study was inspired by similar congruences modulo 4 in the work by the second author and Garvan.


Airy beams on incoherent background. We present a class of diffraction free partially coherent beams each member of which is comprised of a finite power, non accelerating Airy bump residing on a statistically homogeneous, Gaussian correlated background. We examine free space propagation of soft apertured realizations of the proposed beams and show that their evolution is governed by two spatial scales the coherence width of the background and aperture size. A relative magnitude of these factors determines the practical range of propagation distances over which the novel beams can withstand diffraction. The proposed beams can find applications to imaging and optical communications through random media.


FACOS Finding API Relevant Contents on Stack Overflow with Semantic and Syntactic Analysis. Collecting API examples, usages, and mentions relevant to a specific API method over discussions on venues such as Stack Overflow is not a trivial problem. It requires efforts to correctly recognize whether the discussion refers to the API method that developers tools are searching for. The content of the thread, which consists of both text paragraphs describing the involvement of the API method in the discussion and the code snippets containing the API invocation, may refer to the given API method. Leveraging this observation, we develop FACOS, a context specific algorithm to capture the semantic and syntactic information of the paragraphs and code snippets in a discussion. FACOS combines a syntactic word based score with a score from a predictive model fine tuned from CodeBERT. FACOS beats the state of the art approach by 13.9 in terms of F1 score.


Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors. As autonomous driving and augmented reality evolve, a practical concern is data privacy. In particular, these applications rely on localization based on user images. The widely adopted technology uses local feature descriptors, which are derived from the images and it was long thought that they could not be reverted back. However, recent work has demonstrated that under certain conditions reverse engineering attacks are possible and allow an adversary to reconstruct RGB images. This poses a potential risk to user privacy. We take this a step further and model potential adversaries using a privacy threat model. Subsequently, we show under controlled conditions a reverse engineering attack on sparse feature maps and analyze the vulnerability of popular descriptors including FREAK, SIFT and SOSNet. Finally, we evaluate potential mitigation techniques that select a subset of descriptors to carefully balance privacy reconstruction risk while preserving image matching accuracy our results show that similar accuracy can be obtained when revealing less information.


WTR A Test Collection for Web Table Retrieval. We describe the development, characteristics and availability of a test collection for the task of Web table retrieval, which uses a large scale Web Table Corpora extracted from the Common Crawl. Since a Web table usually has rich context information such as the page title and surrounding paragraphs, we not only provide relevance judgments of query table pairs, but also the relevance judgments of query table context pairs with respect to a query, which are ignored by previous test collections. To facilitate future research with this benchmark, we provide details about how the dataset is pre processed and also baseline results from both traditional and recently proposed table retrieval methods. Our experimental results show that proper usage of context labels can benefit previous table retrieval methods.


The human brain and mathematics recent research and educational questions. New understandings of the functioning of human brains engaged in mathematics raise interesting questions for mathematics educators. Novel lines of research are suggested by neuroscientific findings, and new light is shed on some longstanding issues in mathematics education.


Plasma response to resonant magnetic perturbations near rotation zero crossing in low torque plasmas. Plasma response to resonant magnetic perturbations (RMPs) near the pedestal top is crucial for accessing edge localized modes (ELMs) suppression in tokamaks. Since radial location of rotation zero crossing plays a key role in determining the threshold for field penetration of RMP, plasma response may be different in low input torque plasmas. In this work, the linear MHD code MARS F is applied to reveal the dependence of plasma response to RMP on rotation zero crossing by a scan of rotation profiles based on an EAST equilibrium. It is shown that the plasma response is enhanced when zero crossing occurs near rational surfaces. The dependence of plasma response on the location of rotation zero crossing is well fitted by a double Gaussian, indicating two effects in this enhancement. One is induced by rotation screening effect shown as a wide base (with a width around 10 20 krad s), and the other is related to resistive singular layer effect characterized by a localized peak (with a width around 3 4 krad s). The width of the peak scales with the resistive singular layer width. The plasma displacement suggests the response is tearing like when zero crossing is within the singular layer, while it is kink like when zero crossing is far from the layer. The enhancement of magnetic islands width at the peak is only around a factor of two, when the absolute value of local rotation is not larger than 10 20 krad s. It is further confirmed in a modeling of plasma response in an EAST ELM suppression discharge. Though there is a zero crossing in E times B rotation but not in electron perpendicular rotation, no significant difference in plasma response is obtained using these two rotation profiles. This suggests that the rotation near pedestal top should not be far away from zero but may not be necessary to have zero crossing for accessing ELM suppression.


Spirit Distillation A Model Compression Method with Multi domain Knowledge Transfer. Recent applications pose requirements of both cross domain knowledge transfer and model compression to machine learning models due to insufficient training data and limited computational resources. In this paper, we propose a new knowledge distillation model, named Spirit Distillation (SD), which is a model compression method with multi domain knowledge transfer. The compact student network mimics out a representation equivalent to the front part of the teacher network, through which the general knowledge can be transferred from the source domain (teacher) to the target domain (student). To further improve the robustness of the student, we extend SD to Enhanced Spirit Distillation (ESD) in exploiting a more comprehensive knowledge by introducing the proximity domain which is similar to the target domain for feature extraction. Results demonstrate that our method can boost mIOU and high precision accuracy by 1.4 and 8.2 respectively with 78.2 segmentation variance, and can gain a precise compact network with only 41.8 FLOPs.


On the Completeness and Complexity of the Lifted Dynamic Junction Tree Algorithm. Lifted inference allows to perform inference in polynomial time w.r.t. domain sizes. For a lifted algorithm, completeness investigates model classes for which the algorithm is guaranteed to compute a lifted solution. We contribute, to the best of our knowledge, the first completeness and complexity analysis for a temporal lifted algorithm, the so called lifted dynamic junction tree algorithm (LDJT). To treat time as a first class citizen, LDJT introduces some constraints. Given these constraints, we analyse the classes of liftable models. Further, we show that LDJT has many advantages from a complexity point of view compared to a propositional temporal inference algorithm w.r.t. domain sizes. Therefore, LDJT advances the number of models for which inference tasks can be solved in reasonable time not only from a practically point of view, but also from a theoretical point of view.


Towards Practical Integrity in the Smart Home with HomeEndorser. Home automation in modern smart home platforms is often facilitated using trigger action routines. While such routines enable flexible automation, they also lead to an instance of the integrity problem in these systems untrusted third parties may use platform APIs to modify the abstract home objects (AHOs) that privileged, high integrity devices such as security cameras rely on (i.e., as triggers), thereby transitively attacking them. As most accesses to AHOs are legitimate, removing the permissions or applying naive information flow controls would not only fail to prevent these problems, but also break useful functionality. Therefore, this paper proposes the alternate approach of home abstraction endorsement, which endorses a proposed change to an AHO by correlating it with certain specific, preceding, environmental changes. We present the HomeEndorser framework, which provides a policy model for specifying endorsement policies for AHOs as changes in device states, relative to their location, and a platform based reference monitor for mediating all API requests to change AHOs against those device states. We evaluate HomeEndorser on the HomeAssistant platform, finding that we can derive over 1000 policy rules for HomeEndorser to endorse changes to 6 key AHOs, preventing malice and accidents for less than 10 overhead for endorsement check microbenchmarks, and with no false alarms under realistic usage scenarios. In doing so, HomeEndorser lays the first steps towards providing a practical foundation for ensuring that API induced changes to abstract home objects correlate with the physical realities of the user's environment.


On Ehresmann semigroups. We formulate an alternative approach to describing Ehresmann semigroups by means of left and right 'etale actions of a meet semilattice on a category. We also characterize the Ehresmann semigroups that arise as the set of all subsets of a finite category. As applications, we prove that every restriction semigroup can be nicely embedded into a restriction semigroup constructed from a category, and we describe when a restriction semigroup can be nicely embedded into an inverse semigroup.


Iterated Greedy Algorithms for a Complex Parallel Machine Scheduling Problem. This paper addresses a complex parallel machine scheduling problem with jobs divided into operations and operations grouped in families. Non anticipatory family setup times are held at the beginning of each batch, defined by the combination of one setup time and a sequence of operations from a unique family. Other aspects are also considered in the problem, such as release dates for operations and machines, operation's sizes, and machine's eligibility and capacity. We consider item availability to define the completion times of the operations within the batches, to minimize the total weighted completion time of jobs. We developed Iterated Greedy (IG) algorithms combining destroy and repair operators with a Random Variable Neighborhood Descent (RVND) local search procedure, using four neighborhood structures to solve the problem. The best algorithm variant outperforms the current literature methods for the problem, in terms of average deviation for the best solutions and computational times, in a known benchmark set of 72 instances. New upper bounds are also provided for some instances within this set. Besides, computational experiments are conducted to evaluate the proposed methods' performance in a more challenging set of instances introduced in this work. Two IG variants using a greedy repair operator showed superior performance with more than 70 of the best solutions found uniquely by these variants. Despite the simplicity, the method using the most common destruction and repair operators presented the best results in different evaluated criteria, highlighting its potential and applicability in solving a complex machine scheduling problem.


Validating human driver models for interaction aware automated vehicle controllers A human factors approach. A major challenge for autonomous vehicles is interacting with other traffic participants safely and smoothly. A promising approach to handle such traffic interactions is equipping autonomous vehicles with interaction aware controllers (IACs). These controllers predict how surrounding human drivers will respond to the autonomous vehicle's actions, based on a driver model. However, the predictive validity of driver models used in IACs is rarely validated, which can limit the interactive capabilities of IACs outside the simple simulated environments in which they are demonstrated. In this paper, we argue that besides evaluating the interactive capabilities of IACs, their underlying driver models should be validated on natural human driving behavior. We propose a workflow for this validation that includes scenario based data extraction and a two stage (tactical operational) evaluation procedure based on human factors literature. We demonstrate this workflow in a case study on an inverse reinforcement learning based driver model replicated from an existing IAC. This model only showed the correct tactical behavior in 40 of the predictions. The model's operational behavior was inconsistent with observed human behavior. The case study illustrates that a principled evaluation workflow is useful and needed. We believe that our workflow will support the development of appropriate driver models for future automated vehicles.


Evacuation schemes on Cayley graphs and non amenability of groups. In this paper we introduce a concept of an evacuation scheme on the Cayley graph of an infinite finitely generated group. This is a collection of infinite simple paths bringing all vertices to infinity. We impose a restriction that every edge can be used a uniformly bounded number of times in this scheme. An easy observation shows that existing of such a scheme is equivalent to non amenability of the group. A special case happens if every edge can be used only once. These scheme are called pure. We obtain a criterion for existing of such a scheme in terms of isoperimetric constant of the graph. We analyze R. ,Thompson's group F , for which the amenability property is a famous open problem. We show that pure evacuation schemes do not exist for the set of generators x 0,x 1, bar x 1 , where bar x 1 x 1x 0 1 . However, the question becomes open if edges with labels x 0 pm1 can be used twice. Existing of pure evacuation scheme for this version is implied by some natural conjectures.


Moser Tardos Algorithm Beyond Shearer's Bound. In a seminal paper (Moser and Tardos, JACM'10), Moser and Tardos developed a simple and powerful algorithm to find solutions to combinatorial problems in the variable Lov 'a sz Local Lemma (LLL) setting. Kolipaka and Szegedy (STOC'11) proved that the Moser Tardos algorithm is efficient up to the tight condition of the abstract Lov 'a sz Local Lemma, known as Shearer's bound. A fundamental problem around LLL is whether the efficient region of the Moser Tardos algorithm can be further extended. In this paper, we give a positive answer to this problem. We show that the efficient region of the Moser Tardos algorithm goes beyond the Shearer's bound of the underlying dependency graph, if the graph is not chordal. Otherwise, the dependency graph is chordal, and it has been shown that Shearer's bound exactly characterizes the efficient region for such graphs (Kolipaka and Szegedy, STOC'11 He, Li, Liu, Wang and Xia, FOCS'17). Moreover, we demonstrate that the efficient region can exceed Shearer's bound by a constant by explicitly calculating the gaps on several infinite lattices. The core of our proof is a new criterion on the efficiency of the Moser Tardos algorithm which takes the intersection between dependent events into consideration. Our criterion is strictly better than Shearer's bound whenever the intersection exists between dependent events. Meanwhile, if any two dependent events are mutually exclusive, our criterion becomes the Shearer's bound, which is known to be tight in this situation for the Moser Tardos algorithm (Kolipaka and Szegedy, STOC'11 Guo, Jerrum and Liu, JACM'19).


On Fading Channel Dependency Structures with a Positive Zero Outage Capacity. With emerging wireless technologies like 6G, many new applications like autonomous systems evolve which have strict demands on the reliability and latency of data communications. In the scenario of the commonly investigated independent slow fading links, the zero outage capacity (ZOC) is zero and retransmissions are therefore inevitable. In this work, we show that a positive ZOC can be achieved under the same setting of slow fading with constant transmit power and without perfect channel state information at the transmitter, if the joint distribution of the channel gains follows certain structures. This allows reliable reception without any outages, thus not requiring retransmissions. Based on a systematic copula approach, we show that there exists a set of dependency structures for which positive ZOCs can be achieved for both maximum ratio combining (MRC) and selection combining (SC). We characterize the maximum ZOC within a finite number of bits. The results are evaluated explicitly for the special cases of Rayleigh fading and Nakagami m fading in order to quantify the ZOCs for common fading models.


Groups generated by involutions, numberings of posets, and central measures. We define a new class of countable groups, which are defined by its action on the set of monotonic numberings (diagrams) of an arbitrary finite or countable partial ordered set (poset). These groups are generated by the set of involutions? and in the case of finite posets could be considered as generalization of Coxeter's symmetric groups. We discuss the problems concerned to infinite groups jf this type, in particular the problem of the descripton of invariant measures on the space of numberings (central measures)with respect to actions of those groups. The probelms are tightly connected with the new theory of representations of the generalizations of infinite symmetric group.


A Latent Transformer for Disentangled Face Editing in Images and Videos. High quality facial image editing is a challenging problem in the movie post production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the entanglement of facial attributes and the loss of the person's identity. Furthermore, many algorithms are limited to a certain task. To tackle these limitations, we propose to edit facial attributes via the latent space of a StyleGAN generator, by training a dedicated latent transformation network and incorporating explicit disentanglement and identity preservation terms in the loss function. We further introduce a pipeline to generalize our face editing to videos. Our model achieves a disentangled, controllable, and identity preserving facial attribute editing, even in the challenging case of real (i.e., non synthetic) images and videos. We conduct extensive experiments on image and video datasets and show that our model outperforms other state of the art methods in visual quality and quantitative evaluation. Source codes are available at https github.com InterDigitalInc latent transformer.


Context Aware Transfer Attacks for Object Detection. Blackbox transfer attacks for image classifiers have been extensively studied in recent years. In contrast, little progress has been made on transfer attacks for object detectors. Object detectors take a holistic view of the image and the detection of one object (or lack thereof) often depends on other objects in the scene. This makes such detectors inherently context aware and adversarial attacks in this space are more challenging than those targeting image classifiers. In this paper, we present a new approach to generate context aware attacks for object detectors. We show that by using co occurrence of objects and their relative locations and sizes as context information, we can successfully generate targeted mis categorization attacks that achieve higher transfer success rates on blackbox object detectors than the state of the art. We test our approach on a variety of object detectors with images from PASCAL VOC and MS COCO datasets and demonstrate up to 20 percentage points improvement in performance compared to the other state of the art methods.


5G Traffic Prediction with Time Series Analysis. In todays day and age, a mobile phone has become a basic requirement needed for anyone to thrive. With the cellular traffic demand increasing so dramatically, it is now necessary to accurately predict the user traffic in cellular networks, so as to improve the performance in terms of resource allocation and utilisation. By leveraging the power of machine learning and identifying its usefulness in the field of cellular networks we try to achieve three main objectives classification of the application generating the traffic, prediction of packet arrival intensity and burst occurrence. The design of the prediction and classification system is done using Long Short Term Memory model. The LSTM predictor developed in this experiment would return the number of uplink packets and also estimate the probability of burst occurrence in the specified future time interval. For the purpose of classification, the regression layer in our LSTM prediction model is replaced by a softmax classifier which is used to classify the application generating the cellular traffic into one of the four applications including surfing, video calling, voice calling, and video streaming.


Chain center duality for locally compact groups. The chain group C(G) of a locally compact group G has one generator g rho for each irreducible unitary G representation rho , a relation g rho g rho' g rho" whenever rho is weakly contained in rho' otimes rho" , and g rho g rho 1 for the representation rho contragredient to rho . G satisfies chain center duality if assigning to each g rho the central character of rho is an isomorphism of C(G) onto the dual widehat Z(G) of the center of G . We prove that G satisfies chain center duality if it is (a) a compact by abelian extension, (b) connected nilpotent, (c) countable discrete icc or (d) connected semisimple this generalizes M. M " u ger's result compact groups satisfy chain center duality.


Relativistic plasma aperture for laser intensity enhancement. A substantial increase in local laser intensity is observed in the near field behind a plasma shutter.This increase is caused by the interference of the diffracted light at the relativistic plasma aperture and it is studied both analytically and using numerical simulations. This effect is only accessible in the regime of relativistically induced transparency and thus it requires a careful choice of laser and target parameters. The theoretical estimates for the maximum field strength and its spatial location as a function of target and laser parameters are provided and compared with simulation results. Our full 3D Particle in Cell simulations indicate that the laser intensity may be increased roughly by an order of magnitude improving the feasibility of strong field QED research with the present generation of lasers.


IIITT LT EDI EACL2021 Hope Speech Detection There is always Hope in Transformers. In a world filled with serious challenges like climate change, religious and political conflicts, global pandemics, terrorism, and racial discrimination, an internet full of hate speech, abusive and offensive content is the last thing we desire for. In this paper, we work to identify and promote positive and supportive content on these platforms. We work with several transformer based models to classify social media comments as hope speech or not hope speech in English, Malayalam and Tamil languages. This paper portrays our work for the Shared Task on Hope Speech Detection for Equality, Diversity, and Inclusion at LT EDI 2021 EACL 2021.


Genetic Algorithm based hyper parameters optimization for transfer Convolutional Neural Network. Hyperparameter optimization is a challenging problem in developing deep neural networks. Decision of transfer layers and trainable layers is a major task for design of the transfer convolutional neural networks (CNN). Conventional transfer CNN models are usually manually designed based on intuition. In this paper, a genetic algorithm is applied to select trainable layers of the transfer model. The filter criterion is constructed by accuracy and the counts of the trainable layers. The results show that the method is competent in this task. The system will converge with a precision of 97 in the classification of Cats and Dogs datasets, in no more than 15 generations. Moreover, backward inference according the results of the genetic algorithm shows that our method can capture the gradient features in network layers, which plays a part on understanding of the transfer AI models.


Fast Parametric Model Checking through Model Fragmentation. Parametric model checking (PMC) computes algebraic formulae that express key non functional properties of a system (reliability, performance, etc.) as rational functions of the system and environment parameters. In software engineering, PMC formulae can be used during design, e.g., to analyse the sensitivity of different system architectures to parametric variability, or to find optimal system configurations. They can also be used at runtime, e.g., to check if non functional requirements are still satisfied after environmental changes, or to select new configurations after such changes. However, current PMC techniques do not scale well to systems with complex behaviour and more than a few parameters. Our paper introduces a fast PMC (fPMC) approach that overcomes this limitation, extending the applicability of PMC to a broader class of systems than previously possible. To this end, fPMC partitions the Markov models that PMC operates with into emph fragments whose reachability properties are analysed independently, and obtains PMC reachability formulae by combining the results of these fragment analyses. To demonstrate the effectiveness of fPMC, we show how our fPMC tool can analyse three systems (taken from the research literature, and belonging to different application domains) with which current PMC techniques and tools struggle.


BERT Embeddings Can Track Context in Conversational Search. The use of conversational assistants to search for information is becoming increasingly more popular among the general public, pushing the research towards more advanced and sophisticated techniques. In the last few years, in particular, the interest in conversational search is increasing, not only because of the generalization of conversational assistants but also because conversational search is a step forward in allowing a more natural interaction with the system. In this work, the focus is on exploring the context present of the conversation via the historical utterances and respective embeddings with the aim of developing a conversational search system that helps people search for information in a natural way. In particular, this system must be able to understand the context where the question is posed, tracking the current state of the conversation and detecting mentions to previous questions and answers. We achieve this by using a context tracking component based on neural query rewriting models. Another crucial aspect of the system is to provide the most relevant answers given the question and the conversational history. To achieve this objective, we used a Transformer based re ranking method and expanded this architecture to use the conversational context. The results obtained with the system developed showed the advantages of using the context present in the natural language utterances and in the neural embeddings generated throughout the conversation.


Towards Automated Acceptance testing for industrial robots. Industrial robots are important machines applied in numerous modern industries that execute repetitive tasks with high accuracy, replacing or supporting dangerous jobs. In this kind of system, with increased complexity in which cost is related to the time the system keeps working, the system must operate with a minimum number of failures. In other words, a quality aspect important in industry is reliability. We hypothesize that Automated Acceptance Testing improves reliability for industrial robot program. We present the research question, the motivation for this study, our hypothesis and future research efforts.


Fair Representation Guaranteeing Approximate Multiple Group Fairness for Unknown Tasks. Motivated by scenarios where data is used for diverse prediction tasks, we study whether fair representation can be used to guarantee fairness for unknown tasks and for multiple fairness notions simultaneously. We consider seven group fairness notions that cover the concepts of independence, separation, and calibration. Against the backdrop of the fairness impossibility results, we explore approximate fairness. We prove that, although fair representation might not guarantee fairness for all prediction tasks, it does guarantee fairness for an important subset of tasks the tasks for which the representation is discriminative. Specifically, all seven group fairness notions are linearly controlled by fairness and discriminativeness of the representation. When an incompatibility exists between different fairness notions, fair and discriminative representation hits the sweet spot that approximately satisfies all notions. Motivated by our theoretical findings, we propose to learn both fair and discriminative representations using pretext loss which self supervises learning, and Maximum Mean Discrepancy as a fair regularizer. Experiments on tabular, image, and face datasets show that using the learned representation, downstream predictions that we are unaware of when learning the representation indeed become fairer for seven group fairness notions, and the fairness guarantees computed from our theoretical results are all valid.


Bimanual Shelf Picking Planner Based on Collapse Prediction. In logistics warehouse, since many objects are randomly stacked on shelves, it becomes difficult for a robot to safely extract one of the objects without other objects falling from the shelf. In previous works, a robot needed to extract the target object after rearranging the neighboring objects. In contrast, humans extract an object from a shelf while supporting other neighboring objects. In this paper, we propose a bimanual manipulation planner based on collapse prediction trained with data generated from a physics simulator, which can safely extract a single object while supporting the other object. We confirmed that the proposed method achieves more than 80 success rate for safe extraction by real world experiments using a dual arm manipulator.


A topological selection of folding pathways from native states of knotted proteins. Understanding the biological function of knots in proteins and their folding process is an open and challenging question in biology. Recent studies classify the topology and geometry of knotted proteins by analysing the distribution of a protein's planar projections using topological objects called knotoids. We approach the analysis of proteins with the same topology by introducing a topologically inspired statistical metric between their knotoid distributions. We detect geometric differences between trefoil proteins by characterising their entanglement and we recover a clustering by sequence similarity. By looking directly at the geometry and topology of their native states, we are able to probe different folding pathways for proteins forming open ended trefoil knots. Interestingly, our pipeline reveals that the folding pathway of shallow knotted Carbonic Anhydrases involves the creation of a double looped structure, differently from what was previously observed for deeply knotted trefoil proteins. We validate this with Molecular Dynamics simulations.


Analytic Study of Families of Spurious Minima in Two Layer ReLU Neural Networks A Tale of Symmetry II. We study the optimization problem associated with fitting two layer ReLU neural networks with respect to the squared loss, where labels are generated by a target network. We make use of the rich symmetry structure to develop a novel set of tools for studying families of spurious minima. In contrast to existing approaches which operate in limiting regimes, our technique directly addresses the nonconvex loss landscape for a finite number of inputs d and neurons k , and provides analytic, rather than heuristic, information. In particular, we derive analytic estimates for the loss at different minima, and prove that modulo O(d 1 2 ) terms the Hessian spectrum concentrates near small positive constants, with the exception of Theta(d) eigenvalues which grow linearly with d . We further show that the Hessian spectrum at global and spurious minima coincide to O(d 1 2 ) order, thus challenging our ability to argue about statistical generalization through local curvature. Lastly, our technique provides the exact emph fractional dimensionality at which families of critical points turn from saddles into spurious minima. This makes possible the study of the creation and the annihilation of spurious minima using powerful tools from equivariant bifurcation theory.


Topology optimization with a closed cavity exclusion constraint for additive manufacturing based on the fictitious physical model approach. This paper proposes a topology optimization method that considers the geometric constraint of no closed cavities to improve the effectiveness of additive manufacturing based on the fictitious physical model approach. First, the basic topology optimization concept and level set based method are introduced. Next, the fictitious physical model for a geometric constraint in the topology optimization framework is discussed. Then, a model for the geometric constraint of no closed cavities for additive manufacturing is proposed. Numerical examples are provided to validate the proposed model. In addition, topology optimization considering the geometric constraint is formulated, and topology optimization algorithms are constructed using the finite element method. Finally, optimization examples are provided to validate the proposed topology optimization method.


CoreQuisite Circumstantial Preconditions of Common Sense Knowledge. The task of identifying and reasoning with circumstantial preconditions associated with everyday facts is natural to humans. It is unclear whether state of the art language models (LMs) understand the implicit preconditions that enable or invalidate commonsense facts, such as "A glass is used for drinking water", Despite their impressive accuracy on existing commonsense tasks. In this paper, we propose a new problem of reasoning with circumstantial preconditions, and present a dataset, called CoreQuisite, which annotates commonsense facts with preconditions expressed in natural language. Based on this resource, we create three canonical evaluation tasks and use them to examine the capability of existing LMs to understand situational pre conditions. Our results show that there is a 10 30 gap between machine and human performance on our tasks. We make all resources and software publicly available.


Temperature Dependent Characteristics and Electrostatic Threshold Voltage Tuning of Accumulated Body MOSFETs. Narrow channel accumulated body nMOSFET devices with p type side gates surrounding the active area have been electrically characterized between 100 and 400 K with varied side gate biasing (Vside). The subthreshold slope (SS) and drain induced barrier lowering (DIBL) decrease and threshold voltage (Vt) increases linearly with reduced temperature and reduced side gate bias. Detailed analysis on a 27 nm x 78 nm (width x length) device show SS decreasing from 115 mV dec at 400 K to 90 mV dec at 300 K and down to 36 mV dec at 100 K, DIBL decreasing by approximately 10 mV V for each 100 K reduction in operating temperature, and Vt increasing from 0.42 V to 0.61 V as the temperature is reduced from 400 K to 100 K. Vt can be adjusted from 0.3 V to 1.1 V with 0.3 V V sensitivity by depletion or accumulation of the body of the device using Vside. This high level of tunability allows electronic control of Vt and drive current for variable temperature operation in a wide temperature range with extremely low leakage currents ( 10 13 A).


Provably Stable Full Spectrum Dispersion Relation Preserving Schemes. The dispersion error is often the dominant error for computed solutions of wave propagation problems with high frequency components. In this paper, we define and give explicit examples of alpha dispersion relation preserving schemes. These are dual pair finite difference schemes for systems of hyperbolic partial differential equations which preserve the dispersion relation of the continuous problem uniformly to an alpha error tolerance. We give a general framework to design provably stable finite difference operators that preserve the dispersion relation for hyperbolic systems such as the elastic wave equation. The operators we derive here can resolve the highest frequency ( pi mode) present on any equidistant grid at a tolerance of 5 error. This significantly improves on the current standard that have a tolerance of 100 error.


Bag of Tricks for Optimizing Transformer Efficiency. Improving Transformer efficiency has become increasingly attractive recently. A wide range of methods has been proposed, e.g., pruning, quantization, new architectures and etc. But these methods are either sophisticated in implementation or dependent on hardware. In this paper, we show that the efficiency of Transformer can be improved by combining some simple and hardware agnostic methods, including tuning hyper parameters, better design choices and training strategies. On the WMT news translation tasks, we improve the inference efficiency of a strong Transformer system by 3.80X on CPU and 2.52X on GPU. The code is publicly available at https github.com Lollipop321 mini decoder network.


K theory and equivariant spectral triple for the quantum group U q(2) for complex deformation parameters. Let q q e i pi theta , , theta in( 1,1 , be a nonzero complex number such that q neq 1 and consider the compact quantum group U q(2) . For theta notin mathbb Q setminus 0,1 , we obtain the K theory of the C algebra C(U q(2)) . Then, we produce a spectral triple on U q(2) which is equivariant under its own comultiplication action. The spectral triple obtained here is even, 4 summable, non degenerate, and the Dirac operator acts on two copies of the L 2 space of U q(2) . The Chern character of the associated Fredholm module is shown to be nontrivial. At the end, we compute the spectral dimension of U q(2) .


Domestic waste detection and grasping points for robotic picking up. This paper presents an AI system applied to location and robotic grasping. Experimental setup is based on a parameter study to train a deep learning network based on Mask RCNN to perform waste location in indoor and outdoor environment, using five different classes and generating a new waste dataset. Initially the AI system obtain the RGBD data of the environment, followed by the detection of objects using the neural network. Later, the 3D object shape is computed using the network result and the depth channel. Finally, the shape is used to compute grasping for a robot arm with a two finger gripper. The objective is to classify the waste in groups to improve a recycling strategy.


Learning with Smooth Hinge Losses. Due to the non smoothness of the Hinge loss in SVM, it is difficult to obtain a faster convergence rate with modern optimization algorithms. In this paper, we introduce two smooth Hinge losses psi G( alpha sigma) and psi M( alpha sigma) which are infinitely differentiable and converge to the Hinge loss uniformly in alpha as sigma tends to 0 . By replacing the Hinge loss with these two smooth Hinge losses, we obtain two smooth support vector machines(SSVMs), respectively. Solving the SSVMs with the Trust Region Newton method (TRON) leads to two quadratically convergent algorithms. Experiments in text classification tasks show that the proposed SSVMs are effective in real world applications. We also introduce a general smooth convex loss function to unify several commonly used convex loss functions in machine learning. The general framework provides smooth approximation functions to non smooth convex loss functions, which can be used to obtain smooth models that can be solved with faster convergent optimization algorithms.


Publicly Auditable MPC as a Service with succinct verification and universal setup. In recent years, multiparty computation as a service (MPCaaS) has gained popularity as a way to build distributed privacy preserving systems. We argue that for many such applications, we should also require that the MPC protocol is publicly auditable, meaning that anyone can check the given computation is carried out correctly even if the server nodes carrying out the computation are all corrupt. In a nutshell, the way to make an MPC protocol auditable is to combine an underlying MPC protocol with verifiable computing proof (in particular, a SNARK). Building a general purpose MPCaaS from existing constructions would require us to perform a costly "trusted setup" every time we wish to run a new or modified application. To address this, we provide the first efficient construction for auditable MPC that has a one time universal setup. Despite improving the trusted setup, we match the state of the art in asymptotic performance the server nodes incur a linear computation overhead and constant round communication overhead compared to the underlying MPC, and the audit size and verification are logarithmic in the application circuit size. We also provide an implementation and benchmarks that support our asymptotic analysis in example applications. Furthermore, compared with existing auditable MPC protocols, besides offering a universal setup our construction also has a 3x smaller proof, 3x faster verification time and comparable prover time.


On the randomness analysis of link quality prediction limitations and benefits. In wireless multi hop networks, such as wireless sensor networks, link quality (LQ) is one of the most important metrics and is widely used in higher layer applications such as routing protocols. An accurate link quality prediction may greatly help to improve the performance of wireless multi hop networks. Researchers have proposed a lot of link quality prediction models in recent years. However, due to the dynamic and stochastic nature of wireless transmission, the performance of link quality prediction remains challenging. In this article, we mainly analyze the influence of the stochastic nature of wireless transmission on the link quality prediction model and discuss the benefits in the application of wireless multi hop networks with the performance limited link quality prediction models.


Learning based signal detection for MIMO systems with unknown noise statistics. This paper aims to devise a generalized maximum likelihood (ML) estimator to robustly detect signals with unknown noise statistics in multiple input multiple output (MIMO) systems. In practice, there is little or even no statistical knowledge on the system noise, which in many cases is non Gaussian, impulsive and not analyzable. Existing detection methods have mainly focused on specific noise models, which are not robust enough with unknown noise statistics. To tackle this issue, we propose a novel ML detection framework to effectively recover the desired signal. Our framework is a fully probabilistic one that can efficiently approximate the unknown noise distribution through a normalizing flow. Importantly, this framework is driven by an unsupervised learning approach, where only the noise samples are required. To reduce the computational complexity, we further present a low complexity version of the framework, by utilizing an initial estimation to reduce the search space. Simulation results show that our framework outperforms other existing algorithms in terms of bit error rate (BER) in non analytical noise environments, while it can reach the ML performance bound in analytical noise environments. The code of this paper is available at https github.com skypitcher manfe.


Unique continuation from a crack's tip under Neumann boundary conditions. We derive local asymptotics of solutions to second order elliptic equations at the edge of a (N 1) dimensional crack, with homogeneous Neumann boundary conditions prescribed on both sides of the crack. A combination of blow up analysis and monotonicity arguments provides a classification of all possible asymptotic homogeneities of solutions at the crack's tip, together with a a strong unique continuation principle.


Indirect light absorption model for highly strained silicon infrared sensors. The optical properties of silicon can be greatly tuned by applying strain and opening new perspectives, particularly in applications where infrared is key. In this work, we use a recent model for the indirect light absorption of silicon and include the effects of tensile and compressive uniaxial strains. The model is based on material properties such as the bandgap, the conduction and valence band density of states effective masses, and the phonon frequencies, which are obtained from first principles including strain up to 2 along the 110 and 111 directions. We show that the limit of absorption can increase from 1.14 (1.09) to 1.35 mu m (0.92 eV) under 2 strain and that the absorption increases by a factor of 55 for the zero strain cutoff wavelength of 1.14 mu m when a 2 compressive strain is applied in the 110 direction. We demonstrate that this effect is mainly due to the impact of strain on the electronic bandgaps of silicon, directly followed by the valence band density of states effective mass.


Listening to the city, attentively A Spatio Temporal Attention Boosted Autoencoder for the Short Term Flow Prediction Problem. In recent years, studying and predicting alternative mobility (e.g., sharing services) patterns in urban environments has become increasingly important as accurate and timely information on current and future vehicle flows can successfully increase the quality and availability of transportation services. This need is aggravated during the current pandemic crisis, which pushes policymakers and private citizens to seek social distancing compliant urban mobility services, such as electric bikes and scooter sharing offerings. However, predicting the number of incoming and outgoing vehicles for different city areas is challenging due to the nonlinear spatial and temporal dependencies typical of urban mobility patterns. In this work, we propose STREED Net, a novel deep learning network with a multi attention (spatial and temporal) mechanism that effectively captures and exploits complex spatial and temporal patterns in mobility data. The results of a thorough experimental analysis using real life data are reported, indicating that the proposed model improves the state of the art for this task.


A Hybrid APM CPGSO Approach for Constraint Satisfaction Problem Solving Application to Remote Sensing. Constraint satisfaction problem (CSP) has been actively used for modeling and solving a wide range of complex real world problems. However, it has been proven that developing efficient methods for solving CSP, especially for large problems, is very difficult and challenging. Existing complete methods for problem solving are in most cases unsuitable. Therefore, proposing hybrid CSP based methods for problem solving has been of increasing interest in the last decades. This paper aims at proposing a novel approach that combines incomplete and complete CSP methods for problem solving. The proposed approach takes advantage of the group search algorithm (GSO) and the constraint propagation (CP) methods to solve problems related to the remote sensing field. To the best of our knowledge, this paper represents the first study that proposes a hybridization between an improved version of GSO and CP in the resolution of complex constraint based problems. Experiments have been conducted for the resolution of object recognition problems in satellite images. Results show good performances in terms of convergence and running time of the proposed CSP based method compared to existing state of the art methods.


Robust Physics Based Manipulation by Interleaving Open and Closed Loop Execution. We present a planning and control framework for physics based manipulation under uncertainty. The key idea is to interleave robust open loop execution with closed loop control. We derive robustness metrics through contraction theory. We use these metrics to plan trajectories that are robust to both state uncertainty and model inaccuracies. However, fully robust trajectories are extremely difficult to find or may not exist for many multi contact manipulation problems. We separate a trajectory into robust and non robust segments through a minimum cost path search on a robustness graph. Robust segments are executed open loop and non robust segments are executed with model predictive control. We conduct experiments on a real robotic system for reaching in clutter. Our results suggest that the open and closed loop approach results in up to 35 more real world success compared to open loop baselines and a 40 reduction in execution time compared to model predictive control. We show for the first time that partially open loop manipulation plans generated with our approach reach similar success rates to model predictive control, while achieving a more fluent real time execution. A video showing real robot executions can be found at https youtu.be rPOPCwHfV4g.


Large population games with interactions through controls and common noise convergence results and equivalence between open loop and closed loop controls. In the presence of a common noise, we study the convergence problems in mean field game (MFG) and mean field control (MFC) problem where the cost function and the state dynamics depend upon the joint conditional distribution of the controlled state and the control process. In the first part, we consider the MFG setting. We start by recalling the notions of measure valued MFG equilibria and of approximate closed loop Nash equilibria associated to the corresponding N player game. Then, we show that all convergent sequences of approximate closed loop Nash equilibria, when N to infty, converge to measure valued MFG equilibria. And conversely, any measure valued MFG equilibrium is the limit of a sequence of approximate closed loop Nash equilibria. In other words, measure valued MFG equilibria are the accumulation points of the approximate closed loop Nash equilibria. Previous work has shown that measure valued MFG equilibria are the accumulation points of the approximate open loop Nash equilibria. Therefore, we obtain that the limits of approximate closed loop Nash equilibria and approximate open loop Nash equilibria are the same. In the second part, we deal with the MFC setting. After recalling the closed loop and open loop formulations of the MFC problem, we prove that they are equivalent. We also provide some convergence results related to approximate closed loop Pareto equilibria.


ADAPT Awesome Domain Adaptation Python Toolbox. ADAPT is an open source python library providing the implementation of several domain adaptation methods. The library is suited for scikit learn estimator object (object which implement fit and predict methods) and tensorflow models. Most of the implemented methods are developed in an estimator agnostic fashion, offering various possibilities adapted to multiple usage. The library offers three modules corresponding to the three principal strategies of domain adaptation (i) feature based containing methods performing feature transformation (ii) instance based with the implementation of reweighting techniques and (iii) parameter based proposing methods to adapt pre trained models to novel observations. A full documentation is proposed online https adapt python.github.io adapt with gallery of examples. Besides, the library presents an high test coverage.


WRICNet A Weighted Rich scale Inception Coder Network for Multi Resolution Remote Sensing Image Change Detection. Majority models of remote sensing image changing detection can only get great effect in a specific resolution data set. With the purpose of improving change detection effectiveness of the model in the multi resolution data set, a weighted rich scale inception coder network (WRICNet) is proposed in this article, which can make a great fusion of shallow multi scale features, and deep multi scale features. The weighted rich scale inception module of the proposed can obtain shallow multi scale features, the weighted rich scale coder module can obtain deep multi scale features. The weighted scale block assigns appropriate weights to features of different scales, which can strengthen expressive ability of the edge of the changing area. The performance experiments on the multi resolution data set demonstrate that, compared to the comparative methods, the proposed can further reduce the false alarm outside the change area, and the missed alarm in the change area, besides, the edge of the change area is more accurate. The ablation study of the proposed shows that the training strategy, and improvements of this article can improve the effectiveness of change detection.


Taut and Tense Networks. Geometrical constructions using flexible cords have been known since the earliest days of recorded mathematics. In this paper we introduce rigorous definitions for two classes of string networks. A taut network is one in which all cords are tight in every possible configuration a tense network has configurations in which one or more cords are not tight, but is externally constrained to avoid such configurations. We show that taut networks compute only affine linear functions and subspaces, whereas tense networks (which are closely related to linkages) can trace any algebraic curve.


Neural Networks, Inside Out Solving for Inputs Given Parameters (A Preliminary Investigation). Artificial neural network (ANN) is a supervised learning algorithm, where parameters are learned by several back and forth iterations of passing the inputs through the network, comparing the output with the expected labels, and correcting the parameters. Inspired by a recent work of Boer and Kramer (2020), we investigate a different problem Suppose an observer can view how the ANN parameters evolve over many iterations, but the dataset is oblivious to him. For instance, this can be an adversary eavesdropping on a multi party computation of an ANN parameters (where intermediate parameters are leaked). Can he form a system of equations, and solve it to recover the dataset?


REAM sharp An Enhancement Approach to Reference based Evaluation Metrics for Open domain Dialog Generation. The lack of reliable automatic evaluation metrics is a major impediment to the development of open domain dialogue systems. Various reference based metrics have been proposed to calculate a score between a predicted response and a small set of references. However, these metrics show unsatisfactory correlations with human judgments. For a reference based metric, its reliability mainly depends on two factors its ability to measure the similarity between the predicted response and the reference response, as well as the reliability of the given reference set. Yet, there are few discussions on the latter. Our work attempts to fill this vacancy. We first clarify an assumption on reference based metrics that, if more high quality references are added into the reference set, the reliability of the metric will increase. Next, we present REAM sharp an enhancement approach to Reference based EvAluation Metrics for open domain dialogue systems. A prediction model is designed to estimate the reliability of the given reference set. We show how its predicted results can be helpful to augment the reference set, and thus improve the reliability of the metric. Experiments validate both the effectiveness of our prediction model and that the reliability of reference based metrics improves with the augmented reference sets.


Divisible Codes. A linear code over mathbb F q with the Hamming metric is called Delta divisible if the weights of all codewords are divisible by Delta . They have been introduced by Harold Ward a few decades ago. Applications include subspace codes, partial spreads, vector space partitions, and distance optimal codes. The determination of the possible lengths of projective divisible codes is an interesting and comprehensive challenge.


Impact of Blocking Correlation on the Performance of mmWave Cellular Networks. In mmWave networks, a large or nearby object can obstruct multiple communication links, which results in spatial correlation in the blocking probability between a user and two or more base stations (BSs). This paper characterizes this blocking correlation and derives its impact on the signal to interference plus noise ratio (SINR) of a mmWave cellular network. We first present an exact analysis of a 1D network and highlight the impact of blocking correlation in the derived expressions. Gaining insights from the 1D analysis, we develop an analytical framework for a 2D network where we characterize the sum interference at the user by considering the correlation between the blocking of serving and interfering links. Using this, we derive the SINR coverage probability. Via simulations, we demonstrate that including blockage correlation in the analysis is required for accurate characterization of the system performance, in particular when the blocking objects tend to be large.


Silting reduction in extriangulated categories. Presilting and silting subcategories in extriangulated categories were introduced by Adachi and Tsukamoto recently. In this paper, we prove that the Gabriel Zisman localization mathcal B ( rm thick mathcal W) of an extriangulated category mathcal B with respect to a presilting subcategory mathcal W satisfying certain condition can be realized as a subfactor category of mathcal B . This generalizes the result by Iyama Yang for silting reduction on triangulated categories. Then we discuss the relation between silting subcategories and tilting subcategories in extriangulated categories, this gives us a kind of important examples of our results. In particular, for a finite dimensional Gorenstein algebra, we get the relative version of the description of the singularity category due to Happel and Chen Zhang by this reduction.


Thread Evolution Kit for Optimizing Thread Operations on CE IoT Devices. Most modern operating systems have adopted the one to one thread model to support fast execution of threads in both multi core and single core systems. This thread model, which maps the kernel space and user space threads in a one to one manner, supports quick thread creation and termination in high performance server environments. However, the performance of time critical threads is degraded when multiple threads are being run in low end CE devices with limited system resources. When a CE device runs many threads to support diverse application functionalities, low level hardware specifications often lead to significant resource contention among the threads trying to obtain system resources. As a result, the operating system encounters challenges, such as excessive thread context switching overhead, execution delay of time critical threads, and a lack of virtual memory for thread stacks. This paper proposes a state of the art Thread Evolution Kit (TEK) that consists of three primary components a CPU Mediator, Stack Tuner, and Enhanced Thread Identifier. From the experiment, we can see that the proposed scheme significantly improves user responsiveness (7x faster) under high CPU contention compared to the traditional thread model. Also, TEK solves the segmentation fault problem that frequently occurs when a CE application increases the number of threads during its execution.


Neuro Symbolic Constraint Programming for Structured Prediction. We propose Nester, a method for injecting neural networks into constrained structured predictors. The job of the neural network(s) is to compute an initial, raw prediction that is compatible with the input data but does not necessarily satisfy the constraints. The structured predictor then builds a structure using a constraint solver that assembles and corrects the raw predictions in accordance with hard and soft constraints. In doing so, Nester takes advantage of the features of its two components the neural network learns complex representations from low level data while the constraint programming component reasons about the high level properties of the prediction task. The entire architecture can be trained in an end to end fashion. An empirical evaluation on handwritten equation recognition shows that Nester achieves better performance than both the neural network and the constrained structured predictor on their own, especially when training examples are scarce, while scaling to more complex problems than other neuro programming approaches. Nester proves especially useful to reduce errors at the semantic level of the problem, which is particularly challenging for neural network architectures.Sub


Accidental Interaction in the Torsional Spectrum of Singly Deuterated Hydrogen Peroxide HOOD. We extended previously recorded infrared spectra of singly deuterated hydrogen peroxide (HOOD) to the submm wavelength region and derived accurate molecular parameters and a semi empirical equilibrium structure. In total, more than 1500 ro torsional HOOD transitions have been assigned between 6 and 120 cm 1 . We succeeded to analyze the accidental interaction between the torsional sub states by measuring several perturbed transitions. In addition to the set of Watsonian parameters for each tunneling component, only two interaction constants were required to describe the spectrum. The K a and J dependance of the torsional splitting could be determined also for the perturbed states.


AI Powered Compiler Techniques for DL Code Optimization. Creating high performance implementations of deep learning primitives on CPUs is a challenging task. Multiple considerations including multi level cache hierarchy, and wide SIMD units of CPU platforms influence the choice of program transformations to apply for performance optimization. In this paper, we present machine learning powered compiler techniques to optimize loop nests. We take a two pronged approach to code optimization We first apply high level optimizations to optimize the code to take optimal advantage of the cache memories. Then, we perform low level, target specific optimizations to effectively vectorize the code to run well on the SIMD units of the machine. For high level optimizations, we use polyhedral compilation techniques and deep learning approaches. For low level optimization, we use a target specific code generator that generates code using vector intrinsics and Reinforcement Learning (RL) techniques to find the optimal parameters for the code generator. We perform experimental evaluation of the developed techniques on various matrix multiplications that occur in popular deep learning workloads. The experimental results show that the compiler techniques presented in the paper achieve 7.6X and 8.2X speed ups over a baseline for sequential and parallel runs respectively.


Two Chebyshev Spectral Methods for Solving Normal Modes in Atmospheric Acoustics. The normal mode model is important in computational atmospheric acoustics. It is often used to compute the atmospheric acoustic field under a harmonic point source. Its solution consists of a set of discrete modes radiating into the upper atmosphere, usually related to the continuous spectrum. In this article, we present two spectral methods, the Chebyshev Tau and Chebyshev Collocation methods, to solve for the atmospheric acoustic normal modes, and corresponding programs were developed. The two spectral methods successfully transform the problem of searching for the modal wavenumbers in the complex plane into a simple dense matrix eigenvalue problem by projecting the governing equation onto a set of orthogonal bases, which can be easily solved through linear algebra methods. After obtaining the eigenvalues and eigenvectors, the horizontal wavenumbers and their corresponding modes can be obtained with simple processing. Numerical experiments were examined for both downwind and upwind conditions to verify the effectiveness of the methods. The running time data indicated that both spectral methods proposed in this article are faster than the Legendre Galerkin spectral method proposed previously.


A Vectored Fragmentation Metric for Elastic Optical Networks. When circuits are set up and dismantled dynamically in elastic optical networks, spectrum tends to become fragmented in the fiber links. The fragmentation limits the available path choices and may lead to significant blocking of connection requests. There are two types of fragmentation in the network spectrum in the links due to contiguity constraints and over the paths due to continuity. Study of fragmentation and its management is essential to operate the networks efficiently. This paper proposes a vectored fragmentation metric for characterizing the fragmentation, which covers both types of fragmentation. We discuss the characteristics of this metric in both transient and steady state of the dynamic network. We also test the proposed metric for connection requests granularity range, arrival rates and holding times, to establish functionality of this metric. We also compare the link based fragmentation metric with our Vectored Fragmentation Metric to understand the better representation.


The bipartite Ramsey number br(C 2n , C 2m ) . Given bipartite graphs H 1 , dots , H k , the bipartite Ramsey number br(H 1, dots, H k) is the minimum integer N such that any k edge coloring of complete bipartite graph K N, N contains a monochromatic H i in color i for 1 le i le k . There are considerable results on asymptotic values of bipartite Ramsey numbers of cycles. For exact value, Zhang Sun cite Zhangs determined br(C 4, C 2n ) , Zhang Sun Wu cite Zhangsw determined br(C 6, C 2n ) , and Gholami Rowshan cite GR determined br(C 8, C 2n ) . In this paper, we solve all remaining cases and give the exact values of br(C 2n , C 2m ) for all n ge m ge 5 , this answers a question concerned by Buci 'c Letzter Sudakov cite BLS , Gholami Rowshan cite GR , Zhang Sun cite Zhangs , and Zhang Sun Wu cite Zhangsw .


Category Theory in Machine Learning. Over the past two decades machine learning has permeated almost every realm of technology. At the same time, many researchers have begun using category theory as a unifying language, facilitating communication between different scientific disciplines. It is therefore unsurprising that there is a burgeoning interest in applying category theory to machine learning. We aim to document the motivations, goals and common themes across these applications. We touch on gradient based learning, probability, and equivariant learning.


SMASH a Semantic enabled Multi agent Approach for Self adaptation of Human centered IoT. Nowadays, IoT devices have an enlarging scope of activities spanning from sensing, computing to acting and even more, learning, reasoning and planning. As the number of IoT applications increases, these objects are becoming more and more ubiquitous. Therefore, they need to adapt their functionality in response to the uncertainties of their environment to achieve their goals. In Human centered IoT, objects and devices have direct interactions with human beings and have access to online contextual information. Self adaptation of such applications is a crucial subject that needs to be addressed in a way that respects human goals and human values. Hence, IoT applications must be equipped with self adaptation techniques to manage their run time uncertainties locally or in cooperation with each other. This paper presents SMASH a multi agent approach for self adaptation of IoT applications in human centered environments. In this paper, we have considered the Smart Home as the case study of smart environments. SMASH agents are provided with a 4 layer architecture based on the BDI agent model that integrates human values with goal reasoning, planning, and acting. It also takes advantage of a semantic enabled platform called Home'In to address interoperability issues among non identical agents and devices with heterogeneous protocols and data formats. This approach is compared with the literature and is validated by developing a scenario as the proof of concept. The timely responses of SMASH agents show the feasibility of the proposed approach in human centered environments.


Acoustic radiation force and radiation torque beyond particles Effects of non spherical shape and Willis coupling. Acoustophoresis deals with the manipulation of sub wavelength scatterers in an incident acoustic field. The geometric details of manipulated particles are often neglected by replacing them with equivalent symmetric geometries such as spheres, spheroids, cylinders or disks. It has been demonstrated that geometric asymmetry, represented by Willis coupling terms, can strongly affect the scattering of a small object, hence neglecting these terms may miss important force contributions. In this work, we present a generalized formalism of acoustic radiation force and radiation torque based on the polarizability tensor, where Willis coupling terms are included to account for geometric asymmetry. Following Gorkov's approach, the effects of geometric asymmetry are explicitly formulated as additional terms in the radiation force and torque expressions. By breaking the symmetry of a sphere along one axis using intrusion and protrusion, we characterize the changes in the force and torque in terms of partial components, associated with the direct and Willis Coupling coefficients of the polarizability tensor. We investigate in detail the cases of standing and travelling plane waves, showing how the equilibrium positions and angles are shifted by these additional terms. We show that while the contributions of asymmetry to the force are often negligible for small particles, these terms greatly affect the radiation torque. Our presented theory, providing a way of calculating radiation force and torque directly from polarizability coefficients, shows that in general it is essential to account for shape of objects undergoing acoustophoretic manipulation, and this may have important implications for applications such as the manipulation of biological cells.


Adapting Vehicle Detector to Target Domain by Adversarial Prediction Alignment. While recent advancement of domain adaptation techniques is significant, most of methods only align a feature extractor and do not adapt a classifier to target domain, which would be a cause of performance degradation. We propose novel domain adaptation technique for object detection that aligns prediction output space. In addition to feature alignment, we aligned predictions of locations and class confidences of our vehicle detector for satellite images by adversarial training. The proposed method significantly improved AP score by over 5 , which shows effectivity of our method for object detection tasks in satellite images.


On L 2 boundedness of pseudo multipliers associated to the Grushin operator. In this article we define analogues of pseudo differential operators associated to the joint functional calculus for the Grushin operator using their spectral resolution, and study Calder 'on Vaillancourt type theorems for these operators.


Nakai Moishezon ampleness criterion for real line bundles. We show that the Nakai Moishezon ampleness criterion holds for real line bundles on complete schemes. As applications, we treat the relative Nakai Moishezon ampleness criterion for real line bundles and the Nakai Moishezon ampleness criterion for real line bundles on complete algebraic spaces. The main ingredient of this paper is Birkar's characterization of augmented base loci of real divisors on projective schemes.


Incentivizing Efficient Equilibria in Traffic Networks with Mixed Autonomy. Traffic congestion has large economic and social costs. The introduction of autonomous vehicles can potentially reduce this congestion by increasing road capacity via vehicle platooning and by creating an avenue for influencing people's choice of routes. We consider a network of parallel roads with two modes of transportation (i) human drivers, who will choose the quickest route available to them, and (ii) a ride hailing service, which provides an array of autonomous vehicle route options, each with different prices, to users. We formalize a model of vehicle flow in mixed autonomy and a model of how autonomous service users make choices between routes with different prices and latencies. Developing an algorithm to learn the preferences of the users, we formulate a planning optimization that chooses prices to maximize a social objective. We demonstrate the benefit of the proposed scheme by comparing the results to theoretical benchmarks which we show can be efficiently calculated.


Weak Uniqueness for the Stochastic Heat Equation Driven by a Multiplicative Stable Noise. We consider the stochastic heat equation frac partial Y t(x) partial t frac 1 2 Delta x Y t(x) Y t (x) beta dot L alpha with t ge 0 , x in mathbb R and L alpha being an alpha stable white noise without negative jumps. When alpha in (1,2) and beta in ( frac 1 alpha , 1) we prove that weak uniqueness holds for the above using the approximating duality approach developed by Mytnik (Ann. Probab. (1998) 26 968 984).


Estimation and Prediction of Deterministic Human Intent Signal to augment Haptic Glove aided Control of Robotic Hand. The paper focuses on Haptic Glove (HG) based control of a Robotic Hand (RH) executing in hand manipulation. A control algorithm is presented to allow the RH relocate the object held to a goal pose. The motion signals for both the HG and the RH are high dimensional. The RH kinematics is usually different from the HG kinematics. The variability of kinematics of the two devices, added with the incomplete information about the human hand kinematics result in difficulty in direct mapping of the high dimensional motion signal of the HG to the RH. Hence, a method is proposed to estimate the human intent from the high dimensional HG motion signal and reconstruct the signal at the RH to ensure object relocation. It is also shown that the lag in synthesis of the motion signal of the human hand added with the control latency of the RH leads to a requirement of the prediction of the human intent signal. Then, a recurrent neural network (RNN) is proposed to predict the human intent signal ahead of time.


Variational Information Bottleneck Model for Accurate Indoor Position Recognition. Recognizing user location with WiFi fingerprints is a popular approach for accurate indoor positioning problems. In this work, our goal is to interpret WiFi fingerprints into actual user locations. However, WiFi fingerprint data can be very high dimensional in some cases, we need to find a good representation of the input data for the learning task first. Otherwise, using neural networks will suffer from severe overfitting. In this work, we solve this issue by combining the Information Bottleneck method and Variational Inference. Based on these two approaches, we propose a Variational Information Bottleneck model for accurate indoor positioning. The proposed model consists of an encoder structure and a predictor structure. The encoder is to find a good representation in the input data for the learning task. The predictor is to use the latent representation to predict the final output. To enhance the generalization of our model, we also adopt the Dropout technique for each hidden layer of the decoder. We conduct the validation experiments on a real world dataset. We also compare the proposed model to other existing methods so as to quantify the performances of our method.


Field Guide Inspired Zero Shot Learning. Modern recognition systems require large amounts of supervision to achieve accuracy. Adapting to new domains requires significant data from experts, which is onerous and can become too expensive. Zero shot learning requires an annotated set of attributes for a novel category. Annotating the full set of attributes for a novel category proves to be a tedious and expensive task in deployment. This is especially the case when the recognition domain is an expert domain. We introduce a new field guide inspired approach to zero shot annotation where the learner model interactively asks for the most useful attributes that define a class. We evaluate our method on classification benchmarks with attribute annotations like CUB, SUN, and AWA2 and show that our model achieves the performance of a model with full annotations at the cost of a significantly fewer number of annotations. Since the time of experts is precious, decreasing annotation cost can be very valuable for real world deployment.


Label Assemble Leveraging Multiple Datasets with Partial Labels. The success of deep learning relies heavily on large and diverse datasets with extensive labels, but we often only have access to several small datasets associated with partial labels. In this paper, we start a new initiative, "Label Assemble", that aims to unleash the full potential of partially labeled data from an assembly of public datasets. Specifically, we introduce a new dynamic adapter to encode different visual tasks, which addresses the challenges of incomparable, heterogeneous, or even conflicting labeling protocols. We also employ pseudo labeling and consistency constraints to harness data with missing labels and to mitigate the domain gap across datasets. From rigorous evaluations on three natural imaging and six medical imaging tasks, we discover that learning from "negative examples" facilitates both classification and segmentation of classes of interest. This sheds new light on the computer aided diagnosis of rare diseases and emerging pandemics, wherein "positive examples" are hard to collect, yet "negative examples" are relatively easier to assemble. Apart from exceeding prior arts in the ChestXray benchmark, our model is particularly strong in identifying diseases of minority classes, yielding over 3 point improvement on average. Remarkably, when using existing partial labels, our model performance is on par with that using full labels, eliminating the need for an additional 40 of annotation costs. Code will be made available at https github.com MrGiovanni LabelAssemble.


CamLiFlow Bidirectional Camera LiDAR Fusion for Joint Optical Flow and Scene Flow Estimation. In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and 3D information in an "early fusion" or "late fusion" manner. Such one size fits all approaches suffer from a dilemma of failing to fully utilize the characteristic of each modality or to maximize the inter modality complementarity. To address the problem, we propose a novel end to end framework, called CamLiFlow. It consists of 2D and 3D branches with multiple bidirectional connections between them in specific layers. Different from previous work, we apply a point based 3D branch to better extract the geometric features and design a symmetric learnable operator to fuse dense image features and sparse point features. Experiments show that CamLiFlow achieves better performance with fewer parameters. Our method ranks 1st on the KITTI Scene Flow benchmark, outperforming the previous art with 1 7 parameters. Code is available at https github.com MCG NJU CamLiFlow.


A note on morphisms to wreath products. Given a morphism varphi G to A wr B from a finitely presented group G to a wreath product A wr B , we show that, if the image of varphi is a sufficiently large subgroup, then mathrm ker ( varphi) contains a non abelian free subgroup and varphi factors through an acylindrically hyperbolic quotient of G . As direct applications, we classify the finitely presented subgroups in A wr B up to isomorphism and we deduce that a group having a wreath product ( text non trivial ) wr ( text infinite ) as a quotient must be SQ universal (extending theorems of Baumslag and Cornulier Kar). Finally, we exploit our theorem in order to describe the structure of the automorphism groups of several families of wreath products, highlighting an interesting connection with the Kaplansky conjecture on units in group rings.


Transfer learning to improve streamflow forecasts in data sparse regions. Effective water resource management requires information on water availability, both in terms of quality and quantity, spatially and temporally. In this paper, we study the methodology behind Transfer Learning (TL) through fine tuning and parameter transferring for better generalization performance of streamflow prediction in data sparse regions. We propose a standard recurrent neural network in the form of Long Short Term Memory (LSTM) to fit on a sufficiently large source domain dataset and repurpose the learned weights to a significantly smaller, yet similar target domain datasets. We present a methodology to implement transfer learning approaches for spatiotemporal applications by separating the spatial and temporal components of the model and training the model to generalize based on categorical datasets representing spatial variability. The framework is developed on a rich benchmark dataset from the US and evaluated on a smaller dataset collected by The Nature Conservancy in Kenya. The LSTM model exhibits generalization performance through our TL technique. Results from this current experiment demonstrate the effective predictive skill of forecasting streamflow responses when knowledge transferring and static descriptors are used to improve hydrologic model generalization in data sparse regions.


Thermal Management of Photovoltaics using Porous Nanochannels. The photoelectric conversion efficiency of a solar cell is dependent on its temperature. When the solar radiation is incident on the photovoltaics (PV) panel, a large portion of it is absorbed by the underlying material which increases its internal energy leading to the generation of heat. An overheated PV panel results in a decline in its performance which calls for an efficient cooling mechanism that can offer an optimum output of the electrical power. In the present numerical work, thermal management with a porous nanochannels device capable to dissipate high heat flux is employed to regulate the temperature of a commercial PV panel by integrating the device on the back face of the panel. The spatial and temporal variation of the PV surface temperature is obtained by solving the energy balance equation numerically. By evaluating the steady state PV surface temperature with and without thermal management, the extent of cooling and the resulting enhancement in the electrical power output is studied in detail. The nanochannels device is found to reduce the PV surface temperature significantly with an average cooling of 31.5 oC. Additionally, the enhancement in the electrical power output by 33 and the reduction in the response time to 1 8th highlight the potential of using porous nanochannels as a thermal management device. Furthermore, the numerical method is used to develop a universal curve which can predict the extent of PV cooling for any generic thermal management device.


Constructing pseudo Anosovs from expanding interval maps. We investigate a phenomenon observed by W. Thurston wherein one constructs a pseudo Anosov homeomorphism on the limit set of a certain lift of a piecewise linear expanding interval map. We reconcile this construction with a special subclass of generalized pseudo Anosovs, first defined by de Carvalho. From there we classify the circumstances under which this construction produces a pseudo Anosov. As an application, we produce for each g geq 1 a pseudo Anosov phi g on the surface of genus g that preserves an algebraically primitive translation structure and whose dilatation lambda g is a Salem number.


A Weakly Supervised Model for Solving Math word Problems. Solving math word problems (MWPs) is an important and challenging problem in natural language processing. Existing approaches to solve MWPs require full supervision in the form of intermediate equations. However, labeling every math word problem with its corresponding equations is a time consuming and expensive task. In order to address this challenge of equation annotation, we propose a weakly supervised model for solving math word problems by requiring only the final answer as supervision. We approach this problem by first learning to generate the equation using the problem description and the final answer, which we then use to train a supervised MWP solver. We propose and compare various weakly supervised techniques to learn to generate equations directly from the problem description and answer. Through extensive experiment, we demonstrate that even without using equations for supervision, our approach achieves an accuracy of 56.0 on the standard Math23K dataset. We also curate and release a new dataset for MWPs in English consisting of 10227 instances suitable for training weakly supervised models.


Anomaly Detection of Time Series with Smoothness Inducing Sequential Variational Auto Encoder. Deep generative models have demonstrated their effectiveness in learning latent representation and modeling complex dependencies of time series. In this paper, we present a Smoothness Inducing Sequential Variational Auto Encoder (SISVAE) model for robust estimation and anomaly detection of multi dimensional time series. Our model is based on Variational Auto Encoder (VAE), and its backbone is fulfilled by a Recurrent Neural Network to capture latent temporal structures of time series for both generative model and inference model. Specifically, our model parameterizes mean and variance for each time stamp with flexible neural networks, resulting in a non stationary model that can work without the assumption of constant noise as commonly made by existing Markov models. However, such a flexibility may cause the model fragile to anomalies. To achieve robust density estimation which can also benefit detection tasks, we propose a smoothness inducing prior over possible estimations. The proposed prior works as a regularizer that places penalty at non smooth reconstructions. Our model is learned efficiently with a novel stochastic gradient variational Bayes estimator. In particular, we study two decision criteria for anomaly detection reconstruction probability and reconstruction error. We show the effectiveness of our model on both synthetic datasets and public real world benchmarks.


DARDet A Dense Anchor free Rotated Object Detector in Aerial Images. Rotated object detection in aerial images has received increasing attention for a wide range of applications. However, it is also a challenging task due to the huge variations of scale, rotation, aspect ratio, and densely arranged targets. Most existing methods heavily rely on a large number of pre defined anchors with different scales, angles, and aspect ratios, and are optimized with a distance loss. Therefore, these methods are sensitive to anchor hyper parameters and easily suffer from performance degradation caused by boundary discontinuity. To handle this problem, in this paper, we propose a dense anchor free rotated object detector (DARDet) for rotated object detection in aerial images. Our DARDet directly predicts five parameters of rotated boxes at each foreground pixel of feature maps. We design a new alignment convolution module to extracts aligned features and introduce a PIoU loss for precise and stable regression. Our method achieves state of the art performance on three commonly used aerial objects datasets (i.e., DOTA, HRSC2016, and UCAS AOD) while keeping high efficiency. Code is available at https github.com zf020114 DARDet.


Fast computation of matrix function based centrality measures for layer coupled multiplex networks. Centrality measures identify and rank the most influential entities of complex networks. In this paper, we generalize matrix function based centrality measures, which have been studied extensively for single layer and temporal networks in recent years to layer coupled multiplex networks. The layers of these networks can reflect different relationships and interactions between entities or changing interactions over time. We use the supra adjacency matrix as network representation, which has already been used to generalize eigenvector centrality to temporal and multiplex networks. With a suitable choice of edge weights, the definition of single layer matrix function based centrality measures in terms of walks on networks carries over naturally to the multilayer case. In contrast to other walk based centralities, matrix function based centralities are parameterized measures, which have been shown to interpolate between (local) degree and (global) eigenvector centrality in the single layer case. As the explicit evaluation of the involved matrix function expressions becomes infeasible for medium to large scale networks, we present highly efficient approximation techniques from numerical linear algebra, which rely on Krylov subspace methods, Gauss quadrature, and stochastic trace estimation. We present extensive numerical studies on synthetic and real world multiplex transportation, communication, and collaboration networks. The comparison with established multilayer centrality measures shows that our framework produces meaningful rankings of nodes, layers, and node layer pairs. Furthermore, our experiments corroborate the theoretically indicated linear computational complexity of the employed numerical methods for sparse supra adjacency matrices, which allows the efficient treatment of large scale networks with the number of node layer pairs of order 10 7 or higher.


Synthesis of Compositional Animations from Textual Descriptions. "How can we animate 3D characters from a movie script or move robots by simply telling them what we would like them to do?" "How unstructured and complex can we make a sentence and still generate plausible movements from it?" These are questions that need to be answered in the long run, as the field is still in its infancy. Inspired by these problems, we present a new technique for generating compositional actions, which handles complex input sentences. Our output is a 3D pose sequence depicting the actions in the input sentence. We propose a hierarchical two stream sequential model to explore a finer joint level mapping between natural language sentences and 3D pose sequences corresponding to the given motion. We learn two manifold representations of the motion one each for the upper body and the lower body movements. Our model can generate plausible pose sequences for short sentences describing single actions as well as long compositional sentences describing multiple sequential and superimposed actions. We evaluate our proposed model on the publicly available KIT Motion Language Dataset containing 3D pose data with human annotated sentences. Experimental results show that our model advances the state of the art on text based motion synthesis in objective evaluations by a margin of 50 . Qualitative evaluations based on a user study indicate that our synthesized motions are perceived to be the closest to the ground truth motion captures for both short and compositional sentences.


Maximum diameter of 3 and 4 colorable graphs. P. Erd H o s, J. Pach, R. Pollack, and Z. Tuza J. Combin. Theory, B 47 (1989), 279 285 made conjectures for the maximum diameter of connected graphs without a complete subgraph K k 1 , which have order n and minimum degree delta . Settling a weaker version of a problem, by strengthening the K k 1 free condition to k colorable, we solve the problem for k 3 and k 4 using a unified linear programming duality approach. The case k 4 is a substantial simplification of the result of 'E. Czabarka, P. Dankelmann, and L. A. Sz 'ekely Europ. J. Comb., 30 (2009), 1082 1089 .


ManipulaTHOR A Framework for Visual Object Manipulation. The domain of Embodied AI has recently witnessed substantial progress, particularly in navigating agents within their environments. These early successes have laid the building blocks for the community to tackle tasks that require agents to actively interact with objects in their environment. Object manipulation is an established research domain within the robotics community and poses several challenges including manipulator motion, grasping and long horizon planning, particularly when dealing with oft overlooked practical setups involving visually rich and complex scenes, manipulation using mobile agents (as opposed to tabletop manipulation), and generalization to unseen environments and objects. We propose a framework for object manipulation built upon the physics enabled, visually rich AI2 THOR framework and present a new challenge to the Embodied AI community known as ArmPointNav. This task extends the popular point navigation task to object manipulation and offers new challenges including 3D obstacle avoidance, manipulating objects in the presence of occlusion, and multi object manipulation that necessitates long term planning. Popular learning paradigms that are successful on PointNav challenges show promise, but leave a large room for improvement.