DST Data Selection and joint Training for Learning with Noisy Labels. Training a deep neural network heavily relies on a large amount of training data with accurate annotations. To alleviate this problem, various methods have been proposed to annotate the data automatically. However, automatically generating annotations will inevitably yields noisy labels. In this paper, we propose a Data Selection and joint Training (DST) method to automatically select training samples with accurate annotations. Specifically, DST fits a mixture model according to the original annotation as well as the predicted label for each training sample, and the mixture model is utilized to dynamically divide the training dataset into a correctly labeled dataset, a correctly predicted set and a wrong dataset. Then, DST is trained with these datasets in a supervised manner. Due to confirmation bias problem, we train the two networks alternately, and each network is tasked to establish the data division to teach another network. For each iteration, the correctly labeled and predicted labels are reweighted respectively by the probabilities from the mixture model, and a uniform distribution is used to generate the probabilities of the wrong samples. Experiments on CIFAR 10, CIFAR 100 and Clothing1M demonstrate that DST is the comparable or superior to the state of the art methods.


Confusion based rank similarity filters for computationally efficient machine learning on high dimensional data. We introduce a novel type of computationally efficient artificial neural network (ANN) called the rank similarity filter (RSF). RSFs can be used to both transform and classify nonlinearly separable datasets with many data points and dimensions. The weights of RSF are set using the rank orders of features in a data point, or optionally the 'confusion' adjusted ranks between features (determined from their distributions in the dataset). The activation strength of a filter determines its similarity to other points in the dataset, a measure related to cosine similarity. The activation of many RSFs maps samples into a new nonlinear space suitable for linear classification (the rank similarity transform (RST)). We additionally used this method to create the nonlinear rank similarity classifier (RSC), which is a fast and accurate multiclass classifier, and the nonlinear rank similarity probabilistic classifier (RSPC), which is an extension to the multilabel case. We evaluated the classifiers on multiple datasets and RSC was competitive with existing classifiers but with superior computational efficiency. Open source code for RST, RSC and RSPC was written in Python using the popular scikit learn framework to make it easily accessible. In future extensions the algorithm can be applied to specialised hardware suitable for the parallelization of an ANN (GPU) and a Spiking Neural Network (neuromorphic computing) with corresponding performance gains. This makes RSF a promising solution to the problem of efficient analysis of nonlinearly separable data.


CodeLabeller A Web based Code Annotation Tool for Java Design Patterns and Summaries. With the rise of AI in SE, researchers have shown how AI can be applied to assist software developers in a wide variety of activities. However, it has not been accompanied by a complementary increase in labelled datasets, which is required in many supervised learning methods. Several studies have been using crowdsourcing platforms to collect labelled training data in recent years. However, research has shown that the quality of labelled data is unstable due to participant bias, knowledge variance, and task difficulty. Thus, we present CodeLabeller, a web based tool that aims to provide a more efficient approach in handling the process of labelling Java source files at scale by improving the data collection process throughout, and improving the degree of reliability of responses by requiring each labeller to attach a confidence rating to each of their responses. We test CodeLabeller by constructing a corpus of over a thousand source files obtained from a large collection of opensource Java projects, and labelling each Java source file with their respective design patterns and summaries. Apart from assisting researchers to crowdsource a labelled dataset, the tool has practical applicability in software engineering education and assists in building expert ratings for software artefacts. This paper discusses the motivation behind the creation of CodeLabeller, the intended users, a tool demonstration and its UI, its implementation, benefits, and lastly, the evaluation through a user study and in practice usage.


Modular Irregularity Strength of Triangular Book Graph. This paper deals with the modular irregularity strength of a graph of n vertices, a new graph invariant, modified from the irregularity strength, by changing the condition of the vertex weight set associate to the well known irregular labeling from n distinct positive integer to Z n the group of integer modulo n. Investigating the triangular book graph B m ((3)), we first find the irregularity strength of triangular book graph s(B m ((3)) ), as the lower bound for the modular irregularity strength, and then construct a modular irregular s(B m ((3)) ) labeling. The result shows that triangular book graphs admit a modular irregular labeling and its modular irregularity strength and irregularity strength are equal, except for a small case and the infinity property.


Generic equidistribution of periodic orbits for area preserving surface maps. We prove that a C infty generic area preserving diffeomorphism of a closed, oriented surface admits a sequence of equidistributed periodic orbits. This is a quantitative refinement of the recently established generic density theorem for area preserving surface diffeomorphisms. The proof has two ingredients. The first is a "Weyl law" for PFH spectral invariants, which was used to prove the generic density theorem. The second is a variational argument inspired by the work of Marques Neves Song and Irie on equidistribution results for minimal hypersurfaces and three dimensional Reeb flows, respectively.


Compression of volume surface integral equation matrices via Tucker decomposition for magnetic resonance applications. In this work, we propose a method for the compression of the coupling matrix in volume hyp surface integral equation (VSIE) formulations. VSIE methods are used for electromagnetic analysis in magnetic resonance imaging (MRI) applications, for which the coupling matrix models the interactions between the coil and the body. We showed that these effects can be represented as independent interactions between remote elements in 3D tensor formats, and subsequently decomposed with the Tucker model. Our method can work in tandem with the adaptive cross approximation technique to provide fast solutions of VSIE problems. We demonstrated that our compression approaches can enable the use of VSIE matrices of prohibitive memory requirements, by allowing the effective use of modern graphical processing units (GPUs) to accelerate the arising matrix hyp vector products. This is critical to enable numerical MRI simulations at clinical voxel resolutions in a feasible computation time. In this paper, we demonstrate that the VSIE matrix hyp vector products needed to calculate the electromagnetic field produced by an MRI coil inside a numerical body model with 1 mm 3 voxel resolution, could be performed in sim 33 seconds in a GPU, after compressing the associated coupling matrix from sim 80 TB to sim 43 MB.


Thermodynamics of a chemical reaction model for the atom field interaction in a three level laser. The temporal evolution of the levels in a three level laser is macroscopically described by a closed set of rate equations. Here, we complement this picture by providing a model which describes through chemical reactions how the levels are evolving. In most textbooks, the chemical potential is introduced as a concept in quantum statistics. In this paper, we alternatively base its definition on population densities of the excited states in a dopant atom. Then the chemical reaction model delivers a clear and intuitive framework to define the further thermodynamic characteristics of the atom field interactions such as the chemical potential of the photon and the photon entropy.


Controlled Lagrangians and Stabilization of Euler Poincar 'e Mechanical Systems with Broken Symmetry II Potential Shaping. We apply the method of controlled Lagrangians by potential shaping to Euler Poincar 'e mechanical systems with broken symmetry. We assume that the configuration space is a semidirect product mathsf G ltimes V of a Lie group mathsf G and a vector space V with a particular interest in those systems whose configuration space is the special Euclidean group mathsf SE (3) mathsf SO (3) ltimes mathbb R 3 . The key idea behind the work is the use of representations of mathsf G ltimes V and their associated advected parameters. Specifically, we derive matching conditions for the modified potential exploiting the representations and advected parameters. Our motivating examples are a heavy top spinning on a movable base and an underwater vehicle with non coincident centers of gravity and buoyancy. We consider a few different control problems for these systems, and show that our results give a general framework that reproduces our previous work on the former example and also those of Leonard on the latter. Also, in one of the latter cases, we demonstrate the advantage of our representation based approach by giving a simpler and more succinct formulation of the problem.


Your most telling friends Propagating latent ideological features on Twitter using neighborhood coherence. Multidimensional scaling in networks allows for the discovery of latent information about their structure by embedding nodes in some feature space. Ideological scaling for users in social networks such as Twitter is an example, but similar settings can include diverse applications in other networks and even media platforms or e commerce. A growing literature of ideology scaling methods in social networks restricts the scaling procedure to nodes that provide interpretability of the feature space on Twitter, it is common to consider the sub network of parliamentarians and their followers. This allows to interpret inferred latent features as indices for ideology related concepts inspecting the position of members of parliament. While effective in inferring meaningful features, this is generally restrained to these sub networks, limiting interesting applications such as country wide measurement of polarization and its evolution. We propose two methods to propagate ideological features beyond these sub networks one based on homophily (linked users have similar ideology), and the other on structural similarity (nodes with similar neighborhoods have similar ideologies). In our methods, we leverage the concept of neighborhood ideological coherence as a parameter for propagation. Using Twitter data, we produce an ideological scaling for 370K users, and analyze the two families of propagation methods on a population of 6.5M users. We find that, when coherence is considered, the ideology of a user is better estimated from those with similar neighborhoods, than from their immediate neighbors.


High performance distributed feedback quantum dot lasers with laterally coupled dielectric grating. The combination of grating based frequency selective optical feedback mechanisms, such as distributed feedback (DFB) or distributed Bragg reflector (DBR) structures, with quantum dot (QD) gain materials is a main approach towards ultra high performance semiconductor lasers for many key novel applications, either as stand alone sources or as on chip sources in photonic integrated circuits. However, the fabrication of conventional buried Bragg grating structures on GaAs, GaAs Si, GaSb and other material platforms have been met with major material regrowth difficulties. We report a novel and universal approach of introducing laterally coupled dielectric Bragg gratings to semiconductor lasers that allows highly controllable, reliable and strong coupling between the grating and the optical mode. We implement such a grating structure in a low loss amorphous silicon material alongside GaAs lasers with InAs GaAs QD gain layers. The resulting DFB laser arrays emit at pre designed 0.8 THz LWDM frequency intervals in the 1300 nm band with record performance parameters, including side mode suppression ratios as high as 52.7 dB, continuous wave output power of 27.7 mW (room temperature) and 10 mW (at 70 deg C), and ultra low relative intensity noise (RIN) of 165 dB Hz (2.5 25 GHz). The devices are also capable of operating isolator free under very high external reflection levels of up to 12.3 dB whilst maintaining the high spectral and ultra low RIN qualities. These results validate the novel laterally coupled dielectric grating as a technologically superior and potentially cost effective approach for fabricating DFB and DBR lasers free of their semiconductor material constraints, thus universally applicable across different material platforms and wavelength bands.


Learning to shortcut and shortlist order fulfillment deciding. With the increase of order fulfillment options and business objectives taken into consideration in the deciding process, order fulfillment deciding is becoming more and more complex. For example, with the advent of ship from store retailers now have many more fulfillment nodes to consider, and it is now common to take into account many and varied business goals in making fulfillment decisions. With increasing complexity, efficiency of the deciding process can become a real concern. Finding the optimal fulfillment assignments among all possible ones may be too costly to do for every order especially during peak times. In this work, we explore the possibility of exploiting regularity in the fulfillment decision process to reduce the burden on the deciding system. By using data mining we aim to find patterns in past fulfillment decisions that can be used to efficiently predict most likely assignments for future decisions. Essentially, those assignments that can be predicted with high confidence can be used to shortcut, or bypass, the expensive deciding process, or else a set of most likely assignments can be used for shortlisting sending a much smaller set of candidates for consideration by the fulfillment deciding system.


Deducing Optimal Classification Algorithm for Heterogeneous Fabric. For defining the optimal machine learning algorithm, the decision was not easy for which we shall choose. To help future researchers, we describe in this paper the optimal among the best of the algorithms. We built a synthetic data set and performed the supervised machine learning runs for five different algorithms. For heterogeneous rock fabric, we identified Random Forest, among others, to be the appropriate algorithm.


Predicting the probability distribution of bus travel time to move towards reliable planning of public transport services. An important aspect of the quality of a public transport service is its reliability, which is defined as the invariability of the service attributes. Preventive measures taken during planning can reduce risks of unreliability throughout operations. In order to tackle reliability during the service planning phase, a key piece of information is the long term prediction of the density of the travel time, which conveys the uncertainty of travel times. We introduce a reliable approach to one of the problems of service planning in public transport, namely the Multiple Depot Vehicle Scheduling Problem (MDVSP), which takes as input a set of trips and the probability density function (p.d.f.) of the travel time of each trip in order to output delay tolerant vehicle schedules. This work empirically compares probabilistic models for the prediction of the conditional p.d.f. of the travel time, as a first step towards reliable MDVSP solutions. Two types of probabilistic models, namely similarity based density estimation models and a smoothed Logistic Regression for probabilistic classification model, are compared on a dataset of more than 41,000 trips and 50 bus routes of the city of Montr 'eal. The result of a vast majority of probabilistic models outperforms that of a Random Forests model, which is not inherently probabilistic, thus highlighting the added value of modeling the conditional p.d.f. of the travel time with probabilistic models. A similarity based density estimation model using a k Nearest Neighbors method and a Kernel Density Estimation predicted the best estimate of the true conditional p.d.f. on this dataset.


Don't Do What Doesn't Matter Intrinsic Motivation with Action Usefulness. Sparse rewards are double edged training signals in reinforcement learning easy to design but hard to optimize. Intrinsic motivation guidances have thus been developed toward alleviating the resulting exploration problem. They usually incentivize agents to look for new states through novelty signals. Yet, such methods encourage exhaustive exploration of the state space rather than focusing on the environment's salient interaction opportunities. We propose a new exploration method, called Don't Do What Doesn't Matter (DoWhaM), shifting the emphasis from state novelty to state with relevant actions. While most actions consistently change the state when used, textit e.g. moving the agent, some actions are only effective in specific states, textit e.g. , emph opening a door, emph grabbing an object. DoWhaM detects and rewards actions that seldom affect the environment. We evaluate DoWhaM on the procedurally generated environment MiniGrid, against state of the art methods and show that DoWhaM greatly reduces sample complexity.


Argument Linking A Survey and Forecast. Semantic role labeling (SRL) identifying the semantic relationships between a predicate and other constituents in the same sentence is a well studied task in natural language understanding (NLU). However, many of these relationships are evident only at the level of the document, as a role for a predicate in one sentence may often be filled by an argument in a different one. This more general task, known as implicit semantic role labeling or argument linking, has received increased attention in recent years, as researchers have recognized its centrality to information extraction and NLU. This paper surveys the literature on argument linking and identifies several notable shortcomings of existing approaches that indicate the paths along which future research effort could most profitably be spent.


An Impossible Asylum. In 1982, Raymond Smullyan published an article, "The Asylum of Doctor Tarr and Professor Fether," that consists of a series of puzzles. These were later reprinted in the anthology, "The Lady or The Tiger? and Other Logic Puzzles." The last puzzle, which describes the asylum alluded to in the title, was designed to be especially difficult. With the help of automated reasoning, we show that the puzzle's hypotheses are, in fact, inconsistent, which is to say, no such asylum can possibly exist.


Dynamic network analysis improves protein 3D structural classification. Protein structural classification (PSC) is a supervised problem of assigning proteins into pre defined structural (e.g., CATH or SCOPe) classes based on the proteins' sequence or 3D structural features. We recently proposed PSC approaches that model protein 3D structures as protein structure networks (PSNs) and analyze PSN based protein features, which performed better than or comparable to state of the art sequence or other 3D structure based approaches in the task of PSC. However, existing PSN based PSC approaches model the whole 3D structure of a protein as a static PSN. Because folding of a protein is a dynamic process, where some parts of a protein fold before others, modeling the 3D structure of a protein as a dynamic PSN might further help improve the existing PSC performance. Here, we propose for the first time a way to model 3D structures of proteins as dynamic PSNs, with the hypothesis that this will improve upon the current state of the art PSC approaches that are based on static PSNs (and thus upon the existing state of the art sequence and other 3D structural approaches). Indeed, we confirm this on 71 datasets spanning 44,000 protein domains from CATH and SCOPe


OASIS An Active Framework for Set Inversion. In this work, we introduce a novel method for solving the set inversion problem by formulating it as a binary classification problem. Aiming to develop a fast algorithm that can work effectively with high dimensional and computationally expensive nonlinear models, we focus on active learning, a family of new and powerful techniques which can achieve the same level of accuracy with fewer data points compared to traditional learning methods. Specifically, we propose OASIS, an active learning framework using Support Vector Machine algorithms for solving the problem of set inversion. Our method works well in high dimensions and its computational cost is relatively robust to the increase of dimension. We illustrate the performance of OASIS by several simulation studies and show that our algorithm outperforms VISIA, the state of the art method.


Krull dimension in set theory. Let n 1 be a number. Let Gn be the hypergraph of all rectangles in an n dimensional Euclidean space. It is consistent that ZF DC holds, the chromatic number of Gn is countable, yet the chromatic number of Gn 1 is uncountable.


Almost minimizers for a singular system with free boundary. In this paper we study vector valued almost minimizers of the energy functional int D left( nabla mathbf u 2 2 mathbf u right) ,dx . We establish the regularity for both minimizers and the "regular" part of the free boundary. The analysis of the free boundary is based on Weiss type monotonicity formula and the epiperimetric inequality for the energy minimizers.


Making an H Free Graph k Colorable. We study the following question how few edges can we delete from any H free graph on n vertices in order to make the resulting graph k colorable? It turns out that various classical problems in extremal graph theory are special cases of this question. For H any fixed odd cycle, we determine the answer up to a constant factor when n is sufficiently large. We also prove an upper bound when H is a fixed clique that we conjecture is tight up to a constant factor, and prove upper bounds for more general families of graphs. We apply our results to get a new bound on the maximum cut of graphs with a forbidden odd cycle in terms of the number of edges.


Analysis of long term transients and detection of early warning signs of major population changes in a two timescale ecosystem. Identifying early warning signs of sudden population changes and mechanisms leading to regime shifts are highly desirable in population biology. In this paper, a two trophic ecosystem comprising of two species of predators, competing for their common prey, with explicit interference competition is considered. With proper rescaling, the model is portrayed as a singularly perturbed system with fast prey dynamics and slow dynamics of the predators. In a parameter regime near singular Hopf bifurcation, chaotic mixed mode oscillations (MMOs), featuring concatenation of small and large amplitude oscillations are observed as long lasting transients before the system approaches its asymptotic state. To analyze the dynamical cause that initiates a large amplitude oscillation in an MMO orbit, the model is reduced to a suitable normal form near the singular Hopf point. The normal form possesses a separatrix surface that separates two different types of oscillations. A large amplitude oscillation is initiated if a trajectory moves from the "inner" to the "outer side" of this surface. A set of conditions on the normal form variables are obtained to determine whether a trajectory would exhibit another cycle of MMO dynamics before experiencing a regime shift (i.e. approaching its asymptotic state). These conditions can serve as early warning signs for a sudden population shift in an ecosystem.


Sketch Me A Video. Video creation has been an attractive yet challenging task for artists to explore. With the advancement of deep learning, recent works try to utilize deep convolutional neural networks to synthesize a video with the aid of a guiding video, and have achieved promising results. However, the acquisition of guiding videos, or other forms of guiding temporal information is costly expensive and difficult in reality. Therefore, in this work we introduce a new video synthesis task by employing two rough bad drwan sketches only as input to create a realistic portrait video. A two stage Sketch to Video model is proposed, which consists of two key novelties 1) a feature retrieve and projection (FRP) module, which parititions the input sketch into different parts and utilizes these parts for synthesizing a realistic start or end frame and meanwhile generating rich semantic features, is designed to alleviate the sketch out of domain problem due to arbitrarily drawn free form sketch styles by different users. 2) A motion projection followed by feature blending module, which projects a video (used only in training phase) into a motion space modeled by normal distribution and blends the motion variables with semantic features extracted above, is proposed to alleviate the guiding temporal information missing problem in the test phase. Experiments conducted on a combination of CelebAMask HQ and VoxCeleb2 dataset well validate that, our method can acheive both good quantitative and qualitative results in synthesizing high quality videos from two rough bad drawn sketches.


Bounded cohomology and binate groups. A group is boundedly acyclic if its bounded cohomology with trivial real coefficients vanishes in all positive degrees. Amenable groups are boundedly acyclic, while the first non amenable examples were the group of compactly supported homeomorphisms of mathbb R n (Matsumoto Morita) and mitotic groups (L "oh). We prove that binate (alias pseudo mitotic) groups are boundedly acyclic, which provides a unifying approach to the aforementioned results. Moreover, we show that binate groups are universally boundedly acyclic. We obtain several new examples of boundedly acyclic groups as well as computations of the bounded cohomology of certain groups acting on the circle. In particular, we discuss how these results suggest that the bounded cohomology of the Thompson groups F , T , and V is as simple as possible.


Statistical Model Checking of Common Attack Scenarios on Blockchain. Blockchain technology has developed significantly over the last decade. One of the reasons for this is its sustainability architecture, which does not allow modification of the history of committed transactions. That means that developers should consider blockchain vulnerabilities and eliminate them before the deployment of the system. In this paper, we demonstrate a statistical model checking approach for the verification of blockchain systems on three real world attack scenarios. We build and verify models of DNS attack, double spending with memory pool flooding, and consensus delay scenario. After that, we analyze experimental results and propose solutions to avoid these kinds of attacks.


Automatic Classification of Human Translation and Machine Translation A Study from the Perspective of Lexical Diversity. By using a trigram model and fine tuning a pretrained BERT model for sequence classification, we show that machine translation and human translation can be classified with an accuracy above chance level, which suggests that machine translation and human translation are different in a systematic way. The classification accuracy of machine translation is much higher than of human translation. We show that this may be explained by the difference in lexical diversity between machine translation and human translation. If machine translation has independent patterns from human translation, automatic metrics which measure the deviation of machine translation from human translation may conflate difference with quality. Our experiment with two different types of automatic metrics shows correlation with the result of the classification task. Therefore, we suggest the difference in lexical diversity between machine translation and human translation be given more attention in machine translation evaluation.


Extreme mutation testing in practice An industrial case study. Mutation testing is used to evaluate the effectiveness of test suites. In recent years, a promising variation called extreme mutation testing emerged that is computationally less expensive. It identifies methods where their functionality can be entirely removed, and the test suite would not notice it, despite having coverage. These methods are called pseudo tested. In this paper, we compare the execution and analysis times for traditional and extreme mutation testing and discuss what they mean in practice. We look at how extreme mutation testing impacts current software development practices and discuss open challenges that need to be addressed to foster industry adoption. For that, we conducted an industrial case study consisting of running traditional and extreme mutation testing in a large software project from the semiconductor industry that is covered by a test suite of more than 11,000 unit tests. In addition to that, we did a qualitative analysis of 25 pseudo tested methods and interviewed two experienced developers to see how they write unit tests and gathered opinions on how useful the findings of extreme mutation testing are. Our results include execution times, scores, numbers of executed tests and mutators, reasons why methods are pseudo tested, and an interview summary. We conclude that the shorter execution and analysis times are well noticeable in practice and show that extreme mutation testing supplements writing unit tests in conjunction with code coverage tools. We propose that pseudo tested code should be highlighted in code coverage reports and that extreme mutation testing should be performed when writing unit tests rather than in a decoupled session. Future research should investigate how to perform extreme mutation testing while writing unit tests such that the results are available fast enough but still meaningful.


Opening the Black Box Performance Estimation during Code Generation for GPUs. Automatic code generation is frequently used to create implementations of algorithms specifically tuned to particular hardware and application parameters. The code generation process involves the selection of adequate code transformations, tuning parameters, and parallelization strategies. To cover the huge search space, code generation frameworks may apply time intensive autotuning, exploit scenario specific performance models, or treat performance as an intangible black box that must be described via machine learning. This paper addresses the selection problem by identifying the relevant performance defining mechanisms through a performance model coupled with an analytic hardware metric estimator. This enables a quick exploration of large configuration spaces to identify highly efficient candidates with high accuracy. Our current approach targets memory intensive GPGPU applications and focuses on the correct modeling of data transfer volumes to all levels of the memory hierarchy. We show how our method can be coupled to the pystencils stencil code generator, which is used to generate kernels for a range four 3D25pt stencil and a complex two phase fluid solver based on the Lattice Boltzmann Method. For both, it delivers a ranking that can be used to select the best performing candidate. The method is not limited to stencil kernels, but can be integrated into any code generator that can generate the required address expressions.


A Channel Coding Benchmark for Meta Learning. Meta learning provides a popular and effective family of methods for data efficient learning of new tasks. However, several important issues in meta learning have proven hard to study thus far. For example, performance degrades in real world settings where meta learners must learn from a wide and potentially multi modal distribution of training tasks and when distribution shift exists between meta train and meta test task distributions. These issues are typically hard to study since the shape of task distributions, and shift between them are not straightforward to measure or control in standard benchmarks. We propose the channel coding problem as a benchmark for meta learning. Channel coding is an important practical application where task distributions naturally arise, and fast adaptation to new tasks is practically valuable. We use our MetaCC benchmark to study several aspects of meta learning, including the impact of task distribution breadth and shift, which can be controlled in the coding problem. Going forward, MetaCC provides a tool for the community to study the capabilities and limitations of meta learning, and to drive research on practically robust and effective meta learners.


Twisted pre lie algebras of finite topological spaces. In this paper, we first study the species of finite topological spaces recently considered by F. Fauvet, L. Foissy, and D. Manchon. Then, we construct a twisted pre Lie structure on the species of connected finite topological spaces. The underlying pre Lie structure defines a coproduct on the species of finite topological spaces different from those already defined by the Authors above. In the end, we illustrate the link between the Grossman Larson product and the proposed coproduct.


Scalable Optimal Classifiers for Adversarial Settings under Uncertainty. We consider the problem of finding optimal classifiers in an adversarial setting where the class 1 data is generated by an attacker whose objective is not known to the defender an aspect that is key to realistic applications but has so far been overlooked in the literature. To model this situation, we propose a Bayesian game framework where the defender chooses a classifier with no a priori restriction on the set of possible classifiers. The key difficulty in the proposed framework is that the set of possible classifiers is exponential in the set of possible data, which is itself exponential in the number of features used for classification. To counter this, we first show that Bayesian Nash equilibria can be characterized completely via functional threshold classifiers with a small number of parameters. We then show that this low dimensional characterization enables to develop a training method to compute provably approximately optimal classifiers in a scalable manner and to develop a learning algorithm for the online setting with low regret (both independent of the dimension of the set of possible data). We illustrate our results through simulations.


Third order scale independent WENO Z scheme achieving optimal order at critical points. As we found previously, when critical points occur within grid intervals, the accuracy relations of smoothness indicators of WENO JS would differ from that assuming critical points occurring on grid nodes, and accordingly the global smoothness indicator in WENO Z scheme will differ from the original one. Based on above understandings, we first discuss several issues regarding current third order WENO Z improvements (e.g. WENO NP3, F3, NN3, PZ3 and P 3), i.e. the numerical results with scale dependency, the validity of analysis assuming critical points occurring on nodes, and the sensitivity regarding computational time step and initial condition in order convergence studies. By analyses and numerical validations, the defections of present improvements are demonstrated, either scale dependency of results or failure to recover optimal order when critical points occurring at half nodes, then a generic analysis is provided which considers the first order critical point occurring within grid intervals. Based on achieved theoretical outcomes, two scale independent, third order WENO Z schemes are proposed which could truly recover the optimal order at critical points the first one is acquired by limited expansion of grid stencil, deriving new global smoothness indicator and incorporating with the mapping function the second one is achieved by further expanding grid stencil and employing a different global smoothness indicator. For validating, typical 1 D scalar advection problems, 1 D and 2 D problems by Euler equations are chosen and tested. The consequences verify the optimal order recovery at critical points by proposed schemes and show that the first scheme outperforms aforementioned third order WENO Z improvements in terms of numerical resolution, while the second scheme indicates weak numerical robustness in spite of improved resolution and is mainly of theoretical significance


Structuring and presenting data for testing of automotive electronics to reduce effort during decision making. Automotive engineering is recognized as a combination of software and mechanical engineering due to the ever increasing number of software based components in vehicles. Since vehicles have become more sophisticated than before to ensure robustness, testing of automotive electronics is performed in high volume, producing immense test related data. This study investigates how unstructured and decentralized test related data from testing of automotive electronics creates issues in decision making during the testing and analysis process of test artifacts by performing an exploratory case study at one of the leading automotive companies, Volvo Cars. From the findings of the exploratory study, a prototype was designed to improve the data and information structure and presentation for test analysis and diagnostics for automotive electronics. The prototype's results showed that providing better data and information structure significantly increases the efficiency and reduces the workload for testers when conducting test analysis and diagnostics. Testers showed a decrease in task load for tasks related to testing due to better information structure, presentation, correctness and accessibility. Hence, the improvements aided the testers to arrive at decisions regarding root cause analysis of failed tests efficiently. The findings of this study can assist automotive companies in systematically investigating and improving the testing process of automotive electronics in regards to managing and structuring test related data. Keywords Testing, Automotive Electronics, Electronic Control Unit, ECU, Unstructured Data.


Sequential Recommendation for Cold start Users with Meta Transitional Learning. A fundamental challenge for sequential recommenders is to capture the sequential patterns of users toward modeling how users transit among items. In many practical scenarios, however, there are a great number of cold start users with only minimal logged interactions. As a result, existing sequential recommendation models will lose their predictive power due to the difficulties in learning sequential patterns over users with only limited interactions. In this work, we aim to improve sequential recommendation for cold start users with a novel framework named MetaTL, which learns to model the transition patterns of users through meta learning. Specifically, the proposed MetaTL (i) formulates sequential recommendation for cold start users as a few shot learning problem (ii) extracts the dynamic transition patterns among users with a translation based architecture and (iii) adopts meta transitional learning to enable fast learning for cold start users with only limited interactions, leading to accurate inference of sequential interactions.


FastCover An Unsupervised Learning Framework for Multi Hop Influence Maximization in Social Networks. Finding influential users in social networks is a fundamental problem with many possible useful applications. Viewing the social network as a graph, the influence of a set of users can be measured by the number of neighbors located within a given number of hops in the network, where each hop marks a step of influence diffusion. In this paper, we reduce the problem of IM to a budget constrained d hop dominating set problem (kdDSP). We propose a unified machine learning (ML) framework, FastCover, to solve kdDSP by learning an efficient greedy strategy in an unsupervised way. As one critical component of the framework, we devise a novel graph neural network (GNN) architecture, graph reversed attention network (GRAT), that captures the diffusion process among neighbors. Unlike most heuristic algorithms and concurrent ML frameworks for combinatorial optimization problems, FastCover determines the entire seed set from the nodes' scores computed with only one forward propagation of the GNN and has a time complexity quasi linear in the graph size. Experiments on synthetic graphs and real world social networks demonstrate that FastCover finds solutions with better or comparable quality rendered by the concurrent algorithms while achieving a speedup of over 1000x.


Incentives for Item Duplication under Fair Ranking Policies. Ranking is a fundamental operation in information access systems, to filter information and direct user attention towards items deemed most relevant to them. Due to position bias, items of similar relevance may receive significantly different exposure, raising fairness concerns for item providers and motivating recent research into fair ranking. While the area has progressed dramatically over recent years, no study to date has investigated the potential problem posed by duplicated items. Duplicates and near duplicates are common in several domains, including marketplaces and document collections available to search engines. In this work, we study the behaviour of different fair ranking policies in the presence of duplicates, quantifying the extra exposure gained by redundant items. We find that fairness aware ranking policies may conflict with diversity, due to their potential to incentivize duplication more than policies solely focused on relevance. This fact poses a problem for system owners who, as a result of this incentive, may have to deal with increased redundancy, which is at odds with user satisfaction. Finally, we argue that this aspect represents a blind spot in the normative reasoning underlying common fair ranking metrics, as rewarding providers who duplicate their items with increased exposure seems unfair for the remaining providers.


Hamiltonian cycles in 2 tough 2K 2 free graphs. A graph G is called a 2K 2 free graph if it does not contain 2K 2 as an induced subgraph. In 2014, Broersma, Patel and Pyatkin showed that every 25 tough 2K 2 free graph on at least three vertices is Hamiltonian. Recently, Shan improved this result by showing that 3 tough is sufficient instead of 25 tough. In this paper, we show that every 2 tough 2K 2 free graph on at least three vertices is Hamiltonian, which was conjectured by Gao and Pasechnik.


A novel three stage training strategy for long tailed classification. The long tailed distribution datasets poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class balacing strategies or transfer learing from head to tail classes or use two stages learning strategy to re train the classifier. However, the existing methods are difficult to solve the low quality problem when images are obtained by SAR. To address this problem, we establish a novel three stages training strategy, which has excellent results for processing SAR image datasets with long tailed distribution. Specifically, we divide training procedure into three stages. The first stage is to use all kinds of images for rough training, so as to get the rough training model with rich content. The second stage is to make the rough model learn the feature expression by using the residual dataset with the class 0 removed. The third stage is to fine tune the model using class balanced datasets with all 10 classes (including the overall model fine tuning and classifier re optimization). Through this new training strategy, we only use the information of SAR image dataset and the network model with very small parameters to achieve the top 1 accuracy of 22.34 in development phase.


Self Teaching Machines to Read and Comprehend with Large Scale Multi Subject Question Answering Data. In spite of much recent research in the area, it is still unclear whether subject area question answering data is useful for machine reading comprehension (MRC) tasks. In this paper, we investigate this question. We collect a large scale multi subject multiple choice question answering dataset, ExamQA, and use incomplete and noisy snippets returned by a web search engine as the relevant context for each question answering instance to convert it into a weakly labeled MRC instance. We then propose a self teaching paradigm to better use the generated weakly labeled MRC instances to improve a target MRC task. Experimental results show that we can obtain 5.1 in accuracy on a multiple choice MRC dataset, C 3, and 3.8 in exact match on an extractive MRC dataset, CMRC 2018 over state of the art MRC baselines, demonstrating the effectiveness of our framework and the usefulness of large scale subject area question answering data for different types of machine reading comprehension tasks.


On the Numerical Performance of Derivative Free Optimization Methods Based on Finite Difference Approximations. The goal of this paper is to investigate an approach for derivative free optimization that has not received sufficient attention in the literature and is yet one of the simplest to implement and parallelize. It consists of computing gradients of a smoothed approximation of the objective function (and constraints), and employing them within established codes. These gradient approximations are calculated by finite differences, with a differencing interval determined by the noise level in the functions and a bound on the second or third derivatives. It is assumed that noise level is known or can be estimated by means of difference tables or sampling. The use of finite differences has been largely dismissed in the derivative free optimization literature as too expensive in terms of function evaluations and or as impractical when the objective function contains noise. The test results presented in this paper suggest that such views should be re examined and that the finite difference approach has much to be recommended. The tests compared NEWUOA, DFO LS and COBYLA against the finite difference approach on three classes of problems general unconstrained problems, nonlinear least squares, and general nonlinear programs with equality constraints.


Machine learning structure preserving brackets for forecasting irreversible processes. Forecasting of time series data requires imposition of inductive biases to obtain predictive extrapolation, and recent works have imposed Hamiltonian Lagrangian form to preserve structure for systems with reversible dynamics. In this work we present a novel parameterization of dissipative brackets from metriplectic dynamical systems appropriate for learning irreversible dynamics with unknown a priori model form. The process learns generalized Casimirs for energy and entropy guaranteed to be conserved and nondecreasing, respectively. Furthermore, for the case of added thermal noise, we guarantee exact preservation of a fluctuation dissipation theorem, ensuring thermodynamic consistency. We provide benchmarks for dissipative systems demonstrating learned dynamics are more robust and generalize better than either "black box" or penalty based approaches.


Semiclassical analysis in the limit circle case. We consider second order differential equations with real coefficients that are in the limit circle case at infinity. Using the semiclassical Ansatz, we construct solutions (the Jost solutions) of such equations with a prescribed asymptotic behavior for x to infty . It turns out that in the limit circle case, this Ansatz can be chosen common for all values of the spectral parameter z . This leads to asymptotic formulas for all solutions of considered differential equations, both homogeneous and non homogeneous. We also efficiently describe all self adjoint realizations of the corresponding differential operators in terms of boundary conditions at infinity and find a representation for their resolvents.


Regularity theory for mixed local and nonlocal parabolic p Laplace equations. We investigate the mixed local and nonlocal parabolic p Laplace equation begin align partial t u(x,t) Delta p u(x,t) mathcal L u(x,t) 0, end align where Delta p is the local p Laplace operator and mathcal L is the nonlocal p Laplace operator. Based on the combination of suitable Caccioppoli type inequality and Logarithmic Lemma with a De Giorgi Nash Moser iteration, we establish the local boundedness and H " o lder continuity of weak solutions for such equations.


Cooperation and Reputation Dynamics with Reinforcement Learning. Creating incentives for cooperation is a challenge in natural and artificial systems. One potential answer is reputation, whereby agents trade the immediate cost of cooperation for the future benefits of having a good reputation. Game theoretical models have shown that specific social norms can make cooperation stable, but how agents can independently learn to establish effective reputation mechanisms on their own is less understood. We use a simple model of reinforcement learning to show that reputation mechanisms generate two coordination problems agents need to learn how to coordinate on the meaning of existing reputations and collectively agree on a social norm to assign reputations to others based on their behavior. These coordination problems exhibit multiple equilibria, some of which effectively establish cooperation. When we train agents with a standard Q learning algorithm in an environment with the presence of reputation mechanisms, convergence to undesirable equilibria is widespread. We propose two mechanisms to alleviate this (i) seeding a proportion of the system with fixed agents that steer others towards good equilibria and (ii), intrinsic rewards based on the idea of introspection, i.e., augmenting agents' rewards by an amount proportionate to the performance of their own strategy against themselves. A combination of these simple mechanisms is successful in stabilizing cooperation, even in a fully decentralized version of the problem where agents learn to use and assign reputations simultaneously. We show how our results relate to the literature in Evolutionary Game Theory, and discuss implications for artificial, human and hybrid systems, where reputations can be used as a way to establish trust and cooperation.


Closeness Centrality via the Condorcet Principle. We uncover a new relation between Closeness centrality and the Condorcet principle. We define a Condorcet winner in a graph as a node that compared to any other node is closer to more nodes. In other words, if we assume that nodes vote on a closer candidate, a Condorcet winner would win a two candidate election against any other node in a plurality vote. We show that Closeness centrality and its random walk version, Random Walk Closeness centrality, are the only classic centrality measures that are Condorcet consistent on trees, i.e., if a Condorcet winner exists, they rank it first. While they are not Condorcet consistent in general graphs, we show that Closeness centrality satisfies the Condorcet Comparison property that states that out of two adjacent nodes, the one preferred by more nodes has higher centrality. We show that Closeness centrality is the only regular distance based centrality with such a property.


Using Network Analysis on Twitter Data to Identify Threats on Indonesian Digital Activism. In this study, we tried to see and characterize potential threats to digital activism in the internet active nation of Indonesia by doing network analysis on a recent digital activism event on Twitter, which protested against a recent law related to alcoholic beverage investment. We hoped insights from the study can help the nation moving forward as public discourses are likely to stay online post COVID. From this study, we found that threats in form of hashtag hijackings happen often in digital activism, and there were traces of a systematic information campaign in our observed case. We also found that the usage of bots is prevalent in and they showed significant activity, although the extent to which they influenced the conversation needs to be followed through more. These threats are something to think about as activism goes increasingly digital after COVID 19 as it can imbue unwanted messages, sow polarization, and distract the conversation from the real issue.


CoMeT An Integrated Interval Thermal Simulation Toolchain for 2D, 2.5D, and 3D Processor Memory Systems. Processing cores and the accompanying main memory working in tandem enable the modern processors. Dissipating heat produced from computation, memory access remains a significant problem for processors. Therefore, processor thermal management continues to be an active research topic. Most thermal management research takes place using simulations, given the challenges of measuring temperature in real processors. Since core and memory are fabricated on separate packages in most existing processors, with the memory having lower power densities, thermal management research in processors has primarily focused on the cores. Memory bandwidth limitations associated with 2D processors lead to high density 2.5D and 3D packaging technology. 2.5D packaging places cores and memory on the same package. 3D packaging technology takes it further by stacking layers of memory on the top of cores themselves. Such packagings significantly increase the power density, making processors prone to heating. Therefore, mitigating thermal issues in high density processors (packaged with stacked memory) becomes an even more pressing problem. However, given the lack of thermal modeling for memories in existing interval thermal simulation toolchains, they are unsuitable for studying thermal management for high density processors. To address this issue, we present CoMeT, the first integrated Core and Memory interval Thermal simulation toolchain. CoMeT comprehensively supports thermal simulation of high and low density processors corresponding to four different core memory configurations off chip DDR memory, off chip 3D memory, 2.5D, and 3D. CoMeT supports several novel features that facilitate overlying system research. Compared to an equivalent state of the art core only toolchain, CoMeT adds only a 5 simulation time overhead. The source code of CoMeT has been made open for public use under the MIT license.


ClassSR A General Framework to Accelerate Super Resolution Networks by Data Characteristic. We aim at accelerating super resolution (SR) networks on large images (2K 8K). The large images are usually decomposed into small sub images in practical usages. Based on this processing, we found that different image regions have different restoration difficulties and can be processed by networks with different capacities. Intuitively, smooth areas are easier to super solve than complex textures. To utilize this property, we can adopt appropriate SR networks to process different sub images after the decomposition. On this basis, we propose a new solution pipeline ClassSR that combines classification and SR in a unified framework. In particular, it first uses a Class Module to classify the sub images into different classes according to restoration difficulties, then applies an SR Module to perform SR for different classes. The Class Module is a conventional classification network, while the SR Module is a network container that consists of the to be accelerated SR network and its simplified versions. We further introduce a new classification method with two losses Class Loss and Average Loss to produce the classification results. After joint training, a majority of sub images will pass through smaller networks, thus the computational cost can be significantly reduced. Experiments show that our ClassSR can help most existing methods (e.g., FSRCNN, CARN, SRResNet, RCAN) save up to 50 FLOPs on DIV8K datasets. This general framework can also be applied in other low level vision tasks.


A multi sheath model for highly nonlinear plasma wakefields. An improved description for nonlinear plasma wakefields with phase velocities near the speed of light is presented and compared against fully kinetic particle in cell simulations. These wakefields are excited by intense particle beams or lasers pushing plasma electrons radially outward, creating an ion bubble surrounded by a sheath of electrons characterized by the source term S equiv frac 1 en p ( rho J z c) where rho and J z are the charge and axial current densities. Previously, the sheath source term was described phenomenologically with a positive definite function, resulting in a positive definite wake potential. In reality, the wake potential is negative at the rear of the ion column which is important for self injection and accurate beam loading models. To account for this, we introduce a multi sheath model in which the source term, S , of the plasma wake can be negative in regions outside the ion bubble. Using this model, we obtain a new expression for the wake potential and a modified differential equation for the bubble radius. Numerical results obtained from these equations are validated against particle in cell simulations for unloaded and loaded wakes. The new model provides accurate predictions of the shape and duration of trailing bunch current profiles that flatten plasma wakefields. It is also used to design a trailing bunch for a desired longitudinally varying loaded wakefield. We present beam loading results for laser wakefields and discuss how the model can be improved for laser drivers in future work. Finally, we discuss differences between the predictions of the multi and single sheath models for beam loading.


Combining Reward Information from Multiple Sources. Given two sources of evidence about a latent variable, one can combine the information from both by multiplying the likelihoods of each piece of evidence. However, when one or both of the observation models are misspecified, the distributions will conflict. We study this problem in the setting with two conflicting reward functions learned from different sources. In such a setting, we would like to retreat to a broader distribution over reward functions, in order to mitigate the effects of misspecification. We assume that an agent will maximize expected reward given this distribution over reward functions, and identify four desiderata for this setting. We propose a novel algorithm, Multitask Inverse Reward Design (MIRD), and compare it to a range of simple baselines. While all methods must trade off between conservatism and informativeness, through a combination of theory and empirical results on a toy environment, we find that MIRD and its variant MIRD IF strike a good balance between the two.


Towards a Formal Modelling, Analysis, and Verification of a Clone Node Attack Detection Scheme in the Internet of Things. In a clone node attack, an attacker attempted to physically capture the devices to gather sensitive information to conduct various insider attacks. Several solutions for detecting clone node attacks on IoT networks have been presented in the viewpoints above. These solutions are focused on specific system designs, processes, and feature sets and act as a high level abstraction of underlying system architectures based on a few performance requirements. However, critical features like formal analysis, modelling, and verification are frequently overlooked in existing proposed solutions aimed at verifying the correctness and robustness of systems in order to ensure that no problematic scenarios or anomalies exist. This paper presents a formal analysis, modelling, and verification of our existing proposed clone node attack detection scheme in IoT. Firstly, we modelled the architectural components of the proposed scheme using High Level Petri Nets (HLPNs) and then mapped them using their specified functionalities. Secondly, we defined and analysed the behavioural properties of the proposed scheme using Z specification language. Furthermore, we used the Satisfiability Modulo Theories Library (SMT Lib) and the Z3 Solver to validate and demonstrate the overall functionality of the proposed scheme. Finally, in addition to modelling and analysis, this work employs Coloured Petri Nets (CPNs), which combine Petri Nets with a high level programming language, making them more suitable for large scale system modelling. To perform the simulations in CPN, we used both timed and untimed models, where timed models are used to evaluate performance, and untimed models are used to validate logical validity.


Learning Noisy Hedonic Games. We consider the learning task of prediction of formation of core stable coalition structure in hedonic games based on agents' noisy preferences. We have considered two cases complete information (noisy preferences of all the agents are entirely known) and partial information (noisy preferences over some coalitions are only known). We introduce a noise model that probabilistically scales the valuations of coalitions. The performance metric is the probability of our prediction conditioned on all or few noisy preferences of the agents be correct. The nature of our results is that this prediction probability is relatively low, including being zero, and rarely it is one. In the complete information two agent model, in which each agent retains' or inflates' the values of its coalitions, we identify the expressions of the prediction probabilities in terms of the noise probability. We identify the interval of the noise probability such that the prediction probability is at least a user given threshold. It turned out that, for some noisy games, the noise probability interval does not exist for a threshold as low as 0.1481, thus demonstrating that the prediction probabilities are generally low even in this model. In the partial information setup, we consider n agent games with l support of noise values, and such noisy preferences are available for some coalitions only. We obtain the bounds on the prediction probability of a partition to be epsilon PAC stable in the noise free game in the cases when the realized noisy game has or hasn't epsilon PAC stable outcome.


Long term impact of a primary school intervention on aspects of Einsteinian physics. The physics that underpins modern technology is based on Einstein's theories of relativity and quantum mechanics. Most school students complete their compulsory science education without being taught any of these Einsteinian concepts. Only those who take a specialised physics course have the opportunity to learn modern physics. In 2011, the first study of a modern physics teaching intervention with an Australian upper primary (aged 10 11) class was conducted. The initial intervention was the first step of the Einstein First collaboration towards challenging the current paradigm of Newtonian teaching in schools. It was found that modern physics concepts could be taught to these students. In 2020, 11 participants of the initial study (out of a total of 26) were contacted for a follow up questionnaire and interview to investigate any long term impact. The results of the follow up indicate that the intervention maintained a positive impression on participants. The models and analogies used during the six week intervention were highly memorable. The participants indicated that they found the intervention to be beneficial to their future learning. Even close to ten years after the intervention, the participants remembered several key concepts (such as curved space time). The long term follow up indicates that Einsteinian physics can be taught at the upper primary level and be recalled several years later.


Simultaneous rational approximation to successive powers of a real number. We develop new tools leading, for each integer n ge 4 , to a significantly improved upper bound for the uniform exponent of rational approximation widehat lambda n( xi) to successive powers 1, xi, dots, xi n of a given real transcendental number xi . As an application, we obtain a refined lower bound for the exponent of approximation to xi by algebraic integers of degree at most n 1 . The new lower bound is n 2 a sqrt n 4 3 with a (1 log(2)) 2 simeq 0.153 , instead of the current n 2 mathcal O (1) .


Continuous time limit of the stochastic ensemble Kalman inversion Strong convergence analysis. The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively applies the ensemble Kalman update to evolve (the approximation of the) prior into the posterior measure. For the convergence analysis of the EKI it is common practice to derive a continuous version, replacing the iteration with a stochastic differential equation. In this paper we validate this approach by showing that the stochastic EKI iteration converges to paths of the continuous time stochastic differential equation by considering both the nonlinear and linear setting, and we prove convergence in probability for the former, and convergence in moments for the latter. The methods employed can also be applied to the analysis of more general numerical schemes for stochastic differential equations in general.


Cremona groups over finite fields, Neretin groups, and non positively curved cube complexes. We show that plane Cremona groups over finite fields embed into Neretin groups, i.e., groups of almost automorphisms of rooted trees. The image of this embedding is dense if our base field has odd characteristic or is equal to F 2 . This is no longer true, if the finite base field has even characteristic and contains at least 4 elements for this case we show that the permutations induced by birational transformations on rational points of regular projective surfaces are always even. In a second part, we construct explicit locally compact CAT(0) cube complexes, on which Neretin groups act properly. This allows us to recover in a unified way various results on Neretin groups such as that they are of type F infty . We also prove a new fixed point theorem for CAT(0) cube complexes without infinite cubes and use it to deduce a regularisation theorem for plane Cremona groups over finite fields.


Learning to Manipulate Tools by Aligning Simulation to Video Demonstration. A seamless integration of robots into human environments requires robots to learn how to use existing human tools. Current approaches for learning tool manipulation skills mostly rely on expert demonstrations provided in the target robot environment, for example, by manually guiding the robot manipulator or by teleoperation. In this work, we introduce an automated approach that replaces an expert demonstration with a Youtube video for learning a tool manipulation strategy. The main contributions are twofold. First, we design an alignment procedure that aligns the simulated environment with the real world scene observed in the video. This is formulated as an optimization problem that finds a spatial alignment of the tool trajectory to maximize the sparse goal reward given by the environment. Second, we describe an imitation learning approach that focuses on the trajectory of the tool rather than the motion of the human. For this we combine reinforcement learning with an optimization procedure to find a control policy and the placement of the robot based on the tool motion in the aligned environment. We demonstrate the proposed approach on spade, scythe and hammer tools in simulation, and show the effectiveness of the trained policy for the spade on a real Franka Emika Panda robot demonstration.


Holomorphic semigroups and Sarason's characterization of vanishing mean oscillation. It is a classical theorem of Sarason that an analytic function of bounded mean oscillation ( BMOA ), is of vanishing mean oscillation if and only if its rotations converge in norm to the original function as the angle of the rotation tends to zero. In a series of two papers Blasco et al. have raised the problem of characterizing all semigroups of holomorphic functions ( varphi t) that can replace the semigroup of rotations in Sarason's Theorem. We give a complete answer to this question, in terms of a logarithmic vanishing oscillation condition on the infinitesimal generator of the semigroup ( varphi t) . In addition we confirm the conjecture of Blasco et al. that all such semigroups are elliptic. We also investigate the analogous question for the Bloch and the little Bloch space and surprisingly enough we find that the semigroups for which the Bloch version of Sarason's Theorem holds are exactly the same as in the BMOA case.


Flexible daytime radiative cooling enhanced by enabling three phase composites with scattering interfaces between silica microspheres and hierarchical porous coatings. Daytime radiative cooling has attracted considerable attention recently due to its tremendous potential for passively exploiting the coldness of deep sky as clean and renewable energy. Many advanced materials with novel photonic micro nanostructures have already been developed to enable highly efficient daytime radiative coolers, among which the flexible hierarchical porous coatings (HPCs) are a more distinguished category. However, it is still hard to precisely control the size distribution of the randomized pores within the HPCs, usually resulting in a deficient solar reflection at the near infrared optical regime under diverse fabrication conditions of the coatings. We report here a three phase (i.e., air pore phase, microsphere phase and polymer phase) self assembled hybrid porous composite coating which dramatically increases the average solar reflectance and yields a remarkable temperature drop of 10 degC and 30 degC compared to the ambient circumstance and black paint, respectively, according to the rooftop measurements. Mie theory and Monte Carlo simulations reveal the origin of the low reflectivity of as prepared two phase porous HPCs, and the optical cooling improvement of the three phase porous composite coatings is attributed to the newly generated interfaces possessing the high scattering efficiency between the hierarchical pores and silica microspheres hybridized with appropriate mass fractions. As a result, the hybrid porous composite approach enhances the whole performance of the coatings, which provides a promising alternative to the flexible daytime radiative cooler.


Class balanced underwater object detection dataset generated by class wise style augmentation. Underwater object detection technique is of great significance for various applications in underwater the scenes. However, class imbalance issue is still an unsolved bottleneck for current underwater object detection algorithms. It leads to large precision discrepancies among different classes that the dominant classes with more training data achieve higher detection precisions while the minority classes with fewer training data achieves much lower detection precisions. In this paper, we propose a novel class wise style augmentation (CWSA) algorithm to generate a class balanced underwater dataset Balance18 from the public contest underwater dataset URPC2018. CWSA is a new kind of data augmentation technique which augments the training data for the minority classes by generating various colors, textures and contrasts for the minority classes. Compare with previous data augmentation algorithms such flipping, cropping and rotations, CWSA is able to generate a class balanced underwater dataset with diverse color distortions and haze effects.


Graph Contrastive Pre training for Effective Theorem Reasoning. Interactive theorem proving is a challenging and tedious process, which requires non trivial expertise and detailed low level instructions (or tactics) from human experts. Tactic prediction is a natural way to automate this process. Existing methods show promising results on tactic prediction by learning a deep neural network (DNN) based model from proofs written by human experts. In this paper, we propose NeuroTactic, a novel extension with a special focus on improving the representation learning for theorem proving. NeuroTactic leverages graph neural networks (GNNs) to represent the theorems and premises, and applies graph contrastive learning for pre training. We demonstrate that the representation learning of theorems is essential to predict tactics. Compared with other methods, NeuroTactic achieves state of the art performance on the CoqGym dataset.


KNN, An Underestimated Model for Regional Rainfall Forecasting. Regional rainfall forecasting is an important issue in hydrology and meteorology. This paper aims to design an integrated tool by applying various machine learning algorithms, especially the state of the art deep learning algorithms including Deep Neural Network, Wide Neural Network, Deep and Wide Neural Network, Reservoir Computing, Long Short Term Memory, Support Vector Machine, K Nearest Neighbor for forecasting regional precipitations over different catchments in Upstate New York. Through the experimental results and the comparison among machine learning models including classification and regression, we find that KNN is an outstanding model over other models to handle the uncertainty in the precipitation data. The data normalization methods such as ZScore and MinMax are also evaluated and discussed.


A Weight Initialization Based on the Linear Product Structure for Neural Networks. Weight initialization plays an important role in training neural networks and also affects tremendous deep learning applications. Various weight initialization strategies have already been developed for different activation functions with different neural networks. These initialization algorithms are based on minimizing the variance of the parameters between layers and might still fail when neural networks are deep, e.g., dying ReLU. To address this challenge, we study neural networks from a nonlinear computation point of view and propose a novel weight initialization strategy that is based on the linear product structure (LPS) of neural networks. The proposed strategy is derived from the polynomial approximation of activation functions by using theories of numerical algebraic geometry to guarantee to find all the local minima. We also provide a theoretical analysis that the LPS initialization has a lower probability of dying ReLU comparing to other existing initialization strategies. Finally, we test the LPS initialization algorithm on both fully connected neural networks and convolutional neural networks to show its feasibility, efficiency, and robustness on public datasets.


Efficient color coatings for single junction and multijunction colored solar cells. Colored solar cells suffer from lower efficiency due to reflection and absorption losses by coatings. By studying different types of coatings on solar cells, the spectrum parameters impacting the solar cell efficiency were identified. A collection of color coatings was fabricated and characterized using spectrophotometry and colorimetric photography. The coatings include commercial absorption filters, commercial distributed bragg reflectors, lab made interference coatings, and cellulose nanocrystal coatings. Commercial single junction and multijunction solar cells were used to measure the impact of the color coatings on solar cell performance. Structural colors were found to result in the highest brightness to color loss ratio. Structural colors do not fade provided that the structure is not compromised. Color loss in single junction solar cells is a result of the proportion of reflected light in the absorption range of the material. Multijunction solar cells were strongly affected by current mismatch losses, where narrow reflection peaks resulted in high efficiency losses. Structural color coatings made using cellulose nanocrystals exhibited low and broad reflection peaks that produced bright colors and maintained high performance of single junction and multijunction solar cells, retaining up to 83 of the reference power obtained in the absence of a color coating.


Feature Generation for Long tail Classification. The visual world naturally exhibits an imbalance in the number of object or scene instances resulting in a emph long tailed distribution . This imbalance poses significant challenges for classification models based on deep learning. Oversampling instances of the tail classes attempts to solve this imbalance. However, the limited visual diversity results in a network with poor representation ability. A simple counter to this is decoupling the representation and classifier networks and using oversampling only to train the classifier. In this paper, instead of repeatedly re sampling the same image (and thereby features), we explore a direction that attempts to generate meaningful features by estimating the tail category's distribution. Inspired by ideas from recent work on few shot learning, we create calibrated distributions to sample additional features that are subsequently used to train the classifier. Through several experiments on the CIFAR 100 LT (long tail) dataset with varying imbalance factors and on mini ImageNet LT (long tail), we show the efficacy of our approach and establish a new state of the art. We also present a qualitative analysis of generated features using t SNE visualizations and analyze the nearest neighbors used to calibrate the tail class distributions. Our code is available at https github.com rahulvigneswaran TailCalibX.


Deep Reinforcement Learning for L3 Slice Localization in Sarcopenia Assessment. Sarcopenia is a medical condition characterized by a reduction in muscle mass and function. A quantitative diagnosis technique consists of localizing the CT slice passing through the middle of the third lumbar area (L3) and segmenting muscles at this level. In this paper, we propose a deep reinforcement learning method for accurate localization of the L3 CT slice. Our method trains a reinforcement learning agent by incentivizing it to discover the right position. Specifically, a Deep Q Network is trained to find the best policy to follow for this problem. Visualizing the training process shows that the agent mimics the scrolling of an experienced radiologist. Extensive experiments against other state of the art deep learning based methods for L3 localization prove the superiority of our technique which performs well even with a limited amount of data and annotations.


Two weight dyadic Hardy's inequalities. We give a survey of results and proofs on two weight Hardy's inequalities on infinite trees. Most of the results are already known, but some appear here for the first time. Among the new results that we prove there is the characterization of the compactness of the Hardy operator, a reverse H "older inequality for trace measures and a simple proof of the characterization of trace measures based on a monotonicity argument. Furthermore we give a probabilistic proof of an inequality due to Wolff. We also provide a list of open problems and suggest some possible lines of future research.


Deep Hedging of Derivatives Using Reinforcement Learning. This paper shows how reinforcement learning can be used to derive optimal hedging strategies for derivatives when there are transaction costs. The paper illustrates the approach by showing the difference between using delta hedging and optimal hedging for a short position in a call option when the objective is to minimize a function equal to the mean hedging cost plus a constant times the standard deviation of the hedging cost. Two situations are considered. In the first, the asset price follows a geometric Brownian motion. In the second, the asset price follows a stochastic volatility process. The paper extends the basic reinforcement learning approach in a number of ways. First, it uses two different Q functions so that both the expected value of the cost and the expected value of the square of the cost are tracked for different state action combinations. This approach increases the range of objective functions that can be used. Second, it uses a learning algorithm that allows for continuous state and action space. Third, it compares the accounting P L approach (where the hedged position is valued at each step) and the cash flow approach (where cash inflows and outflows are used). We find that a hybrid approach involving the use of an accounting P L approach that incorporates a relatively simple valuation model works well. The valuation model does not have to correspond to the process assumed for the underlying asset price.


A Family of Density Scaled Filtered Complexes. We develop novel methods for using persistent homology to infer the homology of an unknown Riemannian manifold (M, g) from a point cloud sampled from an arbitrary smooth probability density function. Standard distance based filtered complexes, such as the v C ech complex, often have trouble distinguishing noise from features that are simply small. We address this problem by defining a family of "density scaled filtered complexes" that includes a density scaled v C ech complex and a density scaled Vietoris Rips complex. We show that the density scaled v C ech complex is homotopy equivalent to M for filtration values in an interval whose starting point converges to 0 in probability as the number of points N to infty and whose ending point approaches infinity as N to infty . By contrast, the standard v C ech complex may only be homotopy equivalent to M for a very small range of filtration values. The density scaled filtered complexes also have the property that they are invariant under conformal transformations, such as scaling. We implement a filtered complex widehat DVR that approximates the density scaled Vietoris Rips complex, and we empirically test the performance of our implementation. As examples, we use widehat DVR to identify clusters that have different densities, and we apply widehat DVR to a time delay embedding of the Lorenz dynamical system. Our implementation is stable (under conditions that are almost surely satisfied) and designed to handle outliers in the point cloud that do not lie on M .


Therapeutic Interfering Particles Exploiting Viral Replication and Assembly Mechanisms Show Promising Performance A Modelling Study. Defective interfering particles arise spontaneously during a viral infection as mutants lacking essential parts of the viral genome. Their ability to replicate in the presence of the wild type (WT) virus (at the expense of viable viral particles) is mimicked and exploited by therapeutic interfering particles. We propose a strategy for the design of therapeutic interfering RNAs (tiRNAs) against positive sense single stranded RNA viruses that assemble via packaging signal mediated assembly. These tiRNAs contain both an optimised version of the virus assembly manual that is encoded by multiple dispersed RNA packaging signals and a replication signal for viral polymerase, but lack any protein coding information. We use an intracellular model for hepatitis C viral (HCV) infection that captures key aspects of the competition dynamics between tiRNAs and viral genomes for virally produced capsid protein and polymerase. We show that only a small increase in the assembly and replication efficiency of the tiRNAs compared with WT virus is required in order to achieve a treatment efficacy greater than 99 . This demonstrates that the proposed tiRNA design could be a promising treatment option for RNA viral infections.


Identifying Helpful Sentences in Product Reviews. In recent years online shopping has gained momentum and became an important venue for customers wishing to save time and simplify their shopping process. A key advantage of shopping online is the ability to read what other customers are saying about products of interest. In this work, we aim to maintain this advantage in situations where extreme brevity is needed, for example, when shopping by voice. We suggest a novel task of extracting a single representative helpful sentence from a set of reviews for a given product. The selected sentence should meet two conditions first, it should be helpful for a purchase decision and second, the opinion it expresses should be supported by multiple reviewers. This task is closely related to the task of Multi Document Summarization in the product reviews domain but differs in its objective and its level of conciseness. We collect a dataset in English of sentence helpfulness scores via crowd sourcing and demonstrate its reliability despite the inherent subjectivity involved. Next, we describe a complete model that extracts representative helpful sentences with positive and negative sentiment towards the product and demonstrate that it outperforms several baselines.


Contrastive Spatio Temporal Pretext Learning for Self supervised Video Representation. Spatio temporal representation learning is critical for video self supervised representation. Recent approaches mainly use contrastive learning and pretext tasks. However, these approaches learn representation by discriminating sampled instances via feature similarity in the latent space while ignoring the intermediate state of the learned representations, which limits the overall performance. In this work, taking into account the degree of similarity of sampled instances as the intermediate state, we propose a novel pretext task spatio temporal overlap rate (STOR) prediction. It stems from the observation that humans are capable of discriminating the overlap rates of videos in space and time. This task encourages the model to discriminate the STOR of two generated samples to learn the representations. Moreover, we employ a joint optimization combining pretext tasks with contrastive learning to further enhance the spatio temporal representation learning. We also study the mutual influence of each component in the proposed scheme. Extensive experiments demonstrate that our proposed STOR task can favor both contrastive learning and pretext tasks. The joint optimization scheme can significantly improve the spatio temporal representation in video understanding. The code is available at https github.com Katou2 CSTP.


On the ordinary Hecke orbit conjecture. We prove the ordinary Hecke orbit conjecture for Shimura varieties of abelian type at primes of good reduction. We make use of the global Serre Tate coordinates of Chai as well as recent results of D'Addezio about the p adic monodromy of isocrystals. The new ingredients in this paper are a general monodromy theorem for Hecke stable subvarieties and a rigidity result for the formal completions of ordinary Hecke orbits.


Anosov triangle reflection groups in SL(3,R). We identify all Anosov representations of compact hyperbolic triangle reflection groups into mathrm SL (3, mathbb R) . Specifically, we prove that such a representation is Anosov if and only if it lies in the Hitchin component of the representation space, or it lies in the Barbot component and the product of the three generators of the triangle group has distinct real eigenvalues.


Effect of Foam Insertion in Aneurysm Sac on Flow Structures in Parent Lumen Relating Vortex Structures with Disturbed Shear. Numerous studies suggest that disturbed shear, causing endothelium dysfunction, can be related to neighboring vortex structures. With this motivation, this study presents a methodology to characterize the vortex structures. Precisely, we use mapping and characterization of vortex structures' changes to relate it with the hemodynamic indicators of disturbed shear. Topological features of vortex core lines (VCLs) are used to quantify the changes in vortex structures. We use the Sujudi Haimes algorithm to extract the VCLs from the flow simulation results. The idea of relating vortex structures with disturbed shear is demonstrated for cerebral arteries with aneurysms virtually treated by inserting foam in the sac. To get physiologically realistic flow fields, we simulate blood flow in two patient specific geometries before and after foam insertion, with realistic velocity waveform imposed at the inlet, using the Carreau Yashuda model to mimic the shear thinning behavior. With homogenous porous medium assumption, flow through the foam is modeled using the Forcheimmer Brinkmann extended Darcy model. Results show that foam insertion increases the number of VCLs in the parent lumen. The average length of VCL increases by 168.9 and 55.6 in both geometries. For both geometries under consideration, results demonstrate that the region with increased disturbed shear lies in the same arterial segment exhibiting an increase in the number of oblique VCLs. Based on the findings, we conjecture that an increase in oblique VCLs is related to increased disturbed shear at the neighboring portion of the arterial wall.


Transverse Hydraulic Fracture Initiation Insights from Intermediate Scale Hydraulic Fracture Tests. In a uniform stress field, a tensile hydraulic fracture will favor propagation in the plane formed by the maximum (most compressive) and intermediate principal stresses. For the propagation of hydraulic fractures in non uniform stress fields, especially those where the principal stress directions change spatially, things become much more complex, are less well understood, and therefore are more difficult to predict. Such is often the case when a hydraulic fracture is initiated from a borehole drilled in the direction of the minimum principal stress. This is a well known problem that has been the subject of several numerical and experimental studies. The purpose of this paper is to offer new insights from a series of hydraulic fracture tests conducted in sub horizontal boreholes drilled in the Sanford Underground Research Facility. This project, called the Enhanced Geothermal Systems (EGS) Collab project, has developed a test bed at a depth of approximately 1478 meters underground consisting of sub horizontal injection, production, and monitoring wells. This paper presents stimulation test data, and supporting geologic geophysical characterization data. The test data are compared to previous numerical and experimental studies to determine how well this new experimental data compares with previous modeling, laboratory, and field tests.


Stretching Your Data With Taffy Filters. Popular approximate membership query structures such as Bloom filters and cuckoo filters are widely used in databases, security, and networking. These structures represent sets approximately, and support at least two operations insert and lookup lookup always returns true on elements inserted into the structure it also returns true with some probability 0 varepsilon 1 on elements not inserted into the structure. These latter elements are called false positives. Compensatory for these false positives, filters can be much smaller than hash tables that represent the same set. However, unlike hash tables, cuckoo filters and Bloom filters must be initialized with the intended number of inserts to be performed, and cannot grow larger inserts beyond this number fail or significantly increase the false positive probability. This paper presents designs and implementations of filters than can grow without inserts failing and without meaningfully increasing the false positive probability, even if the filters are created with a small initial size. The resulting code is available on GitHub under a permissive open source license.


Smooth simplicial sets and universal Chern Weil homomorphism. We start by introducing and developing a basic geometric categorical notion of a smooth simplicial set. Loosely, this is to diffeological spaces of Chen Souriau as simplicial sets are to spaces. Given a Frechet Lie group G , we construct abstract classifying spaces BG mathcal U as smooth Kan complexes. Here the index mathcal U is a chosen Grothendieck universe of a certain type. When G in addition has the homotopy type of a CW complex, there is a homotopy equivalence BG simeq BG mathcal U , where BG is the usual Milnor classifying space. This leads to our main application that for G a Frechet Lie group, having the homotopy type of a CW complex, there is a universal Chern Weil homomorphism begin equation mathbb R mathfrak g G to H (BG, mathbb R ), end equation satisfying naturality, and generalizing the classical Chern Weil homomorphism for compact Lie groups. We give an example in the form of an application to the study of the infinite dimensional symplectomorphism group of a symplectic manifold.


On a Generalized Briot Bouquet type Differential Subordination. We introduce and study the following special type of differential subordination implication begin equation label abs p(z)Q(z) frac zp'(z) beta p(z) alpha prec h(z) quad Rightarrow p(z) prec h(z), end equation which generalizes the Briot Bouquet differential subordination, where Q(z) is analytic and 0 neq beta, alpha in mathbb C . Further, some special cases of our result are also discussed. Finally, analogues of open door lemma and integral existence theorem with applications to univalent functions are obtained.


Sums of integral squares in complex bi quadratic fields and in CM fields. Let K be a complex bi quadratic field with ring of integers mathcal O K . For K mathbb Q ( sqrt m , sqrt n ), where m equiv 3 pmod 4 and n equiv 1 pmod 4 , we prove that every algebraic integer can be written as sum of integral squares. Using this, we prove that for any complex bi quadratic field K , every element of 4 mathcal O K can be written as sum of five integral squares. In addition, we show that the Pythagoras number of ring of integers of any CM field is at most five. Moreover, we give two classes of complex bi quadratic fields for which p( mathcal O K ) 3 and p(4 mathcal O K ) 3 respectively. Here, p( mathcal O K ) is the Pythagoras number of ring of integers of K and p(4 mathcal O K ) is the smallest positive integer t such that every element of 4 mathcal O K can be written as sum of t integral squares.


SOLO Search Online, Learn Offline for Combinatorial Optimization Problems. We study combinatorial problems with real world applications such as machine scheduling, routing, and assignment. We propose a method that combines Reinforcement Learning (RL) and planning. This method can equally be applied to both the offline, as well as online, variants of the combinatorial problem, in which the problem components (e.g., jobs in scheduling problems) are not known in advance, but rather arrive during the decision making process. Our solution is quite generic, scalable, and leverages distributional knowledge of the problem parameters. We frame the solution process as an MDP, and take a Deep Q Learning approach wherein states are represented as graphs, thereby allowing our trained policies to deal with arbitrary changes in a principled manner. Though learned policies work well in expectation, small deviations can have substantial negative effects in combinatorial settings. We mitigate these drawbacks by employing our graph convolutional policies as non optimal heuristics in a compatible search algorithm, Monte Carlo Tree Search, to significantly improve overall performance. We demonstrate our method on two problems Machine Scheduling and Capacitated Vehicle Routing. We show that our method outperforms custom tailored mathematical solvers, state of the art learning based algorithms, and common heuristics, both in computation time and performance.


Unsupervised Image Fusion Using Deep Image Priors. A significant number of researchers have applied deep learning methods to image fusion. However, most works require a large amount of training data or depend on pre trained models or frameworks to capture features from source images. This is inevitably hampered by a shortage of training data or a mismatch between the framework and the actual problem. Deep Image Prior (DIP) has been introduced to exploit convolutional neural networks' ability to synthesize the 'prior' in the input image. However, the original design of DIP is hard to be generalized to multi image processing problems, particularly for image fusion. Therefore, we propose a new image fusion technique that extends DIP to fusion tasks formulated as inverse problems. Additionally, we apply a multi channel approach to enhance DIP's effect further. The evaluation is conducted with several commonly used image fusion assessment metrics. The results are compared with state of the art image fusion methods. Our method outperforms these techniques for a range of metrics. In particular, it is shown to provide the best objective results for most metrics when applied to medical images.


Low bandwidth recovery of linear functions of Reed Solomon encoded data. We study the problem of efficiently computing on encoded data. More specifically, we study the question of low bandwidth computation of functions F mathbb F k to mathbb F of some data x in mathbb F k , given access to an encoding c in mathbb F n of x under an error correcting code. In our model relevant in distributed storage, distributed computation and secret sharing each symbol of c is held by a different party, and we aim to minimize the total amount of information downloaded from each party in order to compute F(x) . Special cases of this problem have arisen in several domains, and we believe that it is fruitful to study this problem in generality. Our main result is a low bandwidth scheme to compute linear functions for Reed Solomon codes, even in the presence of erasures. More precisely, let epsilon 0 and let mathcal C mathbb F k to mathbb F n be a full length Reed Solomon code of rate 1 epsilon over a field mathbb F with constant characteristic. For any gamma in 0, epsilon) , our scheme can compute any linear function F(x) given access to any (1 gamma) fraction of the symbols of mathcal C (x) , with download bandwidth O(n ( epsilon gamma)) bits. In contrast, the naive scheme that involves reconstructing the data x and then computing F(x) uses Theta(n log n) bits. Our scheme has applications in distributed storage, coded computation, and homomorphic secret sharing.