Nodal solutions for singular semilinear elliptic systems. n this paper, we prove existence of nodal solutions for singular semilinear elliptic systems without variational structure where its both components are of sign changing. Our approach is based on sub supersolutions method combined with perturbation arguments involving singular terms.


Modeling material transport regulation and traffic jam in neurons using PDE constrained optimization. The intracellular transport process plays an important role in delivering essential materials throughout branched geometries of neurons for their survival and function. Many neurodegenerative diseases have been associated with the disruption of transport. Therefore, it is essential to study how neurons control the transport process to localize materials to necessary locations. Here, we develop a novel optimization model to simulate the traffic regulation mechanism of material transport in complex geometries of neurons. The transport is controlled to avoid traffic jam of materials by minimizing a pre defined objective function. The optimization subjects to a set of partial differential equation (PDE) constraints that describe the material transport process based on a macroscopic molecular motor assisted transport model of intracellular particles. The proposed PDE constrained optimization model is solved in complex tree structures by using isogeometric analysis (IGA). Different simulation parameters are used to introduce traffic jams and study how neurons handle the transport issue. Specifically, we successfully model and explain the traffic jam caused by reduced number of microtubules (MTs) and MT swirls. In summary, our model effectively simulates the material transport process in healthy neurons and also explains the formation of a traffic jam in abnormal neurons. Our results demonstrate that both geometry and MT structure play important roles in achieving an optimal transport process in neuron.


Towards A Systematic Discussion of Missingness in Visual Analytics. Data driven decision making has been a common task in today's big data era, from simple choices such as finding a fast way for driving to work, to complex decisions on cancer treatment in healthcare, often supported by visual analytics. For various reasons (e.g., an ill defined problem space, network failures or bias), visual analytics for sensemaking of data involves missingness (e.g., missing data and incomplete analysis), which can impact human decisions. For example, data, with missing records, can cost a business millions of dollars, and failing to recognize key evidence can put an innocent person into a sentence to death as a falsely convicted of murder. Being aware of missingness is critical to avoid such catastrophes. To achieve this, as an initial step, we present a framework of categorizing missingness in visual analytics from two perspectives data centric and human centric. The former emphasizes missingness in three data related categories data composition, data relationship and data usage. The latter focuses on the human perceived missingness at three levels observed missingness, inferred missingness and ignored missingness. Based on the framework, we discuss possible roles of visualizations for handling missingness, and conclude our discussion with future research opportunities.


Regularity of the Schr "o dinger cost. The Schr "o dinger problem is an entropy minimisation problem on the space of probability measures. Its optimal value is a cost between two probability measures. In this article we investigate some regularity properties of this cost continuity with respect to the marginals and time derivative of the cost along probability measures valued curves.


Import options for chemical energy carriers from renewable sources to Germany. Import and export of fossil energy carriers are cornerstones of energy systems world wide. If energy systems are to become climate neutral and sustainable, fossil carriers need to be substituted with carbon neutral alternatives or electrified if possible. We investigate synthetic chemical energy carriers, hydrogen, methane, methanol, ammonia and Fischer Tropsch fuels, produced using electricity from renewable energy sourceses as fossil substitutes. Renewable energy sourceses potentials are obtained from GIS analysis and hourly resolved time series are derived using reanalysis weather data. We model the sourcing of feedstock chemicals, synthesis and transport along nine different energy supply chains to Germany. and compare import options for seven locations around the world against each other and with domestically sourced alternatives on the basis of their respective cost per unit of hydrogen and energy delivered. We find that for each type of chemical energy carrier an import option with lower costs compared to domestic production in Germany exists. The lowest cost import options for energy and hydrogen are by hydrogen pipeline from Denmark, Spain and Western Asia and North Africa at 40.6 to 46.8 EUR per MWh (LHV) (1.4 to 1.6 EUR per kg H2) in 2050 assuming 5 p.a. capital cost. For complex energy carriers like methane, ammonia, methanol or Fischer Tropsch fuel, imports from Argentina by ship to Germany are attractive even compared to closer European Union or Western Asia and North Africa exporters. For meeting hydrogen demand, direct hydrogen imports are more attractive than indirect routes using methane, methanol or ammoniaimports and subsequent decomposition to hydrogen because of high capital investment costs and energetic losses of the indirect routes. We make our model and data available under open licenses for adaptation and reuse.


Contrastive Mixup Self and Semi Supervised learning for Tabular Domain. Recent literature in self supervised has demonstrated significant progress in closing the gap between supervised and unsupervised methods in the image and text domains. These methods rely on domain specific augmentations that are not directly amenable to the tabular domain. Instead, we introduce Contrastive Mixup, a semi supervised learning framework for tabular data and demonstrate its effectiveness in limited annotated data settings. Our proposed method leverages Mixup based augmentation under the manifold assumption by mapping samples to a low dimensional latent space and encourage interpolated samples to have high a similarity within the same labeled class. Unlabeled samples are additionally employed via a transductive label propagation method to further enrich the set of similar and dissimilar pairs that can be used in the contrastive loss term. We demonstrate the effectiveness of the proposed framework on public tabular datasets and real world clinical datasets.


PredRNN A Recurrent Neural Network for Spatiotemporal Predictive Learning. The predictive learning of spatiotemporal sequences aims to generate future images by learning from the historical context, where the visual dynamics are believed to have modular structures that can be learned with compositional subsystems. This paper models these structures by presenting PredRNN, a new recurrent network, in which a pair of memory cells are explicitly decoupled, operate in nearly independent transition manners, and finally form unified representations of the complex environment. Concretely, besides the original memory cell of LSTM, this network is featured by a zigzag memory flow that propagates in both bottom up and top down directions across all layers, enabling the learned visual dynamics at different levels of RNNs to communicate. It also leverages a memory decoupling loss to keep the memory cells from learning redundant features. We further propose a new curriculum learning strategy to force PredRNN to learn long term dynamics from context frames, which can be generalized to most sequence to sequence models. We provide detailed ablation studies to verify the effectiveness of each component. Our approach is shown to obtain highly competitive results on five datasets for both action free and action conditioned predictive learning scenarios.


Data Free Knowledge Transfer A Survey. In the last decade, many deep learning models have been well trained and made a great success in various fields of machine intelligence, especially for computer vision and natural language processing. To better leverage the potential of these well trained models in intra domain or cross domain transfer learning situations, knowledge distillation (KD) and domain adaptation (DA) are proposed and become research highlights. They both aim to transfer useful information from a well trained model with original training data. However, the original data is not always available in many cases due to privacy, copyright or confidentiality. Recently, the data free knowledge transfer paradigm has attracted appealing attention as it deals with distilling valuable knowledge from well trained models without requiring to access to the training data. In particular, it mainly consists of the data free knowledge distillation (DFKD) and source data free domain adaptation (SFDA). On the one hand, DFKD aims to transfer the intra domain knowledge of original data from a cumbersome teacher network to a compact student network for model compression and efficient inference. On the other hand, the goal of SFDA is to reuse the cross domain knowledge stored in a well trained source model and adapt it to a target domain. In this paper, we provide a comprehensive survey on data free knowledge transfer from the perspectives of knowledge distillation and unsupervised domain adaptation, to help readers have a better understanding of the current research status and ideas. Applications and challenges of the two areas are briefly reviewed, respectively. Furthermore, we provide some insights to the subject of future research.


Enumeration of binary trees compatible with a perfect phylogeny. Evolutionary models used for describing molecular sequence variation suppose that at a non recombining genomic segment, sequences share ancestry that can be represented as a genealogy a rooted, binary, timed tree, with tips corresponding to individual sequences. Under the infinitely many sites mutation model, mutations are randomly superimposed along the branches of the genealogy, so that every mutation occurs at a chromosomal site that has not previously mutated if a mutation occurs at an interior branch, then all individuals descending from that branch carry the mutation. The implication is that observed patterns of molecular variation from this model impose combinatorial constraints on the hidden state space of genealogies. In particular, observed molecular variation can be represented in the form of a perfect phylogeny, a tree structure that fully encodes the mutational differences among sequences. For a sample of n sequences, a perfect phylogeny might not possess n distinct leaves, and hence might be compatible with many possible binary tree structures that could describe the evolutionary relationships among the n sequences. Here, we investigate enumerative properties of the set of binary ranked and unranked tree shapes that are compatible with a perfect phylogeny, and hence, the binary ranked and unranked tree shapes conditioned on an observed pattern of mutations under the infinitely many sites mutation model. We provide a recursive enumeration of these shapes. We consider both perfect phylogenies that can be represented as binary and those that are multifurcating. The results have implications for computational aspects of the statistical inference of evolutionary parameters that underlie sets of molecular sequences.


Flatfield Ultrafast Imaging with Single Shot Non Synchronous Array Photography. We present a method for acquiring a sequence of time resolved images in a single shot, called Single Shot Non Synchronous Array Photography (SNAP). In SNAP, a pulsed laser beam is split by a diffractive optical element into an array of angled beamlets whose illumination fronts remain perpendicular to the optical axis. Different time delays are imparted to each beamlet by an echelon, enabling them to probe a scene in rapid succession. The beamlets are then imaged onto different regions of a camera by a lenslet array. Because the illumination fronts remain flat (head on) independently of beamlet angle, the temporal resolution of SNAP is fundamentally limited only by the laser pulse duration, akin to a "global shutter" in conventional imaging. We demonstrate SNAP by capturing the evolution of a laser induced plasma filament for 20 frames at an average rate of 4.2 Tfps.


Quantum plasmon enhanced nonlinear wave mixing in graphene nanoflakes. A distant neighbor quantum mechanical method is used to study the nonlinear optical wave mixing in graphene nanoflakes (GNFs), including sum and difference frequency generation, as well as four wave mixing. Our analysis shows that molecular scale GNFs support quantum plasmons in the visible spectrum region, and significant enhancement of nonlinear optical wave mixing is achieved. Specifically, the second and third order wave mixing polarizabilities of GNFs are dramatically enhanced, provided that one (or more) of the input or output frequencies coincide with a quantum plasmon resonance. Moreover, by embedding a cavity into hexagonal GNFs, we show that one can break the structural inversion symmetry and enable otherwise forbidden second order wave mixing, which is found to be enhanced by the quantum plasmon resonance too. This study reveals that the molecular sized graphene could be used in the quantum regime for nanoscale nonlinear optical devices and ultrasensitive molecular sensors.


The chromatic symmetric function of a graph centred at a vertex. We discover new linear relations between the chromatic symmetric functions of certain sequences of graphs and apply these relations to find new families of e positive unit interval graphs. Motivated by the results of Gebhard and Sagan, we revisit their ideas and reinterpret their equivalence relation in terms of a new quotient algebra of NCSym. We investigate the projection of the chromatic symmetric function Y G in noncommuting variables in this quotient algebra, which defines y G v , the chromatic symmetric function of a graph G centred at a vertex v . We then apply our methods to y G v and find new families of unit interval graphs that are (e) positive, a stronger condition than classical e positivity, thus confirming new cases of the (3 1) free conjecture of Stanley and Stembridge. In our study of y G v , we also describe methods of constructing new e positive graphs from given (e) positive graphs and classify the (e) positivity of trees and cut vertices. We moreover construct a related quotient algebra of NCQSym to prove theorems relating the coefficients of y G v to acyclic orientations of graphs, including a noncommutative refinement of Stanley's sink theorem.


Tilings of the Sphere by Congruent Quadrilaterals with Exactly Two Equal Edges. In this paper we give a classification of tilings of the sphere by congruent quadrilaterals with exactly two equal edges. The tilings are the earth map tilings, (p,q) earth map tilings and their flip modifications, and quadrilateral subdivisions of the cube and the triangular prism. We described the ranges of values of the edges and angles for the tile to be geometrically realisable. The symmetry groups of the tilings are also determined.


A note on positive partial transpose blocks. In this article, we study the class of PPT blocks. A simple proof yields the following result For X, A, B in mathbb M n , if left( begin array cc A X X B end array right) is PPT, then X leq left ( A B right) U (A B)U, for some unitary U in mathbb M n . Several consequences of this inequality are established. These consequences improve, generalize and unify many corresponding results in the literature.


NATOs Mission Critical Space Capabilities under Threat Cybersecurity Gaps in the Military Space Asset Supply Chain. The North Atlantic Treaty Organizations (NATO) public private Space Asset Supply Chain (SASC) currently exhibits significant cybersecurity gaps. It is well established that data obtained from space assets is fundamental to NATO, as they allow for the facilitation of its missions, self defence and effective deterrence of its adversaries. Any hostile cyber operation, suspending control over a space asset, severely impacts both NATO missions and allied Member States national security. This threat is exacerbated by NATOs mostly unregulated cyber SASC. Hence, this thesis answers a twofold research question a) What are current cybersecurity gaps along NATOs global SASC and b) How can NATO and its allied Member States gain greater control over such gaps to safeguard the supply of NATO mission critical information? An ontological field study is carried out by conducting nineteen semi structured interviews with high level representatives from relevant public, private and academic organizations. This research was undertaken in collaboration with the NATO Cooperative Cyber Defence Centre of Excellence (CCDCOE) in Tallinn, Estonia. This thesis concludes that current cybersecurity gaps along NATOs SASC are caused by cyber vulnerabilities such as legacy systems or the use of Commercial Off the Shelf (COTS) technology. Inadequate cyber SASC management is caused by hindrances such as misaligned classification levels and significant understaffing. On this basis, NATO should consider two major collaboration initiatives a) Raising Awareness throughout the whole of the NATO system, and b) Pushing forward the creation of regulation through a standardized security framework on SASC cybersecurity. Doing so would enable NATO and its Member States to recognise cyberthreats to mission critical data early on along its cyber SASC, and thus increase transparency, responsibility, and liability.


Autonomous Attack Mitigation for Industrial Control Systems. Defending computer networks from cyber attack requires timely responses to alerts and threat intelligence. Decisions about how to respond involve coordinating actions across multiple nodes based on imperfect indicators of compromise while minimizing disruptions to network operations. Currently, playbooks are used to automate portions of a response process, but often leave complex decision making to a human analyst. In this work, we present a deep reinforcement learning approach to autonomous response and recovery in large industrial control networks. We propose an attention based neural architecture that is flexible to the size of the network under protection. To train and evaluate the autonomous defender agent, we present an industrial control network simulation environment suitable for reinforcement learning. Experiments show that the learned agent can effectively mitigate advanced attacks that progress with few observable signals over several months before execution. The proposed deep reinforcement learning approach outperforms a fully automated playbook method in simulation, taking less disruptive actions while also defending more nodes on the network. The learned policy is also more robust to changes in attacker behavior than playbook approaches.


REPT Bridging Language Models and Machine Reading Comprehension via Retrieval Based Pre training. Pre trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large scale corpora does benefit MRC, the poor support in evidence extraction which requires reasoning across multiple sentences hinders PLMs from further advancing MRC. To bridge the gap between general PLMs and MRC, we present REPT, a REtrieval based Pre Training approach. In particular, we introduce two self supervised tasks to strengthen evidence extraction during pre training, which is further inherited by downstream MRC tasks through the consistent retrieval operation and model architecture. To evaluate our proposed method, we conduct extensive experiments on five MRC datasets that require collecting evidence from and reasoning across multiple sentences. Experimental results demonstrate the effectiveness of our pre training approach. Moreover, further analysis shows that our approach is able to enhance the capacity of evidence extraction without explicit supervision.


Bounding p Brauer characters in finite groups with two conjugacy classes of p elements. Let k(B 0) and l(B 0) respectively denote the number of ordinary and p Brauer irreducible characters in the principal block B 0 of a finite group G. We prove that, if k(B 0) l(B 0) 1, then l(B 0) geq p 1 or else p 11 and l(B 0) 9. This follows from a more general result that for every finite group G in which all non trivial p elements are conjugate, l(B 0) geq p 1 or else p 11 and G O p' (G) 11 2 SL(2,5). These results are useful in the study of principal blocks with a few characters. We propose that, in every finite group G of order divisible by p, the number of irreducible Brauer characters in the principal p block of G is always at least 2 sqrt p 1 1 k p(G), where k p(G) is the number of conjugacy classes of p elements of G. This indeed is a consequence of the celebrated Alperin weight conjecture and known results on bounding the number of p regular classes in finite groups.


Multiple Hook Removing Game Whose Starting Position is a Rectangular Young Diagram with the Unimodal Numbering. We introduce a new impartial game, named Multiple Hook Removing Game (MHRG for short). We also determine the mathcal G values of some game positions (including the starting positions) in MHRG (m,n) , the MHRG whose starting position is the rectangular Young diagram of size m times n with the unimodal numbering. In addition, we prove that MHRG (m,n) is isomorphic, as games, to MHRG (m,n 1) (if m le n and m n is even), and give a relationship between MHRG (n,n 1) (and MHRG (n,n) ) and HRG (S n) , the Hook Removing Game in terms of shifted Young diagrams.


SSC Semantic Scan Context for Large Scale Place Recognition. Place recognition gives a SLAM system the ability to correct cumulative errors. Unlike images that contain rich texture features, point clouds are almost pure geometric information which makes place recognition based on point clouds challenging. Existing works usually encode low level features such as coordinate, normal, reflection intensity, etc., as local or global descriptors to represent scenes. Besides, they often ignore the translation between point clouds when matching descriptors. Different from most existing methods, we explore the use of high level features, namely semantics, to improve the descriptor's representation ability. Also, when matching descriptors, we try to correct the translation between point clouds to improve accuracy. Concretely, we propose a novel global descriptor, Semantic Scan Context, which explores semantic information to represent scenes more effectively. We also present a two step global semantic ICP to obtain the 3D pose (x, y, yaw) used to align the point cloud to improve matching performance. Our experiments on the KITTI dataset show that our approach outperforms the state of the art methods with a large margin. Our code is available at https github.com lilin hitcrt SSC.


Ensemble Learning using Error Correcting Output Codes New Classification Error Bounds. New bounds on classification error rates for the error correcting output code (ECOC) approach in machine learning are presented. These bounds have exponential decay complexity with respect to codeword length and theoretically validate the effectiveness of the ECOC approach. Bounds are derived for two different models the first under the assumption that all base classifiers are independent and the second under the assumption that all base classifiers are mutually correlated up to first order. Moreover, we perform ECOC classification on six datasets and compare their error rates with our bounds to experimentally validate our work and show the effect of correlation on classification accuracy.


Schwarz Pick and Landau type theorems for solutions to the Dirichlet Neumann problem in the unit disk. The aim of this paper is to establish some properties of solutions to the Dirichlet Neumann problem ( partial z partial overline z ) 2 w g in the unit disc ID , w gamma 0 and partial nu partial z partial overline z w gamma on mathbb T (the unit circle), frac 1 2 pi i int mathbb T w zeta overline zeta ( zeta) frac d zeta zeta c , where partial nu denotes differentiation in the outward normal direction. More precisely, we obtain Schwarz Pick type inequalities and Landau type theorem for solutions to the Dirichlet Neumann problem.


Strong ill posedness for fractional Hartree and cubic NLS Equations. In this paper, we consider fractional Hartree (fHE) and fractional cubic nonlinear Schr "odinger (fNLS) equations on mathbb R d . We establish norm inflation (stronger phenomena than mere ill posedness) for fHE and fNLS in Fourier Lebesgue and modulation spaces with negative regularity. (In particular, these spaces include Sobolev spaces.) We further show that this can be even worse by exhibiting norm inflation with infinite loss of regularity. To establish later phenomena, we employ Fourier analytic approach and introduce new resonant sets corresponding to the fractional dispersion ( Delta) alpha 2 . In particular, we obtain norm inflation above scaling critical regularity in some of these spaces when dispersion index alpha is large enough. It turns out that our approach could treat both equations (fHE) and (fNLS) in a unified manner. The method also should be applicable to wider classes of nonlinear equations with Hartree type nonlinearity.


Energy efficient distributed analytics at the edge of the network for IoT environments. Due to the pervasive diffusion of personal mobile and IoT devices, many "smart environments" (e.g., smart cities and smart factories) will be, generators of huge amounts of data. Currently, analysis of this data is typically achieved through centralised cloud based services. However, according to many studies, this approach may present significant issues from the standpoint of data ownership, as well as wireless network capacity. In this paper, we exploit the fog computing paradigm to move computation close to where data is produced. We exploit a well known distributed machine learning framework (Hypothesis Transfer Learning), and perform data analytics on mobile nodes passing by IoT devices, in addition to fog gateways at the edge of the network infrastructure. We analyse the performance of different configurations of the distributed learning framework, in terms of (i) accuracy obtained in the learning task and (ii) energy spent to send data between the involved nodes. Specifically, we consider reference wireless technologies for communication between the different types of nodes we consider, e.g. LTE, Nb IoT, 802.15.4, 802.11, etc. Our results show that collecting data through the mobile nodes and executing the distributed analytics using short range communication technologies, such as 802.15.4 and 802.11, allows to strongly reduce the energy consumption of the system up to 94 with a loss in accuracy w.r.t. a centralised cloud solution up to 2 .


Event triggered bipartite consensus for multiagent system with general linear dynamics an integral type event triggered control. In this paper, we propose an integral based event triggering controller for bipartite consensus of the multi agent systems whose dynamics are described by general linear system. We prove that the system achieves the bipartite consensus in asymptotic regime and there is a positive minimum inter event time (MIET) between two consecutive triggering times of each agent. The proof of the asymptotive stability involves a novel argument used to bound the norm of the difference between the true state and its estimated state (for each time) by an integration of its square. Numerical results are provided supporting the effectiveness of the proposed controller.


A simpler spectral approach for clustering in directed networks. We study the task of clustering in directed networks. We show that using the eigenvalue eigenvector decomposition of the adjacency matrix is simpler than all common methods which are based on a combination of data regularization and SVD truncation, and works well down to the very sparse regime where the edge density has constant order. Our analysis is based on a Master Theorem describing sharp asymptotics for isolated eigenvalues eigenvectors of sparse, non symmetric matrices with independent entries. We also describe the limiting distribution of the entries of these eigenvectors in the task of digraph clustering with spectral embeddings, we provide numerical evidence for the superiority of Gaussian Mixture clustering over the widely used k means algorithm.


Cohomological support loci and Pluricanonical systems on irregular varieties. For an irregular variety X of general type, we show that if a general fiber F of the Albanese morphism of X satisfies certain Hodge theoretic condition, the 0 th cohomological support loci of K X generates the Picard variety of X . We then show that the condition that the 0 th cohomological support loci of K X generates the Picard variety of X can often be applied to prove the birationality of certain pluricanonical maps of X .


Semi Supervising Learning, Transfer Learning, and Knowledge Distillation with SimCLR. Recent breakthroughs in the field of semi supervised learning have achieved results that match state of the art traditional supervised learning methods. Most successful semi supervised learning approaches in computer vision focus on leveraging huge amount of unlabeled data, learning the general representation via data augmentation and transformation, creating pseudo labels, implementing different loss functions, and eventually transferring this knowledge to more task specific smaller models. In this paper, we aim to conduct our analyses on three different aspects of SimCLR, the current state of the art semi supervised learning framework for computer vision. First, we analyze properties of contrast learning on fine tuning, as we understand that contrast learning is what makes this method so successful. Second, we research knowledge distillation through teacher forcing paradigm. We observe that when the teacher and the student share the same base model, knowledge distillation will achieve better result. Finally, we study how transfer learning works and its relationship with the number of classes on different data sets. Our results indicate that transfer learning performs better when number of classes are smaller.


Semantic Construction Grammar Bridging the NL Logic Divide. In this paper, we discuss Semantic Construction Grammar (SCG), a system developed over the past several years to facilitate translation between natural language and logical representations. Crucially, SCG is designed to support a variety of different methods of representation, ranging from those that are fairly close to the NL structure (e.g. so called 'logical forms'), to those that are quite different from the NL structure, with higher order and high arity relations. Semantic constraints and checks on representations are integral to the process of NL understanding with SCG, and are easily carried out due to the SCG's integration with Cyc's Knowledge Base and inference engine.


Semi Supervised Classification and Segmentation on High Resolution Aerial Images. FloodNet is a high resolution image dataset acquired by a small UAV platform, DJI Mavic Pro quadcopters, after Hurricane Harvey. The dataset presents a unique challenge of advancing the damage assessment process for post disaster scenarios using unlabeled and limited labeled dataset. We propose a solution to address their classification and semantic segmentation challenge. We approach this problem by generating pseudo labels for both classification and segmentation during training and slowly incrementing the amount by which the pseudo label loss affects the final loss. Using this semi supervised method of training helped us improve our baseline supervised loss by a huge margin for classification, allowing the model to generalize and perform better on the validation and test splits of the dataset. In this paper, we compare and contrast the various methods and models for image classification and semantic segmentation on the FloodNet dataset.


Data Augmentation for Low Resource Named Entity Recognition Using Backtranslation. The state of art natural language processing systems relies on sizable training datasets to achieve high performance. Lack of such datasets in the specialized low resource domains lead to suboptimal performance. In this work, we adapt backtranslation to generate high quality and linguistically diverse synthetic data for low resource named entity recognition. We perform experiments on two datasets from the materials science (MaSciP) and biomedical domains (S800). The empirical results demonstrate the effectiveness of our proposed augmentation strategy, particularly in the low resource scenario.


Inverse boundary value problems for polyharmonic operators with non smooth coefficients. We consider inverse boundary value problems for polyharmonic operators and in particular, the problem of recovering the coefficients of terms up to order one. The main interest of our result is that it further relaxes the regularity required to establish uniqueness. The proof relies on an averaging technique introduced by Haberman and Tataru for the study of an inverse boundary value problem for a second order operator.


Leveraging spectral analysis to elucidate membrane locking and unlocking in isogeometric finite element formulations of the curved Euler Bernoulli beam. In this paper, we take a fresh look at using spectral analysis for assessing locking phenomena in finite element formulations. We propose to "measure" locking by comparing the difference between eigenvalue and mode error curves computed on coarse meshes with "asymptotic" error curves computed on "overkill" meshes, both plotted with respect to the normalized mode number. To demonstrate the intimate relation between membrane locking and spectral accuracy, we focus on the example of a circular ring discretized with isogeometric curved Euler Bernoulli beam elements. We show that the transverse displacement dominating modes are locking prone, while the circumferential displacement dominating modes are naturally locking free. We use eigenvalue and mode errors to assess five isogeometric finite element formulations in terms of their locking related efficiency the displacement based formulation with full and reduced integration and three locking free formulations based on the B bar, discrete strain gap and Hellinger Reissner methods. Our study shows that spectral analysis uncovers locking related effects across the spectrum of eigenvalues and eigenmodes, rigorously characterizing membrane locking in the displacement based formulation and unlocking in the locking free formulations.


SPTS Single Point Text Spotting. Existing scene text spotting (i.e., end to end text detection and recognition) methods rely on costly bounding box annotations (e.g., text line, word level, or character level bounding boxes). For the first time, we demonstrate that training scene text spotting models can be achieved with an extremely low cost annotation of a single point for each instance. We propose an end to end scene text spotting method that tackles scene text spotting as a sequence prediction task. Given an image as input, we formulate the desired detection and recognition results as a sequence of discrete tokens and use an auto regressive Transformer to predict the sequence. The proposed method is simple yet effective, which can achieve state of the art results on widely used benchmarks. Most significantly, we show that the performance is not very sensitive to the positions of the point annotation, meaning that it can be much easier to be annotated or even be automatically generated than the bounding box that requires precise positions. We believe that such a pioneer attempt indicates a significant opportunity for scene text spotting applications of a much larger scale than previously possible. The code will be publicly available.


Impact of Gender Debiased Word Embeddings in Language Modeling. Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent studies have shown that the human generated data used in training is an apparent factor of getting biases. In addition, current algorithms have also been proven to amplify biases from data. To further address these concerns, in this paper, we study how an state of the art recurrent neural language model behaves when trained on data, which under represents females, using pre trained standard and debiased word embeddings. Results show that language models inherit higher bias when trained on unbalanced data when using pre trained embeddings, in comparison with using embeddings trained within the task. Moreover, results show that, on the same data, language models inherit lower bias when using debiased pre trained emdeddings, compared to using standard pre trained embeddings.


Model based cellular kinetic analysis of SARS CoV 2 infection different immune response modes and treatment strategies. Increasing number in global COVID 19 cases demands for mathematical model to analyze the interaction between the virus dynamics and the response of innate and adaptive immunity. Here, based on the assumption of a weak and delayed response of the innate and adaptive immunity in SARS CoV 2 infection, we constructed a mathematical model to describe the dynamic processes of immune system. Integrating theoretical results with clinical COVID 19 patients' data, we classified the COVID 19 development processes into three typical modes of immune responses, correlated with the clinical classification of mild moderate, severe and critical patients. We found that the immune efficacy (the ability of host to clear virus and kill infected cells) and the lymphocyte supply (the abundance and pool of na "ive T and B cell) play important roles in the dynamic process and determine the clinical outcome, especially for the severe and critical patients. Furthermore, we put forward possible treatment strategies for the three typical modes of immune response. We hope our results can help to understand the dynamical mechanism of the immune response against SARS CoV 2 infection, and to be useful for the treatment strategies and vaccine design.


Dynamic Models of Spherical Parallel Robots for Model Based Control Schemes. In this paper, derivation of different forms of dynamic formulation of spherical parallel robots (SPRs) is investigated. These formulations include the explicit dynamic forms, linear regressor, and Slotine Li (SL) regressor, which are required for the design and implementation of the vast majority of model based controllers and dynamic parameters identification schemes. To this end, the implicit dynamic of SPRs is first formulated using the principle of virtual work in task space, and then by using an extension, their explicit dynamic formulation is derived. The dynamic equation is then analytically reformulated into linear and S L regression form with respect to the inertial parameters, and by using the Gauss Jordan procedure, it is reduced to a unique and closed form structure. Finally, to illustrate the effectiveness of the proposed method, two different SPRs, namely, the ARAS Diamond, and the 3 RRR, are examined as the case studies. The obtained results are verified by using the MSC ADAMS software, and are shared to interested audience for public access.


Privacy Amplification for Federated Learning via User Sampling and Wireless Aggregation. In this paper, we study the problem of federated learning over a wireless channel with user sampling, modeled by a Gaussian multiple access channel, subject to central and local differential privacy (DP LDP) constraints. It has been shown that the superposition nature of the wireless channel provides a dual benefit of bandwidth efficient gradient aggregation, in conjunction with strong DP guarantees for the users. Specifically, the central DP privacy leakage has been shown to scale as mathcal O (1 K 1 2 ) , where K is the number of users. It has also been shown that user sampling coupled with orthogonal transmission can enhance the central DP privacy leakage with the same scaling behavior. In this work, we show that, by join incorporating both wireless aggregation and user sampling, one can obtain even stronger privacy guarantees. We propose a private wireless gradient aggregation scheme, which relies on independently randomized participation decisions by each user. The central DP leakage of our proposed scheme scales as mathcal O (1 K 3 4 ) . In addition, we show that LDP is also boosted by user sampling. We also present analysis for the convergence rate of the proposed scheme and study the tradeoffs between wireless resources, convergence, and privacy theoretically and empirically for two scenarios when the number of sampled participants are (a) known, or (b) unknown at the parameter server.


DISCO Verification Division of Input Space into COnvex polytopes for neural network verification. The impressive results of modern neural networks partly come from their non linear behaviour. Unfortunately, this property makes it very difficult to apply formal verification tools, even if we restrict ourselves to networks with a piecewise linear structure. However, such networks yields subregions that are linear and thus simpler to analyse independently. In this paper, we propose a method to simplify the verification problem by operating a partitionning into multiple linear subproblems. To evaluate the feasibility of such an approach, we perform an empirical analysis of neural networks to estimate the number of linear regions, and compare them to the bounds currently known. We also present the impact of a technique aiming at reducing the number of linear regions during training.


Fixed Budget Best Arm Identification in Structured Bandits. Best arm identification (BAI) in a fixed budget setting is a bandit problem where the learning agent maximizes the probability of identifying the best arm after a fixed number of observations. Most works on this topic study unstructured problems with a small number of arms, which limits their applicability. We propose a general tractable algorithm that incorporates the structure, by successively eliminating suboptimal arms based on their mean reward estimates from a joint generalization model. We analyze our algorithm in linear and generalized linear models (GLMs) and propose a practical implementation based on a G optimal design. In linear models, our algorithm has competitive regret guarantees to prior works and performs at least as well empirically. In GLMs, this is the first practical algorithm with analysis for fixed budget BAI.


EarthGAN Can we visualize the Earth's mantle convection using a surrogate model?. Scientific simulations are often used to gain insight into foundational questions. However, many potentially useful simulation results are difficult to visualize without powerful computers. In this research, we seek to build a surrogate model, using a generative adversarial network, to allow for the visualization of the Earth's Mantle Convection data set on readily accessible hardware. We present our preliminary method and results, and all code is made publicly available. The preliminary results show that a surrogate model of the Earth's Mantle Convection data set can generate useful results. A comparison to the "ground truth" is provided.


Absorbing state phase transition and activated random walks with unbounded capacities. In this article, we study the existence of an absorbing state phase transition of an Abelian process that generalises the Activated Random Walk (ARW). Given a vertex transitive G (V,E) , we associate to each site x in V a capacity w x ge 0 , which describes how many inactive particles x can hold, where w x x in V is a collection of i.i.d random variables. When G is an amenable graph, we prove that if mathbb E w x infty , the model goes through an absorbing state phase transition and if mathbb E w x infty , the model fixates for all lambda 0 . Moreover, in the former case, we provide bounds for the critical density that match the ones available in the classical Activated Random Walk.


Feature Importance in a Deep Learning Climate Emulator. We present a study using a class of post hoc local explanation methods i.e., feature importance methods for "understanding" a deep learning (DL) emulator of climate. Specifically, we consider a multiple input single output emulator that uses a DenseNet encoder decoder architecture and is trained to predict interannual variations of sea surface temperature (SST) at 1, 6, and 9 month lead times using the preceding 36 months of (appropriately filtered) SST data. First, feature importance methods are employed for individual predictions to spatio temporally identify input features that are important for model prediction at chosen geographical regions and chosen prediction lead times. In a second step, we also examine the behavior of feature importance in a generalized sense by considering an aggregation of the importance heatmaps over training samples. We find that 1) the climate emulator's prediction at any geographical location depends dominantly on a small neighborhood around it 2) the longer the prediction lead time, the further back the "importance" extends and 3) to leading order, the temporal decay of "importance" is independent of geographical location. An ablation experiment is adopted to verify the findings. From the perspective of climate dynamics, these findings suggest a dominant role for local processes and a negligible role for remote teleconnections at the spatial and temporal scales we consider. From the perspective of network architecture, the spatio temporal relations between the inputs and outputs we find suggest potential model refinements. We discuss further extensions of our methods, some of which we are considering in ongoing work.


VICEROY GDPR CCPA compliant Enforcement of Verifiable Accountless Consumer Requests. Recent data protection regulations (such as GDPR and CCPA) grant consumers various rights, including the right to access, modify or delete any personal information collected about them (and retained) by a service provider. To exercise these rights, one must submit a verifiable consumer request proving that the collected data indeed pertains to them. This action is straightforward for consumers with active accounts with a service provider at the time of data collection, since they can use standard (e.g., password based) means of authentication to validate their requests. However, a major conundrum arises from the need to support consumers without accounts to exercise their rights. To this end, some service providers began requiring such accountless consumers to reveal and prove their identities (e.g., using government issued documents, utility bills, or credit card numbers) as part of issuing a verifiable consumer request. While understandable as a short term cure, this approach is cumbersome and expensive for service providers as well as privacy invasive for consumers. Consequently, there is a strong need to provide better means of authenticating requests from accountless consumers. To achieve this, we propose VICEROY, a privacy preserving and scalable framework for producing proofs of data ownership, which form a basis for verifiable consumer requests. Building upon existing web techniques and features, VICEROY allows accountless consumers to interact with service providers, and later prove that they are the same person in a privacy preserving manner, while requiring minimal changes for both parties. We design and implement VICEROY with emphasis on security privacy, deployability and usability. We also thoroughly assess its practicality via extensive experiments.


Budget based real time Executor for Micro ROS. The Robot Operating System (ROS) is a popular robotics middleware framework. In the last years, it underwent a redesign and reimplementation under the name ROS 2. It now features QoS configurable communication and a flexible layered architecture. Micro ROS is a variant developed specifically for resource constrained microcontrollers (MCU). Such MCUs are commonly used in robotics for sensors and actuators, for time critical control functions, and for safety. While the execution management of ROS 2 has been addressed by an Executor concept, its lack of real time capabilities make it unsuitable for industrial use. Neither defining an execution order nor the assignment of scheduling parameters to tasks is possible, despite the fact that advanced real time scheduling algorithms are well known and available in modern RTOS's. For example, the NuttX RTOS supports a variant of the reservation based scheduling which is very attractive for industrial applications It allows to assign execution time budgets to software components so that a system integrator can thereby guarantee the real time requirements of the entire system. This paper presents for the first time a ROS 2 Executor design which enables the real time scheduling capabilities of the operating system. In particular, we successfully demonstrate the budget based scheduling of the NuttX RTOS with a micro ROS application on an STM32 microcontroller.


Good case and Bad case Latency of Unauthenticated Byzantine Broadcast A Complete Categorization. This paper studies the em good case latency of em unauthenticated Byzantine fault tolerant broadcast, which measures the time it takes for all non faulty parties to commit given a non faulty broadcaster. For both asynchrony and synchrony, we show that n geq 4f is the tight resilience threshold that separates good case 2 rounds and 3 rounds. For asynchronous Byzantine reliable broadcast (BRB), we also investigate the em bad case latency for all non faulty parties to commit when the broadcaster is faulty but some non faulty party commits. We provide matching upper and lower bounds on the resilience threshold of bad case latency for BRB protocols with optimal good case latency of 2 rounds. In particular, we show 2 impossibility results and propose 4 asynchronous BRB protocols.


Size Matters. Fully convolutional neural networks can process input of arbitrary size by applying a combination of downsampling and pooling. However, we find that fully convolutional image classifiers are not agnostic to the input size but rather show significant differences in performance presenting the same image at different scales can result in different outcomes. A closer look reveals that there is no simple relationship between input size and model performance (no bigger is better'), but that each each network has a preferred input size, for which it shows best results. We investigate this phenomenon by applying different methods, including spectral analysis of layer activations and probe classifiers, showing that there are characteristic features depending on the network architecture. From this we find that the size of discriminatory features is critically influencing how the inference process is distributed among the layers.


On the Phi Stability and Related Conjectures. Let mathbf X be a random variable uniformly distributed on the discrete cube 1,1 n , and let T rho be the noise operator acting on Boolean functions f 1,1 n to 0,1 , where rho in 0,1 is the noise parameter, representing the correlation coefficient between each coordination of mathbf X and its noise corrupted version. Given a convex function Phi and the mean mathbb E f( mathbf X ) a in 0,1 , which Boolean function f maximizes the Phi stability mathbb E Phi(T rho f( mathbf X )) of f ? Special cases of this problem include the (symmetric and asymmetric) alpha stability problems and the "Most Informative Boolean Function" problem. In this paper, we provide several upper bounds for the maximal Phi stability. When specializing Phi to some particular forms, by these upper bounds, we partially resolve Mossel and O'Donnell's conjecture on alpha stability with alpha 2 , Li and M 'edard's conjecture on alpha stability with 1 alpha 2 , and Courtade and Kumar's conjecture on the "Most Informative Boolean Function" which corresponds to a conjecture on alpha stability with alpha 1 . Our proofs are based on discrete Fourier analysis, optimization theory, and improvements of the Friedgut Kalai Naor (FKN) theorem. Our improvements of the FKN theorem are sharp or asymptotically sharp for certain cases.


First principles correction scheme for linear response time dependent density functional theory calculations of core electronic states. Linear response time dependent density functional theory (LR TDDFT) for core level spectroscopy using standard local functionals suffers from self interaction error and a lack of orbital relaxation upon creation of the core hole. As a result, LR TDDFT calculated X ray absorption near edge structure (XANES) spectra need to be shifted along the energy axis to match experimental data. We propose a correction scheme based on many body perturbation theory to calculate the shift from first principles. The ionization potential of the core donor state is first computed and then substituted for the corresponding Kohn Sham orbital energy, thus emulating Koopmans' condition. Both self interaction error and orbital relaxation are taken into account. The method exploits the localized nature of core states for efficiency and integrates seamlessly in our previous implementation of core level LR TDDFT, yielding corrected spectra in a single calculation. We benchmark the correction scheme on molecules at the K and L edges as well as for core binding energies and report accuracies comparable to higher order methods. We also demonstrate applicability in large and extended systems and discuss efficient approximations.


Indecomposable objects in Khovanov Sazdanovic's generalizations of Deligne's interpolation categories. Khovanov and Sazdanovic recently introduced symmetric monoidal categories parameterized by rational functions and given by quotients of categories of two dimensional cobordisms. These categories generalize Deligne's interpolation categories of representations of symmetric groups. In this paper, we classify indecomposable objects and identify the associated graded Grothendieck rings of Khovanov Sazdanovic's categories through sums of representation categories over crossed products of polynomial rings over a general field. To obtain these results, we introduce associated graded categories for Krull Schmidt categories with filtrations as a categorification of the associated graded Grothendieck ring, and study field extensions and Galois descent for Krull Schmidt categories.


Canonical Heights on Shimura Varieties and the Andr 'e Oort Conjecture. The main purpose of this work is to prove the Andr 'e Oort conjecture in full generality.


Learning where to learn Gradient sparsity in meta and continual learning. Finding neural network weights that generalize well from small datasets is difficult. A promising approach is to learn a weight initialization such that a small number of weight changes results in low generalization error. We show that this form of meta learning can be improved by letting the learning algorithm decide which weights to change, i.e., by learning where to learn. We find that patterned sparsity emerges from this process, with the pattern of sparsity varying on a problem by problem basis. This selective sparsity results in better generalization and less interference in a range of few shot and continual learning problems. Moreover, we find that sparse learning also emerges in a more expressive model where learning rates are meta learned. Our results shed light on an ongoing debate on whether meta learning can discover adaptable features and suggest that learning by sparse gradient descent is a powerful inductive bias for meta learning systems.


AutoSmart An Efficient and Automatic Machine Learning framework for Temporal Relational Data. Temporal relational data, perhaps the most commonly used data type in industrial machine learning applications, needs labor intensive feature engineering and data analyzing for giving precise model predictions. An automatic machine learning framework is needed to ease the manual efforts in fine tuning the models so that the experts can focus more on other problems that really need humans' engagement such as problem definition, deployment, and business services. However, there are three main challenges for building automatic solutions for temporal relational data 1) how to effectively and automatically mining useful information from the multiple tables and the relations from them? 2) how to be self adjustable to control the time and memory consumption within a certain budget? and 3) how to give generic solutions to a wide range of tasks? In this work, we propose our solution that successfully addresses the above issues in an end to end automatic way. The proposed framework, AutoSmart, is the winning solution to the KDD Cup 2019 of the AutoML Track, which is one of the largest AutoML competition to date (860 teams with around 4,955 submissions). The framework includes automatic data processing, table merging, feature engineering, and model tuning, with a time memory controller for efficiently and automatically formulating the models. The proposed framework outperforms the baseline solution significantly on several datasets in various domains.


Interpretable Compositional Convolutional Neural Networks. The reasonable definition of semantic interpretability presents the core challenge in explainable AI. This paper proposes a method to modify a traditional convolutional neural network (CNN) into an interpretable compositional CNN, in order to learn filters that encode meaningful visual patterns in intermediate convolutional layers. In a compositional CNN, each filter is supposed to consistently represent a specific compositional object part or image region with a clear meaning. The compositional CNN learns from image labels for classification without any annotations of parts or regions for supervision. Our method can be broadly applied to different types of CNNs. Experiments have demonstrated the effectiveness of our method.


Optimizing Information Freshness for Cooperative IoT Systems with Stochastic Arrivals. This paper considers a cooperative Internet of Things (IoT) system with a source aiming to transmit randomly generated status updates to a designated destination as timely as possible under the help of a relay. We adopt a recently proposed concept, the age of information (AoI), to characterize the timeliness of the status updates. In the considered system, delivering the status updates via the one hop direct link will have a shorter transmission time at the cost of incurring a higher error probability, while the delivery of status updates through the two hop relay link could be more reliable at the cost of suffering longer transmission time. Thus, it is important to design the relaying protocol of the considered system for optimizing the information freshness. Considering the limited capabilities of IoT devices, we propose two low complexity age oriented relaying (AoR) protocols, i.e., the source prioritized AoR (SP AoR) protocol and the relay prioritized AoR (RP AoR) protocol, to reduce the AoI of the considered system. By carefully analyzing the evolution of the instantaneous AoI, we derive closed form expressions of the average AoI for both proposed AoR protocols. We further optimize the generation probability of the status updates at the source in both protocols. Simulation results validate our theoretical analysis, and demonstrate that the two proposed protocols outperform each other under various system parameters. Moreover, the protocol with better performance can achieve near optimal performance compared with the optimal scheduling policy attained by applying the Markov decision process (MDP) tool.


What Are We Really Testing in Mutation Testing for Machine Learning? A Critical Reflection. Mutation testing is a well established technique for assessing a test suite's quality by injecting artificial faults into production code. In recent years, mutation testing has been extended to machine learning (ML) systems, and deep learning (DL) in particular researchers have proposed approaches, tools, and statistically sound heuristics to determine whether mutants in DL systems are killed or not. However, as we will argue in this work, questions can be raised to what extent currently used mutation testing techniques in DL are actually in line with the classical interpretation of mutation testing. We observe that ML model development resembles a test driven development (TDD) process, in which a training algorithm ( programmer') generates a model (program) that fits the data points (test data) to labels (implicit assertions), up to a certain threshold. However, considering proposed mutation testing techniques for ML systems under this TDD metaphor, in current approaches, the distinction between production and test code is blurry, and the realism of mutation operators can be challenged. We also consider the fundamental hypotheses underlying classical mutation testing the competent programmer hypothesis and coupling effect hypothesis. As we will illustrate, these hypotheses do not trivially translate to ML system development, and more conscious and explicit scoping and concept mapping will be needed to truly draw parallels. Based on our observations, we propose several action points for better alignment of mutation testing techniques for ML with paradigms and vocabularies of classical mutation testing.


Finite Volume Least Squares Neural Network (FV LSNN) Method for Scalar Nonlinear Hyperbolic Conservation Laws. In 4 , we introduced the least squares ReLU neural network (LSNN) method for solving the linear advection reaction problem with discontinuous solution and showed that the number of degrees of freedom for the LSNN method is significantly less than that of traditional mesh based methods. The LSNN method is a discretization of an equivalent least squares (LS) formulation in the class of neural network functions with the ReLU activation function and evaluation of the LS functional is done by using numerical integration and proper numerical differentiation. By developing a novel finite volume approximation (FVA) to the divergence operator, this paper studies the LSNN method for scalar nonlinear hyperbolic conservation laws. The FVA introduced in this paper is tailored to the LSNN method and is more accurate than traditional, well studied FV schemes used in mesh based numerical methods. Numerical results of some benchmark test problems with both convex and non convex fluxes show that the finite volume LSNN (FV LSNN) method is capable of computing the physical solution for problems with rarefaction waves and capturing the shock of the underlying problem automatically through the free hyper planes of the ReLU neural network. Moreover, the method does not exhibit the common Gibbs phenomena along the discontinuous interface.


Dilated convolution with learnable spacings. Dilated convolution is basically a convolution with a wider kernel created by regularly inserting spaces between the kernel elements. In this article, we present a new version of the dilated convolution in which the spacings are made learnable via backpropagation through an interpolation technique. We call this method "Dilated Convolution with Learnable Spacings" (DCLS) and we generalize its approach to the n dimensional convolution case. However, our main focus here will be the 2D case for which we developed two implementations a naive one that constructs the dilated kernel, suitable for small dilation rates, and a more time memory efficient one that uses a modified version of the "im2col" algorithm. We then illustrate how this technique improves the accuracy of existing architectures on semantic segmentation task on Pascal Voc 2012 dataset via a simple drop in replacement of the classical dilated convolutional layers by DCLS ones. Furthermore, we show that DCLS allows to reduce the number of learnable parameters of the depthwise convolutions used in the recent ConvMixer architecture by a factor 3 with no or very low reduction in accuracy and that by replacing large dense kernels with sparse DCLS ones. The code of the method is based on Pytorch and available at https github.com K H Ismail Dilated Convolution with Learnable Spacings PyTorch.


Unsupervised Two Stage Anomaly Detection. Anomaly detection from a single image is challenging since anomaly data is always rare and can be with highly unpredictable types. With only anomaly free data available, most existing methods train an AutoEncoder to reconstruct the input image and find the difference between the input and output to identify the anomalous region. However, such methods face a potential problem a coarse reconstruction generates extra image differences while a high fidelity one may draw in the anomaly. In this paper, we solve this contradiction by proposing a two stage approach, which generates high fidelity yet anomaly free reconstructions. Our Unsupervised Two stage Anomaly Detection (UTAD) relies on two technical components, namely the Impression Extractor (IE Net) and the Expert Net. The IE Net and Expert Net accomplish the two stage anomaly free image reconstruction task while they also generate intuitive intermediate results, making the whole UTAD interpretable. Extensive experiments show that our method outperforms state of the arts on four anomaly detection datasets with different types of real world objects and textures.


LRez C API and toolkit for analyzing and managing Linked Reads data. Linked Reads technologies, such as 10x Genomics, combine both the high quality and low cost of short reads sequencing and a long range information, through the use of barcodes able to tag reads which originate from a common long DNA fragment. This technology has been employed in a broad range of applications including assembly or phasing of genomes, and structural variant calling. However, to date, no tool or API dedicated to the manipulation of Linked Reads data exist. We introduce LRez, a C API and toolkit which allows easy management of Linked Reads data. LRez includes various functionalities, for computing number of common barcodes between genomic regions, extracting barcodes from BAM files, as well as indexing and querying both BAM and FASTQ files to quickly fetch reads or alignments sharing one or multiple barcodes. LRez can thus be used in a broad range of applications requiring barcode processing, in order to improve their performances. LRez is implemented in C , supported on Linux platforms, and available under AGPL 3.0 License at https github.com morispi LRez.


A Transition based Parser for Unscoped Episodic Logical Forms. "Episodic Logic Unscoped Logical Form" (EL ULF) is a semantic representation capturing predicate argument structure as well as more challenging aspects of language within the Episodic Logic formalism. We present the first learned approach for parsing sentences into ULFs, using a growing set of annotated examples. The results provide a strong baseline for future improvement. Our method learns a sequence to sequence model for predicting the transition action sequence within a modified cache transition system. We evaluate the efficacy of type grammar based constraints, a word to symbol lexicon, and transition system state features in this task. Our system is available at https github.com genelkim ulf transition parser We also present the first official annotated ULF dataset at https www.cs.rochester.edu u gkim21 ulf resources .


Fibre optics. Lenses, optics and dependent lenses (or equivalently morphisms of containers, or equivalently natural transformations of polynomial functors) are all widely used in applied category theory as models of bidirectional processes. From the definition of lenses over a finite product category, optics weaken the required structure to actions of monoidal categories, and dependent lenses make use of the additional property of finite completeness (or, in case of polynomials, even local cartesian closure). This has caused a split in the applied category theory literature between those using optics and those using dependent lenses. The goal of this paper is to unify optics with dependent lenses, by finding a definition of fibre optics admitting both as special cases.


Effective semantic segmentation in Cataract Surgery What matters most?. Our work proposes neural network design choices that set the state of the art on a challenging public benchmark on cataract surgery, CaDIS. Our methodology achieves strong performance across three semantic segmentation tasks with increasingly granular surgical tool class sets by effectively handling class imbalance, an inherent challenge in any surgical video. We consider and evaluate two conceptually simple data oversampling methods as well as different loss functions. We show significant performance gains across network architectures and tasks especially on the rarest tool classes, thereby presenting an approach for achieving high performance when imbalanced granular datasets are considered. Our code and trained models are available at https github.com RViMLab MICCAI2021 Cataract semantic segmentation and qualitative results on unseen surgical video can be found at https youtu.be twVIPUj1WZM.


Stiffness modeling for near field acoustic levitation bearings. The dynamic characteristics of near field levitation bearings have been investigated in this study. Through theoretical analysis, two different types of system stiffness are defined and derived analytically. The dynamic stiffness relates the excitation amplitude to the dynamic force amplitude, while the effective stiffness governs the time averaged force displacement relationship. The results indicate two non linear and asymmetric spring constants that can effectively predict levitation force and height. The models are verified with a carefully designed experimental setup to eliminate the structural resonance effect. Besides, some unique dynamic behaviors are investigated and predicted based on the proposed stiffness model.


GroupFormer Group Activity Recognition with Clustered Spatial Temporal Transformer. Group activity recognition is a crucial yet challenging problem, whose core lies in fully exploring spatial temporal interactions among individuals and generating reasonable group representations. However, previous methods either model spatial and temporal information separately, or directly aggregate individual features to form group features. To address these issues, we propose a novel group activity recognition network termed GroupFormer. It captures spatial temporal contextual information jointly to augment the individual and group representations effectively with a clustered spatial temporal transformer. Specifically, our GroupFormer has three appealing advantages (1) A tailor modified Transformer, Clustered Spatial Temporal Transformer, is proposed to enhance the individual representation and group representation. (2) It models the spatial and temporal dependencies integrally and utilizes decoders to build the bridge between the spatial and temporal information. (3) A clustered attention mechanism is utilized to dynamically divide individuals into multiple clusters for better learning activity aware semantic representations. Moreover, experimental results show that the proposed framework outperforms state of the art methods on the Volleyball dataset and Collective Activity dataset. Code is available at https github.com xueyee GroupFormer.


Antimagic Orientation of Forests. An antimagic labeling of a digraph D with n vertices and m arcs is a bijection from the set of arcs of D to 1,2, cdots,m such that all n oriented vertex sums are pairwise distinct, where the oriented vertex sum of a vertex is the sum of labels of all arcs entering that vertex minus the sum of labels of all arcs leaving it. A graph G admits an antimagic orientation if G has an orientation D such that D has an antimagic labeling. Hefetz, M " u tze and Schwartz conjectured every connected graph admits an antimagic orientation. In this paper, we support this conjecture by proving that any forest obtained from a given forest with at most one isolated vertex by subdividing each edge at least once admits an antimagic orientation.


A Tunable Model for Graph Generation Using LSTM and Conditional VAE. With the development of graph applications, generative models for graphs have been more crucial. Classically, stochastic models that generate graphs with a pre defined probability of edges and nodes have been studied. Recently, some models that reproduce the structural features of graphs by learning from actual graph data using machine learning have been studied. However, in these conventional studies based on machine learning, structural features of graphs can be learned from data, but it is not possible to tune features and generate graphs with specific features. In this paper, we propose a generative model that can tune specific features, while learning structural features of a graph from data. With a dataset of graphs with various features generated by a stochastic model, we confirm that our model can generate a graph with specific features.


MPC Friendly Commitments for Publicly Verifiable Covert Security. We address the problem of efficiently verifying a commitment in a two party computation. This addresses the scenario where a party P1 commits to a value x to be used in a subsequent secure computation with another party P2 that wants to receive assurance that P1 did not cheat, i.e. that x was indeed the value inputted into the secure computation. Our constructions operate in the publicly verifiable covert (PVC) security model, which is a relaxation of the malicious model of MPC appropriate in settings where P1 faces a reputational harm if caught cheating. We introduce the notion of PVC commitment scheme and indexed hash functions to build commitments schemes tailored to the PVC framework, and propose constructions for both arithmetic and Boolean circuits that result in very efficient circuits. From a practical standpoint, our constructions for Boolean circuits are 60 times faster to evaluate securely, and use 36 times less communication than baseline methods based on hashing. Moreover, we show that our constructions are tight in terms of required non linear operations, by proving lower bounds on the nonlinear gate count of commitment verification circuits. Finally, we present a technique to amplify the security properties our constructions that allows to efficiently recover malicious guarantees with statistical security.


Physics informed Neural Network for Nonlinear Dynamics in Fiber Optics. A physics informed neural network (PINN) that combines deep learning with physics is studied to solve the nonlinear Schr "odinger equation for learning nonlinear dynamics in fiber optics. We carry out a systematic investigation and comprehensive verification on PINN for multiple physical effects in optical fibers, including dispersion, self phase modulation, and higher order nonlinear effects. Moreover, both special case (soliton propagation) and general case (multi pulse propagation) are investigated and realized with PINN. In the previous studies, the PINN was mainly effective for single scenario. To overcome this problem, the physical parameters (pulse peak power and amplitudes of sub pulses) are hereby embedded as additional input parameter controllers, which allow PINN to learn the physical constraints of different scenarios and perform good generalizability. Furthermore, PINN exhibits better performance than the data driven neural network using much less data, and its computational complexity (in terms of number of multiplications) is much lower than that of the split step Fourier method. The results report here show that the PINN is not only an effective partial differential equation solver, but also a prospective technique to advance the scientific computing and automatic modeling in fiber optics.


Heisenberg homology on surface configurations. Motivated by the Lawrence Krammer Bigelow representations of the classical braid groups, we study the homology of unordered configurations in an orientable genus g surface with one boundary component, over non commutative local systems defined from representations of the discrete Heisenberg group. For a general representation we obtain a twisted action of the mapping class group. In the case of the Schr "odinger representation or its finite dimensional analogues, by composing with a Stone von Neumann isomorphism we are able to untwist and obtain a representation to the projective unitary group which lifts to a unitary representation of the stably universal central extension of the mapping class group.


The Early Years of Quantum Monte Carlo (2) Finite Temperature Simulations. In this article we present the second part of our historical survey on quantum Monte Carlo methods. IWe focus on the simulations performed at a finite temperature and based on the path integral formulation of quantum mechanics. We introduce the method and insist on the central role played by the description of the transition to superfluidity for Helium 4.


Cooling and diffusion rates in coherent electron cooling concepts. We present analytic cooling and diffusion rates for a simplified model of coherent electron cooling (CEC), based on a proton energy kick at each turn. This model also allows to estimate analytically the rms value of electron beam density fluctuations in the "kicker" section. Having such analytic expressions should allow for better understanding of the CEC mechanism, and for a quicker analysis and optimization of main system parameters. Our analysis is applicable to any CEC amplification mechanism, as long as the wake (kick) function is available.


Directed Diversity Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideation. Crowdsourcing can collect many diverse ideas by prompting ideators individually, but this can generate redundant ideas. Prior methods reduce redundancy by presenting peers' ideas or peer proposed prompts, but these require much human coordination. We introduce Directed Diversity, an automatic prompt selection approach that leverages language model embedding distances to maximize diversity. Ideators can be directed towards diverse prompts and away from prior ideas, thus improving their collective creativity. Since there are diverse metrics of diversity, we present a Diversity Prompting Evaluation Framework consolidating metrics from several research disciplines to analyze along the ideation chain prompt selection, prompt creativity, prompt ideation mediation, and ideation creativity. Using this framework, we evaluated Directed Diversity in a series of a simulation study and four user studies for the use case of crowdsourcing motivational messages to encourage physical activity. We show that automated diverse prompting can variously improve collective creativity across many nuanced metrics of diversity.


Averages and nonvanishing of central values of triple product L functions. Let f,g,h be three normalized cusp newforms of weight 2k on Gamma 0(N) which are eigenforms of Hecke operators. We use Ichino's period formula combined with a relative trace formula to show exact averages of L(3k 1,f times g times h) . We also present some applications of the average formulas to the nonvanishing problem, giving a lower bound on the number of nonvanishing central L values when one of the forms is fixed.


Describing Emergency Remote Teaching using a Learning Management System A South African COVID 19 Study of Resilience through ICT. In an effort to counter the spread of COVID 19 many schools were forced to shut down. Primary schools in South Africa were forced to shift to emergency remote teaching abruptly relying on using a Learning Management System (LMS) to aid their teaching. LMSs helped primary schools build resilience to cope with unexpected events. An opportunity rose to study the affordances and constraints faced when using a LMS for remote teaching, specifically for primary school learners ('Gen Z') a largely ignored area of research. Through a case study of 6 schools, this research describes the affordances and constraints of the LMS supported teaching system in use in primary schools. Affordances related to schools, learners and teachers while constraints were classified from a financial, technological, school, learner and teacher perspective. Noteworthy affordances included using LMSs as notice boards and satisfying parents, the key stakeholders. In terms of constraints, the digital divide was a recurring theme while device and data costs were consistently a limitation. There were many cases of schools not realizing the full potential of LMS usage. This research should be useful for primary schools wanting to use a LMS for their teaching.


Mid Infrared Photon Pair Generation in AgGaS 2 . We demonstrate non degenerate photon pair generation by spontaneous parametric down conversion in a silver gallium sulfide AgGaS 2 crystal. By tuning the pump wavelength, we achieve phase matching over a large spectral range. This allows to generate idler photons in the mid infrared spectral range above 6 mu m wavelength with corresponding signal photons in the visible. Also, we show photon pair generation with broad spectral bandwidth. These results are a valuable step towards the development of quantum imaging and sensing techniques in the mid infrared.


Weierstrass pure gaps on curves with three distinguished points. Let mathbb K be an algebraically closed field. In this paper, we consider the class of smooth plane curves of degree n 1 3 over mathbb K , containing three points, P 1,P 2, and P 3 , such that nP 1 P 2 , nP 2 P 3 , and nP 3 P 1 are divisors cut out by three distinct lines. For such curves, we determine the dimension of certain special divisors supported on P 1,P 2,P 3 , as well as an explicit description of all pure gaps at any subset of P 1,P 2,P 3 . When mathbb K overline mathbb F q , this class of curves, which includes the Hermitian curve, is used to construct algebraic geometry codes having minimum distance better than the Goppa bound.


Low latency allcast over broadcast erasure channels. Consider n nodes communicating over an unreliable broadcast channel. Each node has a single packet that needs to be communicated to all other nodes. Time is slotted, and a time slot is long enough for each node to broadcast one packet. Each broadcast reaches a random subset of nodes. The objective is to minimise the time until all nodes have received all packets. We study two schemes, (i) random relaying, and (ii) random linear network coding, and analyse their performance in an asymptotic regime in which n tends to infinity. Simulation results for a wide range of n are also presented.


Painless step size adaptation for SGD. Convergence and generalization are two crucial aspects of performance in neural networks. When analyzed separately, these properties may lead to contradictory results. Optimizing a convergence rate yields fast training, but does not guarantee the best generalization error. To avoid the conflict, recent studies suggest adopting a moderately large step size for optimizers, but the added value on the performance remains unclear. We propose the LIGHT function with the four configurations which regulate explicitly an improvement in convergence and generalization on testing. This contribution allows to 1) improve both convergence and generalization of neural networks with no need to guarantee their stability 2) build more reliable and explainable network architectures with no need for overparameterization. We refer to it as "painless" step size adaptation.


Machine Learning versus Mathematical Model to Estimate the Transverse Shear Stress Distribution in a Rectangular Channel. One of the most important subjects of hydraulic engineering is the reliable estimation of the transverse distribution in the rectangular channel of bed and wall shear stresses. This study makes use of the Tsallis entropy, genetic programming (GP) and adaptive neuro fuzzy inference system (ANFIS) methods to assess the shear stress distribution (SSD) in the rectangular channel. To evaluate the results of the Tsallis entropy, GP and ANFIS models, laboratory observations were used in which shear stress was measured using an optimized Preston tube. This is then used to measure the SSD in various aspect ratios in the rectangular channel. To investigate the shear stress percentage, 10 data series with a total of 112 different data were used. The results of the sensitivity analysis show that the most influential parameter for the SSD in a smooth rectangular channel is the dimensionless parameter B H, Where the transverse coordinate is B, and the flow depth is H. With the parameters (b B), (B H) for the bed and (z H), (B H) for the wall as inputs, the modeling of the GP was better than the other one. Based on the analysis, it can be concluded that the use of GP and ANFIS algorithms is more effective in estimating shear stress in smooth rectangular channels than the Tsallis entropy based equations.


Towards Axiomatic Explanations for Neural Ranking Models. Recently, neural networks have been successfully employed to improve upon state of the art performance in ad hoc retrieval tasks via machine learned ranking functions. While neural retrieval models grow in complexity and impact, little is understood about their correspondence with well studied IR principles. Recent work on interpretability in machine learning has provided tools and techniques to understand neural models in general, yet there has been little progress towards explaining ranking models. We investigate whether one can explain the behavior of neural ranking models in terms of their congruence with well understood principles of document ranking by using established theories from axiomatic IR. Axiomatic analysis of information retrieval models has formalized a set of constraints on ranking decisions that reasonable retrieval models should fulfill. We operationalize this axiomatic thinking to reproduce rankings based on combinations of elementary constraints. This allows us to investigate to what extent the ranking decisions of neural rankers can be explained in terms of retrieval axioms, and which axioms apply in which situations. Our experimental study considers a comprehensive set of axioms over several representative neural rankers. While the existing axioms can already explain the particularly confident ranking decisions rather well, future work should extend the axiom set to also cover the other still "unexplainable" neural IR rank decisions.


gaBERT an Irish Language Model. The BERT family of neural language models have become highly popular due to their ability to provide sequences of text with rich context sensitive token encodings which are able to generalise well to many Natural Language Processing tasks. Over 120 monolingual BERT models covering over 50 languages have been released, as well as a multilingual model trained on 104 languages. We introduce, gaBERT, a monolingual BERT model for the Irish language. We compare our gaBERT model to multilingual BERT and show that gaBERT provides better representations for a downstream parsing task. We also show how different filtering criteria, vocabulary size and the choice of subword tokenisation model affect downstream performance. We release gaBERT and related code to the community.


Transfer Learning for Sequence Generation from Single source to Multi source. Multi source sequence generation (MSG) is an important kind of sequence generation tasks that takes multiple sources, including automatic post editing, multi source translation, multi document summarization, etc. As MSG tasks suffer from the data scarcity problem and recent pretrained models have been proven to be effective for low resource downstream tasks, transferring pretrained sequence to sequence models to MSG tasks is essential. Although directly finetuning pretrained models on MSG tasks and concatenating multiple sources into a single long sequence is regarded as a simple method to transfer pretrained models to MSG tasks, we conjecture that the direct finetuning method leads to catastrophic forgetting and solely relying on pretrained self attention layers to capture cross source information is not sufficient. Therefore, we propose a two stage finetuning method to alleviate the pretrain finetune discrepancy and introduce a novel MSG model with a fine encoder to learn better representations in MSG tasks. Experiments show that our approach achieves new state of the art results on the WMT17 APE task and multi source translation task using the WMT14 test set. When adapted to document level translation, our framework outperforms strong baselines significantly.


Time Critical Tasks Implementation in MEC based Multi Robot Cooperation Systems. Mobile edge computing (MEC) deployment in a multi robot cooperation (MRC) system is an effective way to accomplish the tasks in terms of energy consumption and implementation latency. However, the computation and communication resources need to be considered jointly to fully exploit the advantages brought by the MEC technology. In this paper, the scenario where multi robots cooperate to accomplish the time critical tasks is studied, where an intelligent master robot (MR) acts as an edge server to provide services to multiple slave robots (SRs) and the SRs are responsible for the environment sensing and data collection. To save energy and prolong the function time of the system, two schemes are proposed to optimize the computation and communication resources, respectively. In the first scheme, the energy consumption of SRs is minimized and balanced while guaranteeing that the tasks are accomplished under a time constraint. In the second scheme, not only the energy consumption, but also the remaining energies of the SRs are considered to enhance the robustness of the system. Through the analysis and numerical simulations, we demonstrate that even though the first policy may guarantee the minimization on the total SRs' energy consumption, the function time of MRC system by the second scheme is longer than that by the first one.


Projection A Mechanism for Human like Reasoning in Artificial Intelligence. Artificial Intelligence systems cannot yet match human abilities to apply knowledge to situations that vary from what they have been programmed for, or trained for. In visual object recognition methods of inference exploiting top down information (from a model) have been shown to be effective for recognising entities in difficult conditions. Here this type of inference, called projection', is shown to be a key mechanism to solve the problem of applying knowledge to varied or challenging situations, across a range of AI domains, such as vision, robotics, or language. Finally the relevance of projection to tackling the commonsense knowledge problem is discussed.


Modeling Pedagogical Learning Environment with Hybrid Model based on ICT. Pedagogy is a method that handles the ethos and culture of instruction from educators and the learning of learners. Pedagogy of Information and Communications Technology (ICT) refers to the interactions among the teacher, children, and learning environment based on ICT. It is a discipline that deals with the theory and practice of teaching strategies, teaching actions, teaching judgments, and decisions. It is also the understanding and needs of students as well as the background and interests of an individual one. In this paper, we have designed the pedagogical learning environment from the perspective of ICT education. In our methodology of the pedagogy for ICT, education includes the interaction among different elements. The methodology improves to propagate convenience differently into the educational environment. We are also building a hybrid model for the ICT development program. The hybrid model represents the combination of standards, stages, year level, and class level as well as brings it into one umbrella. We have constructed the pedagogical learning environment theoretically from the perspective of ICT education to the consideration of outcome based ICT learning. Outcome based education is a fundamental element for building any nation completely around the globe.


Making Table Understanding Work in Practice. Understanding the semantics of tables at scale is crucial for tasks like data integration, preparation, and search. Table understanding methods aim at detecting a table's topic, semantic column types, column relations, or entities. With the rise of deep learning, powerful models have been developed for these tasks with excellent accuracy on benchmarks. However, we observe that there exists a gap between the performance of these models on these benchmarks and their applicability in practice. In this paper, we address the question what do we need for these models to work in practice? We discuss three challenges of deploying table understanding models and propose a framework to address them. These challenges include 1) difficulty in customizing models to specific domains, 2) lack of training data for typical database tables often found in enterprises, and 3) lack of confidence in the inferences made by models. We present SigmaTyper which implements this framework for the semantic column type detection task. SigmaTyper encapsulates a hybrid model trained on GitTables and integrates a lightweight human in the loop approach to customize the model. Lastly, we highlight avenues for future research that further close the gap towards making table understanding effective in practice.


A Random Algorithm for Profit Maximization with Multiple Adoptions in Online Social Networks. Online social networks have been one of the most effective platforms for marketing and advertising. Through "word of mouth" effects, information or product adoption could spread from some influential individuals to millions of users in social networks. Given a social network G and a constant k , the influence maximization problem seeks for k nodes in G that can influence the largest number of nodes. This problem has found important applications, and a large amount of works have been devoted to identifying the few most influential users. But most of existing works only focus on the diffusion of a single idea or product in social networks. However, in reality, one company may produce multiple kinds of products and one user may also have multiple adoptions. Given multiple kinds of different products with different activation costs and profits, it is crucial for the company to distribute the limited budget among multiple products in order to achieve profit maximization. Profit Maximization with Multiple Adoptions (PM 2 A) problem aims to seek for a seed set within the budget to maximize the overall profit. In this paper, a Randomized Modified Greedy (RMG) algorithm based on the Reverse Influence Sampling (RIS) technique is presented for the PM 2 A problem, which could achieve a (1 1 e varepsilon) approximate solution with high probability. Compared with the algorithm proposed in 16 that achieves a frac 1 2 (1 1 e 2 ) approximate solution, our algorithm provides a better performance ratio which is also the best performance ratio of the PM 2 A problem. Comprehensive experiments on three real world social networks are conducted, and the results demonstrate that our RMG algorithm outperforms the algorithm proposed in 16 and other heuristics in terms of profit maximization, and could better allocate the budget.


Snakes combine vertical and lateral bending to traverse uneven terrain. Terrestrial locomotion requires generating appropriate ground reaction forces which depend on substrate geometry and physical properties. The richness of positions and orientations of terrain features in the 3 D world gives limbless animals like snakes that can bend their body versatility to generate forces from different contact areas for propulsion. Despite many previous studies of how snakes use lateral body bending for propulsion on relatively flat surfaces with lateral contact points, little is known about whether and how much snakes use vertical body bending in combination with lateral bending in 3 D terrain. This lack had contributed to snake robots being inferior to animals in stability, efficiency, and versatility when traversing complex 3 D environments. Here, to begin to elucidate this, we studied how the generalist corn snake traversed an uneven arena of blocks of random height variation 5 times its body height. The animal traversed the uneven terrain with perfect stability by propagating 3 D bending down its body with little transverse motion (11 deg slip angle). Although the animal preferred moving through valleys with higher neighboring blocks, it did not prefer lateral bending. Among body terrain contact regions that potentially provide propulsion, 52 were formed by vertical body bending and 48 by lateral bending. The combination of vertical and lateral bending may dramatically expand the sources of propulsive forces available to limbless locomotors by utilizing various asperities available in 3 D terrain. Direct measurements of contact forces are necessary to further understand how snakes coordinate 3 D bending along the entire body via sensory feedback to propel through 3 D terrain. These studies will open a path to new propulsive mechanisms for snake robots, potentially increasing the performance and versatility in 3 D terrain.


Double framed moduli spaces of quiver representations. Motivated by problems in the neural networks setting, we study moduli spaces of double framed quiver representations and give both a linear algebra description and a representation theoretic description of these moduli spaces. We define a network category whose isomorphism classes of objects correspond to the orbits of quiver representations, in which neural networks map input data. We then prove that the output of a neural network depends only on the corresponding point in the moduli space. Finally, we present a different perspective on mapping neural networks with a specific activation function, called ReLU, to a moduli space using the symplectic reduction approach to quiver moduli.