Learning Transferable 3D Adversarial Cloaks for Deep Trained Detectors. This paper presents a novel patch based adversarial attack pipeline that trains adversarial patches on 3D human meshes. We sample triangular faces on a reference human mesh, and create an adversarial texture atlas over those faces. The adversarial texture is transferred to human meshes in various poses, which are rendered onto a collection of real world background images. Contrary to the traditional patch based adversarial attacks, where prior work attempts to fool trained object detectors using appended adversarial patches, this new form of attack is mapped into the 3D object world and back propagated to the texture atlas through differentiable rendering. As such, the adversarial patch is trained under deformation consistent with real world materials. In addition, and unlike existing adversarial patches, our new 3D adversarial patch is shown to fool state of the art deep object detectors robustly under varying views, potentially leading to an attacking scheme that is persistently strong in the physical world.


A note on banded linear systems. In 2 a new factorization for infinite Hessenberg banded matrices was introduced. In this note we prove that this kind of factorization can also be used for finite matrices. In addition, a new method for solving banded linear systems is provided.


Two layer neural networks with values in a Banach space. We study two layer neural networks whose domain and range are Banach spaces with separable preduals. In addition, we assume that the image space is equipped with a partial order, i.e. it is a Riesz space. As the nonlinearity we choose the lattice operation of taking the positive part in case of mathbb R d valued neural networks this corresponds to the ReLU activation function. We prove inverse and direct approximation theorems with Monte Carlo rates, extending existing results for the finite dimensional case. In the second part of the paper, we consider training such networks using a finite amount of noisy observations from the regularisation theory viewpoint. We discuss regularity conditions known as source conditions and obtain convergence rates in a Bregman distance in the regime when both the noise level goes to zero and the number of samples goes to infinity at appropriate rates.


Efficient and Local Parallel Random Walks. Random walks are a fundamental primitive used in many machine learning algorithms with several applications in clustering and semi supervised learning. Despite their relevance, the first efficient parallel algorithm to compute random walks has been introduced very recently (Lacki et al.). Unfortunately their method has a fundamental shortcoming their algorithm is non local in that it heavily relies on computing random walks out of all nodes in the input graph, even though in many practical applications one is interested in computing random walks only from a small subset of nodes in the graph. In this paper, we present a new algorithm that overcomes this limitation by building random walk efficiently and locally at the same time. We show that our technique is both memory and round efficient, and in particular yields an efficient parallel local clustering algorithm. Finally, we complement our theoretical analysis with experimental results showing that our algorithm is significantly more scalable than previous approaches.


On the derived category of the adjoint Grassmannian of type F. We construct a full rectangular Lefschetz collection in the derived category of the adjoint Grassmannian in type mathrm F 4 . This gives the first example of a full exceptional collection on this variety and also completes the proof of a conjecture due to Alexander Kuznetsov and the author that relates the structure of the derived category of coherent sheaves to the small quantum cohomology in the case of adjoint varieties for non simply laced groups.


Submodular Mutual Information for Targeted Data Subset Selection. With the rapid growth of data, it is becoming increasingly difficult to train or improve deep learning models with the right subset of data. We show that this problem can be effectively solved at an additional labeling cost by targeted data subset selection(TSS) where a subset of unlabeled data points similar to an auxiliary set are added to the training data. We do so by using a rich class of Submodular Mutual Information (SMI) functions and demonstrate its effectiveness for image classification on CIFAR 10 and MNIST datasets. Lastly, we compare the performance of SMI functions for TSS with other state of the art methods for closely related problems like active learning. Using SMI functions, we observe 20 30 gain over the model's performance before re training with added targeted subset 12 more than other methods.


How to Identify Investor's types in real financial markets by means of agent based simulation. The paper proposes a computational adaptation of the principles underlying principal component analysis with agent based simulation in order to produce a novel modeling methodology for financial time series and financial markets. Goal of the proposed methodology is to find a reduced set of investor s models (agents) which is able to approximate or explain a target financial time series. As computational testbed for the study, we choose the learning system L FABS which combines simulated annealing with agent based simulation for approximating financial time series. We will also comment on how L FABS s architecture could exploit parallel computation to scale when dealing with massive agent simulations. Two experimental case studies showing the efficacy of the proposed methodology are reported.


Sufficient optimality conditions for a separable product quasiconcave programming. In mathematical economics, the used functions are, in general, considered to be quasiconcave. Moreover, they are, in many cases, separable of nature. It is known that a local maximum of a quasiconcave function is not, in general, a global maximum. In this paper we will show that this property is true when the quasiconcave function is furthermore separable. Sufficient optimality conditions for a separable quasiconcave programming will be studied in both differentiable and nondifferentiable cases. Thanks to separability condition, quasiconcave functions have nice properties in optimization problems.


Geometric theory of meromorphic functions. This is a survey of results on the following problem. Consider a simply connected Riemann surface spread over the Riemann sphere. How are the properties of the uniformizing function of this surface related to the geometric properties of the surface? Based on the lecture in U. Michigan in May 2006.


Enabling News Consumers to View and Understand Biased News Coverage A Study on the Perception and Visualization of Media Bias. Traditional media outlets are known to report political news in a biased way, potentially affecting the political beliefs of the audience and even altering their voting behaviors. Many researchers focus on automatically detecting and identifying media bias in the news, but only very few studies exist that systematically analyze how theses biases can be best visualized and communicated. We create three manually annotated datasets and test varying visualization strategies. The results show no strong effects of becoming aware of the bias of the treatment groups compared to the control group, although a visualization of hand annotated bias communicated bias instances more effectively than a framing visualization. Showing participants an overview page, which opposes different viewpoints on the same topic, does not yield differences in respondents' bias perception. Using a multilevel model, we find that perceived journalist bias is significantly related to perceived political extremeness and impartiality of the article.


Spin electron acoustic waves and solitons in high density degenerate relativistic plasmas. The spin electron acoustic waves (sometimes called the spin plasmons) can be found in degenerate electron gas if the spin up electrons and spin down electrons move relatively each other. Here, we suggest relativistic hydrodynamics with the separate spin evolution which allows us to study linear and nonlinear spin electron acoustic waves, including the spin electron acoustic solitons. Presented hydrodynamic model is the corresponding generalization of the relativistic hydrodynamic model with the average reverse gamma factor evolution which consists of the equations for evolution of the following functions the partial concentrations (for spin up electrons and spin down electrons), the partial velocity fields, the partial average reverse relativistic gamma factors, and the partial flux of the reverse relativistic gamma factors. We find that the relativistic effects decreases the phase velocity of spin electron acoustic waves. Numerical analysis of the changes of spectra of Langmuir wave, spin electron acoustic wave, and ion acoustic wave under the change of the spin polarization of electrons is presented. It is demonstrated that spectra of Langmuir wave and spin electron acoustic wave getting closer to each other in the relativistic limit. Spin dependence of the amplitude and width of the relativistic spin electron acoustic soliton is demonstrated as well. Reformation of the bright soliton of potential of the electric field into the dark soliton under the influence of the relativistic effects is found.


A strongly coupled immersed boundary method for fluid structure interaction that mimics the efficiency of stationary body methods. Strongly coupled immersed boundary (IB) methods solve the nonlinear fluid and structural equations of motion simultaneously for strongly enforcing the no slip constraint on the body. Handling this constraint requires solving several large dimensional systems that scale by the number of grid points in the flow domain even though the nonlinear constraints scale only by the small number of points used to represent the fluid structure interface. These costly large scale operations for determining only a small number of unknowns at the interface creates a bottleneck to efficiently time advancing strongly coupled IB methods. In this manuscript, we present a remedy for this bottleneck that is motivated by the efficient strategy employed in stationary body IB methods while preserving the favorable stability properties of strongly coupled algorithms we precompute a matrix that encapsulates the large dimensional system so that the prohibitive large scale operations need not be performed at every time step. This precomputation process yields a modified system of small dimensional constraint equations that is solved at minimal computational cost while time advancing the equations. We also present a parallel implementation that scales favorably across multiple processors. The accuracy, computational efficiency and scalability of our approach are demonstrated on several two dimensional flow problems. Although the demonstration problems consist of a combination of rigid and torsionally mounted bodies, the formulation is derived in a more general setting involving an arbitrary number of rigid, torsionally mounted, and continuously deformable bodies.


Discriminative Domain Invariant Adversarial Network for Deep Domain Generalization. Domain generalization approaches aim to learn a domain invariant prediction model for unknown target domains from multiple training source domains with different distributions. Significant efforts have recently been committed to broad domain generalization, which is a challenging and topical problem in machine learning and computer vision communities. Most previous domain generalization approaches assume that the conditional distribution across the domains remain the same across the source domains and learn a domain invariant model by minimizing the marginal distributions. However, the assumption of a stable conditional distribution of the training source domains does not really hold in practice. The hyperplane learned from the source domains will easily misclassify samples scattered at the boundary of clusters or far from their corresponding class centres. To address the above two drawbacks, we propose a discriminative domain invariant adversarial network (DDIAN) for domain generalization. The discriminativeness of the features are guaranteed through a discriminative feature module and domain invariant features are guaranteed through the global domain and local sub domain alignment modules. Extensive experiments on several benchmarks show that DDIAN achieves better prediction on unseen target data during training compared to state of the art domain generalization approaches.


Simplicial affine semigroups with monomial minimal reduction ideals. We characterize when the monomial maximal ideal of a simplicial affine semigroup ring has a monomial minimal reduction. When this is the case, we study the Cohen Macaulay and Gorenstein properties of the associated graded ring and provide several bounds for the reduction number with respect to the monomial minimal reduction.


Phase field model for phagocytosis dynamics. The basic process of the innate immune system when phagocyte (white blood cell) engulf or swallow a target particle (bacterium or dead cell), is called phagocytosis. We apply the phase field approach in the spirit of 1 , that couples the order parameter u with 3D polarization (orientation) vector field textbf P of the actin network of the phagocyte cytoskeleton. We derive a single closed scalar integro differential equation governing the 3D phagocyte membrane dynamics during bead engulfment, which includes the normal velocity of the membrane, curvature, volume relaxation rate, a function determined by the molecular effects of the subcell level, and the adhesion effect of the motionless rigid spherical bead. This equation is easily solved numerically. The simulation manifests the pedestal and the cup phases but not the final complete bead internalization.


Medical Information Retrieval and Interpretation A Question Answer based Interaction Model. The Internet has become a very powerful platform where diverse medical information are expressed daily. Recently, a huge growth is seen in searches like symptoms, diseases, medicines, and many other health related queries around the globe. The search engines typically populate the result by using the single query provided by the user and hence reaching to the final result may require a lot of manual filtering from the user's end. Current search engines and recommendation systems still lack real time interactions that may provide more precise result generation. This paper proposes an intelligent and interactive system tied up with the vast medical big data repository on the web and illustrates its potential in finding medical information.


Federated Graph Learning A Position Paper. Graph neural networks (GNN) have been successful in many fields, and derived various researches and applications in real industries. However, in some privacy sensitive scenarios (like finance, healthcare), training a GNN model centrally faces challenges due to the distributed data silos. Federated learning (FL) is a an emerging technique that can collaboratively train a shared model while keeping the data decentralized, which is a rational solution for distributed GNN training. We term it as federated graph learning (FGL). Although FGL has received increasing attention recently, the definition and challenges of FGL is still up in the air. In this position paper, we present a categorization to clarify it. Considering how graph data are distributed among clients, we propose four types of FGL inter graph FL, intra graph FL and graph structured FL, where intra graph is further divided into horizontal and vertical FGL. For each type of FGL, we make a detailed discussion about the formulation and applications, and propose some potential challenges.


The stationary distribution of reflected Brownian motion in a wedge differential properties. We consider a semimartingale reflected Brownian motion (SRBM) in a two dimensional wedge. Under standard assumptions on the parameters of the model (opening of the wedge, angles of the reflections on the axes, drift), we study the algebraic and differential nature of the Laplace transform of its stationary distribution. We derive necessary and sufficient conditions for this Laplace transform to be rational, algebraic, differentially finite or more generally differentially algebraic. These conditions are explicit linear dependencies among the angles involved in the definition of the model. A complicated integral expression is known for this Laplace transform. In the differentially algebraic case, we go further and provide an explicit, integral free expression. In particular, we obtain new derivations of the Laplace transform in several well known cases, namely the skew symmetric case, the orthogonal reflections case and the sum of exponential densities case (corresponding to the so called Dieker Moriarty conditions on the parameters). To prove these results, we start from a functional equation that the Laplace transform satisfies, to which we apply tools from diverse horizons. To establish differential algebraicity, a key ingredient is Tutte's invariant approach, which originates in enumerative combinatorics. It allows us to express the Laplace transform (or its square) as a rational function of a certain canonical invariant, a hypergeometric function in our context. To establish differential transcendence, we turn the functional equation into a difference equation and apply Galoisian results on the nature of the solutions to such equations.


Floor, ceiling, slopes, and K theory. In this note we calculate mathrm K (k x x e, (x) mathbf Z p) using the mathbf Z p(i) complexes introduced by Bhatt Morrow Scholze and Bhatt Scholze, recovering calculations of Hesselholt Madsen and Speirs. This generalizes an example of Mathew which treats the case e 2 and p 2 . Our main innovation is systematic use of the floor and ceiling functions, which clarifies matters substantially even for e 2 . As an application, we answer some questions of Hesselholt.


Multi dimensional wave steering with higher order topological phononic crystal. The recent discovery and realizations of higher order topological insulators enrich the fundamental studies on topological phases. Here, we report three dimensional (3D) wave steering capabilities enabled by topological boundary states at three different orders in a 3D phononic crystal with nontrivial bulk topology originated from the synergy of mirror symmetry of the unit cell and a non symmorphic glide symmetry of the lattice. The multitude of topological states brings diverse possibility of wave manipulations. Through judicious engineering of the boundary modes, we experimentally demonstrate two functionalities at different dimensions 2D negative refraction of sound wave enabled by a first order topological surface state with negative dispersion, and a 3D acoustic interferometer leveraging on second order topological hinge states. Our work showcases that topological modes at different orders promise diverse wave steering applications across different dimensions.


Operator Splitting for Adaptive Radiation Therapy with Nonlinear Health Dynamics. We present an optimization based approach to radiation treatment planning over time. Our approach formulates treatment planning as an optimal control problem with nonlinear patient health dynamics derived from the standard linear quadratic cell survival model. As the formulation is nonconvex, we propose a method for obtaining an approximate solution by solving a sequence of convex optimization problems. This method is fast, efficient, and robust to model error, adapting readily to changes in the patient's health between treatment sessions. Moreover, we show that it can be combined with the operator splitting method ADMM to produce an algorithm that is highly scalable and can handle large clinical cases. We introduce an open source Python implementation of our algorithm, AdaRad, and demonstrate its performance on several examples.


An Automated Method to Enrich Consumer Health Vocabularies Using GloVe Word Embeddings and An Auxiliary Lexical Resource. Background Clear language makes communication easier between any two parties. A layman may have difficulty communicating with a professional due to not understanding the specialized terms common to the domain. In healthcare, it is rare to find a layman knowledgeable in medical terminology which can lead to poor understanding of their condition and or treatment. To bridge this gap, several professional vocabularies and ontologies have been created to map laymen medical terms to professional medical terms and vice versa. Objective Many of the presented vocabularies are built manually or semi automatically requiring large investments of time and human effort and consequently the slow growth of these vocabularies. In this paper, we present an automatic method to enrich laymen's vocabularies that has the benefit of being able to be applied to vocabularies in any domain. Methods Our entirely automatic approach uses machine learning, specifically Global Vectors for Word Embeddings (GloVe), on a corpus collected from a social media healthcare platform to extend and enhance consumer health vocabularies (CHV). Our approach further improves the CHV by incorporating synonyms and hyponyms from the WordNet ontology. The basic GloVe and our novel algorithms incorporating WordNet were evaluated using two laymen datasets from the National Library of Medicine (NLM), Open Access Consumer Health Vocabulary (OAC CHV) and MedlinePlus Healthcare Vocabulary. Results The results show that GloVe was able to find new laymen terms with an F score of 48.44 . Furthermore, our enhanced GloVe approach outperformed basic GloVe with an average F score of 61 , a relative improvement of 25 . Furthermore, the enhanced GloVe showed a statistical significance over the two ground truth datasets with P .001.


From the Sigma type to the Grothendieck construction. We translate properties of the Sigma type in Martin L "of Type Theory (MLTT) to properties of the Grothendieck construction in category theory. Namely, equivalences in MLTT that involve the Sigma type motivate isomorphisms between corresponding categories that involve the Grothendieck construction. The type theoretic axiom of choice and the "associativity" of the Sigma type are the main examples of this phenomenon that are treated here.


Reading Task Classification Using EEG and Eye Tracking Data. The Zurich Cognitive Language Processing Corpus (ZuCo) provides eye tracking and EEG signals from two reading paradigms, normal reading and task specific reading. We analyze whether machine learning methods are able to classify these two tasks using eye tracking and EEG features. We implement models with aggregated sentence level features as well as fine grained word level features. We test the models in within subject and cross subject evaluation scenarios. All models are tested on the ZuCo 1.0 and ZuCo 2.0 data subsets, which are characterized by differing recording procedures and thus allow for different levels of generalizability. Finally, we provide a series of control experiments to analyze the results in more detail.


Triple Ladder Lumped Circuit with Sixth Order Modal Exceptional Degeneracy. We introduce a circuit topology based on a simple triple ladder circuit realized with lumped reactive components that provides a sixth order degenerate band edge (6DBE). The 6DBE is a special kind of sixth order exceptional point of degeneracy in a lossless and gainless periodic ladder. This degeneracy provides a very flat band edge in the phase frequency dispersion diagram. The proposed topology exhibits unique structured resonance features associated with a high loaded Q factor. We investigate the Floquet Bloch modes in an infinite length periodic triple ladder and their dispersion relation using the S parameter formalism. We also provide the approximate analytic expressions of the eigenmodes and dispersion relation around the degenerate point based on the Puiseux series expansion. We investigate the filtering characteristics of a finite length structure terminated with loads to highlight the special properties of the 6DBE compared to ladders with regular band edge (RBE) and fourth order degenerate band edge (DBE). The circuit framework introduced here with a 6DBE can be exploited in designing novel high Q factor oscillators, filters, sensors, and pulse shaping networks.


Inverse Problems Leveraging Pre trained Contrastive Representations. We study a new family of inverse problems for recovering representations of corrupted data. We assume access to a pre trained representation learning network R(x) that operates on clean images, like CLIP. The problem is to recover the representation of an image R(x), if we are only given a corrupted version A(x), for some known forward operator A. We propose a supervised inversion method that uses a contrastive objective to obtain excellent representations for highly corrupted images. Using a linear probe on our robust representations, we achieve a higher accuracy than end to end supervised baselines when classifying images with various types of distortions, including blurring, additive noise, and random pixel masking. We evaluate on a subset of ImageNet and observe that our method is robust to varying levels of distortion. Our method outperforms end to end baselines even with a fraction of the labeled data in a wide range of forward operators.


On the edge dimension and fractional edge dimension of graphs. Let G be a graph with vertex set V(G) and edge set E(G) , and let d(u,w) denote the length of a u w geodesic in G . For any v in V(G) and e xy in E(G) , let d(e,v) min d(x,v),d(y,v) . For distinct e 1, e 2 in E(G) , let R e 1,e 2 z in V(G) d(z,e 1) neq d(z,e 2) . Kelenc et al. Discrete Appl. Math. 251 (2018) 204 220 introduced the edge dimension of a graph A vertex subset S subseteq V(G) is an edge resolving set of G if S cap R e 1,e 2 ge 1 for any distinct e 1, e 2 in E(G) , and the edge dimension edim(G) of G is the minimum cardinality among all edge resolving sets of G . For a real valued function g defined on V(G) and for U subseteq V(G) , let g(U) sum s in U g(s) . Then g V(G) rightarrow 0,1 is an edge resolving function of G if g(R e 1,e 2 ) ge1 for any distinct e 1,e 2 in E(G) . The fractional edge dimension edim f(G) of G is min g(V(G)) g mbox is an edge resolving function of G . Note that edim f(G) reduces to edim(G) if the codomain of edge resolving functions is restricted to 0,1 . We introduce and study fractional edge dimension and obtain some general results on the edge dimension of graphs. We show that there exist two non isomorphic graphs on the same vertex set with the same edge metric coordinates. We construct two graphs G and H such that H subset G and both edim(H) edim(G) and edim f(H) edim f(G) can be arbitrarily large. We show that a graph G with edim(G) 2 cannot have K 5 or K 3,3 as a subgraph, and we construct a non planar graph H satisfying edim(H) 2 . It is easy to see that, for any connected graph G of order n ge3 , 1 le edim f(G) le frac n 2 we characterize graphs G satisfying edim f(G) 1 and examine some graph classes satisfying edim f(G) frac n 2 . We also determine the fractional edge dimension for some classes of graphs.


Measuring obscured OAM spectrum using Stokes fluctuations. A novel technique to measure the orbital angular momentum (OAM) spectrum of the beam obscured by a complex random media is proposed and experimentally demonstrated. This is realized by measuring the complex correlation polarization function (CPCF) with the help of a two point Stokes fluctuations correlation of the random light. The OAM spectrum analysis is implemented by projecting a complex field of the CPCF into spiral harmonics. A detailed theoretical framework is developed to measure complex amplitude and to decompose different integer OAM states of the obscured beam. The developed theoretical framework is verified by numerical simulation and tested by experimental demonstration of OAM mode compositions of the fractional optical vortex (FOV) beam.


On the Epstein zeta function and the zeros of a class of Dirichlet series. By generalizing the classical Selberg Chowla formula, we establish the analytic continuation and functional equation for a large class of Epstein zeta functions. This continuation is studied in order to provide new classes of theorems regarding the distribution of zeros of Dirichlet series in their critical lines and to produce a new method for the study of these problems. Due to the symmetries provided by the representation via the Selberg Chowla formula, some generalizations of well known formulas in analytic number theory are also deduced as examples.


Discussion Tracker Supporting Teacher Learning about Students' Collaborative Argumentation in High School Classrooms. Teaching collaborative argumentation is an advanced skill that many K 12 teachers struggle to develop. To address this, we have developed Discussion Tracker, a classroom discussion analytics system based on novel algorithms for classifying argument moves, specificity, and collaboration. Results from a classroom deployment indicate that teachers found the analytics useful, and that the underlying classifiers perform with moderate to substantial agreement with humans.


Multi source Pseudo label Learning of Semantic Segmentation for the Scene Recognition of Agricultural Mobile Robots. This paper describes a novel method of training a semantic segmentation model for scene recognition of agricultural mobile robots exploiting publicly available datasets of outdoor scenes that are different from the target greenhouse environments. Semantic segmentation models require abundant labels given by tedious manual annotation. A method to work around it is unsupervised domain adaptation (UDA) that transfers knowledge from labeled source datasets to unlabeled target datasets. However, the effectiveness of existing methods is not well studied in adaptation between heterogeneous environments, such as urban scenes and greenhouses. In this paper, we propose a method to train a semantic segmentation model for greenhouse images without manually labeled datasets of greenhouse images. The core of our idea is to use multiple rich image datasets of different environments with segmentation labels to generate pseudo labels for the target images to effectively transfer the knowledge from multiple sources and realize a precise training of semantic segmentation. Along with the pseudo label generation, we introduce state of the art methods to deal with noise in the pseudo labels to further improve the performance. We demonstrate in experiments with multiple greenhouse datasets that our proposed method improves the performance compared to the single source baselines and an existing approach.


Contrastive Learning from Extremely Augmented Skeleton Sequences for Self supervised Action Recognition. In recent years, self supervised representation learning for skeleton based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to construct similar positive samples, which limits the ability to explore novel movement patterns. In this paper, to make better use of the movement patterns introduced by extreme augmentations, a Contrastive Learning framework utilizing Abundant Information Mining for self supervised action Representation (AimCLR) is proposed. First, the extreme augmentations and the Energy based Attention guided Drop Module (EADM) are proposed to obtain diverse positive samples, which bring novel movement patterns to improve the universality of the learned representations. Second, since directly using extreme augmentations may not be able to boost the performance due to the drastic changes in original identity, the Dual Distributional Divergence Minimization Loss (D 3 M Loss) is proposed to minimize the distribution divergence in a more gentle way. Third, the Nearest Neighbors Mining (NNM) is proposed to further expand positive samples to make the abundant information mining process more reasonable. Exhaustive experiments on NTU RGB D 60, PKU MMD, NTU RGB D 120 datasets have verified that our AimCLR can significantly perform favorably against state of the art methods under a variety of evaluation protocols with observed higher quality action representations. Our code is available at https github.com Levigty AimCLR.


Classifying COVID 19 Spike Sequences from Geographic Location Using Deep Learning. With the rapid spread of COVID 19 worldwide, viral genomic data is available in the order of millions of sequences on public databases such as GISAID. This emph Big Data creates a unique opportunity for analysis towards the research of effective vaccine development for current pandemics, and avoiding or mitigating future pandemics. One piece of information that comes with every such viral sequence is the geographical location where it was collected the patterns found between viral variants and geographic location surely being an important part of this analysis. One major challenge that researchers face is processing such huge, highly dimensional data to get useful insights as quickly as possible. Most of the existing methods face scalability issues when dealing with the magnitude of such data. In this paper, we propose an algorithm that first computes a numerical representation of the spike protein sequence of SARS CoV 2 using k mers substrings) and then uses a deep learning based model to classify the sequences in terms of geographical location. We show that our proposed model significantly outperforms the baselines. We also show the importance of different amino acids in the spike sequences by computing the information gain corresponding to the true class labels.


fastball A fast algorithm to sample bipartite graphs with fixed degree sequences. Many applications require randomly sampling bipartite graphs with fixed degrees, or randomly sampling incidence matrices with fixed row and column sums. Although several algorithms to perform this sampling have been proposed, the "curveball" algorithm is the most efficient, running in O(n log n) time, and has been proven to sample uniformly at random. In this paper, we introduce the "fastball" algorithm, which adopts a similar approach but runs in O(n) time. We show that fastball allows the random sampling of large bipartite graphs with fixed degrees roughly five times faster than curveball.


Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic. Natural language inference (NLI) aims to determine the logical relationship between two sentences among the target labels Entailment, Contradiction, and Neutral. In recent years, deep learning models have become a prevailing approach to NLI, but they lack interpretability and explainability. In this work, we address the explainability for NLI by weakly supervised logical reasoning, and propose an Explainable Phrasal Reasoning (EPR) approach. Our model first detects phrases as the semantic unit and aligns corresponding phrases. Then, the model predicts the NLI label for the aligned phrases, and induces the sentence label by fuzzy logic formulas. Our EPR is almost everywhere differentiable and thus the system can be trained end to end in a weakly supervised manner. We annotated a corpus and developed a set of metrics to evaluate phrasal reasoning. Results show that our EPR yields much more meaningful explanations in terms of F scores than previous studies. To the best of our knowledge, we are the first to develop a weakly supervised phrasal reasoning model for the NLI task.


Secure Charging and Payment System for Electric Land Vehicles with Authentication Protocol. It is obvious that fossil fuels are a limited resource and will be replaced by other energy sources in the future considering economic and en vironmental problems. Electricity comes to the forefront among the sources that are candidates to replace fossil fuels. In the near future, electric land, air and sea vehicles will start to take more place in daily life. For this reason, systems for the charging systems of these devices and post charge payments have been developed. There is no general standard on this issue yet. In this study, a charge and payment system, which is safe against known cyber attacks for use in electric land ve hicles, and which prioritizes privacy, is proposed. A system has been proposed to verify each other wired or wirelessly with an authentication protocol, where the data communication is encrypted, and the payment transactions are performed securely and invoiced to the vehicle owners.


Hadamard weighted geometric mean inequalities for the spectral and essential spectral radius of positive operators on Banach function and sequence spaces. We prove new inequalities for the spectral radius, essential spectral radius, operator norm, measure of noncompactness and numerical radius of Hadamard weighted geometric means of positive kernel operators on Banach function and sequence spaces. Several inequalities appear to be new even in the finite dimensional case.


Screening of the Characteristics of Hate Crimes against Asian American and Comparison to African Americans in Bay Area. COVID 19 has aided the spread of racism, as well as national insecurity, distrust of immigrants, and general xenophobia, both of which may be linked to the rise in anti Asian hate crimes during the pandemic. Coronavirus Disease 2019(COVID19) is thought to have originated in late December 2019 in Wuhan, China, and quickly spread across the world during the spring months of 2020. Asian Americans recorded in increase in racially based hate crimes including physical abuse and intimidation as COVID 19 spread throughout the United States. This research study was conducted by high school students in the Bay Area to compare the intention and characteristics of hate crimes against Asian Americans to hate crimes against African Americans. According to studies of both victim related and most offender related variables, hate crimes against Asian Americans have been rapidly growing in the United States and vary from those against African Americans. This leads to an investigation into the racial disparity between Asian American offenders and those of other races. The nature and characteristics of hate crimes against Asian Americans are compared to those of hate crimes against African Americans in our research. According to studies of all victim related factors, hate crimes against Asian Americans are similar to those against African Americans. Hate crimes against Asian Americans, on the other hand, vary greatly from hate crimes against African Americans in terms of the offender's ethnicity and all incident related variables.


Heat flux deposition pattern on the inner first wall of Tore Supra. The Inner First Wall (IFW) is the main limiter in Tore Supra for long and powerful discharges. The original graphite IFW was partly damaged by 8 years of operation and a sector of 60 textdegree was replaced between 1995 and 1997 by CFC brazed elements. They are designed to accept twice as much flux (2 MW m 2 ) as the older ones and are expected to be more resilient. The new elements gave the opportunity to install diagnostics (thermocouples and langmuir probes) on a poloidal sector, to characterise the behaviour of the new IFW and especially the heat flux profile. The pattern doesn't follow the cosine law and is governed by strong perpendicular heat flux and abnormal deposition at the contact point between the limiter and the plasma. The most energetic shots of the last campaign showed that the IFW could be loaded with twice the power deposited during these shots.


Disfl QA A Benchmark Dataset for Understanding Disfluencies in Question Answering. Disfluencies is an under studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this paper, we present a new challenge question answering dataset, Disfl QA, a derivative of SQuAD, where humans introduce contextual disfluencies in previously fluent questions. Disfl QA contains a variety of challenging disfluencies that require a more comprehensive understanding of the text than what was necessary in prior datasets. Experiments show that the performance of existing state of the art question answering models degrades significantly when tested on Disfl QA in a zero shot setting.We show data augmentation methods partially recover the loss in performance and also demonstrate the efficacy of using gold data for fine tuning. We argue that we need large scale disfluency datasets in order for NLP models to be robust to them. The dataset is publicly available at https github.com google research datasets disfl qa.


Optimal Rate Adaption in Federated Learning with Compressed Communications. Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for simplicity, most implementations adopt a fixed compression rate only. In this paper, we for the first time systematically examine this tradeoff, identifying the influence of the compression error on the final model accuracy with respect to the learning rate. Specifically, we factor the compression error of each global iteration into the convergence rate analysis under both strongly convex and non convex loss functions. We then present an adaptation framework to maximize the final model accuracy by strategically adjusting the compression rate in each iteration. We have discussed the key implementation issues of our framework in practical networks with representative compression algorithms. Experiments over the popular MNIST and CIFAR 10 datasets confirm that our solution effectively reduces network traffic yet maintains high model accuracy in FL.


undeSErVed trust Exploiting Permutation Agnostic Remote Attestation. The ongoing trend of moving data and computation to the cloud is met with concerns regarding privacy and protection of intellectual property. Cloud Service Providers (CSP) must be fully trusted to not tamper with or disclose processed data, hampering adoption of cloud services for many sensitive or critical applications. As a result, CSPs and CPU manufacturers are rushing to find solutions for secure outsourced computation in the Cloud. While enclaves, like Intel SGX, are strongly limited in terms of throughput and size, AMD's Secure Encrypted Virtualization (SEV) offers hardware support for transparently protecting code and data of entire VMs, thus removing the performance, memory and software adaption barriers of enclaves. Through attestation of boot code integrity and means for securely transferring secrets into an encrypted VM, CSPs are effectively removed from the list of trusted entities. There have been several attacks on the security of SEV, by abusing I O channels to encrypt and decrypt data, or by moving encrypted code blocks at runtime. Yet, none of these attacks have targeted the attestation protocol, the core of the secure computing environment created by SEV. We show that the current attestation mechanism of Zen 1 and Zen 2 architectures has a significant flaw, allowing us to manipulate the loaded code without affecting the attestation outcome. An attacker may abuse this weakness to inject arbitrary code at startup and thus take control over the entire VM execution, without any indication to the VM's owner. Our attack primitives allow the attacker to do extensive modifications to the bootloader and the operating system, like injecting spy code or extracting secret data. We present a full end to end attack, from the initial exploit to leaking the key of the encrypted disk image during boot, giving the attacker unthrottled access to all of the VM's persistent data.


Neural Photofit Gaze based Mental Image Reconstruction. We propose a novel method that leverages human fixations to visually decode the image a person has in mind into a photofit (facial composite). Our method combines three neural networks An encoder, a scoring network, and a decoder. The encoder extracts image features and predicts a neural activation map for each face looked at by a human observer. A neural scoring network compares the human and neural attention and predicts a relevance score for each extracted image feature. Finally, image features are aggregated into a single feature vector as a linear combination of all features weighted by relevance which a decoder decodes into the final photofit. We train the neural scoring network on a novel dataset containing gaze data of 19 participants looking at collages of synthetic faces. We show that our method significantly outperforms a mean baseline predictor and report on a human study that shows that we can decode photofits that are visually plausible and close to the observer's mental image.


Multimodal Aware Weakly Supervised Metric Learning with Self weighting Triplet Loss. In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar samples closer while push the dissimilar ones as far as possible. However, when some classes of the dataset exhibit multimodal distribution, these goals conflict and thus can hardly be concurrently satisfied. Additionally, to ensure a valid metric, many methods require a repeated eigenvalue decomposition process, which is expensive and numerically unstable. Therefore, how to learn an appropriate distance metric from weakly supervised data remains an open but challenging problem. To address this issue, in this paper, we propose a novel weakly supervised metric learning algorithm, named MultimoDal Aware weakly supervised Metric Learning (MDaML). MDaML partitions the data space into several clusters and allocates the local cluster centers and weight for each sample. Then, combining it with the weighted triplet loss can further enhance the local separability, which encourages the local dissimilar samples to keep a large distance from the local similar samples. Meanwhile, MDaML casts the metric learning problem into an unconstrained optimization on the SPD manifold, which can be efficiently solved by Riemannian Conjugate Gradient Descent (RCGD). Extensive experiments conducted on 13 datasets validate the superiority of the proposed MDaML.


Physical Adversarial Attacks on an Aerial Imagery Object Detector. Deep neural networks (DNNs) have become essential for processing the vast amounts of aerial imagery collected using earth observing satellite platforms. However, DNNs are vulnerable towards adversarial examples, and it is expected that this weakness also plagues DNNs for aerial imagery. In this work, we demonstrate one of the first efforts on physical adversarial attacks on aerial imagery, whereby adversarial patches were optimised, fabricated and installed on or near target objects (cars) to significantly reduce the efficacy of an object detector applied on overhead images. Physical adversarial attacks on aerial images, particularly those captured from satellite platforms, are challenged by atmospheric factors (lighting, weather, seasons) and the distance between the observer and target. To investigate the effects of these challenges, we devised novel experiments and metrics to evaluate the efficacy of physical adversarial attacks against object detectors in aerial scenes. Our results indicate the palpable threat posed by physical adversarial attacks towards DNNs for processing satellite imagery.


Automatic Rail Component Detection Based on AttnConv Net. The automatic detection of major rail components using railway images is beneficial to ensure the rail transport safety. In this paper, we propose an attention powered deep convolutional network (AttnConv net) to detect multiple rail components including the rail, clips, and bolts. The proposed method consists of a deep convolutional neural network (DCNN) as the backbone, cascading attention blocks (CAB), and two feed forward networks (FFN). Two types of positional embedding are applied to enrich information in latent features extracted from the backbone. Based on processed latent features, the CAB aims to learn the local context of rail components including their categories and component boundaries. Final categories and bounding boxes are generated via two FFN implemented in parallel. To enhance the detection of small components, various data augmentation methods are employed in the training process. The effectiveness of the proposed AttnConv net is validated with one real dataset and another synthesized dataset. Compared with classic convolutional neural network based methods, our proposed method simplifies the detection pipeline by eliminating the need of prior and post processing, which offers a new speed quality solution to enable faster and more accurate image based rail component detections


Weakly Supervised Dense Action Anticipation. Dense anticipation aims to forecast future actions and their durations for long horizons. Existing approaches rely on fully labelled data, i.e. sequences labelled with all future actions and their durations. We present a (semi ) weakly supervised method using only a small number of fully labelled sequences and predominantly sequences in which only the (one) upcoming action is labelled. To this end, we propose a framework that generates pseudo labels for future actions and their durations and adaptively refines them through a refinement module. Given only the upcoming action label as input, these pseudo labels guide action duration prediction for the future. We further design an attention mechanism to predict context aware durations. Experiments on the Breakfast and 50Salads benchmarks verify our method's effectiveness we are competitive even when compared to fully supervised state of the art models. We will make our code available at https github.com zhanghaotong1 WSLVideoDenseAnticipation.


On the Performance of Pipelined HotStuff. HotStuff is a state of the art Byzantine fault tolerant consensus protocol. It can be pipelined to build large scale blockchains. One of its variants called LibraBFT is adopted in Facebook's Libra blockchain. Although it is well known that pipelined HotStuff is secure against up to 1 3 of Byzantine nodes, its performance in terms of throughput and delay is still under explored. In this paper, we develop a multi metric evaluation framework to quantitatively analyze pipelined mbox HotStuff's performance with respect to its chain growth rate, chain quality, and latency. We then propose two attack strategies and evaluate their effects on the performance of pipelined HotStuff. Our analysis shows that the chain growth rate (resp, chain quality) of pipelined HotStuff under our attacks can drop to as low as 4 9 (resp, 12 17) of that without attacks when 1 3 nodes are Byzantine. As another application, we use our framework to evaluate certain engineering optimizations adopted by LibraBFT. We find that these optimizations make the system more vulnerable to our attacks than the original pipelined HotStuff. Finally, we provide two countermeasures to thwart these attacks. We hope that our studies can shed light on the rigorous understanding of the state of the art pipelined HotStuff protocol as well as its variants.


Radar SLAM A Robust SLAM System for All Weather Conditions. A Simultaneous Localization and Mapping (SLAM) system must be robust to support long term mobile vehicle and robot applications. However, camera and LiDAR based SLAM systems can be fragile when facing challenging illumination or weather conditions which degrade their imagery and point cloud data. Radar, whose operating electromagnetic spectrum is less affected by environmental changes, is promising although its distinct sensing geometry and noise characteristics bring open challenges when being exploited for SLAM. However, there are still open challenges since most existing visual and LiDAR SLAM systems do not operate in bad weathers. This paper studies the use of a Frequency Modulated Continuous Wave radar for SLAM in large scale outdoor environments. We propose a full radar SLAM system, including a novel radar motion tracking algorithm that leverages radar geometry for reliable feature tracking. It also optimally compensates motion distortion and estimates pose by joint optimization. Its loop closure component is designed to be simple yet efficient for radar imagery by capturing and exploiting structural information of the surrounding environment. while a scheme to reject ambiguous loop closure candidates is also designed specifically for radar. Extensive experiments on three public radar datasets, ranging from city streets and residential areas to countryside and highways, show competitive accuracy and reliability performance of the proposed radar SLAM system compared to the state of the art LiDAR, vision and radar methods. The results show that our system is technically viable in achieving reliable SLAM in extreme weather conditions, e.g. heavy snow and dense fog, demonstrating the promising potential of using radar for all weather localization and mapping.


Pretraining the Noisy Channel Model for Task Oriented Dialogue. Direct decoding for task oriented dialogue is known to suffer from the explaining away effect, manifested in models that prefer short and generic responses. Here we argue for the use of Bayes' theorem to factorize the dialogue task into two models, the distribution of the context given the response, and the prior for the response itself. This approach, an instantiation of the noisy channel model, both mitigates the explaining away effect and allows the principled incorporation of large pretrained models for the response prior. We present extensive experiments showing that a noisy channel model decodes better responses compared to direct decoding and that a two stage pretraining strategy, employing both open domain and task oriented dialogue data, improves over randomly initialized models.


Conditional a posteriori error bounds for high order DG time stepping approximations of semilinear heat models with blow up. This work is concerned with the development of an adaptive numerical method for semilinear heat flow models featuring a general (possibly) nonlinear reaction term that may cause the solution to blow up in finite time. The fully discrete scheme consists of a high order discontinuous Galerkin (dG) time stepping method and a conforming finite element discretisation (cG) in space. The proposed adaptive procedure is based on rigorously devised conditional a posteriori error bounds in the L infty (L infty ) norm. Numerical experiments complement the theoretical results.


NB QC LDPC Coded QAM Signals with Optimized Mapping Bounds and Simulation Results. The goal of the paper is to study specific properties of nonbinary low density parity check (NB LDPC) codes when used in coded modulation systems. The paper is focused on the practically important NB LDPC codes over extensions of the Galois field GF (2 m) with m le 6 used with QAM signaling. Performance of NB QC LDPC coded transmission strongly depends on mapping of nonbinary symbols to signal constellation points. We obtain a random coding bound on the maximum likelihood decoding error probability for an ensemble of random irregular NB LDPC codes used with QAM signaling for specific symbol to signal point mappings. This bound is based on the ensemble average Euclidean distance spectra derived for these mappings. The simulation results for the belief propagation decoding in the coded modulation schemes with the NB quasi cyclic (QC) LDPC codes under different mappings are given. Comparisons with the optimized binary QC LDPC codes in the WiFi and 5G standards, as well as with the new bound, are performed.


Distortion Reversal in Aperiodic Tilings. It is proved that homeomorphic images of certain two dimensional aperiodic tilings, such as Ammann A2 tilings, are recognizable, in both mathematical and practical senses. One implication of the results is that it is possible to search for distorted aperiodic structures in nature, where they may be hiding in plain sight.


NEMR Network Embedding on Metric of Relation. Network embedding maps the nodes of a given network into a low dimensional space such that the semantic similarities among the nodes can be effectively inferred. Most existing approaches use inner product of node embedding to measure the similarity between nodes leading to the fact that they lack the capacity to capture complex relationships among nodes. Besides, they take the path in the network just as structural auxiliary information when inferring node embeddings, while paths in the network are formed with rich user informations which are semantically relevant and cannot be ignored. In this paper, We propose a novel method called Network Embedding on the Metric of Relation, abbreviated as NEMR, which can learn the embeddings of nodes in a relational metric space efficiently. First, our NEMR models the relationships among nodes in a metric space with deep learning methods including variational inference that maps the relationship of nodes to a gaussian distribution so as to capture the uncertainties. Secondly, our NEMR considers not only the equivalence of multiple paths but also the natural order of a single path when inferring embeddings of nodes, which makes NEMR can capture the multiple relationships among nodes since multiple paths contain rich user information, e.g., age, hobby and profession. Experimental results on several public datasets show that the NEMR outperforms the state of the art methods on relevant inference tasks including link prediction and node classification.


Stability for the multi dimensional Borg Levinson theorem of the biharmonic operator. In this paper, we prove a conditional H "older stability estimate for the inverse spectral problem of the biharmonic operator. The proof employs the resolvent estimate and a Weyl type law for the biharmonic operator which were obtained by the authors in cite LYZ . This work extends nontrivially the result in cite stefanov from the second order Schr " o dinger operator to the fourth order biharmonic operator.


SMASH Sparse Matrix Atomic Scratchpad Hashing. Sparse matrices, more specifically SpGEMM kernels, are commonly found in a wide range of applications, spanning graph based path finding to machine learning algorithms (e.g., neural networks). A particular challenge in implementing SpGEMM kernels has been the pressure placed on DRAM memory. One approach to tackle this problem is to use an inner product method for the SpGEMM kernel implementation. While the inner product produces fewer intermediate results, it can end up saturating the memory bandwidth, given the high number of redundant fetches of the input matrix elements. Using an outer product based SpGEMM kernel can reduce redundant fetches, but at the cost of increased overhead due to extra computation and memory accesses for producing managing partial products. In this thesis, we introduce a novel SpGEMM kernel implementation based on the row wise product approach. We leverage atomic instructions to merge intermediate partial products as they are generated. The use of atomic instructions eliminates the need to create partial product matrices. To evaluate our row wise product approach, we map an optimized SpGEMM kernel to a custom accelerator designed to accelerate graph based applications. The targeted accelerator is an experimental system named PIUMA, being developed by Intel. PIUMA provides several attractive features, including fast context switching, user configurable caches, globally addressable memory, non coherent caches, and asynchronous pipelines. We tailor our SpGEMM kernel to exploit many of the features of the PIUMA fabric. This thesis compares our SpGEMM implementation against prior solutions, all mapped to the PIUMA framework. We briefly describe some of the PIUMA architecture features and then delve into the details of our optimized SpGEMM kernel. Our SpGEMM kernel can achieve 9.4x speedup as compared to competing approaches.


Fast Construction of 4 Additive Spanners. A k additive spanner of a graph is a subgraph that preserves the distance between any two nodes up to a total additive error of k . Efficient algorithms have been devised for constructing 2 Aingworth et al. SIAM '99 , 6 Baswana et al. ACM '10, Woodruff ICALP '13 , and 8 additive spanners Knudsen '17 , but no efficient algorithms for 4 additive spanners have yet been discovered. In this paper we present a modification of Chechik's 4 additive spanner construction Chechik SODA '13 that produces a 4 additive spanner on Oish(n 7 5 ) edges, with an improved runtime of Oish(mn 3 5 ) from O(mn) . We also discuss generalizations to the setting of weighted additive spanners.


Adaptive Multilevel Monte Carlo for Probabilities. We consider the numerical approximation of mathbb P G in Omega where the d dimensional random variable G cannot be sampled directly, but there is a hierarchy of increasingly accurate approximations G ell ell in mathbb N which can be sampled. The cost of standard Monte Carlo estimation scales poorly with accuracy in this setup since it compounds the approximation and sampling cost. A direct application of Multilevel Monte Carlo improves this cost scaling slightly, but returns sub optimal computational complexities since estimation of the probability involves a discontinuous functional of G ell . We propose a general adaptive framework which is able to return the MLMC complexities seen for smooth or Lipschitz functionals of G ell . Our assumptions and numerical analysis are kept general allowing the methods to be used for a wide class of problems. We present numerical experiments on nested simulation for risk estimation, where G mathbb E X Y is approximated by an inner Monte Carlo estimate. Further experiments are given for digital option pricing, involving an approximation of a d dimensional SDE.


The stability of standard homogeneous Einstein manifolds. Back in 1985, Wang and Ziller obtained a complete classification of all homogeneous spaces of compact simple Lie groups on which the standard or Killing metric is Einstein. The list consists, beyond isotropy irreducible spaces, of 12 infinite families (two of them are actually conceptual constructions) and 22 isolated examples. We study in this paper the nature of each of these Einstein metrics as a critical point of the scalar curvature functional.


Thermal conductivity of micro nano porous polymers Prediction models and applications. Micro nano porous polymeric material is considered a unique industrial material due to its extremely low thermal conductivity, low density, and high surface area. Therefore, it is necessary to establish an accurate thermal conductivity prediction model suiting their applicable conditions and provide a theoretical basis for expanding of their applications. In this work, the development of the calculation model of equivalent thermal conductivity of micro nano porous polymeric materials in recent years was summarized. Firstly, it reviews the process of establishing the overall equivalent thermal conductivity calculation model for micro nano porous polymers. Then, the predicted calculation models of thermal conductivity are introduced according to the conductive thermal conductivity models and the radiative thermal conductivity models separately. In addition, the thermal conduction part is divided into the gaseous thermal conductivity model, solid thermal conductivity model and gas solid coupling model. Finally, it is concluded that, compared with other porous materials, there are few studies on heat transfer of micro nano porous polymers, especially on the special heat transfer mechanisms such as scale effects at the micro nanoscale. In particular, the following aspects of porous polymers still need to be further studied micro scaled thermal radiation, heat transfer characteristics of special morphologies at the nanoscale, heat transfer mechanism and impact factors of micro nano porous polymers. Such studies would provide a more accurate prediction of thermal conductivity and a wider application in energy conversion and storage systems.


Disentangled Motif aware Graph Learning for Phrase Grounding. In this paper, we propose a novel graph learning framework for phrase grounding in the image. Developing from the sequential to the dense graph model, existing works capture coarse grained context but fail to distinguish the diversity of context among phrases and image regions. In contrast, we pay special attention to different motifs implied in the context of the scene graph and devise the disentangled graph network to integrate the motif aware contextual information into representations. Besides, we adopt interventional strategies at the feature and the structure levels to consolidate and generalize representations. Finally, the cross modal attention network is utilized to fuse intra modal features, where each phrase can be computed similarity with regions to select the best grounded one. We validate the efficiency of disentangled and interventional graph network (DIGN) through a series of ablation studies, and our model achieves state of the art performance on Flickr30K Entities and ReferIt Game benchmarks.


Mean exit time for diffusion on irregular domains. Many problems in physics, biology, and economics depend upon the duration of time required for a diffusing particle to cross a boundary. As such, calculations of the distribution of first passage time, and in particular the mean first passage time, is an active area of research relevant to many disciplines. Exact results for the mean first passage time for diffusion on simple geometries, such as lines, discs and spheres, are well known. In contrast, computational methods are often used to study the first passage time for diffusion on more realistic geometries where closed form solutions of the governing elliptic boundary value problem are not available. Here, we develop a perturbation solution to calculate the mean first passage time on irregular domains formed by perturbing the boundary of a disc or an ellipse. Classical perturbation expansion solutions are then constructed using the exact solutions available on a disc and an ellipse. We apply the perturbation solutions to compute the mean first exit time on two naturally occurring irregular domains a map of Tasmania, an island state of Australia, and a map of Taiwan. Comparing the perturbation solutions with numerical solutions of the elliptic boundary value problem on these irregular domains confirms that we obtain a very accurate solution with a few terms in the series only. Matlab software to implement all calculations is available on GitHub.


Investigating Numeracy Learning Ability of a Text to Text Transfer Model. The transformer based pre trained language models have been tremendously successful in most of the conventional NLP tasks. But they often struggle in those tasks where numerical understanding is required. Some possible reasons can be the tokenizers and pre training objectives which are not specifically designed to learn and preserve numeracy. Here we investigate the ability of text to text transfer learning model (T5), which has outperformed its predecessors in the conventional NLP tasks, to learn numeracy. We consider four numeracy tasks numeration, magnitude order prediction, finding minimum and maximum in a series, and sorting. We find that, although T5 models perform reasonably well in the interpolation setting, they struggle considerably in the extrapolation setting across all four tasks.


Non positively curved Ricci surfaces with catenoidal ends. A Ricci surface is defined as a Riemannian surface (M,g M) whose Gauss curvature satisfies the differential equation K Delta K g M(dK,dK) 4K 3 0 . Andrei Moroianu and Sergiu Moroianu proved that a Ricci surface with non positive Gauss curvature admits locally a minimal immersion into mathbb R 3 . In this paper, we are interested in studying non compact orientable Ricci surfaces with catenoidal ends. We use an analogue of the Weierstrass data to obtain some classification results for such Ricci surfaces. We also give an existence result for positive genus Ricci surfaces with catenoidal ends.


Efficient Algorithms for Maximal k Biplex Enumeration. Mining maximal subgraphs with cohesive structures from a bipartite graph has been widely studied. One important cohesive structure on bipartite graphs is k biplex, where each vertex on one side disconnects at most k vertices on the other side. In this paper, we study the maximal k biplex enumeration problem which enumerates all maximal k biplexes. Existing methods suffer from efficiency and or scalability issues and have the time of waiting for the next output exponential w.r.t. the size of the input bipartite graph (i.e., an exponential delay). In this paper, we adopt a reverse search framework called bTraversal, which corresponds to a depth first search (DFS) procedure on an implicit solution graph on top of all maximal k biplexes. We then develop a series of techniques for improving and implementing this framework including (1) carefully selecting an initial solution to start DFS, (2) pruning the vast majority of links from the solution graph of bTraversal, and (3) implementing abstract procedures of the framework. The resulting algorithm is called iTraversal, which has its underlying solution graph significantly sparser than (around 0.1 of) that of bTraversal. Besides, iTraversal provides a guarantee of polynomial delay. Our experimental results on real and synthetic graphs, where the largest one contains more than one billion edges, show that our algorithm is up to four orders of magnitude faster than existing algorithms.


Spectral analysis of climate dynamics with operator theoretic approaches. The Earth's climate system is a classical example of a multiscale, multiphysics dynamical system with an extremely large number of active degrees of freedom, exhibiting variability on scales ranging from micrometers and seconds in cloud microphysics, to thousands of kilometers and centuries in ocean dynamics. Yet, despite this dynamical complexity, climate dynamics is known to exhibit coherent modes of variability. A primary example is the El Ni no Southern Oscillation (ENSO), the dominant mode of interannual (3 5 yr) variability in the climate system. The objective and robust characterization of this and other important phenomena presents a long standing challenge in Earth system science, the resolution of which would lead to improved scientific understanding and prediction of climate dynamics, as well as assessment of their impacts on human and natural systems. Here, we show that the spectral theory of dynamical systems, combined with techniques from data science, provides an effective means for extracting coherent modes of climate variability from high dimensional model and observational data, requiring no frequency prefiltering, but recovering multiple timescales and their interactions. Lifecycle composites of ENSO are shown to improve upon results from conventional indices in terms of dynamical consistency and physical interpretability. In addition, the role of combination modes between ENSO and the annual cycle in ENSO diversity is elucidated.


D'yakov Kontorovich instability of expanding shock waves. In the range of h c h 1 2 M 2 , where h is the D'yakov Kontorovich parameter, h c is its critical value corresponding to the onset of the spontaneous acoustic emission, and M 2 is the downstream Mach number, the classic analysis predicts a special form of the instability of isolated steady planar shock waves non decaying oscillations of shock front ripples. For spherically and cylindrically expanding steady shock waves, we demonstrate instead an instability in a literal sense, a power law growth of shock front perturbations with time. As the parameter h increases from h c to 1 2 M 2 , the instability power index grows from zero to infinity. Shock divergence is a stabilizing factor, and instability is found for high angular mode numbers.


International Conferences of Bibliometrics. Conferences are deeply connected to research fields, in this case bibliometrics. As such, they are a venue to present and discuss current and innovative research, and play an important role for the scholarly community. In this article, we provide an overview on the history of conferences in bibliometrics. We conduct an analysis to list the most prominent conferences that were announced in the newsletter by ISSI, the International Society for Scientometrics and Informetrics. Furthermore, we describe how conferences are connected to learned societies and journals. Finally, we provide an outlook on how conferences might change in future.


Impact of the antibiotic cargo from MSNs on Gram positive and Gram negative bacterial biofilms. Mesoporous silica nanoparticles (MSNs) are promising drug nanocarriers for infection treatment. Many investigations have focused on evaluating the capacity of MSNs to encapsulate antibiotics and release them in a controlled fashion. However, little attention has been paid to determine the antibiotic doses released from these nanosystems that are effective against biofilm during the entire release time. Herein, we report a systematic and quantitative study of the direct effect of the antibiotic cargo released from MSNs on Gram positive and Gram negative bacterial biofilms. Levofloxacin (LVX), gentamicin (GM) and rifampin (RIF) were separately loaded into pure silica and amino modified MSNs. This accounts for the versatility of these nanosystems since they were able to load and release different antibiotic molecules of diverse chemical nature. Biological activity curves of the released antibiotic were determined for both bacterial strains, which allowed to calculate the active doses that are effective against bacterial biofilms. Furthermore, in vitro biocompatibility assays on osteoblast like cells were carried out at different periods of times. Albeit a slight decrease in cell viability was observed at the very initial stage, due to the initial burst antibiotic release, the biocompatibility of these nanosystems is evidenced since a recovery of cell viability was achieved after 72 h of assay. Biological activity curves for GM released from MSNs exhibited sustained patterns and antibiotic doses in the 2 6 mu g mL range up to 100 h, which were not enough to eradicate biofilm. In the case of LVX and RIF first order kinetics featuring an initial burst effect followed by a sustained release above the MIC up to 96 h were observed. Such doses reduced by 99.9 bacterial biofilm and remained active up to 72 h with no emergence of bacterial resistance.


Interactive Analysis of CNN Robustness. While convolutional neural networks (CNNs) have found wide adoption as state of the art models for image related tasks, their predictions are often highly sensitive to small input perturbations, which the human vision is robust against. This paper presents Perturber, a web based application that allows users to instantaneously explore how CNN activations and predictions evolve when a 3D input scene is interactively perturbed. Perturber offers a large variety of scene modifications, such as camera controls, lighting and shading effects, background modifications, object morphing, as well as adversarial attacks, to facilitate the discovery of potential vulnerabilities. Fine tuned model versions can be directly compared for qualitative evaluation of their robustness. Case studies with machine learning experts have shown that Perturber helps users to quickly generate hypotheses about model vulnerabilities and to qualitatively compare model behavior. Using quantitative analyses, we could replicate users' insights with other CNN architectures and input images, yielding new insights about the vulnerability of adversarially trained models.


Age of Information in Relay Assisted Status Updating Systems. In this paper we consider the age of information (AoI) of a status updating system with a relay, where the updates are delivered to destination either from the direct line or the two hop link via the relay. An updating packet generated at source is sent to receiver and the relay simultaneously. When the direct packet transmission fails, the relay replaces the source and retransmits the packet until it is eventually obtained at the receiver side. Assume that the propagation delay on each link is one time slot, we determine the stationary distribution of the AoI for three cases (a) relay has no buffer and the packet delivery from relay cannot be preempted by fresher updates from source (b) relay has no buffer but the packet substitution is allowable (c) relay has size 1 buffer and the packet in buffer is refreshed when a newer packet is obtained. The idea is invoking a multiple dimensional state vector which contains the AoI as a part and constituting the multiple dimensional AoI stochastic process. We find the steady state of each multiple dimensional AoI process by solving the system of stationary equations. Once the steady state distribution of larger dimensional AoI process is known, the stationary AoI distribution is also obtained as it is one of the marginal distributions of that process's steady state distribution. For all the situations, we derive the explicit expression of AoI distribution, and calculate the mean and the variance of the stationary AoI. All the results are compared numerically, including the AoI performance of the non relay state updating system. Numerical results show that adding the relay improves the system's timeliness dramatically, and no buffer and preemption setting in relay achieves both minimal average AoI and AoI's variance. Thus, for the system model discussed in this paper, to reduce the AoI at receiver there is no need to add the buffer in relay.


Coarse Grid Selection Using Simulated Annealing. Multilevel techniques are efficient approaches for solving the large linear systems that arise from discretized partial differential equations and other problems. While geometric multigrid requires detailed knowledge about the underlying problem and its discretization, algebraic multigrid aims to be less intrusive, requiring less knowledge about the origin of the linear system. A key step in algebraic multigrid is the choice of the coarse fine partitioning, aiming to balance the convergence of the iteration with its cost. In work by MacLachlan and Saad, a constrained combinatorial optimization problem is used to define the "best" coarse grid within the setting of a two level reduction based algebraic multigrid method and is shown to be NP complete. Here, we develop a new coarsening algorithm based on simulated annealing to approximate solutions to this problem, which yields improved results over the greedy algorithm developed previously. We present numerical results for test problems on both structured and unstructured meshes, demonstrating the ability to exploit knowledge about the underlying grid structure if it is available.


On PQC Migration and Crypto Agility. Besides the development of PQC algorithms, the actual migration of IT systems to such new schemes has to be considered, best by utilizing or establishing crypto agility. Much work in this respect is currently conducted all over the world, making it hard to keep track of the many individual challenges and respective solutions that have been identified. In consequence, it is difficult to judge for both individual application scenarios and on a global scale, whether all (known) challenges have been addressed respectively or what their current state is. We provide a literature survey and a snapshot of the discovered challenges and solutions categorized in different areas. We use this as starting point for a community project to keep track of the ongoing efforts and the state of the art in this field. Thereby we offer a single entry point into the subject reflecting the current state in a timely manner.


An efficient and secure scheme of verifiable computation for Intel SGX. Cloud computing offers resource constrained users big volume data storage and energy consuming complicated computation. However, owing to the lack of full trust in the cloud, the cloud users prefer privacy preserving outsourced data computation with correctness verification. However, cryptography based schemes introduce high computational costs to both the cloud and its users for verifiable computation with privacy preservation, which makes it difficult to support complicated computations in practice. Intel Software Guard Extensions (SGX) as a trusted execution environment is widely researched in various fields (such as secure data analytics and computation), and is regarded as a promising way to achieve efficient outsourced data computation with privacy preservation over the cloud. But we find two types of threats towards the computation with SGX Disarranging Data Related Code threat and Output Tampering and Misrouting threat. In this paper, we depict these threats using formal methods and successfully conduct the two threats on the enclave program constructed by Rust SGX SDK to demonstrate their impacts on the correctness of computations over SGX enclaves. In order to provide countermeasures, we propose an efficient and secure scheme to resist the threats and realize verifiable computation for Intel SGX. We prove the security and show the efficiency and correctness of our proposed scheme through theoretic analysis and extensive experiments. Furthermore, we compare the performance of our scheme with that of some cryptography based schemes to show its high efficiency.


Casr Cluster Crash Clustering for Linux Applications. Crash report analysis is a necessary step before developers begin fixing errors. Fuzzing or hybrid (with dynamic symbolic execution) fuzzing is often used in the secure development lifecycle. Modern fuzzers could produce many crashes and developers do not have enough time to fix them till release date. There are two approaches that could reduce developers' effort on crash analysis crash clustering and crash severity estimation. Crash severity estimation could help developers to prioritize crashes and close security issues first. Crash clustering puts similar crash reports in one cluster what could speed up the analyzing time for all crash reports. In this paper, we focus on crash clustering. We propose an approach for clustering and deduplicating of crashes that occurred in Linux applications. We implement this approach as a tool that could cluster Casr cite fedotov2020casr crash reports. We evaluated our tool on a set of crash reports that was collected from fuzzing results.


Symmetry preserving enforcement of low dissipation method based on boundary variation diminishing principle. A class of high order shock capturing schemes, P n T m BVD (Deng et al., J. Comp. Phys., 386 323 349, 2019 Comput. Fluids, 200 104433, 2020.) schemes, have been devised to solve the Euler equations with substantially reduced numerical dissipation, which enable high resolution simulations to resolve flow structures of wider range scales. In such simulations with low dissipation, errors of round off level might grow and contaminate the numerical solutions. A typical example of such problems is the loss of symmetry in the numerical solutions for physical problems of symmetric configurations even if the schemes are mathematically in line with the symmetry rules. In this study, the mechanisms of symmetry breaking in a finite volume framework with the P 4 T 2 BVD reconstruction scheme are thoroughly examined. Particular attention has been paid to remove the possible causes due to the lack of associativity in floating point arithmetic which is associated with round off errors. Modifications and new techniques are proposed to completely remove the possible causes for symmetry breaking in different components of the P 4 T 2 BVD finite volume solver. Benchmark tests that have symmetric solution structures are used to verify the proposed methods. The numerical results demonstrate the perfect symmetric solution structures.


A Framework for Learning to Request Rich and Contextually Useful Information from Humans. When deployed, AI agents will encounter problems that are beyond their autonomous problem solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We present a general interactive framework that enables an agent to determine and request contextually useful information from an assistant, and to incorporate rich forms of responses into its decision making process. We demonstrate the practicality of our framework on a simulated human assisted navigation problem. Aided with an assistance requesting policy learned by our method, a navigation agent achieves up to a 7x improvement in success rate on tasks that take place in previously unseen environments, compared to fully autonomous behavior. We show that the agent can take advantage of different types of information depending on the context, and analyze the benefits and challenges of learning the assistance requesting policy when the assistant can recursively decompose tasks into subtasks.


Hugo A Cluster Scheduler that Efficiently Learns to Select Complementary Data Parallel Jobs. Distributed data processing systems like MapReduce, Spark, and Flink are popular tools for analysis of large datasets with cluster resources. Yet, users often overprovision resources for their data processing jobs, while the resource usage of these jobs also typically fluctuates considerably. Therefore, multiple jobs usually get scheduled onto the same shared resources to increase the resource utilization and throughput of clusters. However, job runtimes and the utilization of shared resources can vary significantly depending on the specific combinations of co located jobs. This paper presents Hugo, a cluster scheduler that continuously learns how efficiently jobs share resources, considering metrics for the resource utilization and interference among co located jobs. The scheduler combines offline grouping of jobs with online reinforcement learning to provide a scheduling mechanism that efficiently generalizes from specific monitored job combinations yet also adapts to changes in workloads. Our evaluation of a prototype shows that the approach can reduce the runtimes of exemplary Spark jobs on a YARN cluster by up to 12.5 , while resource utilization is increased and waiting times can be bounded.


Coalgebras for Bisimulation of Weighted Automata over Semirings. Weighted automata are a generalization of nondeterministic automata that associate a weight drawn from a semiring K with every transition and every state. Their behaviours can be formalized either as weighted language equivalence or weighted bisimulation. In this paper we explore the properties of weighted automata in the framework of coalgebras over (i) the category mathsf SMod of semimodules over a semiring K and K linear maps, and (ii) the category mathsf Set of sets and maps. We show that the behavioural equivalences defined by the corresponding final coalgebras in these two cases characterize weighted language equivalence and weighted bisimulation, respectively. These results extend earlier work by Bonchi et al. using the category mathsf Vect of vector spaces and linear maps as the underlying model for weighted automata with weights drawn from a field K . The key step in our work is generalizing the notions of linear relation and linear bisimulation of Boreale from vector spaces to semimodules using the concept of the kernel of a K linear map in the sense of universal algebra. We also provide an abstract procedure for forward partition refinement for computing weighted language equivalence. Since for weighted automata defined over semirings the problem is undecidable in general, it is guaranteed to halt only in special cases. We provide sufficient conditions for the termination of our procedure. Although the results are similar to those of Bonchi et al., many of our proofs are new, especially those about the coalgebra in mathsf SMod characterizing weighted language equivalence.


Unsupervised Enrichment of Persona grounded Dialog with Background Stories. Humans often refer to personal narratives, life experiences, and events to make a conversation more engaging and rich. While persona grounded dialog models are able to generate responses that follow a given persona, they often miss out on stating detailed experiences or events related to a persona, often leaving conversations shallow and dull. In this work, we equip dialog models with 'background stories' related to a persona by leveraging fictional narratives from existing story datasets (e.g. ROCStories). Since current dialog datasets do not contain such narratives as responses, we perform an unsupervised adaptation of a retrieved story for generating a dialog response using a gradient based rewriting technique. Our proposed method encourages the generated response to be fluent (i.e., highly likely) with the dialog history, minimally different from the retrieved story to preserve event ordering and consistent with the original persona. We demonstrate that our method can generate responses that are more diverse, and are rated more engaging and human like by human evaluators, compared to outputs from existing dialog models.


A novel method for robust and efficient prediction of ice shedding from rotorcraft blades. The safety of rotorcraft operating in cold environments is jeopardised by the possibility of ice accretion on the rotor blades. Eventually, ice can shed from the blade due to the high centrifugal forces and impact other parts of the rotorcraft or unbalance the rotor. To establish the shedding time and location for rotorcraft, a robust and efficent numerical multi step icing simulations tool is presented here for predicting the shedding phenomenon. A volume mesh based approach is used to allow for representing the ice shape. In order to increase the robustness of the method, an interpolation procedure is implemented which establishes the possible occurrence of the shedding event and restricts the search domain. Ice shapes along the blades are computed by means of two dimensional ice accretion simulations ice shapes are then interpolated over the blade span. Numerical results compares fairly well, in terms of shedding time and location, to the experimental ones obtained in the AERTS test facility, thus demonstrating the soundness of the present approach.


Separated and complete adelic models for one dimensional Noetherian tensor triangulated categories. We prove the existence of various adelic style models for rigidly small generated tensor triangulated categories whose Balmer spectrum is a one dimensional Noetherian topological space. This special case of our general programme of giving adelic models is particularly concrete and accessible, and we illustrate it with examples from algebra, geometry, topology and representation theory. This version minor improvements, additional references and examples.


Estimates for zero loci of Bernstein Sato ideals. We give estimates for the zero loci of Bernstein Sato ideals. An upper bound is proved as a multivariate generalisation of the upper bound by Lichtin for the roots of Bernstein Sato polynomials. The lower bounds generalise the fact that log canonical thresholds, small jumping numbers of multiplier ideals, and their real versions provide roots of Bernstein Sato polynomials.


Mixture Models for the Analysis, Edition, and Synthesis of Continuous Time Series. This chapter presents an overview of techniques used for the analysis, edition, and synthesis of time series, with a particular emphasis on motion data. The use of mixture models allows the decomposition of time signals as a superposition of basis functions. It provides a compact representation that aims at keeping the essential characteristics of the signals. Various types of basis functions have been proposed, with developments originating from different fields of research, including computer graphics, human motion science, robotics, control, and neuroscience. Examples of applications with radial, Bernstein and Fourier basis functions will be presented, with associated source codes to get familiar with these techniques.


A propos des nombres de Conway Lettre a un ami. About Conway's surreal numbers A letter to a friend (written in French). In memoriam John Horton Conway.


Isogeometric Residual Minimization Method (iGRM) with Direction Splitting for Non Stationary Advection Diffusion Problems. In this paper, we propose a novel computational implicit method, which we call Isogeometric Residual Minimization (iGRM) with direction splitting. The method mixes the benefits resulting from isogeometric analysis, implicit dynamics, residual minimization, and alternating direction solver. We utilize tensor product B spline basis functions in space, implicit second order time integration schemes, residual minimization in every time step, and we exploit Kronecker product structure of the matrix to employ linear computational cost alternating direction solver. We implement an implicit time integration scheme and apply, for each space direction, a stabilized mixed method based on residual minimization. We show that the resulting system of linear equations has a Kronecker product structure, which results in a linear computational cost of the direct solver, even using implicit time integration schemes together with the stabilized mixed formulation. We test our method on three advection diffusion computational examples, including model membrane'' problem, the circular wind problem, and the simulations modeling pollution propagating from a chimney.


Deep Model Intellectual Property Protection via Deep Watermarking. Despite the tremendous success, deep neural networks are exposed to serious IP infringement risks. Given a target deep model, if the attacker knows its full information, it can be easily stolen by fine tuning. Even if only its output is accessible, a surrogate model can be trained through student teacher learning by generating many input output training pairs. Therefore, deep model IP protection is important and necessary. However, it is still seriously under researched. In this work, we propose a new model watermarking framework for protecting deep networks trained for low level computer vision or image processing tasks. Specifically, a special task agnostic barrier is added after the target model, which embeds a unified and invisible watermark into its outputs. When the attacker trains one surrogate model by using the input output pairs of the barrier target model, the hidden watermark will be learned and extracted afterwards. To enable watermarks from binary bits to high resolution images, a deep invisible watermarking mechanism is designed. By jointly training the target model and watermark embedding, the extra barrier can even be absorbed into the target model. Through extensive experiments, we demonstrate the robustness of the proposed framework, which can resist attacks with different network structures and objective functions.


Towards Sensor Data Abstraction of Autonomous Vehicle Perception Systems. Full stack autonomous driving perception modules usually consist of data driven models based on multiple sensor modalities. However, these models might be biased to the sensor setup used for data acquisition. This bias can seriously impair the perception models' transferability to new sensor setups, which continuously occur due to the market's competitive nature. We envision sensor data abstraction as an interface between sensor data and machine learning applications for highly automated vehicles (HAD). For this purpose, we review the primary sensor modalities, camera, lidar, and radar, published in autonomous driving related datasets, examine single sensor abstraction and abstraction of sensor setups, and identify critical paths towards an abstraction of sensor data from multiple perception configurations.


Source Free Unsupervised Graph Domain Adaptation. Graph Neural Networks (GNNs) have achieved great success on a variety of tasks with graph structural data, among which node classification is an essential one. Unsupervised Graph Domain Adaptation (UGDA) shows its practical value of reducing the labeling cost for node classification. It leverages knowledge from a labeled graph (i.e., source domain) to tackle the same task on another unlabeled graph (i.e., target domain). Most existing UGDA methods heavily rely on the labeled graph in the source domain. They utilize labels from the source domain as the supervision signal and are jointly trained on both the source graph and the target graph. However, in some real world scenarios, the source graph is inaccessible because of either unavailability or privacy issues. Therefore, we propose a novel scenario named Source Free Unsupervised Graph Domain Adaptation (SFUGDA). In this scenario, the only information we can leverage from the source domain is the well trained source model, without any exposure to the source graph and its labels. As a result, existing UGDA methods are not feasible anymore. To address the non trivial adaptation challenges in this practical scenario, we propose a model agnostic algorithm for domain adaptation to fully exploit the discriminative ability of the source model while preserving the consistency of structural proximity on the target graph. We prove the effectiveness of the proposed algorithm both theoretically and empirically. The experimental results on four cross domain tasks show consistent improvements of the Macro F1 score up to 0.17.