Stochastic Projective Splitting Solving Saddle Point Problems with Multiple Regularizers. We present a new, stochastic variant of the projective splitting (PS) family of algorithms for monotone inclusion problems. It can solve min max and noncooperative game formulations arising in applications such as robust ML without the convergence issues associated with gradient descent ascent, the current de facto standard approach in such situations. Our proposal is the first version of PS able to use stochastic (as opposed to deterministic) gradient oracles. It is also the first stochastic method that can solve min max games while easily handling multiple constraints and nonsmooth regularizers via projection and proximal operators. We close with numerical experiments on a distributionally robust sparse logistic regression problem.


A firefly algorithm for power management in wireless sensor networks (WSNs). In wireless sensor networks (WSNs), designing a stable, low power routing protocol is a major challenge because successive changes in links or breakdowns destabilize the network topology. Therefore, choosing the right route in this type of network due to resource constraints and their operating environment is one of the most important challenges in these networks. Therefore, the main purpose of these networks is to collect appropriate routing information about the environment around the network sensors while observing the energy consumption of the sensors. One of the important approaches to reduce energy consumption in sensor networks is the use of the clustering technique, but in most clustering methods, only the criterion of the amount of energy of the cluster or the distance of members to the cluster has been considered. Therefore, in this paper, a method is presented using the firefly algorithm and using the four criteria of residual energy, noise rate, number of hops, and distance. The proposed method called EM FIREFLY is introduced which selects the best cluster head with high attractiveness and based on the fitness function and transfers the data packets through these cluster head to the sink. The proposed method is evaluated with NS 2 simulator and compared with the algorithm PSO and optimal clustering methods. The evaluation results show the efficiency of the EM FIREFLY method in maximum relative load and network lifetime criteria compared to other methods discussed in this article.


Expanding World Views Can SETI expand its own horizons and that of Big History too?. The Search for Extraterrestrial Intelligence (SETI) is a research activity that started in the late 1950s, predating the arrival of "Big History" and "Astrobiology" by several decades. Many elements first developed as part of the original SETI narrative are now incorporated in both of these emergent fields. However, SETI still offers the widest possible perspective, since the topic naturally leads us to consider not only the future development of our own society but also the forward trajectories (and past histories) of many other intelligent extraterrestrial forms. In this paper, I present a provocative view of Big History, its rapid convergent focus on our own planet and society, its oversimplified and incomplete view of events in cosmic history, and its limited appreciation of how poorly we understand some aspects of the physical world. Astrophysicists are also not spared in particular those who wish to understand the nature of the universe in "splendid isolation", only looking outwards and upwards. SETI can help re expand all of our horizons but the discovery of extraterrestrial intelligence may also require its own practitioners to abandon preconceptions of what constitutes intelligent, sentient, thinking minds.


Automatic Product Ontology Extraction from Textual Reviews. Ontologies have proven beneficial in different settings that make use of textual reviews. However, manually constructing ontologies is a laborious and time consuming process in need of automation. We propose a novel methodology for automatically extracting ontologies, in the form of meronomies, from product reviews, using a very limited amount of hand annotated training data. We show that the ontologies generated by our method outperform hand crafted ontologies (WordNet) and ontologies extracted by existing methods (Text2Onto and COMET) in several, diverse settings. Specifically, our generated ontologies outperform the others when evaluated by human annotators as well as on an existing Q A dataset from Amazon. Moreover, our method is better able to generalise, in capturing knowledge about unseen products. Finally, we consider a real world setting, showing that our method is better able to determine recommended products based on their reviews, in alternative to using Amazon's standard score aggregations.


Siri, Write the Next Method. Code completion is one of the killer features of Integrated Development Environments (IDEs), and researchers have proposed different methods to improve its accuracy. While these techniques are valuable to speed up code writing, they are limited to recommendations related to the next few tokens a developer is likely to type given the current context. In the best case, they can recommend a few APIs that a developer is likely to use next. We present FeaRS, a novel retrieval based approach that, given the current code a developer is writing in the IDE, can recommend the next complete method (i.e., signature and method body) that the developer is likely to implement. To do this, FeaRS exploits "implementation patterns" (i.e., groups of methods usually implemented within the same task) learned by mining thousands of open source projects. We instantiated our approach to the specific context of Android apps. A large scale empirical evaluation we performed across more than 20k apps shows encouraging preliminary results, but also highlights future challenges to overcome.


SECDA Efficient Hardware Software Co Design of FPGA based DNN Accelerators for Edge Inference. Edge computing devices inherently face tight resource constraints, which is especially apparent when deploying Deep Neural Networks (DNN) with high memory and compute demands. FPGAs are commonly available in edge devices. Since these reconfigurable circuits can achieve higher throughput and lower power consumption than general purpose processors, they are especially well suited for DNN acceleration. However, existing solutions for designing FPGA based DNN accelerators for edge devices come with high development overheads, given the cost of repeated FPGA synthesis passes, reimplementation in a Hardware Description Language (HDL) of the simulated design, and accelerator system integration. In this paper we propose SECDA, a new hardware software co design methodology to reduce design time of optimized DNN inference accelerators on edge devices with FPGAs. SECDA combines cost effective SystemC simulation with hardware execution, streamlining design space exploration and the development process via reduced design evaluation time. As a case study, we use SECDA to efficiently develop two different DNN accelerator designs on a PYNQ Z1 board, a platform that includes an edge FPGA. We quickly and iteratively explore the system's hardware software stack, while identifying and mitigating performance bottlenecks. We evaluate the two accelerator designs with four common DNN models, achieving an average performance speedup across models of up to 3.5 times with a 2.9 times reduction in energy consumption over CPU only inference. Our code is available at https github.com gicLAB SECDA


Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders. The growing deluge of scientific publications demands text analysis tools that can help scientists and policy makers navigate, forecast and beneficially guide scientific research. Recent advances in natural language understanding driven by deep transformer networks offer new possibilities for mapping science. Because the same surface text can take on multiple and sometimes contradictory specialized senses across distinct research communities, sensitivity to context is critical for infometric applications. Transformer embedding models such as BERT capture shades of association and connotation that vary across the different linguistic contexts of any particular word or span of text. Here we report a procedure for encoding scientific documents with these tools, measuring their improvement over static word embeddings in a nearest neighbor retrieval task. We find discriminability of contextual representations is strongly influenced by choice of pooling strategy for summarizing the high dimensional network activations. Importantly, we note that fundamentals such as domain matched training data are more important than state of the art NLP tools. Yet state of the art models did offer significant gains. The best approach we investigated combined domain matched pretraining, sound pooling, and state of the art deep transformer network encoders. Finally, with the goal of leveraging contextual representations from deep encoders, we present a range of measurements for understanding and forecasting research communities in science.


Irregular cusps of orthogonal modular varieties. Irregular cusp of an orthogonal modular variety is a cusp where the lattice for Fourier expansion is strictly smaller than the lattice of translation. Presence of such a cusp affects the study of pluricanonical forms on the modular variety using modular forms. We study toroidal compactification over an irregular cusp, and clarify there the cusp form criterion for the calculation of Kodaira dimension. At the same time, we show that irregular cusps do not arise frequently besides the cases when the group is neat or contains 1, we prove that the stable orthogonal groups of most (but not all) even lattices have no irregular cusp.


Semantic Detection of Potential Wind borne Debris in Construction Jobsites Digital Twining for Hurricane Preparedness and Jobsite Safety. In the United States, hurricanes are the most devastating natural disasters causing billions of dollars worth of damage every year. More importantly, construction jobsites are classified among the most vulnerable environments to severe wind events. During hurricanes, unsecured and incomplete elements of construction sites, such as scaffoldings, plywoods, and metal rods, will become the potential wind borne debris, causing cascading damages to the construction projects and the neighboring communities. Thus, it is no wonder that construction firms implement jobsite emergency plans to enforce preparedness responses before extreme weather events. However, relying on checklist based emergency action plans to carry out a thorough hurricane preparedness is challenging in large scale and complex site environments. For enabling systematic responses for hurricane preparedness, we have proposed a vision based technique to identify and analyze the potential wind borne debris in construction jobsites. Building on this, this paper demonstrates the fidelity of a new machine vision based method to support construction site hurricane preparedness and further discuss its implications. The outcomes indicate that the convenience of visual data collection and the advantages of the machine vision based frameworks enable rapid scene understanding and thus, provide critical heads up for practitioners to recognize and localize the potential wind borne derbies in construction jobsites and effectively implement hurricane preparedness.


A Network based Blockchain ecosystem for peer review publication. Blockchain as an emerging technology has transformed many traditional and conventional ecosystems and business models. Publication review system is one of the interesting subjects for transformation. The conventional models of publication review besides the urgent criticisms necessitates a transformation. This paper has investigated the most dominant shortcomings of literature review of publication review systems. Investigating the capabilities of Blockchain technology in the literature and its transformative capabilities, a network based Blockchain ecosystem is proposed. The ecosystem is providing a decentralized, transparent, and effective collaboration mechanisms for authors, reviewers, and other stakeholders in publication review processes. The main advantage of the ecosystem is committing the of all stakeholders and recognizing their contributions in a publication. Moreover, the ecosystem profits the stakeholders from the resulted reputation of the publication in future citations with its token model. The architecture of the proposed ecosystem supports the management of publication contents and sharing it for stakeholders. Moreover, it enables the configuration of smart contracts for governance of processes among stakeholders. It uses a token transaction Blockchain model to fulfill the token transactions. The capabilities and details of layers in the ecosystem has been discussed addressing the new paradigm of publication review ecosystem.


Adv OLM Generating Textual Adversaries via OLM. Deep learning models are susceptible to adversarial examples that have imperceptible perturbations in the original input, resulting in adversarial attacks against these models. Analysis of these attacks on the state of the art transformers in NLP can help improve the robustness of these models against such adversarial inputs. In this paper, we present Adv OLM, a black box attack method that adapts the idea of Occlusion and Language Models (OLM) to the current state of the art attack methods. OLM is used to rank words of a sentence, which are later substituted using word replacement strategies. We experimentally show that our approach outperforms other attack methods for several text classification tasks.


An operad of 3 manifolds. A coloured operad whose operadic operations are 3 cobordisms is introduced in this paper. This operad is presented purely combinatorially through diagrams in handlebodies together with a calculus, which is a generalization of Kirby's calculus. Both integral and rational calculi are developed and a calculus consisting of finite set of local moves is presented in the paper.


On plane algebraic curves passing through n independent nodes. Let a set of nodes mathcal X in the plane be n independent, i.e., each node has a fundamental polynomial of degree n. Assume that mathcal X d(n,k 3) 3 (n 1) n cdots (n k 5) 3 and 4 le k le n 1. In this paper we prove that there are at most seven linearly independent curves of degree less than or equal to k that pass through all the nodes of mathcal X. We provide a characterization of the case when there are exactly seven such curves. Namely, we prove that then the set mathcal X has a very special construction all its nodes but three belong to a (maximal) curve of degree k 3. Let us mention that in a series of such results this is the third one. In the end, an important application to the bivariate polynomial interpolation is provided, which is essential also for the study of the Gasca Maeztu conjecture.


What Remains of Visual Semantic Embeddings. Zero shot learning (ZSL) has seen a surge in interest over the decade for its tight links with the mechanism making young children recognize novel objects. Although different paradigms of visual semantic embedding models are designed to align visual features and distributed word representations, it is unclear to what extent current ZSL models encode semantic information from distributed word representations. In this work, we introduce the split of tiered ImageNet to the ZSL task, in order to avoid the structural flaws in the standard ImageNet benchmark. We build a unified framework for ZSL with contrastive learning as pre training, which guarantees no semantic information leakage and encourages linearly separable visual features. Our work makes it fair for evaluating visual semantic embedding models on a ZSL setting in which semantic inference is decisive. With this framework, we show that current ZSL models struggle with encoding semantic relationships from word analogy and word hierarchy. Our analyses provide motivation for exploring the role of context language representations in ZSL tasks.


Jira a Kurdish Speech Recognition System Designing and Building Speech Corpus and Pronunciation Lexicon. In this paper, we introduce the first large vocabulary speech recognition system (LVSR) for the Central Kurdish language, named Jira. The Kurdish language is an Indo European language spoken by more than 30 million people in several countries, but due to the lack of speech and text resources, there is no speech recognition system for this language. To fill this gap, we introduce the first speech corpus and pronunciation lexicon for the Kurdish language. Regarding speech corpus, we designed a sentence collection in which the ratio of di phones in the collection resembles the real data of the Central Kurdish language. The designed sentences are uttered by 576 speakers in a controlled environment with noise free microphones (called AsoSoft Speech Office) and in Telegram social network environment using mobile phones (denoted as AsoSoft Speech Crowdsourcing), resulted in 43.68 hours of speech. Besides, a test set including 11 different document topics is designed and recorded in two corresponding speech conditions (i.e., Office and Crowdsourcing). Furthermore, a 60K pronunciation lexicon is prepared in this research in which we faced several challenges and proposed solutions for them. The Kurdish language has several dialects and sub dialects that results in many lexical variations. Our methods for script standardization of lexical variations and automatic pronunciation of the lexicon tokens are presented in detail. To setup the recognition engine, we used the Kaldi toolkit. A statistical tri gram language model that is extracted from the AsoSoft text corpus is used in the system. Several standard recipes including HMM based models (i.e., mono, tri1, tr2, tri2, tri3), SGMM, and DNN methods are used to generate the acoustic model. These methods are trained with AsoSoft Speech Office and AsoSoft Speech Crowdsourcing and a combination of them. The best performance achieved by the SGMM acoustic model which results in 13.9 of the average word error rate (on different document topics) and 4.9 for the general topic.


Local Multi Head Channel Self Attention for Facial Expression Recognition. Since the Transformer architecture was introduced in 2017 there has been many attempts to bring the self attention paradigm in the field of computer vision. In this paper we propose a novel self attention module that can be easily integrated in virtually every convolutional neural network and that is specifically designed for computer vision, the LHC Local (multi) Head Channel (self attention). LHC is based on two main ideas first, we think that in computer vision the best way to leverage the self attention paradigm is the channel wise application instead of the more explored spatial attention and that convolution will not be replaced by attention modules like recurrent networks were in NLP second, a local approach has the potential to better overcome the limitations of convolution than global attention. With LHC Net we managed to achieve a new state of the art in the famous FER2013 dataset with a significantly lower complexity and impact on the "host" architecture in terms of computational cost when compared with the previous SOTA.


Convolution Properties of Orlicz Spaces on hypergroups. In this paper, for a locally compact commutative hypergroup K and for a pair ( Phi 1, Phi 2) of Young functions satisfying sequence condition, we give a necessary condition in terms of aperiodic elements of the center of K, for the convolution f ast g to exist a.e., where f and g are arbitrary elements of Orlicz spaces L Phi 1 (K) and L Phi 2 (K) , respectively. As an application, we present some equivalent conditions for compactness of a compactly generated locally compact abelian group. Moreover, we also characterize compact convolution operators from L 1 w(K) into L Phi w(K) for a weight w on a locally compact hypergroup K .


Adversarial Targeted Forgetting in Regularization and Generative Based Continual Learning Models. Continual (or "incremental") learning approaches are employed when additional knowledge or tasks need to be learned from subsequent batches or from streaming data. However these approaches are typically adversary agnostic, i.e., they do not consider the possibility of a malicious attack. In our prior work, we explored the vulnerabilities of Elastic Weight Consolidation (EWC) to the perceptible misinformation. We now explore the vulnerabilities of other regularization based as well as generative replay based continual learning algorithms, and also extend the attack to imperceptible misinformation. We show that an intelligent adversary can take advantage of a continual learning algorithm's capabilities of retaining existing knowledge over time, and force it to learn and retain deliberately introduced misinformation. To demonstrate this vulnerability, we inject backdoor attack samples into the training data. These attack samples constitute the misinformation, allowing the attacker to capture control of the model at test time. We evaluate the extent of this vulnerability on both rotated and split benchmark variants of the MNIST dataset under two important domain and class incremental learning scenarios. We show that the adversary can create a "false memory" about any task by inserting carefully designed backdoor samples to the test instances of that task thereby controlling the amount of forgetting of any task of its choosing. Perhaps most importantly, we show this vulnerability to be very acute and damaging the model memory can be easily compromised with the addition of backdoor samples into as little as 1 of the training data, even when the misinformation is imperceptible to human eye.


Coalescent Computing. As computational infrastructure extends to the edge, it will increasingly offer the same fine grained resource provisioning mechanisms used in large scale cloud datacenters, and advances in low latency, wireless networking technology will allow service providers to blur the distinction between local and remote resources for commodity computing. From the users' perspectives, their devices will no longer have fixed computational power, but rather will appear to have flexible computational capabilities that vary subject to the shared, disaggregated edge resources available in their physical proximity. System software will transparently leverage these ephemeral resources to provide a better end user experience. We discuss key systems challenges to enabling such tightly coupled, disaggregated, and ephemeral infrastructure provisioning, advocate for more research in the area, and outline possible paths forward.


Curriculum Design for Teaching via Demonstrations Theory and Applications. We consider the problem of teaching via demonstrations in sequential decision making settings. In particular, we study how to design a personalized curriculum over demonstrations to speed up the learner's convergence. We provide a unified curriculum strategy for two popular learner models Maximum Causal Entropy Inverse Reinforcement Learning (MaxEnt IRL) and Cross Entropy Behavioral Cloning (CrossEnt BC). Our unified strategy induces a ranking over demonstrations based on a notion of difficulty scores computed w.r.t. the teacher's optimal policy and the learner's current policy. Compared to the state of the art, our strategy doesn't require access to the learner's internal dynamics and still enjoys similar convergence guarantees under mild technical conditions. Furthermore, we adapt our curriculum strategy to the setting where no teacher agent is present using task specific difficulty scores. Experiments on a synthetic car driving environment and navigation based environments demonstrate the effectiveness of our curriculum strategy.


Non modal elastic instability and elastic waves in weakly perturbed channel flow. In this paper, we present experimental results and reveal that strong perturbations are not necessary for elastic instability to occur in straight channel, inertialess, visco elastic flows at high elasticity. We show that a non normal mode bifurcation is followed by chaotic fluctuations, self organized as stream wise streaks, and elastic waves due to weak disturbances generated by a small cavity at the center of the top channel wall. The chaotic flow persists in the transition, elastic turbulence, and drag reduction regimes, in agreement with previous observations for the case of strong perturbations at the inlet. Furthermore, the elastic waves we observe propagate in the span wise direction, which allows to confirm the elastic waves linear dispersion relation directly for the first time. In addition, the span wise propagating elastic wave's velocity depends on mathrm Wi with the same scaling that was previously observed for stream wise propagating waves, although their velocity magnitude is significantly smaller than what was previously observed for the stream wise ones.


Approximation of Spherical Bodies of Constant Width and Reduced Bodies. We present a spherical version of the theorem of Blaschke that every body of constant width w frac pi 2 can be approximated as well as we wish in the sense of the Hausdorff distance by a body of constant width w whose boundary consists only of pieces of circles of radius w . This is a special case of our theorem about approximation of spherical reduced bodies.


A tight negative example for MMS fair allocations. We consider the problem of allocating indivisible goods to agents with additive valuation functions. Kurokawa, Procaccia and Wang JACM, 2018 present instances for which every allocation gives some agent less than her maximin share. We present such examples with larger gaps. For three agents and nine items, we design an instance in which at least one agent does not get more than a frac 39 40 fraction of her maximin share. Moreover, we show that there is no negative example in which the difference between the number of items and the number of agents is smaller than six, and that the gap (of frac 1 40 ) of our example is worst possible among all instances with nine items. For n ge 4 agents, we show examples in which at least one agent does not get more than a 1 frac 1 n 4 fraction of her maximin share. In the instances designed by Kurokawa, Procaccia and Wang, the gap is exponentially small in n . Our proof techniques extend to allocation of chores (items of negative value), though the quantitative bounds for chores are different from those for goods. For three agents and nine chores, we design an instance in which the MMS gap is frac 1 43 .


Ontology Based Skill Description Learning for Flexible Production Systems. The increasing importance of resource efficient production entails that manufacturing companies have to create a more dynamic production environment, with flexible manufacturing machines and processes. To fully utilize this potential of dynamic manufacturing through automatic production planning, formal skill descriptions of the machines are essential. However, generating those skill descriptions in a manual fashion is labor intensive and requires extensive domain knowledge. In this contribution an ontology based semi automatic skill description system that utilizes production logs and industrial ontologies through inductive logic programming is introduced and benefits and drawbacks of the proposed solution are evaluated.


"What's in the box?!" Deflecting Adversarial Attacks by Randomly Deploying Adversarially Disjoint Models. Machine learning models are now widely deployed in real world applications. However, the existence of adversarial examples has been long considered a real threat to such models. While numerous defenses aiming to improve the robustness have been proposed, many have been shown ineffective. As these vulnerabilities are still nowhere near being eliminated, we propose an alternative deployment based defense paradigm that goes beyond the traditional white box and black box threat models. Instead of training a single partially robust model, one could train a set of same functionality, yet, adversarially disjoint models with minimal in between attack transferability. These models could then be randomly and individually deployed, such that accessing one of them minimally affects the others. Our experiments on CIFAR 10 and a wide range of attacks show that we achieve a significantly lower attack transferability across our disjoint models compared to a baseline of ensemble diversity. In addition, compared to an adversarially trained set, we achieve a higher average robust accuracy while maintaining the accuracy of clean examples.


Equivariant Burnside groups and toric varieties. We study G equivariant birational geometry of toric varieties, where G is a finite group.


Towards fast machine learning assisted Bayesian posterior inference of realistic microseismic events. Bayesian inference applied to microseismic activity monitoring allows for principled estimation of the coordinates of microseismic events from recorded seismograms, and their associated uncertainties. However, forward modelling of these microseismic events, necessary to perform Bayesian source inversion, can be prohibitively expensive in terms of computational resources. A viable solution is to train a surrogate model based on machine learning techniques, to emulate the forward model and thus accelerate Bayesian inference. In this paper, we improve on previous work, which considered only sources with isotropic moment tensor. We train a machine learning algorithm on the power spectrum of the recorded pressure wave and show that the trained emulator allows for the complete and fast retrieval of the event coordinates for textit any source mechanism. Moreover, we show that our approach is computationally inexpensive, as it can be run in less than 1 hour on a commercial laptop, while yielding accurate results using less than 10 4 training seismograms. We additionally demonstrate how the trained emulators can be used to identify the source mechanism through the estimation of the Bayesian evidence. This work lays the foundations for the efficient localisation and characterisation of any recorded seismogram, thus helping to quantify human impact on seismic activity and mitigate seismic hazard.


TAG Task based Accumulated Gradients for Lifelong learning. When an agent encounters a continual stream of new tasks in the lifelong learning setting, it leverages the knowledge it gained from the earlier tasks to help learn the new tasks better. In such a scenario, identifying an efficient knowledge representation becomes a challenging problem. Most research works propose to either store a subset of examples from the past tasks in a replay buffer, dedicate a separate set of parameters to each task or penalize excessive updates over parameters by introducing a regularization term. While existing methods employ the general task agnostic stochastic gradient descent update rule, we propose a task aware optimizer that adapts the learning rate based on the relatedness among tasks. We utilize the directions taken by the parameters during the updates by accumulating the gradients specific to each task. These task based accumulated gradients act as a knowledge base that is maintained and updated throughout the stream. We empirically show that our proposed adaptive learning rate not only accounts for catastrophic forgetting but also allows positive backward transfer. We also show that our method performs better than several state of the art methods in lifelong learning on complex datasets with a large number of tasks.


On fast convergence rates for generalized conditional gradient methods with backtracking stepsize. A generalized conditional gradient method for minimizing the sum of two convex functions, one of them differentiable, is presented. This iterative method relies on two main ingredients First, the minimization of a partially linearized objective functional to compute a descent direction and, second, a stepsize choice based on an Armijo like condition to ensure sufficient descent in every iteration. We provide several convergence results. Under mild assumptions, the method generates sequences of iterates which converge, on subsequences, towards minimizers. Moreover a sublinear rate of convergence for the objective functional values is derived. Second, we show that the method enjoys improved rates of convergence if the partially linearized problem fulfills certain growth estimates. Most notably these results do not require strong convexity of the objective functional. Numerical tests on a variety of challenging PDE constrained optimization problems confirm the practical efficiency of the proposed algorithm.


Cycle Self Training for Domain Adaptation. Mainstream approaches for unsupervised domain adaptation (UDA) learn domain invariant representations to narrow the domain shift. Recently, self training has been gaining momentum in UDA, which exploits unlabeled target data by training with target pseudo labels. However, as corroborated in this work, under distributional shift in UDA, the pseudo labels can be unreliable in terms of their large discrepancy from target ground truth. Thereby, we propose Cycle Self Training (CST), a principled self training algorithm that explicitly enforces pseudo labels to generalize across domains. CST cycles between a forward step and a reverse step until convergence. In the forward step, CST generates target pseudo labels with a source trained classifier. In the reverse step, CST trains a target classifier using target pseudo labels, and then updates the shared representations to make the target classifier perform well on the source data. We introduce the Tsallis entropy as a confidence friendly regularization to improve the quality of target pseudo labels. We analyze CST theoretically under realistic assumptions, and provide hard cases where CST recovers target ground truth, while both invariant feature learning and vanilla self training fail. Empirical results indicate that CST significantly improves over the state of the arts on visual recognition and sentiment analysis benchmarks.


The blowdown of ancient noncollapsed mean curvature flows. In this paper, we consider ancient noncollapsed mean curvature flows M t partial K t subset mathbb R n 1 that do not split off a line. It follows from general theory that the blowdown of any time slice, lim lambda to 0 lambda K t 0 , is at most n 1 dimensional. Here, we show that the blowdown is in fact at most n 2 dimensional. Our proof is based on fine cylindrical analysis, which generalizes the fine neck analysis that played a key role in many recent papers. Moreover, we show that in the uniformly k convex case, the blowdown is at most k 2 dimensional. This generalizes recent results from Choi Haslhofer Hershkovits to higher dimensions, and also has some applications towards the classification problem for singularities in 3 convex mean curvature flow.


Predicting the Success of Domain Adaptation in Text Similarity. Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect the success of domain adaptation. This paper models adaptation success and selection of the most suitable source domains among several candidates in text similarity. We use descriptive domain information and cross domain similarity metrics as predictive features. While mostly positive, the results also point to some domains where adaptation success was difficult to predict.


Study on the stability of thermoelastic Bresse and Timoshenko type systems with Gurtin Pipkin's law via the vertical displacements. The objective of this paper is to study the stability of a linear one dimensional thermoelastic Bresse system in a bounded domain, where the coupling is given through the first component of the Bresse model with the heat conduction of Gurtin Pipkin type. Two kinds of coupling are considered the first coupling is of order one with respect to space variable, and the second one is of order zero. We state the well posedness and show the polynomial stability of the systems, where the decay rates depend on the smoothness of initial data. Moreover, in case of coupling of order one, we prove the equivalence between the exponential stability and some new conditions on the parameters of the system. However, when the coupling is of order zero, we prove the non exponential stability independently of the parameters of the system. Applications to the corresponding particular Timoshenko models are also given, where we prove that both couplings lead to the exponential stability if and only if some conditions on the parameters of the systems are satisfied, and both couplings guarantee the polynomial stability independently of the parameters of the systems. The proof is based on the semigroup theory and a combination of the energy method and the frequency domain approach.


Necessary conditions to a fractional variational problem. In order to solve fractional variational problems, there exist two theorems of necessary conditions an Euler Lagrange equation which involves Caputo and Riemann Liouville fractional derivatives, and other Euler Lagrange equation that involves only Caputo derivatives. In this article, we make a comparison solving a particular fractional variational problem with both methods to obtain some conclusions about which method gives the optimal solution.


On dimension theory of supermodules, super rings and superschemes. We introduce the notion of Krull super dimension of supermodules over certain super commutative Noetherian super rings. We investigate how this notion relates to the notion of odd regular sequence introduced by T.Schmitt and how it behaves with respect to the transition to the graded and bigraded supermodules and super rings associated with the original ones. We also apply these results to the super dimension theory of superschemes of finite type and their morphisms.


Critical Empirical Study on Black box Explanations in AI. This paper provides empirical concerns about post hoc explanations of black box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative consumer panel to test our assumptions, we report three main findings. First, we show that post hoc explanations of black box model tend to give partial and biased information on the underlying mechanism of the algorithm and can be subject to manipulation or information withholding by diverting users' attention. Secondly, we show the importance of tested behavioral indicators, in addition to self reported perceived indicators, to provide a more comprehensive view of the dimensions of interpretability. This paper contributes to shedding new light on the actual theoretical debate between intrinsically transparent AI models and post hoc explanations of black box complex models a debate which is likely to play a highly influential role in the future development and operationalization of AI systems.


Robotic Electrospinning Actuated by Non Circular Joint Continuum Manipulator for Endoluminal Therapy. Electrospinning has exhibited excellent benefits to treat the trauma for tissue engineering due to its produced micro nano fibrous structure. It can effectively adhere to the tissue surface for long term continuous therapy. This paper develops a robotic electrospinning platform for endoluminal therapy. The platform consists of a continuum manipulator, the electrospinning device, and the actuation unit. The continuum manipulator has two bending sections to facilitate the steering of the tip needle for a controllable spinning direction. Non circular joint profile is carefully designed to enable a constant length of the centreline of a continuum manipulator for stable fluid transmission inside it. Experiments are performed on a bronchus phantom, and the steering ability and bending limitation in each direction are also investigated. The endoluminal electrospinning is also fulfilled by a trajectory following and points targeting experiments. The effective adhesive area of the produced fibre is also illustrated. The proposed robotic electrospinning shows its feasibility to precisely spread more therapeutic drug to construct fibrous structure for potential endoluminal treatment.


Bone Adaptation as a Geometric Flow. This paper presents bone adaptation as a geometric flow. The proposed method is based on two assumptions first, that the bone surface is smooth (not fractal) permitting the definition of a tangent plane and, second, that the interface between marrow and bone tissue phases is orientable. This permits the analysis of bone adaptation using the well developed mathematics of geometric flows and the numerical techniques of the level set method. Most importantly, topological changes such as holes forming in plates and rods disconnecting can be treated formally and simulated naturally. First, the relationship between biological theories of bone adaptation and the mathematical object describing geometric flow is described. This is termed the adaptation function, F , and is the multi scale link described by Frost's Utah paradigm between cellular dynamics and bone structure. Second, a model of age related bone loss termed curvature based bone adaptation is presented. Using previous literature, it is shown that curvature based bone adaptation is the limiting continuous equation of simulated bone atrophy, a discrete model of bone aging. Interestingly, the parameters of the model can be defined in such a way that the flow is volume preserving. This implies that bone health can in principle change in ways that fundamentally cannot be measured by areal or volumetric bone mineral density, requiring structure level imaging. Third, a numerical method is described and two in silico experiments are performed demonstrating the non volume preserving and volume preserving cases. Taken together, recognition of bone adaptation as a geometric flow permits the recruitment of mathematical and numerical developments over the last 50 years to understanding and describing the complex surface of bone.


Cyberphysical Sequencing for Distributed Asset Management with Broad Traceability. Cyber Physical systems (CPS) have complex lifecycles involving multiple stakeholders, and the transparency of both hardware and software components' supply chain is opaque at best. This raises concerns for stakeholders who may not trust that what they receive is what was requested. There is an opportunity to build a cyberphysical titling process offering universal traceability and the ability to differentiate systems based on provenance. Today, RFID tags and barcodes address some of these needs, though they are easily manipulated due to non linkage with an object or system's intrinsic characteristics. We propose cyberphysical sequencing as a low cost, light weight and pervasive means of adding track and trace capabilities to any asset that ties a system's physical identity to a unique and invariant digital identifier. CPS sequencing offers benefits similar Digital Twins' for identifying and managing the provenance and identity of an asset throughout its life with far fewer computational and other resources.


Support Vector Machine for Handwritten Character Recognition. Handwriting recognition has been one of the most fascinating and challenging research areas in field of image processing and pattern recognition. It contributes enormously to the improvement of automation process. In this paper, a system for recognition of unconstrained handwritten Malayalam characters is proposed. A database of 10,000 character samples of 44 basic Malayalam characters is used in this work. A discriminate feature set of 64 local and 4 global features are used to train and test SVM classifier and achieved 92.24 accuracy


Hidden symmetries and limit laws in the extreme order statistics of the Laplace random walk. This paper is concerned with the limit laws of the extreme order statistics derived from a symmetric Laplace walk. We provide two different descriptions of the point process of the limiting extreme order statistics a branching representation and a squared Bessel representation. These complementary descriptions expose various hidden symmetries in branching processes and Brownian motion which lie behind some striking formulas found by Schehr and Majumdar (Phys. Rev. Lett., 108 040601). In particular, the Bessel process of dimension 4 2 2 appears in the descriptions as a path decomposition of Brownian motion at a local minimum and the Ray Knight description of Brownian local times near the minimum.


Where to locate COVID 19 mass vaccination facilities?. The outbreak of COVID 19 led to a record breaking race to develop a vaccine. However, the limited vaccine capacity creates another massive challenge how to distribute vaccines to mitigate the near end impact of the pandemic? In the United States in particular, the new Biden administration is launching mass vaccination sites across the country, raising the obvious question of where to locate these clinics to maximize the effectiveness of the vaccination campaign. This paper tackles this question with a novel data driven approach to optimize COVID 19 vaccine distribution. We first augment a state of the art epidemiological model, called DELPHI, to capture the effects of vaccinations and the variability in mortality rates across age groups. We then integrate this predictive model into a prescriptive model to optimize the location of vaccination sites and subsequent vaccine allocation. The model is formulated as a bilinear, non convex optimization model. To solve it, we propose a coordinate descent algorithm that iterates between optimizing vaccine distribution and simulating the dynamics of the pandemic. As compared to benchmarks based on demographic and epidemiological information, the proposed optimization approach increases the effectiveness of the vaccination campaign by an estimated 20 , saving an extra 4000 extra lives in the United States over a three month period. The proposed solution achieves critical fairness objectives by reducing the death toll of the pandemic in several states without hurting others and is highly robust to uncertainties and forecast errors by achieving similar benefits under a vast range of perturbations.


Dueling RL Reinforcement Learning with Trajectory Preferences. We consider the problem of preference based reinforcement learning (PbRL), where, unlike traditional reinforcement learning, an agent receives feedback only in terms of a 1 bit (0 1) preference over a trajectory pair instead of absolute rewards for them. The success of the traditional RL framework crucially relies on the underlying agent reward model, which, however, depends on how accurately a system designer can express an appropriate reward function and often a non trivial task. The main novelty of our framework is the ability to learn from preference based trajectory feedback that eliminates the need to hand craft numeric reward models. This paper sets up a formal framework for the PbRL problem with non markovian rewards, where the trajectory preferences are encoded by a generalized linear model of dimension d . Assuming the transition model is known, we then propose an algorithm with almost optimal regret guarantee of tilde mathcal O left( SH d log (T delta) sqrt T right) . We further, extend the above algorithm to the case of unknown transition dynamics, and provide an algorithm with near optimal regret guarantee widetilde mathcal O (( sqrt d H 2 mathcal S ) sqrt dT sqrt mathcal S mathcal A TH ) . To the best of our knowledge, our work is one of the first to give tight regret guarantees for preference based RL problems with trajectory preferences.


Intrinsically Motivated Self supervised Learning in Reinforcement Learning. In vision based reinforcement learning (RL) tasks, it is prevalent to assign the auxiliary task with a surrogate self supervised loss so as to obtain more semantic representations and improve sample efficiency. However, abundant information in self supervised auxiliary tasks has been disregarded, since the representation learning part and the decision making part are separated. To sufficiently utilize information in the auxiliary task, we present a simple yet effective idea to employ self supervised loss as an intrinsic reward, called Intrinsically Motivated Self Supervised learning in Reinforcement learning (IM SSR). We formally show that the self supervised loss can be decomposed as exploration for novel states and robustness improvement from nuisance elimination. IM SSR can be effortlessly plugged into any reinforcement learning with self supervised auxiliary objectives with nearly no additional cost. Combined with IM SSR, the previous underlying algorithms achieve salient improvements on both sample efficiency and generalization in various vision based robotics tasks from the DeepMind Control Suite, especially when the reward signal is sparse.


Geolog Scalable Logic Programming on Spatial Data. Spatial data is ubiquitous in our data driven society. The Logic Programming community has been investigating the use of spatial data in different settings. Despite the success of this research, the Geographic Information System (GIS) community has rarely made use of these new approaches. This has mainly two reasons. First, there is a lack of tools that tightly integrate logical reasoning into state of the art GIS software. Second, the scalability of solutions has often not been tested and hence, some solutions might work on toy examples but do not scale well to real world settings. The two main contributions of this paper are (1) the Relation Based Programming paradigm, expressing rules on relations instead of individual entities, and (2) Geolog, a tool for spatio logical reasoning that can be installed on top of ArcMap, which is an industry standard GIS. We evaluate our new Relation Based Programming paradigm in four real world scenarios and show that up to two orders of magnitude in performance gain can be achieved compared to the prevalent Entity Based Programming paradigm.


NADE A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations. Adverse Drug Event (ADE) extraction models can rapidly examine large collections of social media texts, detecting mentions of drug related adverse reactions and trigger medical investigations. However, despite the recent advances in NLP, it is currently unknown if such models are robust in face of negation, which is pervasive across language varieties. In this paper we evaluate three state of the art systems, showing their fragility against negation, and then we introduce two possible strategies to increase the robustness of these models a pipeline approach, relying on a specific component for negation detection an augmentation of an ADE extraction dataset to artificially create negated samples and further train the models. We show that both strategies bring significant increases in performance, lowering the number of spurious entities predicted by the models. Our dataset and code will be publicly released to encourage research on the topic.


Translation equivariant Image Quantizer for Bi directional Image Text Generation. Recently, vector quantized image modeling has demonstrated impressive performance on generation tasks such as text to image generation. However, we discover that the current image quantizers do not satisfy translation equivariance in the quantized space due to aliasing, degrading performance in the downstream text to image generation and image to text generation, even in simple experimental setups. Instead of focusing on anti aliasing, we take a direct approach to encourage translation equivariance in the quantized space. In particular, we explore a desirable property of image quantizers, called 'Translation Equivariance in the Quantized Space' and propose a simple but effective way to achieve translation equivariance by regularizing orthogonality in the codebook embedding vectors. Using this method, we improve accuracy by 22 in text to image generation and 26 in image to text generation, outperforming the VQGAN.


Riemann solvers and pressure gradients in Godunov type schemes for variable density incompressible flows. Variable density incompressible flows are governed by parabolic equations. The artificial compressibility method makes these equations hyperbolic type, which means that they can be solved using techniques developed for compressible flows, such as Godunov type schemes. While the artificial compressibility method is well established, its application to variable density flows has been largely neglected in the literature. This paper harnesses recent advances in the wider field by applying a more robust Riemann solver and a more easily parallelisable time discretisation to the variable density equations than previously. We also develop a new method for calculating the pressure gradient as part of the second order reconstruction step. Based on a rearrangement of the momentum equation and an exploitation of the other gradients and source terms, the new pressure gradient calculation automatically captures the pressure gradient discontinuity at the free surface. Benchmark tests demonstrate the improvements gained by this robust Riemann solver and new pressure gradient calculation.


The Lehmer factorial norm on S n . We introduce a new family of norms on the permutation groups S n . We examine their properties.


Smoothing Dialogue States for Open Conversational Machine Reading. Conversational machine reading (CMR) requires machines to communicate with humans through multi turn interactions between two salient dialogue states of decision making and question generation processes. In open CMR settings, as the more realistic scenario, the retrieved background knowledge would be noisy, which results in severe challenges in the information transmission. Existing studies commonly train independent or pipeline systems for the two subtasks. However, those methods are trivial by using hard label decisions to activate question generation, which eventually hinders the model performance. In this work, we propose an effective gating strategy by smoothing the two dialogue states in only one decoder and bridge decision making and question generation to provide a richer dialogue state reference. Experiments on the OR ShARC dataset show the effectiveness of our method, which achieves new state of the art results.


Atomic systems in n Hilbert spaces and their tensor products. Concept of a family of local atoms in n Hilbert space is being studied. K frame in tensor product of n Hilbert spaces is described and a characterization is given. Atomic system in tensor product of n Hilbert spaces is presented and established a relationship between atomic systems in n Hilbert spaces and their tensor products.


3 D Material Style Transfer for Reconstructing Unknown Appearance in Complex Natural Materials. We propose a 3 D material style transfer framework for reconstructing invisible (or faded) appearance properties in complex natural materials. Our algorithm addresses the technical challenge of transferring appearance properties from one object to another of the same material when both objects have intricate, noncorresponding color patterns. Eggshells, exoskeletons, and minerals, for example, have patterns composed of highly randomized layers of organic and inorganic compounds. These materials pose a challenge as the distribution of compounds that determine surface color changes from object to object and within local pattern regions. Our solution adapts appearance observations from a material property distribution in an exemplar to the material property distribution of a target object to reconstruct its unknown appearance. We use measured reflectance in 3 D bispectral textures to record changing material property distributions. Our novel implementation of spherical harmonics uses principles from chemistry and biology to learn relationships between color (hue and saturation) and material composition and concentration in an exemplar. The encoded relationships are transformed to the property distribution of a target for color recovery and material assignment. Quantitative and qualitative evaluation methods show that we replicate color patterns more accurately than methods that only rely on shape correspondences and coarse level perceptual differences. We demonstrate applications of our work for reconstructing color in extinct fossils, restoring faded artifacts and generating synthetic textures.


Factorization method with one plane wave from model driven and data driven perspectives. The factorization method by Kirsch (1998) provides a necessary and sufficient condition for characterizing the shape and position of an unknown scatterer by using far field patterns of infinitely many time harmonic plane waves at a fixed frequency. This paper is concerned with the factorization method with a single far field pattern to recover a convex polygonal scatterer source. Its one wave version relies on the absence of analytical continuation of the scattered radiated wave fields in corner domains. It can be regarded as a domain defined sampling method and does not require forward solvers. In this paper we provide a rigorous mathematical justification of the one wave factorization method and present some preliminary numerical examples. In particular, the proposed scheme can be interpreted as a model driven and data driven method, because it essentially depends on the scattering model and a priori given emph sample data .


Learning to drive from a world on rails. We learn an interactive vision based driving policy from pre recorded driving logs via a model based approach. A forward model of the world supervises a driving policy that predicts the outcome of any potential driving trajectory. To support learning from pre recorded logs, we assume that the world is on rails, meaning neither the agent nor its actions influence the environment. This assumption greatly simplifies the learning problem, factorizing the dynamics into a nonreactive world model and a low dimensional and compact forward model of the ego vehicle. Our approach computes action values for each training trajectory using a tabular dynamic programming evaluation of the Bellman equations these action values in turn supervise the final vision based driving policy. Despite the world on rails assumption, the final driving policy acts well in a dynamic and reactive world. At the time of writing, our method ranks first on the CARLA leaderboard, attaining a 25 higher driving score while using 40 times less data. Our method is also an order of magnitude more sample efficient than state of the art model free reinforcement learning techniques on navigational tasks in the ProcGen benchmark.


Dynamic Graph Learning Neural Network for Multivariate Time Series Modeling. Multivariate time series forecasting is a challenging task because the data involves a mixture of long and short term patterns, with dynamic spatio temporal dependencies among variables. Existing graph neural networks (GNN) typically model multivariate relationships with a pre defined spatial graph or learned fixed adjacency graph. It limits the application of GNN and fails to handle the above challenges. In this paper, we propose a novel framework, namely static and dynamic graph learning neural network (SDGL). The model acquires static and dynamic graph matrices from data to model long and short term patterns respectively. Static matric is developed to capture the fixed long term association pattern via node embeddings, and we leverage graph regularity for controlling the quality of the learned static graph. To capture dynamic dependencies among variables, we propose dynamic graphs learning method to generate time varying matrices based on changing node features and static node embeddings. And in the method, we integrate the learned static graph information as inductive bias to construct dynamic graphs and local spatio temporal patterns better. Extensive experiments are conducted on two traffic datasets with extra structural information and four time series datasets, which show that our approach achieves state of the art performance on almost all datasets. If the paper is accepted, I will open the source code on github.


Corrigendum On the construction of Weakly Ulrich bundles. This note corrects a mistake in Theorem 4.1 of https doi.org 10.1016 j.aim.2021.107598 (arXiv 1901.03395). The error noted here does not affect any other results of loc. cit. To correct the error, here I prove a more general result (Theorem 3.1) and deduce Theorem 3.3 and also the correct version of the previously announced theorem in Theorem 3.4. Theorem 3.5 supplements Theorem 3.3. In it, I prove that if k is an algebraically closed field of characteristic p geq 3 and X k is any smooth, projective, minimal surface of general type and with Pic(X) mathbb Z , then for all integers r geq 5 , X is embedded as a smooth surface by its pluricanonical linear system X hookrightarrow omega X r , and E F ( omega X r 1 )(1) is an almost Ulrich bundle for the pluricanonical embedding X hookrightarrow omega X r of X and for the ample line bundle provided by this embedding. Corollary 3.6 generalizes Theorem 3.1 of https doi.org 10.1016 j.aim.2021.107598 (arXiv 1901.03395). In particular this note corrects and extends the results of loc. cit.


A diffuse interface lattice Boltzmann method for fluid particle interaction problems. In this paper, a diffuse interface lattice Boltzmann method (DI LBM) is developed for fluid particle interaction problems. In this method, the sharp interface between the fluid and solid is replaced by a thin but nonzero thickness transition region named diffuse interface, where the physical variables varies continuously. In order to describe the diffuse interface, we introduce a smooth function, which is similar to the order parameter in phase field model or the volume fraction of solid phase in the partially saturated lattice Boltzmann method (PS LBM). In addition, to depict the fluid particle interaction more accurately, a modified force term is also proposed and included in the evolution equation of the DI LBM. Some classical problems are used to test the DI LBM, and the results are in good agreement with some available theoretical and numerical works. Finally, it is also found that the DI LBM is more efficient and accurate than the PS LBM with the superposition model.


Multivariate Hawkes processes on inhomogeneous random graphs. We consider a population of N interacting neurons, represented by a multivariate Hawkes process the firing rate of each neuron depends on the history of the connected neurons. Contrary to the mean field framework where the interaction occurs on the complete graph, the connectivity between particles is given by a random possibly diluted and inhomogeneous graph where the probability of presence of each edge depends on the spatial position of its vertices. We address the well posedness of this system and Law of Large Numbers results as N to infty . A crucial issue will be to understand how spatial inhomogeneity influences the large time behavior of the system.


A compact manifold with infinite dimensional co invariant cohomology. Let M be a smooth manifold. When Gamma is a group acting on the manifold M by diffeomorphisms one can define the Gamma co invariant cohomology of M to be the cohomology of the differential complex Omega c(M) Gamma mathrm span omega gamma omega, omega in Omega c(M), gamma in Gamma . For a Lie algebra mathcal G acting on the manifold M , one defines the cohomology of mathcal G divergence forms to be the cohomology of the complex mathcal C mathcal G (M) mathrm span L X omega, omega in Omega c(M), X in mathcal G . In this short paper we present a situation where these two cohomologies are infinite dimensional.


DRAS CQSim A Reinforcement Learning based Framework for HPC Cluster Scheduling. For decades, system administrators have been striving to design and tune cluster scheduling policies to improve the performance of high performance computing (HPC) systems. However, the increasingly complex HPC systems combined with highly diverse workloads make such manual process challenging, time consuming, and error prone. We present a reinforcement learning based HPC scheduling framework named DRAS CQSim to automatically learn optimal scheduling policy. DRAS CQSim encapsulates simulation environments, agents, hyperparameter tuning options, and different reinforcement learning algorithms, which allows the system administrators to quickly obtain customized scheduling policies.


An interdisciplinary conceptual study of Artificial Intelligence (AI) for helping benefit risk assessment practices Towards a comprehensive qualification matrix of AI programs and devices (pre print 2020). This paper proposes a comprehensive analysis of existing concepts coming from different disciplines tackling the notion of intelligence, namely psychology and engineering, and from disciplines aiming to regulate AI innovations, namely AI ethics and law. The aim is to identify shared notions or discrepancies to consider for qualifying AI systems. Relevant concepts are integrated into a matrix intended to help defining more precisely when and how computing tools (programs or devices) may be qualified as AI while highlighting critical features to serve a specific technical, ethical and legal assessment of challenges in AI development. Some adaptations of existing notions of AI characteristics are proposed. The matrix is a risk based conceptual model designed to allow an empirical, flexible and scalable qualification of AI technologies in the perspective of benefit risk assessment practices, technological monitoring and regulatory compliance it offers a structured reflection tool for stakeholders in AI development that are engaged in responsible research and innovation.Pre print version (achieved on May 2020)


On refined blowup estimates for the exponential reaction diffusion equation. We consider radial decreasing solutions of the semilinear heat equation with exponential nonlinearity. We provide a relatively simple proof of the sharp upper estimates for the final blowup profile and for the refined space time behavior. We actually establish a global, upper space time estimate, which contains those of the final and refined profiles as special cases.


The beta Delaunay tessellation II The Gaussian limit tessellation. We study the weak convergence of beta and beta' Delaunay tessellations in mathbb R d 1 that were introduced in part I of this paper, as beta to infty . The limiting stationary simplicial random tessellation, which is called the Gaussian Delaunay tessellation, is characterized in terms of a space time paraboloid hull process in mathbb R d 1 times mathbb R . The latter object has previously appeared in the analysis of the number of shocks in the solution of the inviscid Burgers' equation and the description of the local asymptotic geometry of Gaussian random polytopes. In this paper it is used to define a new stationary random simplicial tessellation in mathbb R d 1 . As for the beta and beta' Delaunay tessellation, the distribution of volume power weighted typical cells in the Gaussian Delaunay tessellation is explicitly identified, establishing thereby a new bridge to Gaussian random simplices. Also major geometric characteristics of these cells such as volume moments, expected angle sums and also the cell intensities of the Gaussian Delaunay tessellation are investigated.


Mimic An adaptive algorithm for multivariate time series classification. Time series data are valuable but are often inscrutable. Gaining trust in time series classifiers for finance, healthcare, and other critical applications may rely on creating interpretable models. Researchers have previously been forced to decide between interpretable methods that lack predictive power and deep learning methods that lack transparency. In this paper, we propose a novel Mimic algorithm that retains the predictive accuracy of the strongest classifiers while introducing interpretability. Mimic mirrors the learning method of an existing multivariate time series classifier while simultaneously producing a visual representation that enhances user understanding of the learned model. Experiments on 26 time series datasets support Mimic's ability to imitate a variety of time series classifiers visually and accurately.


Scalar and Matrix Chernoff Bounds from ell infty Independence. We present new scalar and matrix Chernoff style concentration bounds for a broad class of probability distributions over the binary hypercube 0,1 n . Motivated by recent tools developed for the study of mixing times of Markov chains on discrete distributions, we say that a distribution is ell infty independent when the infinity norm of its influence matrix mathcal I is bounded by a constant. We show that any distribution which is ell infty independent satisfies a matrix Chernoff bound that matches the matrix Chernoff bound for independent random variables due to Tropp. Our matrix Chernoff bound is a broad generalization and strengthening of the matrix Chernoff bound of Kyng and Song (FOCS'18). Using our bound, we can conclude as a corollary that a union of O( log V ) random spanning trees gives a spectral graph sparsifier of a graph with V vertices with high probability, matching results for independent edge sampling, and matching lower bounds from Kyng and Song.


Formal Guarantees of Timely Progress for Distributed Knowledge Propagation. Autonomous air traffic management (ATM) operations for urban air mobility (UAM) will necessitate the use of distributed protocols for decentralized coordination between aircraft. As UAM operations are time critical, it will be imperative to have formal guarantees of progress for the distributed protocols used in ATM. Under asynchronous settings, message transmission and processing delays are unbounded, making it impossible to provide deterministic bounds on the time required to make progress. We present an approach for formally guaranteeing timely progress in a Two Phase Acknowledge distributed knowledge propagation protocol by probabilistically modeling the delays using theories of the Multicopy Two Hop Relay protocol and the M M 1 queue system. The guarantee states a probabilistic upper bound to the time for progress as a function of the probabilities of the total transmission and processing delays being less than two given values. We also showcase the development of a library of formal theories, that is tailored towards reasoning about timely progress in distributed protocols deployed in airborne networks, in the Athena proof assistant.


The Zero Set of an Electrical Field from a Finite Number of Point Charges One, Two, and Three Dimensions. We study the structure of the zero set of a finite point charge electrical field F (X,Y,Z) in mathbb R 3 . Indeed, mostly we focus on a finite point charge electrical field F (X,Y) in mathbb R 2 . The well known conjecture is that the zero set of F (X,Y) is finite. We show that this is true in a Special Case when the point charges for F (X,Y) lie on a line. In addition, we give fairly complete structural information about the zero sets of X and Y for F (X,Y) in the Special Case. A highlight of the paper states that in the Special Case the zero set of F (X,Y) contains at most 9M 24 M points, where M is the number of point charges.


A Point free Perspective on Lax extensions and Predicate liftings. In this paper we have a fresh look at the connection between lax extensions and predicate liftings of a functor from the point of view of quantale enriched relations. Using this perspective, in particular we show that various fundamental concepts and results arise naturally and their proofs become very elementary. Ultimately, we prove that every lax extension is represented by a class of predicate liftings and discuss several implications of this result.


Singularities of the stress concentration in the presence of C 1, alpha inclusions with core shell geometry. In high contrast composites, if an inclusion is in close proximity to the matrix boundary, then the stress, which is represented by the gradient of a solution to the Lam ' e systems of linear elasticity, may exhibits the singularities with respect to the distance varepsilon between them. In this paper, we establish the asymptotic formulas of the stress concentration for core shell geometry with C 1, alpha boundaries in all dimensions by precisely capturing all the blow up factor matrices, as the distance varepsilon between interfacial boundaries of a core and a surrounding shell goes to zero. Further, a direct application of these blow up factor matrices gives the optimal gradient estimates.


Leary Minasyan subgroups of biautomatic groups. Commensurating HNN extensions of mathbb Z n , or Leary Minasyan groups, have recently been studied by I. J. Leary and A. Minasyan. These groups are higher dimensional analogues of Baumslag Solitar groups. Among other results, Leary Minasyan groups were shown to serve as first known examples of CAT(0) groups that are not biautomatic. It is well known that a Baumslag Solitar groups are either biautomatic or not embeddable in biautomatic groups. Motivated by this, we may ask whether a similar dichotomy holds for Leary Minasyan groups. In this paper, we answer this question in the affirmative, thus providing examples of CAT(0) groups that are not subgroups of biautomatic groups. The proof relies on studying commensurators of arbitrary finitely generated abelian subgroups in biautomatic groups.


LoRA Low Rank Adaptation of Large Language Models. An important paradigm of natural language processing consists of large scale pre training on general domain data and adaptation to particular tasks or domains. As we pre train larger models, full fine tuning, which retrains all model parameters, becomes less feasible. Using GPT 3 175B as an example deploying independent instances of fine tuned models, each with 175B parameters, is prohibitively expensive. We propose Low Rank Adaptation, or LoRA, which freezes the pre trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks. Compared to GPT 3 175B fine tuned with Adam, LoRA can reduce the number of trainable parameters by 10,000 times and the GPU memory requirement by 3 times. LoRA performs on par or better than fine tuning in model quality on RoBERTa, DeBERTa, GPT 2, and GPT 3, despite having fewer trainable parameters, a higher training throughput, and, unlike adapters, no additional inference latency. We also provide an empirical investigation into rank deficiency in language model adaptation, which sheds light on the efficacy of LoRA. We release a package that facilitates the integration of LoRA with PyTorch models and provide our implementations and model checkpoints for RoBERTa, DeBERTa, and GPT 2 at https github.com microsoft LoRA.


A Survey on Deep Learning Technique for Video Segmentation. Video segmentation, i.e., partitioning video frames into multiple segments or objects, plays a critical role in a broad range of practical applications, from enhancing visual effects in movie, to understanding scenes in autonomous driving, to virtual background creation in video conferencing, just to name a few. Recently, due to the renaissance of connectionism in computer vision, there has been an influx of deep learning based approaches for video segmentation that have delivered compelling performance. In this survey, we comprehensively review two basic lines of research generic object segmentation (of unknown categories) in videos and video semantic segmentation by introducing their respective task settings, background concepts, perceived need, development history, and main challenges. We also provide a detailed overview of representative literature on both methods and datasets. Additionally, we present quantitative performance comparisons of the reviewed methods on benchmark datasets. Finally, we point out a set of unsolved open issues in this field, and suggest possible opportunities for further research. A public website is provided to continuously track recent developments in this fast advancing field https github.com tfzhou VS Survey.


Exponential stabilization on infinite dimensional system with impulse controls. This paper studies the exponential stabilization on infinite dimensional system with impulse controls, where impulse instants appear periodically. The first main result shows that exponential stabilizability of the control system with a periodic feedback law is equivalent to one kind of weak observability inequalities. The second main result presents that, in the setting of a discrete LQ problem, the exponential stabilizability of control system with a periodic feedback law is equivalent to the solvability of an algebraic Riccati type equation which was built up in Qin, Wang and Yu, SIAM J. Control Optim., 59 (2021), pp. 1136 1160 for finite dimensional system. As an application, some sufficient and necessary condition for the exponential stabilization of an impulse controlled system governed by coupled heat equations is given.


A Cyber Threat Intelligence Sharing Scheme based on Federated Learning for Network Intrusion Detection. The uses of Machine Learning (ML) in detection of network attacks have been effective when designed and evaluated in a single organisation. However, it has been very challenging to design an ML based detection system by utilising heterogeneous network data samples originating from several sources. This is mainly due to privacy concerns and the lack of a universal format of datasets. In this paper, we propose a collaborative federated learning scheme to address these issues. The proposed framework allows multiple organisations to join forces in the design, training, and evaluation of a robust ML based network intrusion detection system. The threat intelligence scheme utilises two critical aspects for its application the availability of network data traffic in a common format to allow for the extraction of meaningful patterns across data sources. Secondly, the adoption of a federated learning mechanism to avoid the necessity of sharing sensitive users' information between organisations. As a result, each organisation benefits from other organisations cyber threat intelligence while maintaining the privacy of its data internally. The model is trained locally and only the updated weights are shared with the remaining participants in the federated averaging process. The framework has been designed and evaluated in this paper by using two key datasets in a NetFlow format known as NF UNSW NB15 v2 and NF BoT IoT v2. Two other common scenarios are considered in the evaluation process a centralised training method where the local data samples are shared with other organisations and a localised training method where no threat intelligence is shared. The results demonstrate the efficiency and effectiveness of the proposed framework by designing a universal ML model effectively classifying benign and intrusive traffic originating from multiple organisations without the need for local data exchange.


User Driven Programming Support for Rapid Visualization Authoring in D3. D3 is arguably the most popular language for programming visualizations online. However, D3 requires a level of programming proficiency that fledgling analysts may not yet possess. Instead of asking users to switch to simpler languages or direct manipulation tools, we propose automated programming support features to augment users' existing skill sets. To this end, we mine D3 examples from the web and programmatically translate them into three automated features template completion to quickly program initial visualizations recommendations to suggest complementary interactions for a users' D3 program and code augmentation to implement recommended interactions with a single click. We demonstrate these features in Minerva, an automated development environment for programming interactive D3 visualizations. In a user study with 20 D3 users, we find that Minerva enables participants to program interactive visualizations in D3 with significantly less time and effort.


Dynamic Actuation of DNA Assembled Plasmonic Nanostructures in Microfluidic Cell Sized Compartments. Molecular motor proteins form the basis of cellular dynamics. Recently, notable efforts have led to the creation of their DNA based mimics, which can carry out complex nanoscale motion. However, such functional analogues have not yet been integrated or operated inside synthetic cells toward the goal of realizing artificial biological systems entirely from the bottom up. In this Letter, we encapsulate and actuate DNA assembled dynamic nanostructures inside cell sized microfluidic compartments. These encapsulated DNA nanostructures not only exhibit structural reconfigurability owing to their pH sensitive molecular switches upon external stimuli but also possess optical feedback enabled by the integrated plasmonic probes. In particular, we demonstrate the power of microfluidic compartmentalization for achieving on chip plasmonic enantiomer separation and substrate filtration. Our work exemplifies that the two unique tools, droplet based microfluidics and DNA technology, offering high precision on the microscale and nanoscale, respectively, can be brought together to greatly enrich the complexity and diversity of functional synthetic systems.


Dual Modality Vehicle Anomaly Detection via Bilateral Trajectory Tracing. Traffic anomaly detection has played a crucial role in Intelligent Transportation System (ITS). The main challenges of this task lie in the highly diversified anomaly scenes and variational lighting conditions. Although much work has managed to identify the anomaly in homogenous weather and scene, few resolved to cope with complex ones. In this paper, we proposed a dual modality modularized methodology for the robust detection of abnormal vehicles. We introduced an integrated anomaly detection framework comprising the following modules background modeling, vehicle tracking with detection, mask construction, Region of Interest (ROI) backtracking, and dual modality tracing. Concretely, we employed background modeling to filter the motion information and left the static information for later vehicle detection. For the vehicle detection and tracking module, we adopted YOLOv5 and multi scale tracking to localize the anomalies. Besides, we utilized the frame difference and tracking results to identify the road and obtain the mask. In addition, we introduced multiple similarity estimation metrics to refine the anomaly period via backtracking. Finally, we proposed a dual modality bilateral tracing module to refine the time further. The experiments conducted on the Track 4 testset of the NVIDIA 2021 AI City Challenge yielded a result of 0.9302 F1 Score and 3.4039 root mean square error (RMSE), indicating the effectiveness of our framework.


PAMA TTS Progression Aware Monotonic Attention for Stable Seq2Seq TTS With Accurate Phoneme Duration Control. Sequence expansion between encoder and decoder is a critical challenge in sequence to sequence TTS. Attention based methods achieve great naturalness but suffer from unstable issues like missing and repeating phonemes, not to mention accurate duration control. Duration informed methods, on the contrary, seem to easily adjust phoneme duration but show obvious degradation in speech naturalness. This paper proposes PAMA TTS to address the problem. It takes the advantage of both flexible attention and explicit duration models. Based on the monotonic attention mechanism, PAMA TTS also leverages token duration and relative position of a frame, especially countdown information, i.e. in how many future frames the present phoneme will end. They help the attention to move forward along the token sequence in a soft but reliable control. Experimental results prove that PAMA TTS achieves the highest naturalness, while has on par or even better duration controllability than the duration informed model.


Impact of Weight Loss on Brain Age Improved Brain Health Following Bariatric Surgery. Overweight and obese individuals tend to have increased brain age, reflecting poorer brain health likely due to grey and white matter atrophy related to obesity. However, it is unclear if older brain age associated with obesity can be reversed following weight loss and cardiometabolic health improvement. The aim of this study was to assess the impact of weight loss and cardiometabolic improvement following bariatric surgery on brain health, as measured by change in brain age estimated based on voxel based morphometry (VBM). We used three datasets 1) CamCAN to train the brain age prediction model, 2) Human Connectome Project to investigate whether individuals with obesity have greater brain age than individuals with normal weight, and 3) pre surgery, as well as 4, 12, and 24 month post surgery data from participants (n 87) who underwent a bariatric surgery to investigate whether weight loss and cardiometabolic improvement as a result of bariatric surgery lowers the brain age. Our results from the HCP dataset showed a higher brain age for individuals with obesity compared to individuals with normal weight (p 0.0001). We also found significant improvement in brain health, indicated by a decrease of 2.9 and 5.6 years in adjusted delta age at 12 and 24 months following bariatric surgery compared to baseline (p 0.0005). While the overall effect seemed to be driven by a global change across all brain regions and not from a specific region, our exploratory analysis showed lower delta age in certain brain regions at 24 months. This reduced age was also associated with post surgery improvements in BMI, systolic diastolic blood pressure, and HOMA IR (p 0.05). In conclusion, these results suggest that obesity related brain health abnormalities might be reversed by bariatric surgery induced weight loss and widespread improvements in cardiometabolic alterations.


On Milnor and Tjurina numbers of foliations. We study the relationship between the Milnor and Tjurina numbers of a singular foliation mathcal F , in the complex plane, with respect to a balanced divisor of separatrices mathcal B for mathcal F . For that, we associated with mathcal F a new number called the chi number and we prove that it is a C 1 invariant for holomorphic foliations. We compute the polar excess number of mathcal F with respect to a balanced divisor of separatrices mathcal B for mathcal F , via the Milnor number of the foliation, the multiplicity of some hamiltonian foliations along the separatrices in the support of mathcal B and the chi number of mathcal F . On the other hand, we generalize, in the plane case and the formal context, the well known result of G 'omez Mont given in the holomorphic context, which establishes the equality between the GSV index of the foliation and the difference between the Tjurina number of the foliation and the Tjurina number of a set of separatrices of mathcal F . Finally, we state numerical relationships between some classic indices, as Baum Bott, Camacho Sad, and variational indices of a singular foliation and its Milnor and Tjurina numbers and we obtain a bound for the sum of Milnor numbers of the local separatrices of a holomorphic foliation on the complex projective plane.


PiDRAM A Holistic End to end FPGA based Framework for Processing in DRAM. Processing using memory (PuM) techniques leverage the analog operation of memory cells to perform computation. Several recent works have demonstrated PuM techniques in off the shelf DRAM devices. Since DRAM is the dominant memory technology as main memory in current computing systems, these PuM techniques represent an opportunity for alleviating the data movement bottleneck at very low cost. However, system integration of PuM techniques imposes non trivial challenges that are yet to be solved. Design space exploration of potential solutions to the PuM integration challenges requires appropriate tools to develop necessary hardware and software components. Unfortunately, current specialized DRAM testing platforms, or system simulators do not provide the flexibility and or the holistic system view that is necessary to deal with PuM integration challenges. We design and develop PiDRAM, the first flexible end to end framework that enables system integration studies and evaluation of real PuM techniques. PiDRAM provides software and hardware components to rapidly integrate PuM techniques across the whole system software and hardware stack (e.g., necessary modifications in the operating system, memory controller). We implement PiDRAM on an FPGA based platform along with an open source RISC V system. Using PiDRAM, we implement and evaluate two state of the art PuM techniques in DRAM (i) copy and initialization, (ii) true random number generation. Our results show that the in memory copy and initialization techniques can improve the performance of bulk copy operations by 12.6x and bulk initialization operations by 14.6x on a real system. Implementing the true random number generator requires only 190 lines of Verilog and 74 lines of C code using PiDRAM's software and hardware components.


Control and numerical approximation of fractional diffusion equations. The aim of this work is to give a broad panorama of the control properties of fractional diffusive models from a numerical analysis and simulation perspective. We do this by surveying several research results we obtained in the last years, focusing in particular on the numerical computation of controls. Our reference model will be a non local diffusive dynamics driven by the fractional Laplacian on a bounded domain Omega . The starting point of our analysis will be a Finite Element approximation for the associated elliptic model in one and two space dimensions, for which we also present error estimates and convergence rates in the L 2 and energy norm. Secondly, we will address two specific control scenarios firstly, we consider the standard interior control problem, in which the control is acting from a small subset omega subset Omega . Secondly, we move our attention to the exterior control problem, in which the control region mathcal O subset Omega c is located outside Omega . This exterior control notion extends boundary control to the fractional framework, in which the non local nature of the models does not allow for controls supported on partial Omega . We will conclude by discussing the interesting problem of simultaneous control, in which we consider families of parameter dependent fractional heat equations and we aim at designing a unique control function capable of steering all the different realizations of the model to the same target configuration. In this framework, we will see how the employment of stochastic optimization techniques may help in alleviating the computational burden for the approximation of simultaneous controls. Our discussion is complemented by several open problems related with fractional models which are currently unsolved and may be of interest for future investigation.


Graphs and complexes of lattices. We study lattices acting on mathrm CAT (0) spaces via their commensurated subgroups. To do this we introduce the notions of a graph of lattices and a complex of lattices giving graph and complex of group splittings of mathrm CAT (0) lattices. Using this framework we characterise irreducible uniform ( mathrm Isom ( mathbb E n) times T) lattices by C ast simplicity and give a necessary condition for lattices in products with a Euclidean factor to be biautomatic. We also construct non residually finite uniform lattices acting on arbitrary products of right angled buildings and non biautomatic lattices acting on the product of mathbb E n and a right angled building.


Impedance matched differential superconducting nanowire detectors. Superconducting nanowire single photon detectors (SNSPDs) are the highest performing photon counting technology in the near infrared (NIR). Due to delay line effects, large area SNSPDs typically trade off timing resolution and detection efficiency. Here, we introduce a detector design based on transmission line engineering and differential readout for device level signal conditioning, enabling a high system detection efficiency and a low detector jitter, simultaneously. To make our differential detectors compatible with single ended time taggers, we also engineer analog differential to single ended readout electronics, with minimal impact on the system timing resolution. Our niobium nitride differential SNSPDs achieve 47.3 , pm 2.4 , system detection efficiency and sub 10 , mathrm ps system jitter at 775 , mathrm nm , while at 1550 , mathrm nm they achieve 71.1 , pm 3.7 , system detection efficiency and 13.1 , mathrm ps pm 0.4 , mathrm ps system jitter. These detectors also achieve sub 100 ps timing response at one one hundredth maximum level, 30.7 , mathrm ps pm 0.4 , mathrm ps at 775 , mathrm nm and 47.6 , mathrm ps pm 0.4 , mathrm ps at 1550 , mathrm nm , enabling time correlated single photon counting with high dynamic range response functions. Furthermore, thanks to the differential impedance matched design, our detectors exhibit delay line imaging capabilities and photon number resolution. The properties and high performance metrics achieved by our system make it a versatile photon detection solution for many scientific applications.


Pulse Period Moment Magnitude Relations Derived with Wavelet Analysis and their Relevance to Estimate Structural Deformations. Motivated from the quadratic dependence of peak structural displacements to the pulse period, T p , of pulse like ground motions, this paper revisits the T p M text W relations of ground motions generated from near source earthquakes with epicentral distances, D leq 20 km. A total of 1260 ground motions are interrogated with wavelet analysis to identify energetic acceleration pulses (not velocity pulses) and extract their optimal period, T p , amplitude, a p , phase, phi and number of half cycles, gamma . The interrogation of acceleration records with wavelet analysis is capable of extracting shorter duration distinguishable pulses with engineering significance, which override the longer near source pulses. Our wavelet analysis identified 109 pulse like records from normal faults, 188 records from reverse faults and 125 records from strike slip faults, all with epicentral distances D leq 20 km. Regression analysis on the extracted data concluded that the same T p M text W relation can be used for pulse like ground motions generated either from strike slip faults or from normal faults whereas, a different T p M text W relation is proposed for reverse faults. The study concludes that for the same moment magnitude, M text W , the pulse periods of ground motions generated from strike slip faults are on average larger than these from reverse faults. Most importantly, our wavelet analysis on acceleration records produces T p M text W relations with a lower slope than the slopes of the T p M text W relations presented by past investigators after merely fitting velocity pulses. As a result, our proposed T p M text W relations yield lower T p values for larger magnitude earthquakes (say M text W 6), allowing for the estimation of dependable peak structural displacements that scale invariably with a pT p text 2 .


Harmonic Analysis of Covariant Functions of Characters of Normal Subgroups. Let G be a locally compact group with the group algebra L 1(G) and N be a closed normal subgroup of G . Suppose that xi N to mathbb T is a continuous character and L xi 1(G,N) is the L 1 space of all covariant functions of xi on G . We showed that L 1 xi(G,N) is isometrically isomorphic to a quotient space of L 1(G) . It is also proved that the dual space L 1 xi(G,N) is isometrically isomorphic to L infty xi(G,N) .


Compactness in normed spaces a unified approach through semi norms. In this paper we prove two new abstract compactness criteria in normed spaces. To this end we first introduce the notion of an equinormed set using a suitable family of semi norms on the given normed space satisfying some natural conditions. Those conditions, roughly speaking, state that the norm can be approximated (on the equinormed sets even uniformly) by the elements of this family. As we are given some freedom of choice of the underlying semi normed structure that is used to define equinormed sets, our approach opens a new perspective for building compactness criteria in specific normed spaces. As an example we show that natural selections of families of semi norms in spaces C(X, mathbb R ) and l p for p in 1, infty) lead to the well known compactness criteria (including the Arzel a Ascoli theorem). In the second part of the paper, applying the abstract theorems, we construct a simple compactness criterion in the space of functions of bounded Schramm variation and provide a full characterization of linear integral operators acting from the space of functions of bounded Jordan variation to the space of functions of bounded Schramm variation in therms of their generating kernels.


Privacy Preserving and Sustainable Contact Tracing Using Batteryless Bluetooth Low Energy Beacons. Contact tracing is the techno choice of reference to address the COVID 19 pandemic. Many of the current approaches have severe privacy and security issues and fail to offer a sustainable contact tracing infrastructure. We address these issues introducing an innovative, privacy preserving, sustainable, and experimentally tested architecture that leverages batteryless BLE beacons.