AttacKG Constructing Technique Knowledge Graph from Cyber Threat Intelligence Reports. Cyber attacks are becoming more sophisticated and diverse, making detection increasingly challenging. To combat these attacks, security practitioners actively summarize and exchange their knowledge about attacks across organizations in the form of cyber threat intelligence (CTI) reports. However, as CTI reports written in natural language texts are not structured for automatic analysis, the report usage requires tedious efforts of manual cyber intelligence recovery. Additionally, individual reports typically cover only a limited aspect of attack patterns (techniques) and thus are insufficient to provide a comprehensive view of attacks with multiple variants. To take advantage of threat intelligence delivered by CTI reports, we propose AttacKG to automatically extract structured attack behavior graphs from CTI reports and identify the adopted attack techniques. We then aggregate cyber intelligence across reports to collect different aspects of techniques and enhance attack behavior graphs as technique knowledge graphs (TKGs). Such TKGs with technique level intelligence directly benefit downstream security tasks that rely on technique specifications, e.g., Advanced Persistent Threat (APT) detection. In our evaluation against 1,515 real world CTI reports from diverse intelligence sources, AttacKG effectively identifies 28,262 attack techniques with 8,393 unique Indicators of Compromises (IoCs). Further, to verify AttacKG's accuracy in extracting threat intelligence, we run AttacKG on eight manually labeled CTI reports. Empirical results show that AttacKG accurately identifies attack relevant entities, dependencies, and techniques with F1 scores of 0.895, 0.911, and 0.819, which significantly outperforms the state of the art approaches like EXTRACTOR and TTPDrill.


Delayed Feedback in Episodic Reinforcement Learning. There are many provably efficient algorithms for episodic reinforcement learning. However, these algorithms are built under the assumption that the sequences of states, actions and rewards associated with each episode arrive immediately, allowing policy updates after every interaction with the environment. This assumption is often unrealistic in practice, particularly in areas such as healthcare and online recommendation. In this paper, we study the impact of delayed feedback on several provably efficient algorithms for regret minimisation in episodic reinforcement learning. Firstly, we consider updating the policy as soon as new feedback becomes available. Using this updating scheme, we show that the regret increases by an additive term involving the number of states, actions, episode length and the expected delay. This additive term changes depending on the optimistic algorithm of choice. We also show that updating the policy less frequently can lead to an improved dependency of the regret on the delays.


Continuous data assimilation for two phase flow analysis and simulations. We propose, analyze, and test a novel continuous data assimilation two phase flow algorithm for reservoir simulation. We show that the solutions of the algorithm, constructed using coarse mesh observations, converge at an exponential rate in time to the corresponding exact reference solution of the two phase model. More precisely, we obtain a stability estimate which illustrates an exponential decay of the residual error between the reference and approximate solution, until the error hits a threshold depending on the order of data resolution. Numerical computations are included to demonstrate the effectiveness of this approach, as well as variants with data on sub domains. In particular, we demonstrate numerically that synchronization is achieved for data collected from a small fraction of the domain.


The Klarna Product Page Dataset A Realistic Benchmark for Web Representation Learning. This paper tackles the under explored problem of DOM tree element representation learning. We advance the field of machine learning based web automation and hope to spur further research regarding this crucial area with two contributions. First, we adapt several popular Graph based Neural Network models and apply them to embed elements in website DOM trees. Second, we present a large scale and realistic dataset of webpages. By providing this open access resource, we lower the entry barrier to this area of research. The dataset contains 51,701 manually labeled product pages from 8,175 real e commerce websites. The pages can be rendered entirely in a web browser and are suitable for computer vision applications. This makes it substantially richer and more diverse than other datasets proposed for element representation learning, classification and prediction on the web. Finally, using our proposed dataset, we show that the embeddings produced by a Graph Convolutional Neural Network outperform representations produced by other state of the art methods in a web element prediction task.


Linear Probing Revisited Tombstones Mark the Death of Primary Clustering. First introduced in 1954, linear probing is one of the oldest data structures in computer science, and due to its unrivaled data locality, it continues to be one of the fastest hash tables in practice. It is widely believed and taught, however, that linear probing should never be used at high load factors this is because primary clustering effects cause insertions at load factor 1 1 x to take expected time Theta(x 2) (rather than the ideal Theta(x) ). The dangers of primary clustering, first discovered by Knuth in 1963, have been taught to generations of computer scientists, and have influenced the design of some of many widely used hash tables. We show that primary clustering is not a foregone conclusion. We demonstrate that small design decisions in how deletions are implemented have dramatic effects on the asymptotic performance of insertions, so that, even if a hash table operates continuously at a load factor 1 Theta(1 x) , the expected amortized cost per operation is tilde O (x) . This is because tombstones created by deletions actually cause an anti clustering effect that combats primary clustering. We also present a new variant of linear probing (which we call graveyard hashing) that completely eliminates primary clustering on emph any sequence of operations if, when an operation is performed, the current load factor is 1 1 x for some x , then the expected cost of the operation is O(x) . One corollary is that, in the external memory model with a data blocks of size B , graveyard hashing offers the following remarkable guarantee at any load factor 1 1 x satisfying x o(B) , graveyard hashing achieves 1 o(1) expected block transfers per operation. Past external memory hash tables have only been able to offer a 1 o(1) guarantee when the block size B is at least Omega(x 2) .


Automorphisms of surfaces over fields of positive characteristic. We study automorphism and birational automorphism groups of varieties over fields of positive characteristic from the point of view of Jordan and p Jordan property. In particular, we show that the Cremona group of rank 2 over a field of characteristic p 0 is p Jordan, and the birational automorphism group of an arbitrary geometrically irreducible algebraic surface is nilpotently p Jordan of class at most 2 . Also, we show that the automorphism group of a smooth geometrically irreducible projective variety of non negative Kodaira dimension is Jordan in the usual sense.


SynthRef Generation of Synthetic Referring Expressions for Object Segmentation. Recent advances in deep learning have brought significant progress in visual grounding tasks such as language guided video object segmentation. However, collecting large datasets for these tasks is expensive in terms of annotation time, which represents a bottleneck. To this end, we propose a novel method, namely SynthRef, for generating synthetic referring expressions for target objects in an image (or video frame), and we also present and disseminate the first large scale dataset with synthetic referring expressions for video object segmentation. Our experiments demonstrate that by training with our synthetic referring expressions one can improve the ability of a model to generalize across different datasets, without any additional annotation cost. Moreover, our formulation allows its application to any object detection or segmentation dataset.


Tightening the Biological Constraints on Gradient Based Predictive Coding. Predictive coding (PC) is a general theory of cortical function. The local, gradient based learning rules found in one kind of PC model have recently been shown to closely approximate backpropagation. This finding suggests that this gradient based PC model may be useful for understanding how the brain solves the credit assignment problem. The model may also be useful for developing local learning algorithms that are compatible with neuromorphic hardware. In this paper, we modify this PC model so that it better fits biological constraints, including the constraints that neurons can only have positive firing rates and the constraint that synapses only flow in one direction. We also compute the gradient based weight and activity updates given the modified activity values. We show that, under certain conditions, these modified PC networks perform as well or nearly as well on MNIST data as the unmodified PC model and networks trained with backpropagation.


Scattering for the inhomogeneous nonlinear Schr "odinger equation with a potential. In this paper, we show the scattering of the solution for the focusing inhomogenous nonlinear Schr "odinger equation with a potential begin align i partial t u Delta u Vu x b u p 1 u end align in the energy space H 1( mathbb R 3) . We prove a scattering criterion, and then we use it together with Morawetz estimate to show the scattering theory.


Design techniques for a seamless information system architecture. The paper discusses design techniques for a seamless architecture of information systems (IS). A seamless architecture is understood as such an architectural de scription of an IS, that defines explicit connections between elements of architec tural models of various architectural representations. Design techniques are based on the adaptive clustering method developed by the author, which allows one to bridge technological gaps between architectural abstracts of different levels and to link architectural models in such a way as to ensure the design of a more detailed model based on a model of a higher level of abstraction.


Neural Network Libraries A Deep Learning Framework Designed from Engineers' Perspectives. While there exist a plethora of deep learning tools and frameworks, the fast growing complexity of the field brings new demands and challenges, such as more flexible network design, speedy computation on distributed setting, and compatibility between different tools. In this paper, we introduce Neural Network Libraries (https nnabla.org), a deep learning framework designed from engineer's perspective, with emphasis on usability and compatibility as its core design principles. We elaborate on each of our design principles and its merits, and validate our attempts via experiments.


Joint Parameter and State Estimation of Noisy Discrete Time Nonlinear Systems A Supervisory Multi Observer Approach. This paper presents two schemes to jointly estimate parameters and states of discrete time nonlinear systems in the presence of bounded disturbances and noise and where the parameters belong to a known compact set. The schemes are based on sampling the parameter space and designing a state observer for each sample. A supervisor selects one of these observers at each time instant to produce the parameter and state estimates. In the first scheme, the parameter and state estimates are guaranteed to converge within a certain margin of their true values in finite time, assuming that a sufficiently large number of observers is used and a persistence of excitation condition is satisfied in addition to other observer design conditions. This convergence margin is constituted by a part that can be chosen arbitrarily small by the user and a part determined by the noise levels. The second scheme exploits the convergence properties of the parameter estimate to perform subsequent zoom ins on the parameter subspace to achieve stricter margins for a given number of observers. The strengths of both schemes are demonstrated using a numerical example.


Adaptive surrogates of crashworthiness models for multi purpose engineering analyses accounting for uncertainty. Uncertainty Quantification (UQ) is a booming discipline for complex computational models based on the analysis of robustness, reliability and credibility. UQ analysis for nonlinear crash models with high dimensional outputs presents important challenges. In crashworthiness, nonlinear structural behaviours with multiple hidden modes require expensive models (18 hours for a single run). Surrogate models (metamodels) allow substituting the full order model, introducing a response surface for a reduced training set of numerical experiments. Moreover, uncertain input and large number of degrees of freedom result in high dimensional problems, which derives to a bottle neck that blocks the computational efficiency of the metamodels. Kernel Principal Component Analysis (kPCA) is a multidimensionality reduction technique for non linear problems, with the advantage of capturing the most relevant information from the response and improving the efficiency of the metamodel. Aiming to compute the minimum number of samples with the full order model. The proposed methodology is tested with a practical industrial problem that arises from the automotive industry.


Implicit Feedback based Group Recommender System for Internet of Thing Applications. With the prevalence of Internet of Things (IoT) based social media applications, the distance among people has been greatly shortened. As a result, recommender systems in IoT based social media need to be developed oriented to groups of users rather than individual users. However, existing methods were highly dependent on explicit preference feedbacks, ignoring scenarios of implicit feedback. To remedy such gap, this paper proposes an implicit feedback based group recommender system using probabilistic inference and non cooperative game(GREPING) for IoT based social media. Particularly, unknown process variables can be estimated from observable implicit feedbacks via Bayesian posterior probability inference. In addition, the globally optimal recommendation results can be calculated with the aid of non cooperative game. Two groups of experiments are conducted to assess the GREPING from two aspects efficiency and robustness. Experimental results show obvious promotion and considerable stability of the GREPING compared to baseline methods.


Synthetic Correlated Diffusion Imaging Hyperintensity Delineates Clinically Significant Prostate Cancer. Prostate cancer (PCa) is the second most common cancer in men worldwide and the most frequently diagnosed cancer among men in more developed countries. The prognosis of PCa is excellent if detected at an early stage, making early screening crucial for detection and treatment. In recent years, a new form of diffusion magnetic resonance imaging called correlated diffusion imaging (CDI) was introduced, and preliminary results show promise as a screening tool for PCa. In the largest study of its kind, we investigate the relationship between PCa presence and a new variant of CDI we term synthetic correlated diffusion imaging (CDI s ), as well as its performance for PCa delineation compared to current standard MRI techniques (T2 weighted (T2w) imaging, diffusion weighted imaging (DWI), and dynamic contrast enhanced (DCE) imaging) across a cohort of 200 patient cases. Statistical analyses reveal that hyperintensity in CDI s is a strong indicator of PCa presence and achieves strong delineation of clinically significant cancerous tissue compared to T2w, DWI, and DCE. These results suggest that CDI s hyperintensity may be a powerful biomarker for the presence of PCa, and may have a clinical impact as a diagnostic aid for improving PCa screening.


Toeplitz operators, mathbb T m invariance and quasi homogeneous symbols. For a partition boldsymbol k (k 1, dots, k m) of n consider the group mathrm U ( boldsymbol k ) mathrm U (k 1) times dots times mathrm U (k m) block diagonally embedded in mathrm U (n) and the center mathbb T m of mathrm U ( boldsymbol k ) . We study the Toeplitz operators with mathbb T m invariant symbols acting on the weighted Bergman spaces on the unit ball mathbb B n . We introduce the ( boldsymbol k ,j) quasi radial quasi homogeneous symbols as those that are invariant under the group mathrm U ( boldsymbol k ,j, mathbb T ) obtained from mathrm U ( boldsymbol k ) by replacing the factor mathrm U (k j) with its center mathbb T . These symbols are used to build commutative Banach non C algebras generated by Toeplitz operators. These algebras generalize those from the literature and show that they can be built using groups. We describe the action of such Toeplitz operators on monomials through explicit integral formulas involving the symbols. We prove that every Toeplitz operator with mathbb T m invariant symbol has an associated Toeplitz operator with mathrm U ( boldsymbol k ) invariant symbol in terms of which we can describe some properties.


Cyclic codes over a non chain ring R e,q and their application to LCD codes. Let mathbb F q be a finite field of order q , a prime power integer such that q et 1 where t geq 1,e geq 2 are integers. In this paper, we study cyclic codes of length n over a non chain ring R e,q mathbb F q u langle u e 1 rangle . We define a Gray map varphi and obtain many maximum distance separable (MDS) and optimal mathbb F q linear codes from the Gray images of cyclic codes. Under certain conditions we determine linear complementary dual (LCD) codes of length n when gcd(n,q) neq 1 and gcd(n,q) 1 , respectively. It is proved that a cyclic code mathcal C of length n is an LCD code if and only if its Gray image varphi( mathcal C ) is an LCD code of length 4n over mathbb F q . Among others, we present the conditions for existence of free and non free LCD codes. Moreover, we obtain many optimal LCD codes as the Gray images of non free LCD codes over R e,q .


Low energy constraints on photoelectron spectra measured from liquid water and aqueous solutions. We report on the effects of electron collision and indirect ionization processes, occurring at photoexcitation and electron kinetic energies well below 30 eV on the photoemission spectra of liquid water. We show that the nascent photoelectron spectrum and, hence, the inferred electron binding energy can only be accurately determined if electron energies are large enough that cross sections for quasi elastic scattering processes, such as vibrational excitation, are negligible. Otherwise, quasi elastic scattering leads to strong, down to few meV kinetic energy scattering losses from the direct photoelectron features, which manifest in severely distorted intrinsic photoelectron peak shapes. The associated cross over point from predominant (known) electronically inelastic to quasi elastic scattering seems to arise at surprisingly large electron kinetic energies, of approximately 10 14 eV. Concomitantly, we present evidence for the onset of indirect, autoionization phenomena (occurring via superexcited states) within a few eV of the primary and secondary ionization thresholds. These processes are inferred to compete with the direct ionization channels and primarily produce low energy photoelectrons at photon and electron impact excitation energies below 15 eV. Our results highlight that vibrational inelastic electron scattering processes and neutral photoexcitation and autoionization channels become increasingly important when photon and electron kinetic energies are decreased towards the ionization threshold. Correspondingly, we show that for neat water and aqueous solutions, great care must be taken when quantitatively analyzing photoelectron spectra measured too close to the ionization threshold. Such care is essential for both the accurate determination of solvent and solute ionization energies as well as photoelectron branching ratios and peak magnitudes.


A new class of irreducible modules over the affine Virasoro algebra of type A 1 . In this paper, we construct a class of non weight modules over the affine Virasoro algebra of type A 1 by taking tensor products of a finite number of irreducible modules M( lambda, alpha, beta, gamma) with irreducible highest weight modules V( eta, epsilon, theta) . We obtain the necessary and sufficient conditions for such tensor product modules to be irreducible, and determine the necessary and sufficient conditions for such two modules to be isomorphic. We also compare these modules with other known non weight modules, showing that these irreducible modules are new.


n times n times n Rubik's Cubes and God's Number. The Rubik's Cube is the most popular puzzle in the world. Two of its studied aspects are God's Number, the minimum number of turns necessary to solve any state, and the first law of cubology, a solvability criterion. We modify previous statements of the first law of cubology for n times n times n Rubik's Cubes, and prove necessary and sufficient solvability conditions. We compute the order of the Rubik's Cube group and the number of distinct configurations of the n times n times n Rubik's Cube. Finally, we derive a lower bound for God's Number using the group theoretical results and a counting argument.


Codiskcyclic sets of operators on complex topological vector spaces. Let X be a complex topological vector space and L(X) the set of all continuous linear operators on X. In this paper, we extend the notion of the codiskcyclicity of a single operator T in L(X) to a set of operators Gamma subset L(X). We prove some results for codiskcyclic sets of operators and we establish a codiskcyclicity criterion. As an application, we study the codiskcyclicity of C 0 semigroups of operators.


Unsupervised Portrait Shadow Removal via Generative Priors. Portrait images often suffer from undesirable shadows cast by casual objects or even the face itself. While existing methods for portrait shadow removal require training on a large scale synthetic dataset, we propose the first unsupervised method for portrait shadow removal without any training data. Our key idea is to leverage the generative facial priors embedded in the off the shelf pretrained StyleGAN2. To achieve this, we formulate the shadow removal task as a layer decomposition problem a shadowed portrait image is constructed by the blending of a shadow image and a shadow free image. We propose an effective progressive optimization algorithm to learn the decomposition process. Our approach can also be extended to portrait tattoo removal and watermark removal. Qualitative and quantitative experiments on a real world portrait shadow dataset demonstrate that our approach achieves comparable performance with supervised shadow removal methods. Our source code is available at https github.com YingqingHe Shadow Removal via Generative Priors.


Spatial and temporal scaled physical modeling of fluid convection using hypergravity. Scaled physical modeling is an important means to understand the behavior of fluids in nature. However, a common source of errors is conflicting similarity criteria. Here, we present using hypergravity to improve the scaling similarity of gravity dominated fluid convection, e.g. natural convection and multi phase flow. We demonstrate the validity of the approach by investigating water brine buoyant jet experiments conducted under hypergravity created by a centrifuge. Results show that the scaling similarity increases with the gravitational acceleration. In particular, the model best represents the prototype under N3g with a spatial scale of 1 N and a time scale of 1 N2 by simultaneously satisfying the Froude and Reynolds criteria. The significance of centrifuge radius and fluid velocity in determining the accuracy of the scaled model is discussed in the light of Coriolis force and turbulence. This study demonstrates a new direction for the physical modeling of fluids subject to gravity with broad application prospects.


Efficient Sharpness aware Minimization for Improved Training of Neural Networks. Overparametrized Deep Neural Networks (DNNs) often achieve astounding performances, but may potentially result in severe generalization error. Recently, the relation between the sharpness of the loss landscape and the generalization error has been established by Foret et al. (2020), in which the Sharpness Aware Minimizer (SAM) was proposed to mitigate the degradation of the generalization. Unfortunately, SAM s computational cost is roughly double that of base optimizers, such as Stochastic Gradient Descent (SGD). This paper thus proposes Efficient Sharpness Aware Minimizer (ESAM), which boosts SAM s efficiency at no cost to its generalization performance. ESAM includes two novel and efficient training strategies StochasticWeight Perturbation and Sharpness Sensitive Data Selection. In the former, the sharpness measure is approximated by perturbing a stochastically chosen set of weights in each iteration in the latter, the SAM loss is optimized using only a judiciously selected subset of data that is sensitive to the sharpness. We provide theoretical explanations as to why these strategies perform well. We also show, via extensive experiments on the CIFAR and ImageNet datasets, that ESAM enhances the efficiency over SAM from requiring 100 extra computations to 40 vis a vis base optimizers, while test accuracies are preserved or even improved.


Escaping from Zero Gradient Revisiting Action Constrained Reinforcement Learning via Frank Wolfe Policy Optimization. Action constrained reinforcement learning (RL) is a widely used approach in various real world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the existing projection based approaches ensure zero constraint violation, they could suffer from the zero gradient problem due to the tight coupling of the policy gradient and the projection, which results in sample inefficient training and slow convergence. To tackle this issue, we propose a learning algorithm that decouples the action constraints from the policy parameter update by leveraging state wise Frank Wolfe and a regression based policy update scheme. Moreover, we show that the proposed algorithm enjoys convergence and policy improvement properties in the tabular case as well as generalizes the popular DDPG algorithm for action constrained RL in the general case. Through experiments, we demonstrate that the proposed algorithm significantly outperforms the benchmark methods on a variety of control tasks.


Complexity classification of counting graph homomorphisms modulo a prime number. Counting graph homomorphisms and its generalizations such as the Counting Constraint Satisfaction Problem (CSP), its variations, and counting problems in general have been intensively studied since the pioneering work of Valiant. While the complexity of exact counting of graph homomorphisms (Dyer and Greenhill, 2000) and the counting CSP (Bulatov, 2013, and Dyer and Richerby, 2013) is well understood, counting modulo some natural number has attracted considerable interest as well. In their 2015 paper Faben and Jerrum suggested a conjecture stating that counting homomorphisms to a fixed graph H modulo a prime number is hard whenever it is hard to count exactly, unless H has automorphisms of certain kind. In this paper we confirm this conjecture. As a part of this investigation we develop techniques that widen the spectrum of reductions available for modular counting and apply to the general CSP rather than being limited to graph homomorphisms.


Extracting Qualitative Causal Structure with Transformer Based NLP. Qualitative causal relationships compactly express the direction, dependency, temporal constraints, and monotonicity constraints of discrete or continuous interactions in the world. In everyday or academic language, we may express interactions between quantities (e.g., sleep decreases stress), between discrete events or entities (e.g., a protein inhibits another protein's transcription), or between intentional or functional factors (e.g., hospital patients pray to relieve their pain). This paper presents a transformer based NLP architecture that jointly identifies and extracts (1) variables or factors described in language, (2) qualitative causal relationships over these variables, and (3) qualifiers and magnitudes that constrain these causal relationships. We demonstrate this approach and include promising results from in two use cases, processing textual inputs from academic publications, news articles, and social media.


On the rank of Hankel matrices over finite fields. Given three nonnegative integers p,q,r and a finite field F , how many Hankel matrices left( x i j right) 0 leq i leq p, 0 leq j leq q over F have rank leq r ? This question is classical, and the answer ( q 2r when r leq min left p,q right ) has been obtained independently by various authors using different tools (Daykin, Elkies, Garcia Armas, Ghorpade and Ram). In this note, we study a refinement of this result We show that if we fix the first k of the entries x 0 ,x 1 , ldots,x k 1 for some k leq r leq min left p,q right , then the number of ways to choose the remaining p q k 1 entries x k ,x k 1 , ldots,x p q such that the resulting Hankel matrix left( x i j right) 0 leq i leq p, 0 leq j leq q has rank leq r is q 2r k . This is exactly the answer that one would expect if the first k entries had no effect on the rank, but of course the situation is not this simple. The refined result generalizes (and provides an alternative proof of) a result by Anzis, Chen, Gao, Kim, Li and Patrias on evaluations of Jacobi Trudi determinants over finite fields.


Refinement stable Consensus Methods. In a recent study, Bryant, Francis and Steel investigated the concept of enquote future proofing consensus methods in phylogenetics. That is, they investigated if such methods can be robust against the introduction of additional data like extra trees or new species. In the present manuscript, we analyze consensus methods under a different aspect of introducing new data, namely concerning the discovery of new clades. In evolutionary biology, often formerly unresolved clades get resolved by refined reconstruction methods or new genetic data analyses. In our manuscript we investigate which properties of consensus methods can guarantee that such new insights do not disagree with previously found consensus trees but merely refine them. We call consensus methods with this property emph refinement stable . Along these lines, we also study two famous super tree methods, namely Matrix Representation with Parsimony (MRP) and Matrix Representation with Compatibility (MRC), which have also been suggested as consensus methods in the literature. While we (just like Bryant, Francis and Steel in their recent study) unfortunately have to conclude some negative answers concerning general consensus methods, we also state some relevant and positive results concerning the majority rule (MR) and strict consensus methods, which are amongst the most frequently used consensus methods. Moreover, we show that there exist infinitely many consensus methods which are refinement stable and have some other desirable properties.


DNNV A Framework for Deep Neural Network Verification. Despite the large number of sophisticated deep neural network (DNN) verification algorithms, DNN verifier developers, users, and researchers still face several challenges. First, verifier developers must contend with the rapidly changing DNN field to support new DNN operations and property types. Second, verifier users have the burden of selecting a verifier input format to specify their problem. Due to the many input formats, this decision can greatly restrict the verifiers that a user may run. Finally, researchers face difficulties in re using benchmarks to evaluate and compare verifiers, due to the large number of input formats required to run different verifiers. Existing benchmarks are rarely in formats supported by verifiers other than the one for which the benchmark was introduced. In this work we present DNNV, a framework for reducing the burden on DNN verifier researchers, developers, and users. DNNV standardizes input and output formats, includes a simple yet expressive DSL for specifying DNN properties, and provides powerful simplification and reduction operations to facilitate the application, development, and comparison of DNN verifiers. We show how DNNV increases the support of verifiers for existing benchmarks from 30 to 74 .


Superized Troesch complexes and cohomology for strict polynomial superfunctors. We adapt a construction due to Troesch to the category of strict polynomial superfunctors in order to construct complexes of injective objects whose cohomology is isomorphic to Frobenius twists of the (super)symmetric power functors. We apply these complexes to construct injective resolutions of the even and odd Frobenius twist functors, to investigate the structure of the Yoneda algebra of the Frobenius twist functor, and to compute other extension groups between strict polynomial superfunctors.


Dynamics of Ostrowski skew product I. Limit laws and Hausdorff dimensions. We present a dynamical and spectral study of Ostrowski's map based on the use of transfer operators. The Ostroswki dynamical system is obtained as a skew product of the Gauss map (it has the Gauss map as a base and interval fibers) and produces expansions of real numbers with respect to an irrational base given by continued fractions. By studying spectral properties of the associated transfer operator, we show that the Ostroswki dynamical system admits an absolutely continuous invariant measure with piecewise holomorphic density and exponential mixing properties. We deduce a central limit theorem for associated random variables of an arithmetic nature and motivated by applications in inhomogeneous Diophantine approximation, we get Bowen Ruelle type implicit estimates in terms of spectral elements for the Hausdorff dimension of a certain bounded digit set.


Modeling the geospatial evolution of COVID 19 using spatio temporal convolutional sequence to sequence neural networks. Europe was hit hard by the COVID 19 pandemic and Portugal was one of the most affected countries, having suffered three waves in the first twelve months. Approximately between Jan 19th and Feb 5th 2021 Portugal was the country in the world with the largest incidence rate, with 14 days incidence rates per 100,000 inhabitants in excess of 1000. Despite its importance, accurate prediction of the geospatial evolution of COVID 19 remains a challenge, since existing analytical methods fail to capture the complex dynamics that result from both the contagion within a region and the spreading of the infection from infected neighboring regions. We use a previously developed methodology and official municipality level data from the Portuguese Directorate General for Health (DGS), relative to the first twelve months of the pandemic, to compute an estimate of the incidence rate in each location of mainland Portugal. The resulting sequence of incidence rate maps was then used as a gold standard to test the effectiveness of different approaches in the prediction of the spatial temporal evolution of the incidence rate. Four different methods were tested a simple cell level autoregressive moving average (ARMA) model, a cell level vector autoregressive (VAR) model, a municipality by municipality compartmental SIRD model followed by direct block sequential simulation and a convolutional sequence to sequence neural network model based on the STConvS2S architecture. We conclude that the convolutional sequence to sequence neural network is the best performing method, when predicting the medium term future incidence rate, using the available information.


ChainCQG Flow Aware Conversational Question Generation. Conversational systems enable numerous valuable applications, and question answering is an important component underlying many of these. However, conversational question answering remains challenging due to the lack of realistic, domain specific training data. Inspired by this bottleneck, we focus on conversational question generation as a means to generate synthetic conversations for training and evaluation purposes. We present a number of novel strategies to improve conversational flow and accommodate varying question types and overall fluidity. Specifically, we design ChainCQG as a two stage architecture that learns question answer representations across multiple dialogue turns using a flow propagation training strategy.ChainCQG significantly outperforms both answer aware and answer unaware SOTA baselines (e.g., up to 48 BLEU 1 improvement). Additionally, our model is able to generate different types of questions, with improved fluidity and coreference alignment.


Recollements and stratification. We develop various aspects of the theory of recollements of infty categories, including a symmetric monoidal refinement of the theory. Our main result establishes a formula for the gluing functor of a recollement on the right lax limit of a locally cocartesian fibration determined by a sieve cosieve decomposition of the base. As an application, we prove a reconstruction theorem for sheaves in an infty topos stratified over a finite poset P in the sense of Barwick Glasman Haine. Combining our theorem with methods from the work of Ayala Mazel Gee Rozenblyum, we then prove a conjecture of Barwick Glasman Haine that asserts an equivalence between the infty category of P stratified infty topoi and that of toposic locally cocartesian fibrations over P mathrm op .


Prediction of Influenza A virus infections in humans using an Artificial Neural Network learning approach. The Influenza type A virus can be considered as one of the most severe viruses that can infect multiple species with often fatal consequences to the hosts. The Haemagglutinin (HA) gene of the virus has the potential to be a target for antiviral drug development realised through accurate identification of its sub types and possible the targeted hosts. In this paper, to accurately predict if an Influenza type A virus has the capability to infect human hosts, by using only the HA gene, is therefore developed and tested. The predictive model follows three main steps (i) decoding the protein sequences into numerical signals using EIIP amino acid scale, (ii) analysing these sequences by using Discrete Fourier Transform (DFT) and extracting DFT based features, (iii) using a predictive model, based on Artificial Neural Networks and using the features generated by DFT. In this analysis, from the Influenza Research Database, 30724, 18236 and 8157 HA protein sequences were collected for Human, Avian and Swine, respectively. Given this set of the proteins, the proposed method yielded 97.36 ( 0.04 ), 97.26 ( 0.26 ), 0.978 ( 0.004), 0.963 ( 0.005) and 0.945 ( 0.005) for the training accuracy validation accuracy, precision, recall and Mathews Correlation Coefficient (MCC) respectively, based on a 10 fold cross validation. The classification model generated by using one of the largest dataset, if not the largest, yields promising results that could lead to early detection of such species and help develop precautionary measurements for possible human infections.


Exact and Bounded Collision Probability for Motion Planning under Gaussian Uncertainty. Computing collision free trajectories is of prime importance for safe navigation. We present an approach for computing the collision probability under Gaussian distributed motion and sensing uncertainty with the robot and static obstacle shapes approximated as ellipsoids. The collision condition is formulated as the distance between ellipsoids and unlike previous approaches we provide a method for computing the exact collision probability. Furthermore, we provide a tight upper bound that can be computed much faster during online planning. Comparison to other state of the art methods is also provided. The proposed method is evaluated in simulation under varying configuration and number of obstacles.


Efficient Screening of Diseased Eyes based on Fundus Autofluorescence Images using Support Vector Machine. A variety of vision ailments are associated with geographic atrophy (GA) in the foveal region of the eye. In current clinical practice, the ophthalmologist manually detects potential presence of such GA based on fundus autofluorescence (FAF) images, and hence diagnoses the disease, when relevant. However, in view of the general scarcity of ophthalmologists relative to the large number of subjects seeking eyecare, especially in remote regions, it becomes imperative to develop methods to direct expert time and effort to medically significant cases. Further, subjects from either disadvantaged background or remote localities, who face considerable economic physical barrier in consulting trained ophthalmologists, tend to seek medical attention only after being reasonably certain that an adverse condition exists. To serve the interest of both the ophthalmologist and the potential patient, we plan a screening step, where healthy and diseased eyes are algorithmically differentiated with limited input from only optometrists who are relatively more abundant in number. Specifically, an early treatment diabetic retinopathy study (ETDRS) grid is placed by an optometrist on each FAF image, based on which sectoral statistics are automatically collected. Using such statistics as features, healthy and diseased eyes are proposed to be classified by training an algorithm using available medical records. In this connection, we demonstrate the efficacy of support vector machines (SVM). Specifically, we consider SVM with linear as well as radial basis function (RBF) kernel, and observe satisfactory performance of both variants. Among those, we recommend the latter in view of its slight superiority in terms of classification accuracy (90.55 at a standard training to test ratio of 80 20), and practical class conditional costs.


Theoretical design study of FWM in silicon nitride waveguides with integrated graphene oxide films. We theoretically investigate and optimize four wave mixing (FWM) in silicon nitride (SiN) waveguides integrated with two dimensional (2D) layered graphene oxide (GO) films. Based on extensive previous measurements of the material parameters of the GO films, we perform detailed analysis for the influence of device parameters including waveguide geometry, GO film thickness, length, and coating position on the FWM conversion efficiency (CE) and conversion bandwidth (CB). The influence of dispersion and photo thermal changes in the GO films is also discussed. Owing to the strong mode overlap between the SiN waveguides and the highly nonlinear GO films, FWM in the hybrid waveguides can be significantly enhanced. We obtain good agreement with previous experimental results and show that by optimizing the device parameters to balance the trade off between Kerr nonlinearity and loss, the FWM CE can be improved by as much as 20.7 dB and the FWM CB can be increased by 4.4 folds, relative to the uncoated waveguides. These results highlight the significantly enhanced FWM performance that can be achieved in SiN waveguides by integrating 2D layered GO films.


Neural Networks for Delta Hedging. The Black Scholes model, defined under the assumption of a perfect financial market, theoretically creates a flawless hedging strategy allowing the trader to evade risks in a portfolio of options. However, the concept of a "perfect financial market," which requires zero transaction and continuous trading, is challenging to meet in the real world. Despite such widely known limitations, academics have failed to develop alternative models successful enough to be long established. In this paper, we explore the landscape of Deep Neural Networks(DNN) based hedging systems by testing the hedging capacity of the following neural architectures Recurrent Neural Networks, Temporal Convolutional Networks, Attention Networks, and Span Multi Layer Perceptron Networks. In addition, we attempt to achieve even more promising results by combining traditional derivative hedging models with DNN based approaches. Lastly, we construct textbf NNHedge , a deep learning framework that provides seamless pipelines for model development and assessment for the experiments.


Some diophantine problems concerning a pair of rational triangles with a common circumradius. A triangle with rational sides and rational area is called a rational triangle. In this paper we consider three problems of finding pairs of rational triangles which have a common circumradius as well as either a common perimeter or a common inradius or a common area. While several similar problems concerning pairs of rational triangles have been considered in the existing literature, these three problems have not been studied till now. For each of these problems, we give a parametric solution and we also indicate how additional parametric solutions of these problems may be obtained.


Mathematical representation of the structure of neuron glia networks. Network representations of the nervous system have being useful for the understanding of brain phenomena such as perception, motor coordination, memory, etc. Although brains are composed of both neurons and glial cells, only networks of neurons have been studied so far. Given the emergent role of glial cells in information transmission in the brain, here we develop a mathematical representation of neuron glial networks Upsilon graph. We proceed defining isomorphisms for Upsilon graph, generalizing the multidigraph isomorphism. Then, we define a function for unnesting an Upsilon graph, getting a multidigraph. Additionally, we found that the isomorphism between unnested forms guarantee the isomorphism between their Upsilon graph if the matrix equations has only linearly independent columns and are equal after interchanging some rows and columns . Finally, we introduce a novel approach to model the network shape. Our work presents a mathematical framework for working with neuron glia networks.


Reversible Upper Confidence Bound Algorithm to Generate Diverse Optimized Candidates. Most algorithms for the multi armed bandit problem in reinforcement learning aimed to maximize the expected reward, which are thus useful in searching the optimized candidate with the highest reward (function value) for diverse applications (e.g., AlphaGo). However, in some typical application scenaios such as drug discovery, the aim is to search a diverse set of candidates with high reward. Here we propose a reversible upper confidence bound (rUCB) algorithm for such a purpose, and demonstrate its application in virtual screening upon intrinsically disordered proteins (IDPs). It is shown that rUCB greatly reduces the query times while achieving both high accuracy and low performance loss.The rUCB may have potential application in multipoint optimization and other reinforcement learning cases.


Drone based AI and 3D Reconstruction for Digital Twin Augmentation. Digital Twin is an emerging technology at the forefront of Industry 4.0, with the ultimate goal of combining the physical space and the virtual space. To date, the Digital Twin concept has been applied in many engineering fields, providing useful insights in the areas of engineering design, manufacturing, automation, and construction industry. While the nexus of various technologies opens up new opportunities with Digital Twin, the technology requires a framework to integrate the different technologies, such as the Building Information Model used in the Building and Construction industry. In this work, an Information Fusion framework is proposed to seamlessly fuse heterogeneous components in a Digital Twin framework from the variety of technologies involved. This study aims to augment Digital Twin in buildings with the use of AI and 3D reconstruction empowered by unmanned aviation vehicles. We proposed a drone based Digital Twin augmentation framework with reusable and customisable components. A proof of concept is also developed, and extensive evaluation is conducted for 3D reconstruction and applications of AI for defect detection.


Interplanetary Magnetic Field Control of PolarIonospheric Equivalent Current System Modes. We analyze the response of different ionospheric equivalent current modes to variations in the interplanetary magnetic field (IMF) components By and Bz. Each mode comprises a fixed spatial pattern whose amplitude varies in time, identified by a month by month empirical orthogonal function separation of surface measured magnetic field variance. Here we focus on four sets of modes that have been previously identified as DPY, DP2, NBZ, and DP1. We derive the cross correlation function of each mode set with either IMF (B y ) or (B z ) for lags ranging from 10 to 600 mins with respect to the IMF state at the bow shock nose. For all four sets of modes, the average correlation can be reproduced by a sum of up to three linear responses to the IMF component, each centered on a different lag. These are interpreted as the statistical ionospheric responses to magnetopause merging (15 to 20 min lag) and magnetotail reconnection (60 min lag) and to IMF persistence. Of the mode sets, NBZ and DPY are the most predictable from a given IMF component, with DP1 (the substorm component) the least predictable. The proportion of mode variability explained by the IMF increases for the longer lags, thought to indicate conductivity feedbacks from substorms. In summary, we confirm the postulated physical basis of these modes and quantify their multiple reconfiguration timescales.


On the Expressive Power of TeamLTL and First Order Team Logic over Hyperproperties. In this article we study linear temporal logics with team semantics (TeamLTL) that are novel logics for defining hyperproperties. We define Kamp type translations of these logics into fragments of first order team logic and second order logic. We also characterize the expressive power and the complexity of model checking and satisfiability of team logic and second order logic by relating them to second and third order arithmetic. Our results set in a larger context the recent results of L "uck showing that the extension of TeamLTL by the Boolean negation is highly undecidable under the so called synchronous semantics. We also study stutter invariant fragments of extensions of TeamLTL.


On extreme values for the Sudler product of quadratic irrationals. Given a real number alpha and a natural number N , the Sudler product is defined by P N( alpha) prod r 1 N 2 left lvert sin( pi left(r alpha right)) right rvert. Denoting by F n the n th Fibonacci number and by phi the Golden Ratio, we show that for F n 1 leq N F n , we have P F n 1 ( phi) leq P N( phi) leq P F n 1 ( phi) and min N geq 1 P N( phi) P 1( phi) , thereby proving a conjecture of Grepstad, Kaltenb "ock and Neum "uller. Furthermore, we find closed expressions for liminf N to infty P N( phi) and limsup N to infty frac P N( phi) N whose numerical values can be approximated arbitrarily well. We generalize these results to the case of quadratic irrationals beta with continued fraction expansion beta 0 b,b,b ldots where 1 leq b leq 5 , completing the calculation of liminf N to infty P N( beta) , limsup N to infty frac P N( beta) N for beta being an arbitrary quadratic irrational with continued fraction expansion of period length 1.


Image Protection against Forgery and Pixel Tampering based on a Triple Hybrid Security Approach. Due to the widespread of advanced digital imaging devices, forgery of digital images became more serious attack patterns. In this attack scenario, the attacker tries to manipulate the digital image to conceal some meaningful information of the genuine image for malicious purposes. This leads to increase security interest about protecting images against integrity tampers. This paper proposes a novel technique for protecting colored images against forgery and pixel tamper. The proposed approach is designed as a hybrid model from three security techniques, Message Digest hashing algorithm (MD5), Advanced Encryption Standard 128 bits (AES), and Stenography. The proposed approach has been evaluated using set of image quality metrics for testing the impact of embedding the protection code on image quality. The evaluation results proved that protecting image based on Least Significant Bit (LSB) is the best technique that keep image quality compared with other two bit substitution methods. Moreover, the results proved the superiority of the proposed approach compared with other technique in the literature.


Multi Task Reinforcement Learning with Context based Representations. The benefit of multi task learning over single task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across tasks, its success depends on how well the structure underlying the tasks is captured. In some real world situations, we have access to metadata, or additional information about a task, that may not provide any new insight in the context of a single task setup alone but inform relations across multiple tasks. While this metadata can be useful for improving multi task learning performance, effectively incorporating it can be an additional challenge. We posit that an efficient approach to knowledge transfer is through the use of multiple context dependent, composable representations shared across a family of tasks. In this framework, metadata can help to learn interpretable representations and provide the context to inform which representations to compose and how to compose them. We use the proposed approach to obtain state of the art results in Meta World, a challenging multi task benchmark consisting of 50 distinct robotic manipulation tasks.


Robustness of controlled K Fusion Frame in Hilbert C modules under erasures of submodules. Controlled ast K fusion frames are generalization of controlled fusion frames in frame theory. In this paper, we propose the notion of controlled ast k fusions frames on Hilbert C ast modules. We give some caraterizations and some of their properties are obtained. Then we study the erasures of submodules of a controlled k fusion frame in Hilbert C ast modules and we present some sufficient conditions under which a sequence remains a standart controlled k fusion frame after deletion of some submodules. Finally, we introduce a perturbation for controlled K fusion frames in Hilbert C ast modules and it is shown that under some conditions controlled K fusion frames are stable under this perturbation, and we generalize some of the results obtained for perturbations of controlled K fusion frames.


FEVEROUS Fact Extraction and VERification Over Unstructured and Structured information. Fact verification has attracted a lot of attention in the machine learning and natural language processing communities, as it is one of the key methods for detecting misinformation. Existing large scale benchmarks for this task have focused mostly on textual sources, i.e. unstructured information, and thus ignored the wealth of information available in structured formats, such as tables. In this paper we introduce a novel dataset and benchmark, Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS), which consists of 87,026 verified claims. Each claim is annotated with evidence in the form of sentences and or cells from tables in Wikipedia, as well as a label indicating whether this evidence supports, refutes, or does not provide enough information to reach a verdict. Furthermore, we detail our efforts to track and minimize the biases present in the dataset and could be exploited by models, e.g. being able to predict the label without using evidence. Finally, we develop a baseline for verifying claims against text and tables which predicts both the correct evidence and verdict for 18 of the claims.


Graph theoretic algorithms for Kolmogorov operators Approximating solutions and their gradients in elliptic and parabolic problems on manifolds. We employ kernel based approaches that use samples from a probability distribution to approximate a Kolmogorov operator on a manifold. The self tuning variable bandwidth kernel method Berry Harlim, Appl. Comput. Harmon. Anal., 40(1) 68 96, 2016 computes a large, sparse matrix that approximates the differential operator. Here, we use the eigendecomposition of the discretization to (i) invert the operator, solving a differential equation, and (ii) represent gradient vector fields on the manifold. These methods only require samples from the underlying distribution and, therefore, can be applied in high dimensions or on geometrically complex manifolds when spatial discretizations are not available. We also employ an efficient k d tree algorithm to compute the sparse kernel matrix, which is a computational bottleneck.


Wanderlust Online Continual Object Detection in the Real World. Online continual learning from data streams in dynamic environments is a critical direction in the computer vision field. However, realistic benchmarks and fundamental studies in this line are still missing. To bridge the gap, we present a new online continual object detection benchmark with an egocentric video dataset, Objects Around Krishna (OAK). OAK adopts the KrishnaCAM videos, an ego centric video stream collected over nine months by a graduate student. OAK provides exhaustive bounding box annotations of 80 video snippets ( 17.5 hours) for 105 object categories in outdoor scenes. The emergence of new object categories in our benchmark follows a pattern similar to what a single person might see in their day to day life. The dataset also captures the natural distribution shifts as the person travels to different places. These egocentric long running videos provide a realistic playground for continual learning algorithms, especially in online embodied settings. We also introduce new evaluation metrics to evaluate the model performance and catastrophic forgetting and provide baseline studies for online continual object detection. We believe this benchmark will pose new exciting challenges for learning from non stationary data in continual learning. The OAK dataset and the associated benchmark are released at https oakdata.github.io .


Optimal Gevrey Regularity for Certain Sums of Squares in Two Variables. For q , a integers such that a geq 1 , 1 q , (x, y) in U , U a neighborhood of the origin in mathbb R 2 , we consider the operator D x 2 x 2(q 1) D y 2 y 2a D y 2 . Slightly modifying the method of proof of cite monom we can see that it is Gevrey s 0 hypoelliptic, where s 0 1 1 a 1 (q 1) q 1 . Here we show that this value is optimal, i.e. that there are solutions to P u f with f more regular than G s 0 that are not better than Gevrey s 0 . The above operator reduces to the M 'etivier operator ( cite metivier81 ) when a 1 , q 2 . We give a description of the characteristic manifold of the operator and of its relation with the Treves conjecture on the real analytic regularity for sums of squares.


On relational complexity and base size of finite primitive groups. In this paper we show that if G is a primitive subgroup of S n that is not large base, then any irredundant base for G has size at most 5 log n . This is the first logarithmic bound on the size of an irredundant base for such groups, and is best possible up to a small constant. As a corollary, the relational complexity of G is at most 5 log n 1 , and the maximal size of a minimal base and the height are both at most 5 log n. Furthermore, we deduce that a base for G of size at most 5 log n can be computed in polynomial time.


A Proposed Set of Communicative Gestures for Human Robot Interaction and an RGB Image based Gesture Recognizer Implemented in ROS. We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for human robot interaction. Next, an online user study with 190 participants was performed to investigate if there was an agreed set of gestures that people intuitively use to communicate the given commands to robots when no guidance or training were given. As we found large variations among the gestures exist between participants, we then proposed a set of gestures for the proposed commands to be used as a common foundation for robot interaction. We collected 7500 video demonstrations of the proposed gestures and trained a gesture recognition model, adapting 3D Convolutional Neural Networks (CNN) as the classifier, with a final accuracy of 84.1 (sigma 2.4). The resulting model was capable of training successfully with a relatively small amount of training data. We integrated the gesture recognition model into the ROS framework and report details for a demonstrated use case, where a person commands a robot to perform a pick and place task using the proposed set. This integrated ROS gesture recognition system is made available for use, and built with the intention to allow for new adaptations depending on robot model and use case scenarios, for novel user applications.


On a conjecture of Gowers and Wolf. Gowers and Wolf have conjectured that, given a set of linear forms psi i i 1 t each mapping mathbb Z D to mathbb Z , if s is an integer such that the functions psi 1 s 1 , ldots, psi t s 1 are linearly independent, then averages of the form mathbb E boldsymbol x prod i 1 t f( psi i( boldsymbol x )) may be controlled by the Gowers U s 1 norm of f . We prove (a stronger version of) this conjecture.


Compositional Attention Disentangling Search and Retrieval. Multi head, key value attention is the backbone of the widely successful Transformer model and its variants. This attention mechanism uses multiple parallel key value attention blocks (called heads), each performing two fundamental computations (1) search selection of a relevant entity from a set via query key interactions, and (2) retrieval extraction of relevant features from the selected entity via a value matrix. Importantly, standard attention heads learn a rigid mapping between search and retrieval. In this work, we first highlight how this static nature of the pairing can potentially (a) lead to learning of redundant parameters in certain tasks, and (b) hinder generalization. To alleviate this problem, we propose a novel attention mechanism, called Compositional Attention, that replaces the standard head structure. The proposed mechanism disentangles search and retrieval and composes them in a dynamic, flexible and context dependent manner through an additional soft competition stage between the query key combination and value pairing. Through a series of numerical experiments, we show that it outperforms standard multi head attention on a variety of tasks, including some out of distribution settings. Through our qualitative analysis, we demonstrate that Compositional Attention leads to dynamic specialization based on the type of retrieval needed. Our proposed mechanism generalizes multi head attention, allows independent scaling of search and retrieval, and can easily be implemented in lieu of standard attention heads in any network architecture.


A primal dual flow for affine constrained convex optimization. We introduce a novel primal dual flow for affine constrained convex optimization problems. As a modification of the standard saddle point system, our primal dual flow is proved to possess the exponential decay property, in terms of a tailored Lyapunov function. Then two primal dual methods are obtained from numerical discretizations of the continuous model, and global nonergodic linear convergence rate is established via a discrete Lyapunov function. Instead of solving the subproblem of the primal variable, we apply the semi smooth Newton iteration to the subproblem with respect to the multiplier, provided that there are some additional properties such as semi smoothness and sparsity. Especially, numerical tests on the linearly constrained l 1 l 2 minimization and the total variation based image denoising model have been provided.


Heat equation on the Heisenberg group observability and applications. We investigate observability and Lipschitz stability for the Heisenberg heat equation on the rectangular domain Omega ( 1,1) times mathbb T times mathbb T taking as observation regions slices of the form omega (a,b) times mathbb T times mathbb T or tubes omega (a,b) times omega y times mathbb T , with 1 a b 1 . We prove that observability fails for an arbitrary time T 0 but both observability and Lipschitz stability hold true after a positive minimal time, which depends on the distance between omega and the boundary of Omega T min geqslant frac 1 8 min (1 a) 2,(1 b) 2 . Our proof follows a mixed strategy which combines the approach by Lebeau and Robbiano, which relies on Fourier decomposition, with Carleman inequalities for the heat equations that are solved by the Fourier modes. We extend the analysis to the unbounded domain ( 1,1) times mathbb T times mathbb R .


BERTi 'c The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian. In this paper we describe a transformer model pre trained on 8 billion tokens of crawled text from the Croatian, Bosnian, Serbian and Montenegrin web domains. We evaluate the transformer model on the tasks of part of speech tagging, named entity recognition, geo location prediction and commonsense causal reasoning, showing improvements on all tasks over state of the art models. For commonsense reasoning evaluation, we introduce COPA HR a translation of the Choice of Plausible Alternatives (COPA) dataset into Croatian. The BERTi 'c model is made available for free usage and further task specific fine tuning through HuggingFace.


Designing Language Technologies for Social Good The Road not Taken. Development of speech and language technology for social good (LT4SG), especially those targeted at the welfare of marginalized communities and speakers of low resource and under served languages, has been a prominent theme of research within NLP, Speech, and the AI communities. Researchers have mostly relied on their individual expertise, experiences or ad hoc surveys for prioritization of language technologies that provide social good to the end users. This has been criticized by several scholars who argue that work on LT4SG must include the target linguistic communities during the design and development process. However, none of the LT4SG work and their critiques suggest principled techniques for prioritization of the technologies and methods for inclusion of the end user during the development cycle. Drawing inspiration from the fields of Economics, Ethics, Psychology, and Participatory Design, here we chart out a set of methodologies for prioritizing LT4SG that are aligned with the end user preferences. We then analyze several LT4SG efforts in light of the proposed methodologies and bring out their hidden assumptions and potential pitfalls. While the current study is limited to language technologies, we believe that the principles and prioritization techniques highlighted here are applicable more broadly to AI for Social Good.


End to End Conversational Search for Online Shopping with Utterance Transfer. Successful conversational search systems can present natural, adaptive and interactive shopping experience for online shopping customers. However, building such systems from scratch faces real word challenges from both imperfect product schema knowledge and lack of training dialog data.In this work we first propose ConvSearch, an end to end conversational search system that deeply combines the dialog system with search. It leverages the text profile to retrieve products, which is more robust against imperfect product schema knowledge compared with using product attributes alone. We then address the lack of data challenges by proposing an utterance transfer approach that generates dialogue utterances by using existing dialog from other domains, and leveraging the search behavior data from e commerce retailer. With utterance transfer, we introduce a new conversational search dataset for online shopping. Experiments show that our utterance transfer method can significantly improve the availability of training dialogue data without crowd sourcing, and the conversational search system significantly outperformed the best tested baseline.


A synthetic biology approach for the design of genetic algorithms with bacterial agents. Bacteria have been a source of inspiration for the design of evolutionary algorithms. At the beginning of the 20th century synthetic biology was born, a discipline whose goal is the design of biological systems that do not exist in nature, for example, programmable synthetic bacteria. In this paper, we introduce as a novelty the designing of evolutionary algorithms where all the steps are conducted by synthetic bacteria. To this end, we designed a genetic algorithm, which we have named BAGA, illustrating its utility solving simple instances of optimization problems such as function optimization, 0 1 knapsack problem, Hamiltonian path problem. The results obtained open the possibility of conceiving evolutionary algorithms inspired by principles, mechanisms and genetic circuits from synthetic biology. In summary, we can conclude that synthetic biology is a source of inspiration either for the design of evolutionary algorithms or for some of their steps, as shown by the results obtained in our simulation experiments.


Dynamic Membership for Regular Languages. We study the dynamic membership problem for regular languages fix a language L, read a word w, build in time O( w ) a data structure indicating if w is in L, and maintain this structure efficiently under letter substitutions on w. We consider this problem on the unit cost RAM model with logarithmic word length, where the problem always has a solution in O(log w log log w ) per operation. We show that the problem is in O(log log w ) for languages in an algebraically defined, decidable class QSG, and that it is in O(1) for another such class QLZG. We show that languages not in QSG admit a reduction from the prefix problem for a cyclic group, so that they require Omega (log w log log w ) operations in the worst case and that QSG languages not in QLZG admit a reduction from the prefix problem for the multiplicative monoid U 1 0, 1 , which we conjecture cannot be maintained in O(1). This yields a conditional trichotomy. We also investigate intermediate cases between O(1) and O(log log w ). Our results are shown via the dynamic word problem for monoids and semigroups, for which we also give a classification. We thus solve open problems of the paper of Skovbjerg Frandsen, Miltersen, and Skyum 30 on the dynamic word problem, and additionally cover regular languages.


A Comprehensive Analysis of Allostery in 14 3 3 zeta Docking Proteins using the Spatial Convolution Model (SCM). The Spatial Convolution Model (SCM) analyzes allostery based on the spatial evolution of the docking protein elastic media, whereby convolution of the media in response to wave propagation is solved as a function of Z fluctuations and backbone vibration modes. We show that although the elastic media is a complex three dimensional structure allostery behaves as if it occurs along a stretched oscillating string, where inhomogeneities along the string effect local entropies responsible for ligand binding and transduction of allosteric waves. To identify inhomogeneities along the string, we ignored local density and tension changes during wave propagation and resolved helix wave and physical properties by applying molecular string and beam bending theories. Importantly, we show that allostery occurs at three major scales and that propagation of standing waves create a rolling entropy which drives entropy transfers between fields. Conversion of resonance energy to quantum harmonic oscillators allowed us to consider effects of damping and interactions with the surrounding media as well as to model effects of residue interaction strength on entropy transfer.


Multi task learning on the edge cost efficiency and theoretical optimality. This article proposes a distributed multi task learning (MTL) algorithm based on supervised principal component analysis (SPCA) which is (i) theoretically optimal for Gaussian mixtures, (ii) computationally cheap and scalable. Supporting experiments on synthetic and real benchmark data demonstrate that significant energy gains can be obtained with no performance loss.


Memory Efficient CNN Accelerator Based on Interlayer Feature Map Compression. Existing deep convolutional neural networks (CNNs) generate massive interlayer feature data during network inference. To maintain real time processing in embedded systems, large on chip memory is required to buffer the interlayer feature maps. In this paper, we propose an efficient hardware accelerator with an interlayer feature compression technique to significantly reduce the required on chip memory size and off chip memory access bandwidth. The accelerator compresses interlayer feature maps through transforming the stored data into frequency domain using hardware implemented 8x8 discrete cosine transform (DCT). The high frequency components are removed after the DCT through quantization. Sparse matrix compression is utilized to further compress the interlayer feature maps. The on chip memory allocation scheme is designed to support dynamic configuration of the feature map buffer size and scratch pad size according to different network layer requirements. The hardware accelerator combines compression, decompression, and CNN acceleration into one computing stream, achieving minimal compressing and processing delay. A prototype accelerator is implemented on an FPGA platform and also synthesized in TSMC 28 nm COMS technology. It achieves 403GOPS peak throughput and 1.4x 3.3x interlayer feature map reduction by adding light hardware area overhead, making it a promising hardware accelerator for intelligent IoT devices.


AI Decision Support System Interface Using Cancer Related Data for Lung Cancer Prognosis. Until the beginning of 2021, lung cancer is known to be the most common cancer in the world. The disease is common due to factors such as occupational exposure, smoking and environmental pollution. The early diagnosis and treatment of the disease is of great importance as well as the prevention of the causes that cause the disease. The study was planned to create a web interface that works with machine learning algorithms to predict prognosis using lung cancer clinical and gene expression in the GDC data portal.


Discovering Sex and Age Implicator Edges in the Human Connectome. Determining important vertices in large graphs (e.g., Google's PageRank in the case of the graph of the World Wide Web) facilitated the construction of excellent web search engines, returning the most important hits corresponding to the submitted user queries. Interestingly, finding important edges instead of vertices in large graphs has received much less attention until now. Here we examine the human structural braingraph (or connectome), identified by diffusion magnetic resonance imaging (dMRI) methods, with edges connecting cortical and subcortical gray matter areas and weighted by fiber strengths, measured by the number of the discovered fiber tracts along the edge. We identify several "single" important edges in these braingraphs, whose high or low weights imply the sex or the age of the subject observed. We call these edges implicator edges since solely from their weight, one can infer the sex of the subject with more than 67 accuracy or their age group with more than 62 accuracy. We argue that these brain connections are the most important ones characterizing the sex or the age of the subjects. Surprisingly, the edges implying the male sex are mostly located in the anterior parts of the brain, while those implying the female sex are mostly in the posterior regions. Additionally, most of the inter hemispheric implicator edges are male ones, while the intra hemispheric ones are predominantly female edges. Our pioneering method for finding the sex or age implicator edges can also be applied for characterizing other biological and medical properties, including neurodegenerative and psychiatric diseases besides the sex or the age of the subject, if large and high quality neuroimaging datasets become available.


Photodynamically Active Electrospun Fibres for Antibiotic Free Infection Control. Antimicrobial biomaterials are critical to aid in the regeneration of oral soft tissue and prevent or treat localised bacterial infections. With the rising trend in antibiotic resistance, there is a pressing clinical need for new antimicrobial chemistries and biomaterial design approaches enabling on demand activation of antibiotic free antimicrobial functionality following an infection that are environment friendly, flexible and commercially viable. This study explores the feasibility of integrating a bioresorbable electrospun polymer scaffold with localised antimicrobial photodynamic therapy (aPDT) capability. To enable aPDT, we encapsulated a photosensitiser (PS) in polyester fibres in the PS inert state, so that the antibacterial function would be activated on demand via a visible light source. Fibrous scaffolds were successfully electrospun from FDA approved polyesters, either poly(epsilon caprolactone (PCL) or poly (rac lactide) co glycolide (PLGA) with encapsulated PS (either methylene blue (MB) or erythrosin B (ER)). The electrospun fibres achieved an 100 wt. loading efficiency of PS, which significantly increased their tensile modulus and reduced their average fibre diameter and pore size with respect to PS free controls. In vitro, PS release varied between a burst release profile to limited release within 100 hours depending on the selected scaffold formulation. Exposure of PS encapsulated PCL fibres to visible light successfully led to at least a 1 log reduction in E. coli viability after 60 minutes of light exposure whereas PS free electrospun controls did not inactive microbes. This study successfully demonstrates the significant potential of PS encapsulated electrospun fibres as photodynamically active biomaterial for antibiotic free infection control.


VoIP Can Still Be Exploited Badly. VoIP phones are early representatives as well as present enhancers of the IoT. This paper observes that they are still widely used in a traditional, unsecured configuration and demonstrates the Phonejack family of attacks Phonejack 1 conjectures the exploitation of phone vulnerabilities Phonejack 2 demonstrates how to mount a denial of service attack on a network of phones Phonejack 3 sniffs calls. It is reassuring, however, that inexpensive devices such as a Raspberry Pi can be configured and programmed as effective countermeasures, thus supporting the approach of integrating both technologies. We demonstrate both attacks and defence measures in a video clip. The concluding evaluations argue that trusting the underlying network security measures may turn out overly optimistic moreover, VoIP phones really ought to be protected as laptops routinely are today


DeepMesh Differentiable Iso Surface Extraction. Geometric Deep Learning has recently made striking progress with the advent of continuous deep implicit fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid, resulting in a learnable parameterization that is unlimited in resolution. Unfortunately, these methods are often unsuitable for applications that require an explicit mesh based surface representation because converting an implicit field to such a representation relies on the Marching Cubes algorithm, which cannot be differentiated with respect to the underlying implicit field. In this work, we remove this limitation and introduce a differentiable way to produce explicit surface mesh representations from Deep Implicit Fields. Our key insight is that by reasoning on how implicit field perturbations impact local surface geometry, one can ultimately differentiate the 3D location of surface samples with respect to the underlying deep implicit field. We exploit this to define DeepMesh an end to end differentiable mesh representation that can vary its topology. We validate our theoretical insight through several applications Single view 3D Reconstruction via Differentiable Rendering, Physically Driven Shape Optimization, Full Scene 3D Reconstruction from Scans and End to End Training. In all cases our end to end differentiable parameterization gives us an edge over state of the art algorithms.


Strictly In Place Algorithms for Permuting and Inverting Permutations. We revisit the problem of permuting an array of length n according to a given permutation in place, that is, using only a small number of bits of extra storage. Fich, Munro and Poblete FOCS 1990, SICOMP 1995 obtained an elegant mathcal O (n log n) time algorithm using only mathcal O ( log 2 n) bits of extra space for this basic problem by designing a procedure that scans the permutation and outputs exactly one element from each of its cycles. However, in the strict sense in place should be understood as using only an asymptotically optimal mathcal O ( log n) bits of extra space, or storing a constant number of indices. The problem of permuting in this version is, in fact, a well known interview question, with the expected solution being a quadratic time algorithm. Surprisingly, no faster algorithm seems to be known in the literature. Our first contribution is a strictly in place generalisation of the method of Fich et al. that works in mathcal O varepsilon (n 1 varepsilon ) time, for any varepsilon 0 . Then, we build on this generalisation to obtain a strictly in place algorithm for inverting a given permutation on n elements working in the same complexity. This is a significant improvement on a recent result of Gu 'spiel arXiv 2019 , who designed an mathcal O (n 1.5 ) time algorithm.


Improved Ackermannian lower bound for the Petri nets reachability problem. Petri nets, equivalently presentable as vector addition systems with states, are an established model of concurrency with widespread applications. The reachability problem, where we ask whether from a given initial configuration there exists a sequence of valid execution steps reaching a given final configuration, is the central algorithmic problem for this model. The complexity of the problem has remained, until recently, one of the hardest open questions in verification of concurrent systems. A first upper bound has been provided only in 2015 by Leroux and Schmitz, then refined by the same authors to non primitive recursive Ackermannian upper bound in 2019. The exponential space lower bound, shown by Lipton already in 1976, remained the only known for over 40 years until a breakthrough non elementary lower bound by Czerwi 'n ski, Lasota, Lazic, Leroux and Mazowiecki in 2019. Finally, a matching Ackermannian lower bound announced this year by Czerwi 'n ski and Orlikowski, and independently by Leroux, established the complexity of the problem. Our primary contribution is an improvement of the former construction, making it conceptually simpler and more direct. On the way we improve the lower bound for vector addition systems with states in fixed dimension (or, equivalently, Petri nets with fixed number of places) while Czerwi 'n ski and Orlikowski prove F k hardness (hardness for k th level in Grzegorczyk Hierarchy) in dimension 6k , our simplified construction yields F k hardness already in dimension 3k 2 .


SwarmPlay A Swarm of Nano Quadcopters Playing Tic tac toe Board Game against a Human. We present a new paradigm of games, i.e. SwarmPlay, where each playing component is presented by an individual drone that has its own mobility and swarm intelligence to win against a human player. The motivation behind the research is to make the games with machines tangible and interactive. Although some research on the robotic players for board games already exists, e.g., chess, the SwarmPlay technology has the potential to offer much more engagement and interaction with a human as it proposes a multi agent swarm instead of a single interactive robot. The proposed system consists of a robotic swarm, a workstation, a computer vision (CV), and Game Theory based algorithms. A novel game algorithm was developed to provide a natural game experience to the user. The preliminary user study revealed that participants were highly engaged in the game with drones (69 put a maximum score on the Likert scale) and found it less artificial compared to the regular computer based systems (77 put maximum score). The affection of the user's game perception from its outcome was analyzed and put under discussion. User study revealed that SwarmPlay has the potential to be implemented in a wider range of games, significantly improving human drone interactivity.


Edges in Brain Networks Contributions to Models of Structure and Function. Network models describe the brain as sets of nodes and edges that represent its distributed organization. So far, most discoveries in network neuroscience have prioritized insights that highlight distinct groupings and specialized functional contributions of network nodes. Importantly, these functional contributions are determined and expressed by the web of their interrelationships, formed by network edges. Here, we underscore the important contributions made by brain network edges for understanding distributed brain organization. Different types of edges represent different types of relationships, including connectivity and similarity among nodes. Adopting a specific definition of edges can fundamentally alter how we analyze and interpret a brain network. Furthermore, edges can associate into collectives and higher order arrangements, describe time series, and form edge communities that provide insights into brain network topology complementary to the traditional node centric perspective. Focusing on the edges, and the higher order or dynamic information they can provide, discloses previously underappreciated aspects of structural and functional network organization.


Memorization and Generalization in Neural Code Intelligence Models. Deep Neural Networks are capable of learning highly generalizable patterns from large datasets of source code through millions of parameters. This large capacity also renders them prone to memorizing data points. Recent work suggests that the memorization risk manifests especially strongly when the training dataset is noisy, involving many ambiguous or questionable samples, and memorization is the only recourse. Unfortunately, most code intelligence tasks rely on rather noise prone and repetitive data sources, such as code from GitHub. Given the sheer size of such corpora, determining the role and extent of noise in these is beyond manual inspection. In this paper, we propose an alternative analysis we evaluate the impact of the noise on training neural models of source code by introducing targeted noise to the dataset of several state of the art neural intelligence models and benchmarks based on Java and Python codebases. By studying the resulting behavioral changes at various rates of noise, and across a wide range of metrics, we can characterize both typical generalizing and problematic memorization like learning of models of source code. Our results highlight important risks millions of trainable parameters allow the neural networks to memorize anything, including noisy data, and provide a false sense of generalization. At the same time, the metrics used to analyze this phenomenon proved surprisingly useful for detecting and quantifying such effects, offering a powerful toolset for creating reliable models of code.


Uniqueness of 4 manifolds described as sequences of 3 d handlebodies. Work of numerous authors has shown that any smooth, orientable, closed 4 manifold may be described as a loop of Morse functions on a surface, a loop in the cut complex, a loop in the pants complex, or as a multisection. In this paper, we prove a corresponding uniqueness theorem for each of these descriptions, so that, for example, any two loops of Morse functions on a surface yielding diffeomorphic 4 manifolds are related by a given set of moves.


Characterization of groups E 6(3) and 2 E 6(3) by Gruenberg Kegel graph. The Gruenberg Kegel graph (or the prime graph) Gamma(G) of a finite group G is defined as follows. The vertex set of Gamma(G) is the set of all prime divisors of the order of G . Two distinct primes r and s regarded as vertices are adjacent in Gamma(G) if and only if there exists an element of order rs in G . Suppose that L cong E 6(3) or L cong 2E 6(3) . We prove that if G is a finite group such that Gamma(G) Gamma(L) , then G cong L .


On the problem of smooth approximations in de Branges Rovnyak spaces and connections to subnormal operators. For the class of de Branges Rovnyak spaces mathcal H (b) of the unit disk mathbb D defined by extreme points b of the unit ball of H infty , we study the problem of approximation of a general function in mathcal H (b) by a function with an extension to the unit circle mathbb T of some degree of smoothness, for instance satisfying H "older estimates or being differentiable. We will exhibit connections between this question and the theory of subnormal operators and, in particular, we will tie the possibility of smooth approximations to properties of invariant subspaces of a certain subnormal operator. This leads us to several computable conditions on b which are necessary for such approximations to be possible. For a large class of extreme points b we use our result to obtain explicit necessary and sufficient conditions on the symbol b which guarantee the density of functions with differentiable boundary values in the space mathcal H (b) . These conditions include an interplay between the modulus of b on mathbb T and the spectrum of its inner factor.


Multi Facet Recommender Networks with Spherical Optimization. Implicit feedback is widely explored by modern recommender systems. Since the feedback is often sparse and imbalanced, it poses great challenges to the learning of complex interactions among users and items. Metric learning has been proposed to capture user item interactions from implicit feedback, but existing methods only represent users and items in a single metric space, ignoring the fact that users can have multiple preferences and items can have multiple properties, which leads to potential conflicts limiting their performance in recommendation. To capture the multiple facets of user preferences and item properties while resolving their potential conflicts, we propose the novel framework of Multi fAcet Recommender networks with Spherical optimization (MARS). By designing a cross facet similarity measurement, we project users and items into multiple metric spaces for fine grained representation learning, and compare them only in the proper spaces. Furthermore, we devise a spherical optimization strategy to enhance the effectiveness and robustness of the multi facet recommendation framework. Extensive experiments on six real world benchmark datasets show drastic performance gains brought by MARS, which constantly achieves up to 40 improvements over the state of the art baselines regarding both HR and nDCG metrics.


ArchRepair Block Level Architecture Oriented Repairing for Deep Neural Networks. Over the past few years, deep neural networks (DNNs) have achieved tremendous success and have been continuously applied in many application domains. However, during the practical deployment in the industrial tasks, DNNs are found to be erroneous prone due to various reasons such as overfitting, lacking robustness to real world corruptions during practical usage. To address these challenges, many recent attempts have been made to repair DNNs for version updates under practical operational contexts by updating weights (i.e., network parameters) through retraining, fine tuning, or direct weight fixing at a neural level. In this work, as the first attempt, we initiate to repair DNNs by jointly optimizing the architecture and weights at a higher (i.e., block) level. We first perform empirical studies to investigate the limitation of whole network level and layer level repairing, which motivates us to explore a novel repairing direction for DNN repair at the block level. To this end, we first propose adversarial aware spectrum analysis for vulnerable block localization that considers the neurons' status and weights' gradients in blocks during the forward and backward processes, which enables more accurate candidate block localization for repairing even under a few examples. Then, we further propose the architecture oriented search based repairing that relaxes the targeted block to a continuous repairing search space at higher deep feature levels. By jointly optimizing the architecture and weights in that space, we can identify a much better block architecture. We implement our proposed repairing techniques as a tool, named ArchRepair, and conduct extensive experiments to validate the proposed method. The results show that our method can not only repair but also enhance accuracy robustness, outperforming the state of the art DNN repair techniques.


Accuracy, Interpretability, and Differential Privacy via Explainable Boosting. We show that adding differential privacy to Explainable Boosting Machines (EBMs), a recent method for training interpretable ML models, yields state of the art accuracy while protecting privacy. Our experiments on multiple classification and regression datasets show that DP EBM models suffer surprisingly little accuracy loss even with strong differential privacy guarantees. In addition to high accuracy, two other benefits of applying DP to EBMs are a) trained models provide exact global and local interpretability, which is often important in settings where differential privacy is needed and b) the models can be edited after training without loss of privacy to correct errors which DP noise may have introduced.


Revised SCLP simplex Algorithm with Application to Large Scale Fluid Processing Networks. We describe an efficient implementation of a recent simplex type algorithm for the exact solution of separated continuous linear programs, and compare it with linear programming approximation of these problems obtained via discretization of the time horizon. The implementation overcomes many numerical pitfalls often neglected in theoretical analysis allowing better accuracy or acceleration up to several orders of magnitude both versus previous implementation of the simplex type algorithms and versus a state of the art LP solver using discretization. Numerical study includes medium, large, and very large examples of scheduling problems and problems of control of fluid processing networks. We discuss online and offline optimization settings for various applications and outline future research directions.


Heterogeneous Risk Minimization. Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts. Recently, some invariant learning methods for out of distribution (OOD) generalization have been proposed by leveraging multiple training environments to find invariant relationships. However, modern datasets are frequently assembled by merging data from multiple sources without explicit source labels. The resultant unobserved heterogeneity renders many invariant learning methods inapplicable. In this paper, we propose Heterogeneous Risk Minimization (HRM) framework to achieve joint learning of latent heterogeneity among the data and invariant relationship, which leads to stable prediction despite distributional shifts. We theoretically characterize the roles of the environment labels in invariant learning and justify our newly proposed HRM framework. Extensive experimental results validate the effectiveness of our HRM framework.


Adaptation to DNA damage, an asymptotic approach for a cooperative non local system. Following previous works about integro differential equations of parabolic type modelling the Darwinian evolution of a population, we study a two population system in the cooperative case. First, we provide a theoretical study of the limit of rare mutations and we prove that the limit is described by a constrained Hamilton Jacobi equation. This equation is given by an eigenvalue of a matrix which accounts for the diffusion parameters and the coefficients of the system. Then, we focus on a particular application the understanding of a phenomenon called Adaptation to DNA damage. In this framework, we provide several numerical simulations to illustrate our theoretical results and investigate mathematical and biological questions.