Artificial Intelligence based Autonomous Molecular Design for Medical Therapeutic A Perspective. Domain aware machine learning (ML) models have been increasingly adopted for accelerating small molecule therapeutic design in the recent years. These models have been enabled by significant advancement in state of the art artificial intelligence (AI) and computing infrastructures. Several ML architectures are pre dominantly and independently used either for predicting the properties of small molecules, or for generating lead therapeutic candidates. Synergetically using these individual components along with robust representation and data generation techniques autonomously in closed loops holds enormous promise for accelerated drug design which is a time consuming and expensive task otherwise. In this perspective, we present the most recent breakthrough achieved by each of the components, and how such autonomous AI and ML workflow can be realized to radically accelerate the hit identification and lead optimization. Taken together, this could significantly shorten the timeline for end to end antiviral discovery and optimization times to weeks upon the arrival of a novel zoonotic transmission event. Our perspective serves as a guide for researchers to practice autonomous molecular design in therapeutic discovery.


Interpolation between noncommutative martingale Hardy and BMO spaces the case 0 p 1 . Let mathcal M be a semifinite von Nemann algebra equipped with an increasing filtration ( mathcal M n) n geq 1 of (semifinite) von Neumann subalgebras of mathcal M . For 0 p infty , let mathsf h p c( mathcal M ) denote the noncommutative column conditioned martingale Hardy space and bmo c( M) denote the column lq lq little rq rq martingale BMO space associated with the filtration ( mathcal M n) n geq 1 . We prove the following real interpolation identity if 0 p infty and 0 theta 1 , then for 1 r (1 theta) p , big( mathsf h p c( mathcal M ), bmo c( mathcal M ) big) theta, r mathsf h r c( mathcal M ), with equivalent quasi norms. For the case of complex interpolation, we obtain that if 0 p q infty and 0 theta 1 , then for 1 r (1 theta) p theta q , big mathsf h p c( mathcal M ), mathsf h q c( mathcal M ) big theta mathsf h r c( mathcal M ) with equivalent quasi norms. These extend previously known results from p geq 1 to the full range 0 p infty . Other related spaces such as spaces of adapted sequences and Junge's noncommutative conditioned L p spaces are also shown to form interpolation scale for the full range 0 p infty when either the real method or the complex method is used. Our method of proof is based on a new algebraic atomic decomposition for Orlicz space version of Junge's noncommutative conditioned L p spaces. We apply these results to derive various inequalities for martingales in noncommutative symmetric quasi Banach spaces.


Decompositions of finite high dimensional random arrays. A d dimensional random array on a nonempty set I is a stochastic process boldsymbol X langle X s s in I choose d rangle indexed by the set I choose d of all d element subsets of I . We obtain structural decompositions of finite, high dimensional random arrays whose distribution is invariant under certain symmetries. Our first main result is a distributional decomposition of finite, (approximately) spreadable, high dimensional random arrays whose entries take values in a finite set the two dimensional case of this result is the finite version of an infinitary decomposition due to Fremlin and Talagrand. Our second main result is a physical decomposition of finite, spreadable, high dimensional random arrays with square integrable entries which is the analogue of the Hoeffding Efron Stein decomposition. All proofs are effective. We also present applications of these decompositions in the study of concentration of functions of finite, high dimensional random arrays.


Explicit Bound on Collective Strength of Regular Sequences of Three Homogeneous Polynomials. Let f 1, cdots,f r in k x 1, cdots,x n be homogeneous polynomial of degree d . Ananyan and Hochster (2016) proved that there exists a bound N N(r,d) where if collective strength of f 1, cdots,f r geq N , then f 1, cdots,f r are regular sequence. In this paper, we study the explicit bound N(r,d) when r 3 and d 2,3 and show that N(3,2) 2 and N(3,3) 2 .


Learning Text Image Joint Embedding for Efficient Cross Modal Retrieval with Deep Feature Engineering. This paper introduces a two phase deep feature engineering framework for efficient learning of semantics enhanced joint embedding, which clearly separates the deep feature engineering in data preprocessing from training the text image joint embedding model. We use the Recipe1M dataset for the technical description and empirical validation. In preprocessing, we perform deep feature engineering by combining deep feature engineering with semantic context features derived from raw text image input data. We leverage LSTM to identify key terms, deep NLP models from the BERT family, TextRank, or TF IDF to produce ranking scores for key terms before generating the vector representation for each key term by using word2vec. We leverage wideResNet50 and word2vec to extract and encode the image category semantics of food images to help semantic alignment of the learned recipe and image embeddings in the joint latent space. In joint embedding learning, we perform deep feature engineering by optimizing the batch hard triplet loss function with soft margin and double negative sampling, taking into account also the category based alignment loss and discriminator based alignment loss. Extensive experiments demonstrate that our SEJE approach with deep feature engineering significantly outperforms the state of the art approaches.


Two Decades of Game Jams. In less than a year's time, March 2022 will mark the twentieth anniversary of the first documented game jam, the Indie Game Jam, which took place in Oakland, California in 2002. Initially, game jams were widely seen as frivolous activities. Since then, they have taken the world by storm. Game jams have not only become part of the day to day process of many game developers, but jams are also used for activist purposes, for learning and teaching, as part of the experience economy, for making commercial prototypes that gamers can vote on, and more. Beyond only surveying game jams and the relevant published scientific literature from the last two decades, this paper has several additional contributions. It builds a history of game jams, and proposes two different taxonomies of game jams a historical and a categorical. In addition, it discusses the definition of game jam and identifies the most active research areas within the game jam community such as the interplay and development with local communities, the study and analysis of game jammers and organisers, and works that bring a critical look on game jams.


Existence of an optimal domain for the buckling load of a clamped plate with prescribed volume. We formulate the minimization of the buckling load of a clamped plate as a free boundary value problem with a penalization term for the volume constraint. As the penalization parameter becomes small we show that the optimal shape problem with prescribed volume is solved. In addition, we discuss two different choices for the penalization term.


Dynamic Modeling of Bucket Soil Interactions Using Koopman DFL Lifting Linearization for Model Predictive Contouring Control of Autonomous Excavators. A lifting linearization method based on the Koopman operator and Dual Faceted Linearization is applied to the control of a robotic excavator. In excavation, a bucket interacts with the surrounding soil in a highly nonlinear and complex manner. Here, we propose to represent the nonlinear bucket soil dynamics with a set of linear state equations in a higher dimensional space. The space of independent state variables is augmented by adding variables associated with nonlinear elements involved in the bucket soil dynamics. These include nonlinear resistive forces and moment acting on the bucket from the soil, and the effective inertia of the bucket that varies as the soil is captured into the bucket. Variables associated with these nonlinear resistive and inertia elements are treated as additional state variables, and their time evolution is represented as another set of linear differential equations. The lifted linear dynamic model is then applied to Model Predictive Contouring Control, where a cost functional is minimized as a convex optimization problem thanks to the linear dynamics in the lifted space. The lifted linear model is tuned based on a data driven method by using a soil dynamics simulator. Simulation experiments verify the effectiveness of the proposed lifting linearization compared to its counterpart.


Electron vacancy level dependent hybrid photoionization of F C60 molecule. Our previous studies J. Phys. B 53, 125101 (2020) Euro. Phys. J. D 74, 191 (2020) have predicted that the atom fullerene hybrid photoionization properties for X Cl, Br and I endohedrally confined in C60 are different before and after an electron transfers from C60 to the halogen. It was further found as a rule that the ionization dynamics is insensitive to the C60 level the electron originates from to produce X C60 . In the current study, we report an exception to this rule in F C60. It is found that when the electron vacancy is situated in the C60 level that participates in the hybridization in F C60 , the mixing becomes dramatically large leading to strong modifications in the photoionization of the hybrid levels. But when the vacancy is at any other pure level of C60, the level invariance is retained showing weak hybridization. Even though this case of F C60 is an anomaly in the halogen C60 series, the phenomenon can be more general and can occur with compounds of other atoms caged in a variety of fullerenes. In addition, possible experimental studies are suggested to benchmark the present results.


Curved holographic optical elements from a geometric view point graphical visualization and parametric optimization. We present numerical experiments regarding the diffraction characteristics and their precompensation arising from changing the macroscopic geometry of a flat HOE into a sphere segment. In particular, we discuss a parametric optimization scheme using a grating vector field model which was previously introduced in Ref. 1.


Equivariant Q Learning in Spatial Action Spaces. Recently, a variety of new equivariant neural network model architectures have been proposed that generalize better over rotational and reflectional symmetries than standard models. These models are relevant to robotics because many robotics problems can be expressed in a rotationally symmetric way. This paper focuses on equivariance over a visual state space and a spatial action space the setting where the robot action space includes a subset of rm SE (2) . In this situation, we know a priori that rotations and translations in the state image should result in the same rotations and translations in the spatial action dimensions of the optimal policy. Therefore, we can use equivariant model architectures to make Q learning more sample efficient. This paper identifies when the optimal Q function is equivariant and proposes Q network architectures for this setting. We show experimentally that this approach outperforms standard methods in a set of challenging manipulation problems.


Neural based Modeling for Performance Tuning of Spark Data Analytics. Cloud data analytics has become an integral part of enterprise business operations for data driven insight discovery. Performance modeling of cloud data analytics is crucial for performance tuning and other critical operations in the cloud. Traditional modeling techniques fail to adapt to the high degree of diversity in workloads and system behaviors in this domain. In this paper, we bring recent Deep Learning techniques to bear on the process of automated performance modeling of cloud data analytics, with a focus on Spark data analytics as representative workloads. At the core of our work is the notion of learning workload embeddings (with a set of desired properties) to represent fundamental computational characteristics of different jobs, which enable performance prediction when used together with job configurations that control resource allocation and other system knobs. Our work provides an in depth study of different modeling choices that suit our requirements. Results of extensive experiments reveal the strengths and limitations of different modeling methods, as well as superior performance of our best performing method over a state of the art modeling tool for cloud analytics.


Fast Neighborhood Rendezvous. In the rendezvous problem, two computing entities (called emph agents ) located at different vertices in a graph have to meet at the same vertex. In this paper, we consider the synchronous emph neighborhood rendezvous problem , where the agents are initially located at two adjacent vertices. While this problem can be trivially solved in O( Delta) rounds ( Delta is the maximum degree of the graph), it is highly challenging to reveal whether that problem can be solved in o( Delta) rounds, even assuming the rich computational capability of agents. The only known result is that the time complexity of O( sqrt n ) rounds is achievable if the graph is complete and agents are probabilistic, asymmetric, and can use whiteboards placed at vertices. Our main contribution is to clarify the situation (with respect to computational models and graph classes) admitting such a sublinear time rendezvous algorithm. More precisely, we present two algorithms achieving fast rendezvous additionally assuming bounded minimum degree, unique vertex identifier, accessibility to neighborhood IDs, and randomization. The first algorithm runs within tilde O ( sqrt n Delta delta n delta) rounds for graphs of the minimum degree larger than sqrt n , where n is the number of vertices in the graph, and delta is the minimum degree of the graph. The second algorithm assumes that the largest vertex ID is O(n) , and achieves tilde O left( frac n sqrt delta right) round time complexity without using whiteboards. These algorithms attain o( Delta) round complexity in the case of delta omega ( sqrt n log n) and delta omega(n 2 3 log 4 3 n) respectively.


Learning to Describe Solutions for Bug Reports Based on Developer Discussions. When a software bug is reported, developers engage in a discussion to collaboratively resolve it. While the solution is likely formulated within the discussion, it is often buried in a large amount of text, making it difficult to comprehend and delaying its implementation. To expedite bug resolution, we propose generating a concise natural language description of the solution by synthesizing relevant content within the discussion, which encompasses both natural language and source code. We build a corpus for this task using a novel technique for obtaining noisy supervision from repository changes linked to bug reports, with which we establish benchmarks. We also design two systems for generating a description during an ongoing discussion by classifying when sufficient context for performing the task emerges in real time. With automated and human evaluation, we find this task to form an ideal testbed for complex reasoning in long, bimodal dialogue context.


On First and Second Cohomology Groups for BBW Parabolics for Classical Lie Superalgebras. Let mathfrak g be a classical simple Lie superalgebra. In this paper, the author studies the cohomology groups for the subalgebra mathfrak n relative to the BBW parabolic subalgebras constructed by D. Grantcharov, N. Grantcharov, Nakano and Wu. These classical Lie superalgebras have a triangular decomposition mathfrak g mathfrak n oplus mathfrak f oplus mathfrak n where mathfrak f is a detecting subalgebra as introduced by Boe, Kujawa and Nakano. It is shown that there exists a Hochschild Serre spectral sequence that collapses for all infinite families of classical simple Lie superalgebras. This enables the author to explicitly compute the first and second cohomologies for mathfrak n . The paper concludes with tables listing the weight space decompositions and dimension formulas for these cohomology groups.


Updating Street Maps using Changes Detected in Satellite Imagery. Accurately maintaining digital street maps is labor intensive. To address this challenge, much work has studied automatically processing geospatial data sources such as GPS trajectories and satellite images to reduce the cost of maintaining digital maps. An end to end map update system would first process geospatial data sources to extract insights, and second leverage those insights to update and improve the map. However, prior work largely focuses on the first step of this pipeline these map extraction methods infer road networks from scratch given geospatial data sources (in effect creating entirely new maps), but do not address the second step of leveraging this extracted information to update the existing digital map data. In this paper, we first explain why current map extraction techniques yield low accuracy when extended to update existing maps. We then propose a novel method that leverages the progression of satellite imagery over time to substantially improve accuracy. Our approach first compares satellite images captured at different times to identify portions of the physical road network that have visibly changed, and then updates the existing map accordingly. We show that our change based approach reduces map update error rates four fold.


Deep Reinforcement Learning for Online Control of Stochastic Partial Differential Equations. In many areas, such as the physical sciences, life sciences, and finance, control approaches are used to achieve a desired goal in complex dynamical systems governed by differential equations. In this work we formulate the problem of controlling stochastic partial differential equations (SPDE) as a reinforcement learning problem. We present a learning based, distributed control approach for online control of a system of SPDEs with high dimensional state action space using deep deterministic policy gradient method. We tested the performance of our method on the problem of controlling the stochastic Burgers' equation, describing a turbulent fluid flow in an infinitely large domain.


Application of Deep Self Attention in Knowledge Tracing. The development of intelligent tutoring system has greatly influenced the way students learn and practice, which increases their learning efficiency. The intelligent tutoring system must model learners' mastery of the knowledge before providing feedback and advices to learners, so one class of algorithm called "knowledge tracing" is surely important. This paper proposed Deep Self Attentive Knowledge Tracing (DSAKT) based on the data of PTA, an online assessment system used by students in many universities in China, to help these students learn more efficiently. Experimentation on the data of PTA shows that DSAKT outperforms the other models for knowledge tracing an improvement of AUC by 2.1 on average, and this model also has a good performance on the ASSIST dataset.


Propagation invariant vortex Airy beam whose singular point follows its main lobe. We propose and demonstrate a novel vortex Airy beam which is a superposition of an Airy beam and its laterally sheared beam with a pi 2 phase shift. This new type of vortex Airy beam exhibits stable propagation dynamics, wherein its singular point closely follows its main lobe, unlike conventional vortex Airy beams. Notably, the orbital angular mode purity of this new vortex Airy beam is up to 10 better than that of a conventional vortex Airy beam. We anticipate that this new type of vortex Airy beam, which combines the characteristics of an optical vortex and a diffraction free Airy beam, will facilitate new directions in applications such as microscopy, material processing and nonlinear optics.


A General Language Based Framework for Specifying and Verifying Notions of Opacity. Opacity is an information flow property that captures the notion of plausible deniability in dynamic systems, that is whether an intruder can deduce that "secret" behavior has occurred. In this paper we provide a general framework of opacity to unify the many existing notions of opacity that exist for discrete event systems. We use this framework to discuss language based and state based notions of opacity over automata. We present several methods for language based opacity verification, and a general approach to transform state based notions into language based ones. We demonstrate this approach for current state and initial state opacity, unifying existing results. We then investigate the notions of K step opacity. We provide a language based view of K step opacity encompassing two existing notions and two new ones. We then analyze the corresponding language based verification methods both formally and with numerical examples. In each case, the proposed methods offer significant reductions in runtime and space complexity.


EMDS 6 Environmental Microorganism Image Dataset Sixth Version for Image Denoising, Segmentation, Feature Extraction, Classification and Detection Methods Evaluation. Environmental microorganisms (EMs) are ubiquitous around us and have an important impact on the survival and development of human society. However, the high standards and strict requirements for the preparation of environmental microorganism (EM) data have led to the insufficient of existing related databases, not to mention the databases with GT images. This problem seriously affects the progress of related experiments. Therefore, This study develops the Environmental Microorganism Dataset Sixth Version (EMDS 6), which contains 21 types of EMs. Each type of EM contains 40 original and 40 GT images, in total 1680 EM images. In this study, in order to test the effectiveness of EMDS 6. We choose the classic algorithms of image processing methods such as image denoising, image segmentation and target detection. The experimental result shows that EMDS 6 can be used to evaluate the performance of image denoising, image segmentation, image feature extraction, image classification, and object detection methods.


MotionRNN A Flexible Model for Video Prediction with Spacetime Varying Motions. This paper tackles video prediction from a new dimension of predicting spacetime varying motions that are incessantly changing across both space and time. Prior methods mainly capture the temporal state transitions but overlook the complex spatiotemporal variations of the motion itself, making them difficult to adapt to ever changing motions. We observe that physical world motions can be decomposed into transient variation and motion trend, while the latter can be regarded as the accumulation of previous motions. Thus, simultaneously capturing the transient variation and the motion trend is the key to make spacetime varying motions more predictable. Based on these observations, we propose the MotionRNN framework, which can capture the complex variations within motions and adapt to spacetime varying scenarios. MotionRNN has two main contributions. The first is that we design the MotionGRU unit, which can model the transient variation and motion trend in a unified way. The second is that we apply the MotionGRU to RNN based predictive models and indicate a new flexible video prediction architecture with a Motion Highway that can significantly improve the ability to predict changeable motions and avoid motion vanishing for stacked multiple layer predictive models. With high flexibility, this framework can adapt to a series of models for deterministic spatiotemporal prediction. Our MotionRNN can yield significant improvements on three challenging benchmarks for video prediction with spacetime varying motions.


The efficacy of antiviral drug, HIV viral load and the immune response. Developing antiviral drugs is an exigent task since viruses mutate to overcome the effect of antiviral drugs. As a result, the efficacy of most antiviral drugs is short lived. To include this effect, we modify the Neumann and Dahari model. Considering the fact that the efficacy of the antiviral drug varies in time, the differential equations introduced in the previous model systems are rewritten to study the correlation between the viral load and antiviral drug. The effect of antiviral drug that either prevents infection or stops the production of a virus is explored. First, the efficacy of the drug is considered to decreases monotonously as time progresses. In this case, our result depicts that when the efficacy of the drug is low, the viral load decreases and increases back in time revealing the effect of the antiviral drugs is short lived. On the other hand, for the antiviral drug with high efficacy, the viral load, as well as the number of infected cells, monotonously decreases while the number of uninfected cells increases. The dependence of the critical drug efficacy on time is also explored. Moreover, the correlation between viral load, the antiviral drug, and CTL response is also explored. In this case, not only the dependence for the basic reproduction ratio on the model parameters is explored but also we analyze the critical drug efficacy as a function of time. We show that the term related to the basic reproduction ratio increases when the CTL response step up. A simple analytically solvable mathematical model is also presented to analyze the correlation between viral load and antiviral drugs.


Efficient spatio temporal weather forecasting using U Net. Weather forecast plays an essential role in multiple aspects of the daily life of human beings. Currently, physics based numerical weather prediction is used to predict the weather and requires enormous amount of computational resources. In recent years, deep learning based models have seen wide success in many weather prediction related tasks. In this paper we describe our experiments for the Weather4cast 2021 Challenge, where 8 hours of spatio temporal weather data is predicted based on an initial one hour of spatio temporal data. We focus on SmaAt UNet, an efficient U Net based autoencoder. With this model we achieve competent results whilst maintaining low computational resources. Furthermore, several approaches and possible future work is discussed at the end of the paper.


"This Whole Thing Smacks of Gender" Algorithmic Exclusion in Bioimpedance based Body Composition Analysis. Smart weight scales offer bioimpedance based body composition analysis as a supplement to pure body weight measurement. Companies such as Withings and Fitbit tout composition analysis as providing self knowledge and the ability to make more informed decisions. However, these aspirational statements elide the reality that these numbers are a product of proprietary regression equations that require a binary sex gender as their input. Our paper combines transgender studies influenced personal narrative with an analysis of the scientific basis of bioimpedance technology used as part of the Withings smart scale. Attempting to include nonbinary people reveals that bioelectrical impedance analysis has always rested on physiologically shaky ground. White nonbinary people are merely the tip of the iceberg of those who may find that their smart scale is not so intelligent when it comes to their bodies. Using body composition analysis as an example, we explore how the problem of trans and nonbinary inclusion in personal health tech goes beyond the issues of adding a third "gender" box or slapping a rainbow flag on the packaging. We also provide recommendations as to how to approach creating more inclusive technologies even while still relying on exclusionary data.


JITLine A Simpler, Better, Faster, Finer grained Just In Time Defect Prediction. A Just In Time (JIT) defect prediction model is a classifier to predict if a commit is defect introducing. Recently, CC2Vec a deep learning approach for Just In Time defect prediction has been proposed. However, CC2Vec requires the whole dataset (i.e., training testing) for model training, assuming that all unlabelled testing datasets would be available beforehand, which does not follow the key principles of just in time defect predictions. Our replication study shows that, after excluding the testing dataset for model training, the F measure of CC2Vec is decreased by 38.5 for OpenStack and 45.7 for Qt, highlighting the negative impact of excluding the testing dataset for Just In Time defect prediction. In addition, CC2Vec cannot perform fine grained predictions at the line level (i.e., which lines are most risky for a given commit). In this paper, we propose JITLine a Just In Time defect prediction approach for predicting defect introducing commits and identifying lines that are associated with that defect introducing commit (i.e., defective lines). Through a case study of 37,524 commits from OpenStack and Qt, we find that our JITLine approach is at least 26 38 more accurate (F measure), 17 51 more cost effective (PCI 20 LOC), 70 100 times faster than the state of the art approaches (i.e., CC2Vec and DeepJIT) and the fine grained predictions at the line level by our approach are 133 150 more accurate (Top 10 Accuracy) than the baseline NLP approach. Therefore, our JITLine approach may help practitioners to better prioritize defect introducing commits and better identify defective lines.


Vitruvion A Generative Model of Parametric CAD Sketches. Parametric computer aided design (CAD) tools are the predominant way that engineers specify physical structures, from bicycle pedals to airplanes to printed circuit boards. The key characteristic of parametric CAD is that design intent is encoded not only via geometric primitives, but also by parameterized constraints between the elements. This relational specification can be viewed as the construction of a constraint program, allowing edits to coherently propagate to other parts of the design. Machine learning offers the intriguing possibility of accelerating the design process via generative modeling of these structures, enabling new tools such as autocompletion, constraint inference, and conditional synthesis. In this work, we present such an approach to generative modeling of parametric CAD sketches, which constitute the basic computational building blocks of modern mechanical design. Our model, trained on real world designs from the SketchGraphs dataset, autoregressively synthesizes sketches as sequences of primitives, with initial coordinates, and constraints that reference back to the sampled primitives. As samples from the model match the constraint graph representation used in standard CAD software, they may be directly imported, solved, and edited according to downstream design tasks. In addition, we condition the model on various contexts, including partial sketches (primers) and images of hand drawn sketches. Evaluation of the proposed approach demonstrates its ability to synthesize realistic CAD sketches and its potential to aid the mechanical design workflow.


Boundary layer analysis of repelling particles pushed to an impenetrable barrier. This paper considers the equilibrium positions of n particles in one dimension. Two forces act on the particles a nonlocal repulsive particle interaction force and an external force which pushes them to an impenetrable barrier. While the continuum limit as n to infty is known for a certain class of potentials, numerical simulations show that a discrete boundary layer appears at the impenetrable barrier, i.e. the positions of o(n) particles do not fit to the particle density predicted by the continuum limit. In this paper we establish a first order Gamma convergence result which guarantees that these o(n) particles converge to a specific continuum boundary layer profile.


An estimate of approximation of an analytic function of a matrix by a rational function. Let A be a square complex matrix z 1 , ..., z N in mathbb C be arbitrary (possibly repetitive) points of interpolation f be an analytic function defined on a neighborhood of the convex hull of the union of the spectrum sigma(A) of the matrix A and the points z 1 , ..., z N and the rational function r frac uv (with the degree of the numerator u less than N ) interpolates f at these points (counted according to their multiplicities). Under these assumptions estimates of the kind bigl Vert f(A) r(A) bigr Vert le max t in 0,1 mu in text convex hull z 1,z 2 , dots,z N biggl Vert Omega(A) v(A) 1 frac bigl(vf bigr) (N) bigl((1 t) mu mathbf1 tA bigr) N! biggr Vert, where Omega(z) prod k 1 N(z z k) , are proposed. As an example illustrating the accuracy of such estimates, an approximation of the impulse response of a dynamic system obtained using the reduced order Arnoldi method is considered, the actual accuracy of the approximation is compared with the estimate based on this paper.


Restart of accelerated first order methods with linear convergence under a quadratic functional growth condition. Accelerated first order methods, also called fast gradient methods, are popular optimization methods in the field of convex optimization. However, they are prone to suffer from oscillatory behaviour that slows their convergence when medium to high accuracy is desired. In order to address this, restart schemes have been proposed in the literature, which seek to improve the practical convergence by suppressing the oscillatory behaviour. This paper presents a restart scheme for accelerated first order methods for which we show linear convergence under the satisfaction of a quadratic functional growth condition, thus encompassing a broad class of non necessarily strongly convex optimization problems. Moreover, the worst case convergence rate is comparable to the one obtained using a (generally non implementable) optimal fixed rate restart strategy. We compare the proposed algorithm with other restart schemes by applying them to a model predictive control case study.


ALFRED a methodology to enable component fault trees for layered architectures. Identifying drawbacks or insufficiencies in terms of safety is important also in early development stages of safety critical systems. In industry, development artefacts such as components or units, are often reused from existing artefacts to save time and costs. When development artefacts are reused, their existing safety analysis models are an important input for an early safety assessment for the new system, since they already provide a valid model. Component fault trees support such reuse strategies by a compositional horizontal approach. But current development strategies do not only divide systems horizontally, e.g., By encapsulating different functionality into separate components and hierarchies of components, but also vertically, e.g. Into software and hardware architecture layers. Current safety analysis methodologies, such as component fault trees, do not support such vertical layers. Therefore, we present here a methodology that is able to divide safety analysis models into different layers of a systems architecture. We use so called Architecture Layer Failure Dependencies to enable component fault trees on different layers of an architecture. These dependencies are then used to generate safety evidence for the entire system and over all different architecture layers. A case study applies the approach to hardware and software layers.


Peculiarities of organization of data storage based on intelligent search agent and evolutionary model selection the target information. The article presents a systematic review of the results of the development of the theoretical basis and the pilot implementation of data storage technology with automatic replenishment of data from sources belonging to different thematic segments. It is expected that the repository will contain information about objects with significant innovative potential. The mechanism of selection of such information is based on the determination of its semantic relevance to the generated search queries. At the same time, a quantitative assessment of the innovation of objects, in particular their technological novelty and demand is given. The article describes the accepted indicators of innovation, discusses the application of the theory of evidence for the processing of incomplete and fuzzy information, identifies the main ideas of the method of processing the results of measurements for the calculation of the probabilistic value of the components of innovation, briefly describes the application of the evolutionary approach in the formation of the linguistic model of the archetype of the object, provides information about the experimental verification of the adequacy of the developed computational model. The research results that are described in the article can be used for business planning, forecasting of technological development, information support of investment projects expertise.


Variation operators for semigroups associated with Fourier Bessel expansions. In this paper we establish L p boundedness properties for variation operators defined by semigroups associated with Fourier Bessel expansions.


Clifford Valued Fractal Interpolation. In this short note, we merge the areas of hypercomplex algebras with that of fractal interpolation and approximation. The outcome is a new holistic methodology that allows the modelling of phenomena exhibiting a complex self referential geometry and which require for their description an underlying algebraic structure.


Higman Thompson Like Groups of Higher Rank Graph C Algebras. Let Lambda be a row finite and source free higher rank graph with finitely many vertices. In this paper, we define the Higman Thompson like group Lht of the graph C algebra mathcal O Lambda to be a special subgroup of the unitary group in O Lambda . It is shown that Lht is closely related to the topological full groups of the groupoid associated with Lambda . Some properties of Lht are also investigated. We show that its commutator group DLht is simple and that DLht has only one nontrivial uniformly recurrent subgroup if Lambda is aperiodic and strongly connected. Furthermore, if Lambda is single vertex, then we prove that Lht is C simple and also provide an explicit description on the stabilizer uniformly recurrent subgroup of Lht under a natural action on the infinite path space of Lambda .


Auctus A Dataset Search Engine for Data Augmentation. The large volumes of structured data currently available, from Web tables to open data portals and enterprise data, open up new opportunities for progress in answering many important scientific, societal, and business questions. However, finding relevant data is difficult. While search engines have addressed this problem for Web documents, there are many new challenges involved in supporting the discovery of structured data. We demonstrate how the Auctus dataset search engine addresses some of these challenges. We describe the system architecture and how users can explore datasets through a rich set of queries. We also present case studies which show how Auctus supports data augmentation to improve machine learning models as well as to enrich analytics.


A Two Level Fourth Order Approach For Time Fractional Convection Diffusion Reaction Equation With Variable Coefficients. This paper develops a two level fourth order scheme for solving time fractional convection diffusion reaction equation with variable coefficients subjected to suitable initial and boundary conditions. The basis properties of the new approach are investigated and both stability and error estimates of the proposed numerical scheme are deeply analyzed in the L infty (0,T L 2 ) norm. The theory indicates that the method is unconditionally stable with convergence of order O(k 2 frac lambda 2 h 4 ) , where k and h are time step and mesh size, respectively, and lambda in(0,1) . This result suggests that the two level fourth order technique is more efficient than a large class of numerical techniques widely studied in the literature for the considered problem. Some numerical evidences are provided to verify the unconditional stability and convergence rate of the proposed algorithm.


From Plenipotentiary to Puddingless Users and Uses of New Words in Early English Letters. We study neologism use in two samples of early English correspondence, from 1640 1660 and 1760 1780. Of especial interest are the early adopters of new vocabulary, the social groups they represent, and the types and functions of their neologisms. We describe our computer assisted approach and note the difficulties associated with massive variation in the corpus. Our findings include that while male letter writers tend to use neologisms more frequently than women, the eighteenth century seems to have provided more opportunities for women and the lower ranks to participate in neologism use as well. In both samples, neologisms most frequently occur in letters written between close friends, which could be due to this less stable relationship triggering more creative language use. In the seventeenth century sample, we observe the influence of the English Civil War, while the eighteenth century sample appears to reflect the changing functions of letter writing, as correspondence is increasingly being used as a tool for building and maintaining social relationships in addition to exchanging information.


Automatic Cell Counting in Flourescent Microscopy Using Deep Learning. Counting cells in fluorescent microscopy is a tedious, time consuming task that researchers have to accomplish to assess the effects of different experimental conditions on biological structures of interest. Although such objects are generally easy to identify, the process of manually annotating cells is sometimes subject to arbitrariness due to the operator's interpretation of the borderline cases. We propose a Machine Learning approach that exploits a fully convolutional network in a binary segmentation fashion to localize the objects of interest. Counts are then retrieved as the number of detected items. Specifically, we adopt a UNet like architecture leveraging residual units and an extended bottleneck for enlarging the field of view. In addition, we make use of weighted maps that penalize the errors on cells boundaries increasingly with overcrowding. These changes provide more context and force the model to focus on relevant features during pixel wise classification. As a result, the model performance is enhanced, especially in presence of clumping cells, artifacts and confounding biological structures. Posterior assessment of the results with domain experts confirms that the model detects cells of interest correctly. The model demonstrates a human level ability inasmuch even erroneous predictions seem to fall within the limits of operator interpretation. This qualitative assessment is also corroborated by quantitative metrics as an F 1 score of 0.87. Despite some difficulties in interpretation, results are also satisfactory with respect to the counting task, as testified by mean and median absolute error of, respectively, 0.8 and 1.


Recursively Refined R CNN Instance Segmentation with Self RoI Rebalancing. Within the field of instance segmentation, most of the state of the art deep learning networks rely nowadays on cascade architectures, where multiple object detectors are trained sequentially, re sampling the ground truth at each step. This offers a solution to the problem of exponentially vanishing positive samples. However, it also translates into an increase in network complexity in terms of the number of parameters. To address this issue, we propose Recursively Refined R CNN (R 3 CNN) which avoids duplicates by introducing a loop mechanism instead. At the same time, it achieves a quality boost using a recursive re sampling technique, where a specific IoU quality is utilized in each recursion to eventually equally cover the positive spectrum. Our experiments highlight the specific encoding of the loop mechanism in the weights, requiring its usage at inference time. The R 3 CNN architecture is able to surpass the recently proposed HTC model, while reducing the number of parameters significantly. Experiments on COCO minival 2017 dataset show performance boost independently from the utilized baseline model. The code is available online at https github.com IMPLabUniPr mmdetection tree r3 cnn.


Intrinsic symmetry groups of links. The set of isotopy classes of ordered n component links in the 3 sphere is acted on by the symmetric group via permutation of the components. The intrinsic symmetry group of the link, S(L), is defined to be the set of elements in the symmetric group that preserve the ordered isotopy type of L as an unoriented link. The study of these groups was initiated in 1969, but the question of whether or not every subgroup of the symmetric group arises as an intrinisic symmetry group of some link has remained open. We provide counterexamples in particular, if n 5, then there does not exist an n component link L for which S(L) is the alternating group.


Exponential convergence rate of the harmonic heat flow. We consider the harmonic heat flow for maps from a compact Riemannian manifold into a Riemannian manifold that is complete and of non positive curvature. We prove that if the harmonic heat flow converges to a limiting harmonic map that is a non degenerate critical point of the energy functional, then the rate of convergence is exponential (in the L 2 norm).


Further improvement on index bounds. In this paper we obtain further improvement of index bounds for character sums of polynomials over finite fields. We present some examples, which show that our new bound is an improved bound compared to both the Weil bound and the index bound given by Wan and Wang. As an application, we count the number of all the solutions of some algebraic curves by using our result.


Predicting Molecular Phenotypes with Single Cell RNA Sequencing Data an Assessment of Unsupervised Machine Learning Models. According to the National Cancer Institute, there were 9.5 million cancer related deaths in 2018. A challenge in improving treatment is resistance in genetically unstable cells. The purpose of this study is to evaluate unsupervised machine learning on classifying treatment resistant phenotypes in heterogeneous tumors through analysis of single cell RNA sequencing(scRNAseq) data with a pipeline and evaluation metrics. scRNAseq quantifies mRNA in cells and characterizes cell phenotypes. One scRNAseq dataset was analyzed (tumor non tumor cells of different molecular subtypes and patient identifications). The pipeline consisted of data filtering, dimensionality reduction with Principal Component Analysis, projection with Uniform Manifold Approximation and Projection, clustering with nine approaches (Ward, BIRCH, Gaussian Mixture Model, DBSCAN, Spectral, Affinity Propagation, Agglomerative Clustering, Mean Shift, and K Means), and evaluation. Seven models divided tumor versus non tumor cells and molecular subtype while six models classified different patient identification (13 of which were presented in the dataset) K Means, Ward, and BIRCH often ranked highest with 80 accuracy on the tumor versus non tumor task and 60 for molecular subtype and patient ID. An optimized classification pipeline using K Means, Ward, and BIRCH models was evaluated to be most effective for further analysis. In clinical research where there is currently no standard protocol for scRNAseq analysis, clusters generated from this pipeline can be used to understand cancer cell behavior and malignant growth, directly affecting the success of treatment.


Optimal consumption with loss aversion and reference to past spending maximum. This paper studies an optimal consumption problem for a loss averse agent with reference to past consumption maximum. To account for loss aversion on relative consumption, an S shaped utility is adopted that measures the difference between the non negative consumption rate and a fraction of the historical spending peak. We consider the concave envelope of the realization utility with respect to consumption, allowing us to focus on an auxiliary HJB variational inequality on the strength of concavification principle and dynamic programming arguments. By applying the dual transform and smooth fit conditions, the auxiliary HJB variational inequality is solved in closed form piecewisely and some thresholds of the wealth variable are obtained. The optimal consumption and investment control of the original problem can be derived analytically in the piecewise feedback form. The rigorous verification proofs on optimality and concavification principle are provided. Some numerical sensitivity analysis and financial implications are also presented.


Do What Nature Did To Us Evolving Plastic Recurrent Neural Networks For Task Generalization. While artificial neural networks (ANNs) have been widely adopted in machine learning, researchers are increasingly obsessed by the gaps between ANNs and biological neural networks (BNNs). In this paper, we propose a framework named as Evolutionary Plastic Recurrent Neural Networks (EPRNN). Inspired by BNN, EPRNN composes Evolution Strategies, Plasticity Rules, and Recursion based Learning all in one meta learning framework for generalization to different tasks. More specifically, EPRNN incorporates with nested loops for meta learning an outer loop searches for optimal initial parameters of the neural network and learning rules an inner loop adapts to specific tasks. In the inner loop of EPRNN, we effectively attain both long term memory and short term memory by forging plasticity with recursion based learning mechanisms, both of which are believed to be responsible for memristance in BNNs. The inner loop setting closely simulate that of BNNs, which neither query from any gradient oracle for optimization nor require the exact forms of learning objectives. To evaluate the performance of EPRNN, we carry out extensive experiments in two groups of tasks Sequence Predicting, and Wheeled Robot Navigating. The experiment results demonstrate the unique advantage of EPRNN compared to state of the arts based on plasticity and recursion while yielding comparably good performance against deep learning based approaches in the tasks. The experiment results suggest the potential of EPRNN to generalize to variety of tasks and encourage more efforts in plasticity and recursion based learning mechanisms.


Continuous Welch bounds with Applications. Let ( Omega, mu) be a measure space and tau alpha alpha in Omega be a normalized continuous Bessel family for a finite dimensional Hilbert space mathcal H of dimension d . If the diagonal Delta coloneqq ( alpha, alpha) alpha in Omega is measurable in the measure space Omega times Omega , then we show that begin align sup alpha, beta in Omega, alpha neq beta langle tau alpha, tau beta rangle 2m geq frac 1 ( mu times mu)(( Omega times Omega) setminus Delta) left frac mu( Omega) 2 d m 1 choose m ( mu times mu)( Delta) right , quad forall m in mathbb N . end align This improves 47 years old celebrated result of Welch textit IEEE Transactions on Information Theory, 1974 . We introduce the notions of continuous cross correlation and frame potential of Bessel family and give applications of continuous Welch bounds to these concepts. We also introduce the notion of continuous Grassmannian frames.


Several ways to achieve robustness when solving wave propagation problems. Wave propagation problems are notoriously difficult to solve. Time harmonic problems are especially challenging in mid and high frequency regimes. The main reason is the oscillatory nature of solutions, meaning that the number of degrees of freedom after discretisation increases drastically with the wave number, giving rise to large complex valued problems to solve. Additional difficulties occur when the problem is defined in a highly heterogeneous medium, as is often the case in realistic physical applications. For time discretised problems of Maxwell type, the main challenge remains the significant kernel in curl conforming spaces, an issue that impacts on the design of robust preconditioners. This has already been addressed theoretically for a homogeneous medium but not yet in the presence of heterogeneities. In this review we provide a big picture view of the main difficulties encountered when solving wave propagation problems, from the first step of their discretisation through to their parallel solution using two level methods, by showing their limitations on a few realistic examples. We also propose a new preconditioner inspired by the idea of subspace decomposition, but based on spectral coarse spaces, for curl conforming discretisations of Maxwell's equations in heterogeneous media.


Enhancing the Transferability of Adversarial Attacks through Variance Tuning. Deep neural networks are vulnerable to adversarial examples that mislead the models with imperceptible perturbations. Though adversarial attacks have achieved incredible success rates in the white box setting, most existing adversaries often exhibit weak transferability in the black box setting, especially under the scenario of attacking models with defense mechanisms. In this work, we propose a new method called variance tuning to enhance the class of iterative gradient based attack methods and improve their attack transferability. Specifically, at each iteration for the gradient calculation, instead of directly using the current gradient for the momentum accumulation, we further consider the gradient variance of the previous iteration to tune the current gradient so as to stabilize the update direction and escape from poor local optima. Empirical results on the standard ImageNet dataset demonstrate that our method could significantly improve the transferability of gradient based adversarial attacks. Besides, our method could be used to attack ensemble models or be integrated with various input transformations. Incorporating variance tuning with input transformations on iterative gradient based attacks in the multi model setting, the integrated method could achieve an average success rate of 90.1 against nine advanced defense methods, improving the current best attack performance significantly by 85.1 . Code is available at https github.com JHL HUST VT.


Experimental Observation of Efficient Nonreciprocal Mode Transitions via Spatiotemporally Modulated Acoustic Metamaterials. In lossless acoustic systems, mode transitions are always time reversible, consistent with Lorentz reciprocity, giving rise to symmetric sound manipulation in space time. To overcome this fundamental limitation and break space time symmetry, nonreciprocal sound steering is realized by designing and experimentally implementing spatiotemporally modulated acoustic metamaterials. Relying on no slow mechanical parts, unstable and noisy airflow or complicated piezoelectric array, our mechanism uses the coupling between an ultrathin membrane and external electromagnetic field to realize programmable, dynamic control of acoustic impedance in a motionless and noiseless manner. The fast and flexible impedance modulation at the deeply subwavelength scale enabled by our compact metamaterials provides an effective unidirectional momentum in space time to realize irreversible transition in k omega space between different diffraction modes. The nonreciprocal wave steering functionality of the proposed metamaterial is elucidated by theoretically deriving the time varying acoustic response and demonstrated both numerically and experimentally via two distinctive examples of unidirectional evanescent wave conversion and nonreciprocal blue shift focusing. This work can be further extended into the paradigm of Bloch waves and impact other vibrant domains, such as non Hermitian topological acoustics and parity time symmetric acoustics.


LongT5 Efficient Text To Text Transformer for Long Sequences. Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer based neural models. In this paper, we present a new model, called LongT5, with which we explore the effects of scaling both the input length and model size at the same time. Specifically, we integrated attention ideas from long input transformers (ETC), and adopted pre training strategies from summarization pre training (PEGASUS) into the scalable T5 architecture. The result is a new attention mechanism we call em Transient Global (TGlobal), which mimics ETC's local global attention mechanism, but without requiring additional side inputs. We are able to achieve state of the art results on several summarization tasks and outperform the original T5 models on question answering tasks.


FaceGuard Proactive Deepfake Detection. Existing deepfake detection methods focus on passive detection, i.e., they detect fake face images via exploiting the artifacts produced during deepfake manipulation. A key limitation of passive detection is that it cannot detect fake faces that are generated by new deepfake generation methods. In this work, we propose FaceGuard, a proactive deepfake detection framework. FaceGuard embeds a watermark into a real face image before it is published on social media. Given a face image that claims to be an individual (e.g., Nicolas Cage), FaceGuard extracts a watermark from it and predicts the face image to be fake if the extracted watermark does not match well with the individual's ground truth one. A key component of FaceGuard is a new deep learning based watermarking method, which is 1) robust to normal image post processing such as JPEG compression, Gaussian blurring, cropping, and resizing, but 2) fragile to deepfake manipulation. Our evaluation on multiple datasets shows that FaceGuard can detect deepfakes accurately and outperforms existing methods.


Some comments about CRC selection for the 5G NR specification. In this work the undetected error probability performance of the proposed in the technical specification of 5G new radio cyclic redundancy check codes taking into consideration that they have to work for fixed interval of lengths are investigated. Codes of 6, 11 and 16 check bits with better error detection performance than the proposed in the specification ones are suggested. For 24 check bits the 3 best CRC codes are presented, but no only one best for the whole interval of lengths code was found.


Large Scale Deep Learning Optimizations A Comprehensive Survey. Deep learning have achieved promising results on a wide spectrum of AI applications. Larger datasets and models consistently yield better performance. However, we generally spend longer training time on more computation and communication. In this survey, we aim to provide a clear sketch about the optimizations for large scale deep learning with regard to the model accuracy and model efficiency. We investigate algorithms that are most commonly used for optimizing, elaborate the debatable topic of generalization gap arises in large batch training, and review the SOTA strategies in addressing the communication overhead and reducing the memory footprints.


When Deep Classifiers Agree Analyzing Correlations between Learning Order and Image Statistics. Although a plethora of architectural variants for deep classification has been introduced over time, recent works have found empirical evidence towards similarities in their training process. It has been hypothesized that neural networks converge not only to similar representations, but also exhibit a notion of empirical agreement on which data instances are learned first. Following in the latter works ' footsteps, we define a metric to quantify the relationship between such classification agreement over time, and posit that the agreement phenomenon can be mapped to core statistics of the investigated dataset. We empirically corroborate this hypothesis across the CIFAR10, Pascal, ImageNet and KTH TIPS2 datasets. Our findings indicate that agreement seems to be independent of specific architectures, training hyper parameters or labels, albeit follows an ordering according to image statistics.


RuSentEval Linguistic Source, Encoder Force!. The success of pre trained transformer language models has brought a great deal of interest on how these models work, and what they learn about language. However, prior research in the field is mainly devoted to English, and little is known regarding other languages. To this end, we introduce RuSentEval, an enhanced set of 14 probing tasks for Russian, including ones that have not been explored yet. We apply a combination of complementary probing methods to explore the distribution of various linguistic properties in five multilingual transformers for two typologically contrasting languages Russian and English. Our results provide intriguing findings that contradict the common understanding of how linguistic knowledge is represented, and demonstrate that some properties are learned in a similar manner despite the language differences.


The Paradox of Second Order Homophily in Networks. Homophily the tendency of nodes to connect to others of the same type is a central issue in the study of networks. Here we take a local view of homophily, defining notions of first order homophily of a node (its individual tendency to link to similar others) and second order homophily of a node (the aggregate first order homophily of its neighbors). Through this view, we find a surprising result for homophily values that applies with only minimal assumptions on the graph topology. It can be phrased most simply as "in a graph of red and blue nodes, red friends of red nodes are on average more homophilous than red friends of blue nodes." This gap in averages defies simple intuitive explanations, applies to globally heterophilous and homophilous networks and is reminiscent of but structurally distinct from the Friendship Paradox. The existence of this gap suggests intrinsic biases in homophily measurements between groups, and hence is relevant to empirical studies of homophily in networks.


Disjoint and Simultaneously Hypercyclic Pseudo Shifts. We characterize disjoint and simultaneously hypercyclic tuples of unilateral pseudo shift operators on ell p( mathbb N ) . As a consequence, complementing the results of Bernal and Jung, we give a characterization for simultaneously hypercyclic tuples of unilateral weighted shifts. We also give characterizations for unilateral pseudo shifts that satisfy the Disjoint and Simultaneous Hypercyclicity Criterions. Contrary to the disjoint hypercyclicity case, tuples of weighted shifts turn out to be simultaneously hypercyclic if and only if they satisfy the Simultaneous Hypercyclicity Criterion.


Improving White box Robustness of Pre processing Defenses via Joint Adversarial Training. Deep neural networks (DNNs) are vulnerable to adversarial noise. A range of adversarial defense techniques have been proposed to mitigate the interference of adversarial noise, among which the input pre processing methods are scalable and show great potential to safeguard DNNs. However, pre processing methods may suffer from the robustness degradation effect, in which the defense reduces rather than improving the adversarial robustness of a target model in a white box setting. A potential cause of this negative effect is that adversarial training examples are static and independent to the pre processing model. To solve this problem, we investigate the influence of full adversarial examples which are crafted against the full model, and find they indeed have a positive impact on the robustness of defenses. Furthermore, we find that simply changing the adversarial training examples in pre processing methods does not completely alleviate the robustness degradation effect. This is due to the adversarial risk of the pre processed model being neglected, which is another cause of the robustness degradation effect. Motivated by above analyses, we propose a method called Joint Adversarial Training based Pre processing (JATP) defense. Specifically, we formulate a feature similarity based adversarial risk for the pre processing model by using full adversarial examples found in a feature space. Unlike standard adversarial training, we only update the pre processing model, which prompts us to introduce a pixel wise loss to improve its cross model transferability. We then conduct a joint adversarial training on the pre processing model to minimize this overall risk. Empirical results show that our method could effectively mitigate the robustness degradation effect across different target models in comparison to previous state of the art approaches.


Efficient nonlinear compression of a thin disk oscillator to 8.5 fs at 55 W average power. We demonstrate an efficient hybrid scheme for nonlinear pulse compression of high power thin disk oscillator pulses to the sub 10 fs regime. The output of a home built, 16 MHz, 84 W, 220 fs Yb YAG thin disk oscillator at 1030 nm is first compressed to 17 fs in two nonlinear multipass cells. In a third stage, based on multiple thin sapphire plates, further compression to 8.5 fs with 55 W output power and an overall optical efficiency of 65 is achieved. By sending the 2.5 cycle pulses into a lithium iodate crystal, we were able to generate ultra broadband mid infrared pulses covering the spectral range 2.4 8 mu m.


Neighborhood Rough Set based Multi document Summarization. This research paper proposes a novel Neighbourhood Rough Set based approach for supervised Multi document Text Summarization (MDTS) with analysis and impact on the summarization results for MDTS. Here, Rough Set based LERS algorithm is improved using Neighborhood Rough Set which is itself a novel combination called Neighborhood LERS to be experimented for evaluations of efficacy and efficiency. In this paper, we shall apply and evaluate the proposed Neighborhood LERS for Multi document Summarization which here is proved experimentally to be superior to the base LERS technique for MDTS.


Appell Lerch Sums and N 2 Moduli. We study moduli of odd framed mathcal N 2 elliptic curves subject to certain conditions, and show that the fermionic part of the moduli problem is essentially controlled by the Appell Lerch sum, familiar from the theory of mock modular forms.


Rate independent stochastic evolution equations parametrized solutions. By extending to the stochastic setting the classical vanishing viscosity approach we prove the existence of suitably weak solutions of a class of nonlinear stochastic evolution equation of rate independent type. Approximate solutions are obtained via viscous regularization. Upon properly rescaling time, these approximations converge to a parametrized martingale solution of the problem in rescaled time, where the rescaled noise is given by a general square integrable cylindrical martingale with absolutely continuous quadratic variation. In absence of jumps, these are strong in time martingale solutions of the problem in the original, not rescaled time.


A Partial Reproduction of A Guided Genetic Algorithm for Automated Crash Reproduction. This paper is a partial reproduction of work by Soltani et al. which presented EvoCrash, a tool for replicating software failures in Java by reproducing stack traces. EvoCrash uses a guided genetic algorithm to generate JUnit test cases capable of reproducing failures more reliably than existing coverage based solutions. In this paper, we present the findings of our reproduction of the initial study exploring the effectiveness of EvoCrash and comparison to three existing solutions STAR, JCHARMING, and MuCrash. We further explored the capabilities of EvoCrash on different programs to check for selection bias. We found that we can reproduce the crashes covered by EvoCrash in the original study while reproducing two additional crashes not reported as reproduced. We also find that EvoCrash was unsuccessful in reproducing several crashes from the JCHARMING paper, which were excluded from the original study. Both EvoCrash and JCHARMING could reproduce 73 of the crashes from the JCHARMING paper. We found that there was potentially some selection bias in the dataset for EvoCrash. We also found that some crashes had been reported as non reproducible even when EvoCrash could reproduce them. We suggest this may be due to EvoCrash becoming stuck in a local optimum.


Singularity aware motion planning for multi axis additive manufacturing. Multi axis additive manufacturing enables high flexibility of material deposition along dynamically varied directions. The Cartesian motion platforms of these machines include three parallel axes and two rotational axes. Singularity on rotational axes is a critical issue to be tackled in motion planning for ensuring high quality of manufacturing results. The highly nonlinear mapping in the singular region can convert a smooth toolpath with uniformly sampled waypoints defined in the model coordinate system into a highly discontinuous motion in the machine coordinate system, which leads to over extrusion under extrusion of materials in filament based additive manufacturing. The problem is challenging as both the maximal and the minimal speeds at the tip of a printer head must be controlled in motion. Moreover, collision may occur when sampling based collision avoidance is employed. In this paper, we present a motion planning method to support the manufacturing realization of designed toolpaths for multi axis additive manufacturing. Problems of singularity and collision are considered in an integrated manner to improve the motion therefore the quality of fabrication.


FoodChem A food chemical relation extraction model. In this paper, we present FoodChem, a new Relation Extraction (RE) model for identifying chemicals present in the composition of food entities, based on textual information provided in biomedical peer reviewed scientific literature. The RE task is treated as a binary classification problem, aimed at identifying whether the contains relation exists between a food chemical entity pair. This is accomplished by fine tuning BERT, BioBERT and RoBERTa transformer models. For evaluation purposes, a novel dataset with annotated contains relations in food chemical entity pairs is generated, in a golden and silver version. The models are integrated into a voting scheme in order to produce the silver version of the dataset which we use for augmenting the individual models, while the manually annotated golden version is used for their evaluation. Out of the three evaluated models, the BioBERT model achieves the best results, with a macro averaged F1 score of 0.902 in the unbalanced augmentation setting.


4 vs 7 sparse undirected unweighted Diameter is SETH hard at time n 4 3 . We show, assuming the Strong Exponential Time Hypothesis, that for every varepsilon 0 , approximating undirected unweighted Diameter on n vertex n 1 o(1) edge graphs within ratio 7 4 varepsilon requires m 4 3 o(1) time. This is the first result that conditionally rules out a near linear time 5 3 approximation for undirected Diameter.


Dynamic Kernel Matching for Non conforming Data A Case Study of T cell Receptor Datasets. Most statistical classifiers are designed to find patterns in data where numbers fit into rows and columns, like in a spreadsheet, but many kinds of data do not conform to this structure. To uncover patterns in non conforming data, we describe an approach for modifying established statistical classifiers to handle non conforming data, which we call dynamic kernel matching (DKM). As examples of non conforming data, we consider (i) a dataset of T cell receptor (TCR) sequences labelled by disease antigen and (ii) a dataset of sequenced TCR repertoires labelled by patient cytomegalovirus (CMV) serostatus, anticipating that both datasets contain signatures for diagnosing disease. We successfully fit statistical classifiers augmented with DKM to both datasets and report the performance on holdout data using standard metrics and metrics allowing for indeterminant diagnoses. Finally, we identify the patterns used by our statistical classifiers to generate predictions and show that these patterns agree with observations from experimental studies.


Spark Deficient Gabor Frame Provides a Novel Analysis Operator for Compressed Sensing. The analysis sparsity model is a very effective approach in modern Compressed Sensing applications. Specifically, redundant analysis operators can lead to fewer measurements needed for reconstruction when employing the analysis l 1 minimization in Compressed Sensing. In this paper, we pick an eigenvector of the Zauner unitary matrix and under certain assumptions on the ambient dimension we build a spark deficient Gabor frame. The analysis operator associated with such a spark deficient Gabor frame, is a new (highly) redundant Gabor transform, which we use as a sparsifying transform in Compressed Sensing. We conduct computational experiments on both synthetic and real world data solving the analysis l 1 minimization problem of Compressed Sensing, with four different choices of analysis operators, including our Gabor analysis operator. The results show that our proposed redundant Gabor transform outperforms in all cases Gabor transforms generated by state of the art window vectors of time frequency analysis.


Genus fields of Kummer extensions of rational function fields. In this paper we obtain the genus field of a general Kummer extension of a global rational function field. We study first the case of a general Kummer extension of degree a power of a prime. Then we prove that the genus field of a composite of two abelian extensions of a global rational function field with relatively prime degrees is equal to the composite of their respective genus fields. Our main result, the genus of a general Kummer extension of a global rational function field, is a direct consequence of this fact.


Systematic Review for AI based Language Learning Tools. The Second Language Acquisition field has been significantly impacted by a greater emphasis on individualized learning and rapid developments in artificial intelligence (AI). Although increasingly adaptive language learning tools are being developed with the application of AI to the Computer Assisted Language Learning field, there have been concerns regarding insufficient information and teacher preparation. To effectively utilize these tools, teachers need an in depth overview on recently developed AI based language learning tools. Therefore, this review synthesized information on AI tools that were developed between 2017 and 2020. A majority of these tools utilized machine learning and natural language processing, and were used to identify errors, provide feedback, and assess language abilities. After using these tools, learners demonstrated gains in their language abilities and knowledge. This review concludes by presenting pedagogical implications and emerging themes in the future research of AI based language learning tools.


Sixth Order Compact Finite Difference Scheme for Poisson Interface Problem with Singular Sources. Let Gamma be a smooth curve inside a two dimensional rectangular region Omega . In this paper, we consider the Poisson interface problem nabla 2 u f in Omega setminus Gamma with Dirichlet boundary condition such that f is smooth in Omega setminus Gamma and the jump functions u and nabla u cdot vec n across Gamma are smooth along Gamma . This Poisson interface problem includes the weak solution of nabla 2 u f g delta Gamma in Omega as a special case. Because the source term f is possibly discontinuous across the interface curve Gamma and contains a delta function singularity along the curve Gamma , both the solution u of the Poisson interface problem and its flux nabla u cdot vec n are often discontinuous across the interface. To solve the Poisson interface problem with singular sources, in this paper we propose a sixth order compact finite difference scheme on uniform Cartesian grids. Our proposed compact finite difference scheme with explicitly given stencils extends the immersed interface method (IIM) to the highest possible accuracy order six for compact finite difference schemes on uniform Cartesian grids, but without the need to change coordinates into the local coordinates as in most papers on IIM in the literature. Also in contrast with most published papers on IIM, we explicitly provide the formulas for all involved stencils. The coefficient matrix A in the resulting linear system Ax b , following from the proposed scheme, is independent of any source term f , jump condition g delta Gamma , interface curve Gamma and Dirichlet boundary conditions. Our numerical experiments confirm the sixth accuracy order of the proposed compact finite difference scheme on uniform meshes for the Poisson interface problems with various singular sources.


A Two stage Deep Network for High Dynamic Range Image Reconstruction. Mapping a single exposure low dynamic range (LDR) image into a high dynamic range (HDR) is considered among the most strenuous image to image translation tasks due to exposure related missing information. This study tackles the challenges of single shot LDR to HDR mapping by proposing a novel two stage deep network. Notably, our proposed method aims to reconstruct an HDR image without knowing hardware information, including camera response function (CRF) and exposure settings. Therefore, we aim to perform image enhancement task like denoising, exposure correction, etc., in the first stage. Additionally, the second stage of our deep network learns tone mapping and bit expansion from a convex set of data samples. The qualitative and quantitative comparisons demonstrate that the proposed method can outperform the existing LDR to HDR works with a marginal difference. Apart from that, we collected an LDR image dataset incorporating different camera systems. The evaluation with our collected real world LDR images illustrates that the proposed method can reconstruct plausible HDR images without presenting any visual artefacts. Code available https github. com sharif apu twostageHDR NTIRE21.


Controversy Detection a Text and Graph Neural Network Based Approach. Controversial content refers to any content that attracts both positive and negative feedback. Its automatic identification, especially on social media, is a challenging task as it should be done on a large number of continuously evolving posts, covering a large variety of topics. Most of the existing approaches rely on the graph structure of a topic discussion and or the content of messages. This paper proposes a controversy detection approach based on both graph structure of a discussion and text features. Our proposed approach relies on Graph Neural Network (gnn) to encode the graph representation (including its texts) in an embedding vector before performing a graph classification task. The latter will classify the post as controversial or not. Two controversy detection strategies are proposed. The first one is based on a hierarchical graph representation learning. Graph user nodes are embedded hierarchically and iteratively to compute the whole graph embedding vector. The second one is based on the attention mechanism, which allows each user node to give more or less importance to its neighbors when computing node embeddings. We conduct experiments to evaluate our approach using different real world datasets. Conducted experiments show the positive impact of combining textual features and structural information in terms of performance.


Well posedness of path dependent semilinear parabolic master equations. Master equations are partial differential equations for measure dependent unknowns, and are introduced to describe asymptotic equilibrium of large scale mean field interacting systems, especially in games and control theory. In this paper we introduce new semilinear master equations whose unknowns are functionals of both paths and path measures. They include state dependent master equations, path dependent partial differential equations (PPDEs), history information dependent master equations and time inconsistent (e.g. time delayed) equations, which naturally arise in stochastic control theory and games. We give a classical solution to the master equation by introducing a new notation called strong vertical derivative (SVD) for path dependent functionals, inspired by Dupire's vertical derivative, and applying stochastic forward backward system argument. Moreover, we consider a general non smooth case with a functional mollifying method.


Deep Learning for Click Through Rate Estimation. Click through rate (CTR) estimation plays as a core function module in various personalized online services, including online advertising, recommender systems, and web search etc. From 2015, the success of deep learning started to benefit CTR estimation performance and now deep CTR models have been widely applied in many industrial platforms. In this survey, we provide a comprehensive review of deep learning models for CTR estimation tasks. First, we take a review of the transfer from shallow to deep CTR models and explain why going deep is a necessary trend of development. Second, we concentrate on explicit feature interaction learning modules of deep CTR models. Then, as an important perspective on large platforms with abundant user histories, deep behavior models are discussed. Moreover, the recently emerged automated methods for deep CTR architecture design are presented. Finally, we summarize the survey and discuss the future prospects of this field.


Copycat CNN Are Random Non Labeled Data Enough to Steal Knowledge from Black box Models?. Convolutional neural networks have been successful lately enabling companies to develop neural based products, which demand an expensive process, involving data acquisition and annotation and model generation, usually requiring experts. With all these costs, companies are concerned about the security of their models against copies and deliver them as black boxes accessed by APIs. Nonetheless, we argue that even black box models still have some vulnerabilities. In a preliminary work, we presented a simple, yet powerful, method to copy black box models by querying them with natural random images. In this work, we consolidate and extend the copycat method (i) some constraints are waived (ii) an extensive evaluation with several problems is performed (iii) models are copied between different architectures and, (iv) a deeper analysis is performed by looking at the copycat behavior. Results show that natural random images are effective to generate copycats for several problems.


Confidence Calibration for Domain Generalization under Covariate Shift. Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations 1) they require unlabeled data from the target domain, which may not be available at the stage of calibration in real world applications and 2) their performance depends heavily on the disparity between the distributions of the source and target domains. To address these two limitations, we present novel calibration solutions via domain generalization. Our core idea is to leverage multiple calibration domains to reduce the effective distribution disparity between the target and calibration domains for improved calibration transfer without needing any data from the target domain. We provide theoretical justification and empirical experimental results to demonstrate the effectiveness of our proposed algorithms. Compared against state of the art calibration methods designed for domain adaptation, we observe a decrease of 8.86 percentage points in expected calibration error or, equivalently, an increase of 35 percentage points in improvement ratio for multi class classification on the Office Home dataset.


Distributed stochastic proximal algorithm with random reshuffling for non smooth finite sum optimization. The non smooth finite sum minimization is a fundamental problem in machine learning. This paper develops a distributed stochastic proximal gradient algorithm with random reshuffling to solve the finite sum minimization over time varying multi agent networks. The objective function is a sum of differentiable convex functions and non smooth regularization. Each agent in the network updates local variables with a constant step size by local information and cooperates to seek an optimal solution. We prove that local variable estimates generated by the proposed algorithm achieve consensus and are attracted to a neighborhood of the optimal solution in expectation with an mathcal O ( frac 1 T frac 1 sqrt T ) convergence rate. In addition, this paper shows that the steady state error of the objective function can be arbitrarily small by choosing small enough step sizes. Finally, some comparative simulations are provided to verify the convergence performance of the proposed algorithm.


Zero Shot Cross Lingual Transfer in Legal Domain Using Transformer Models. Zero shot cross lingual transfer is an important feature in modern NLP models and architectures to support low resource languages. In this work, We study zero shot cross lingual transfer from English to French and German under Multi Label Text Classification, where we train a classifier using English training set, and we test using French and German test sets. We extend EURLEX57K dataset, the English dataset for topic classification of legal documents, with French and German official translation. We investigate the effect of using some training techniques, namely Gradual Unfreezing and Language Model finetuning, on the quality of zero shot cross lingual transfer. We find that Language model finetuning of multi lingual pre trained model (M DistilBERT, M BERT) leads to 32.0 34.94 , 76.15 87.54 relative improvement on French and German test sets correspondingly. Also, Gradual unfreezing of pre trained model's layers during training results in relative improvement of 38 45 for French and 58 70 for German. Compared to training a model in Joint Training scheme using English, French and German training sets, zero shot BERT based classification model reaches 86 of the performance achieved by jointly trained BERT based classification model.


On the notion of the parabolic and the cuspidal support of smooth automorphic forms and smooth automorphic representations. In this paper we describe several new aspects of the foundations of the representation theory of the space of smooth automorphic forms (i.e., not necessarily K infty finite automorphic forms) for general connected reductive groups over number fields. Our role model for this space of smooth automorphic forms is a ''smooth version'' of the space of automorphic forms, whose internal structure was the topic of a famous paper of Franke. We prove that the important decomposition along the parabolic support, and the even finer and structurally more important decomposition along the cuspidal support of automorphic forms transfer in a topologized version to the larger setting of smooth automorphic forms. In this way, we establish smooth automorphic versions of the main results of a paper of Franke Schwermer and of Moeglin Waldspurger's book, III.2.6.


What Happened in Social Media during the 2020 BLM Movement? An Analysis of Deleted and Suspended Users in Twitter. After George Floyd's death in May 2020, the volume of discussion in social media increased dramatically. A series of protests followed this tragic event, called as the 2020 BlackLivesMatter (BLM) movement. People participated in the discussion for several reasons including protesting and advocacy, as well as spamming and misinformation spread. Eventually, many user accounts are deleted by their owners or suspended due to violating the rules of social media platforms. In this study, we analyze what happened in Twitter before and after the event triggers. We create a novel dataset that includes approximately 500k users sharing 20m tweets, half of whom actively participated in the 2020 BLM discussion, but some of them were deleted or suspended later. We have the following research questions What differences exist (i) between the users who did participate and not participate in the BLM discussion, and (ii) between old and new users who participated in the discussion? And, (iii) why are users deleted and suspended? To find answers, we conduct several experiments supported by statistical tests including lexical analysis, spamming, negative language, hate speech, and misinformation spread.


Understanding Kerala Floods of 2018 Role of Mixed Rossby Gravity waves. Kerala, the south west coastal state of India, was ravaged by a series of floods during the South West Monsoon of 2018. The season was marked by severely anomalous rainfall trends, with upto 150 mm of departures from the mean daily precipitation in the northern districts of the State. Although, there were many studies about the hydrogeological factors which aggravated the floods in Kerala, no attempt was made to delve into the physics which actually resulted in anomalous precipitation during the year. This study intends to document the dynamical phenomenon which caused the Kerala Floods of 2018. The westward propagating convectively coupled Mixed Rossby Gravity (MRG) waves were excited by the synoptic disturbances of the tropical Pacific at the pressure level of 700 hPa, during the Indian Monsoon of 2018. They travelled across the Indian Ocean in two significant modes a predominant slow moving wave of 20 40 days period (as Madden Julian Oscillation) and a secondary faster wave of 5 8 days period. They are characterised by vertical phase propagation to the upper troposphere, a precursor to deep convection and intense precipitation. Further, the propagation of these waves through a medium enhances its relative vorticity and the gyres or circulations thus formed are symmetrical about the equator. Consequently, the meanders in the wind field and widening of the Intertropical Convergence Zone were observed. The MRG waves, especially the slow mode induced divergence in the wind field, which fueled convection in tropics and brought very heavy rainfall to the State of Kerala in 2018.


Surface Quasi Geostrophic Equation driven by Space Time White Noise. We consider the Surface Quasi Geostrophic equation (SQG) driven by space time white noise and show the existence of a local in time solution by applying the theory of regularity structures. A main difficulty is the presence of Riesz transforms in the non linearity. We show how to lift singular integral operators with a particular structure to the level of regularity structures and using this result we deduce the existence of a solution to SQG by a renormalisation procedure. The fact that the Riesz transforms act only in the spatial variable makes it necessary to use inhomogeneous models instead of the standard ones.


Scenario Model Predictive Control for Data based Energy Management in Plug in Hybrid Electric Vehicles. One of the major limitations of optimization based strategies for allocating the power flow in hybrid powertrains is that they rely on predictions of future power demand. These predictions are inherently uncertain as they are dependent on complex human behaviours that are challenging to model accurately. This paper proposes a data based scenario model predictive control framework, where the inputs are determined at each control update by optimizing the power allocation over multiple previous examples of a route being driven. The proposed energy management optimization is convex, and results from scenario optimization are used to bound the confidence that the one step ahead optimization will be feasible with given probability. It is shown through numerical simulation that scenario model predictive control (MPC) obtains the same reduction in fuel consumption as nominal MPC with full preview of future driver behaviour, and that the scenario MPC optimization can be solved efficiently using a tailored optimization algorithm.


Entity level Factual Consistency of Abstractive Text Summarization. A key challenge for abstractive summarization is ensuring factual consistency of the generated summary with respect to the original document. For example, state of the art models trained on existing datasets exhibit entity hallucination, generating names of entities that are not present in the source document. We propose a set of new metrics to quantify the entity level factual consistency of generated summaries and we show that the entity hallucination problem can be alleviated by simply filtering the training data. In addition, we propose a summary worthy entity classification task to the training process as well as a joint entity and summary generation approach, which yield further improvements in entity level metrics.


Towards a GDPR Compliant Blockchain Based COVID Vaccination Passport. The COVID 19 pandemic has shaken the world and limited work personal life activities. Besides the loss of human lives and agony faced by humankind, the pandemic has badly hit different sectors economically, including the travel industry. Special arrangements, including COVID test before departure and on arrival, and voluntary quarantine, were enforced to limit the risk of transmission. However, the hope for returning to a normal (pre COVID) routine relies on the success of the current COVID vaccination drives administered by different countries. To open for tourism and other necessary travel, a need is realized for a universally accessible proof of COVID vaccination, allowing travelers to cross the borders without any hindrance. This paper presents an architectural framework for a GDPR compliant blockchain based COVID vaccination passport (VacciFi), whilst considering the relevant developments, especially in the European Union region.


Reaction diffusion models for morphological patterning of hESCs. In this paper we consider mathematical modeling of the dynamics of self organized patterning of spatially confined human embryonic stem cells (hESCs) treated with BMP4 (gastruloids) described in recent experimental works. In the first part of the paper we use the activator inhibitor equations of Gierer and Meinhardt to identify 3 reaction diffusion regimes for each of the three morphogenic proteins, BMP4, Wnt and Nodal, based on the characteristic features of the dynamic patterning. We identify appropriate boundary conditions which correspond to the experimental setup and perform numerical simulations of the reaction diffusion (RD) systems, using the finite element approximation, to confirm that the RD systems in these regimes produce realistic dynamics of the protein concentrations. In the second part of the paper we use analytic tools to address the questions of the existence and stability of non homogeneous steady states for the reaction diffusion systems of the type considered in the first part of the paper. We find sufficient conditions on the data of the problem under which the system has an universal attractor.


Applying inviscid linear unsteady lifting line theory to viscous large amplitude problems. Unsteady Lifting Line Theory (ULLT) is a low order method capable of modeling interacting unsteady and finite wing effects at low computational cost. Most formulations of the method assume inviscid flow and small amplitudes. Whilst these assumptions might be suitable for small amplitude aeroelastic problems at high Reynolds numbers, modern engineering applications increasingly involve lower Reynolds numbers, large amplitude kinematics and vortex structures that lead to aerodynamic non linearities. This paper establishes that ULLT still provides a good solution for low Reynolds number, large amplitude kinematics problems, by comparing ULLT results against those of experimentally validated computational fluid dynamics simulations at Re 10000. Three dimensional (3D) effects stabilize Leading Edge Vortex (LEV) structures, resulting in a good prediction of whole wing force coefficients by ULLT. Whilst the inviscid spanwise force distributions are accurate for small amplitude kinematics, the ULLT cannot model 3D vortical structures, and thus it cannot correctly predict the force distribution due the LEV. It can however predict the shedding of LEVs to a limited extent via the leading edge suction parameter criterion. This can then be used as an indicator of the usefulness of the force distribution results.


Neutronics Calculation Advances at Los Alamos Manhattan Project to Monte Carlo. The history and advances of neutronics calculations at Los Alamos during the Manhattan Project through the present is reviewed. We briefly summarize early simpler, and more approximate neutronics methods. We then motivate the need to better predict neutronics behavior through consideration of theoretical equations, models and algorithms, experimental measurements, and available computing capabilities and their limitations. These, coupled with increasing post war defense needs, and the invention of electronic computing led to the creation of Monte Carlo neutronics transport. As a part of the history, we note the crucial role that the scientific comradery between the great Los Alamos scientists played in the process. We focus heavily on these early developments and the subsequent successes of Monte Carlo and its applications to problems of national defense at Los Alamos. We cover the early methods, algorithms, and computers, electronic and women pioneers, that enabled Monte Carlo to spread to all areas of science.