TestTDO's v1.3 Terms, Properties, Relationships and Axioms A Top Domain Software Testing Ontology. The present preprint specifies and defines all Terms, Properties, Relationships and Axioms of TestTDO (software Testing Top Domain Ontology) v1.3, which is a slightly updated version of its predecessor, TestTDO v1.2. TestTDO is a top domain ontology built in the context of a four layered ontological architecture named FCD OntoArch (Foundational, Core, and Domain Ontological Architecture for Sciences). This is a four layered ontological architecture, which considers Foundational, Core, Domain and Instance levels. In turn, the domain level is split down in two sub levels, namely Top domain and Low domain ontological levels. Ontologies at the same level can be related to each other, except for the foundational level where only the ThingFO ontology is found. In addition, ontologies' terms and relationships at lower levels can be semantically enriched by ontologies' terms properties and relationships from the higher levels. Some TestTDO's terms and are extended primarily from SituationCO (Situation Core Ontology), and ProcessCO (Process Core Ontology) concepts. Stereotypes are the mechanism used for enriching TestTDO terms. Note that annotations of updates from the previous version (v1.2) to the current one (v1.3) can be found in Appendix A.


Strictly join irreducible varieties of residuated lattices. We study (strictly) join irreducible varieties in the lattice of subvarieties of residuated lattices. We explore the connections with well connected algebras and suitable generalizations, focusing in particular on representable varieties. Moreover we find weakened notions of Hallden completeness that characterize join irreducibility. We characterize strictly join irreducible varieties of basic hoops, and use the generalized rotation construction to find strictly join irreducible varieties in subvarieties of MTL algebras. We also obtain some general results about linear varieties of residuated lattices, with a particular focus on representable varieties, and a characterization for linear varieties of basic hoops.


Construction of k matchings and k regular subgraphs in graph products. A k matching M of a graph G (V,E) is a subset M subseteq E such that each connected component in the subgraph F (V,M) of G is either a single vertex graph or k regular, i.e., each vertex has degree k . In this contribution, we are interested in k matchings within the four standard graph products the Cartesian, strong, direct and lexicographic product. As we shall see, the problem of finding non empty k matchings ( k geq 3 ) in graph products is NP complete. Due to the general intractability of this problem, we focus on distinct polynomial time constructions of k matchings in a graph product G star H that are based on k G matchings M G and k H matchings M H of its factors G and H , respectively. In particular, we are interested in properties of the factors that have to be satisfied such that these constructions yield a maximum k matching in the respective products. Such constructions are also called "well behaved" and we provide several characterizations for this type of k matchings. Our specific constructions of k matchings in graph products satisfy the property of being weak homomorphism preserving, i.e., constructed matched edges in the product are never "projected" to unmatched edges in the factors. This leads to the concept of weak homomorphism preserving k matchings. Although the specific k matchings constructed here are not always maximum k matchings of the products, they have always maximum size among all weak homomorphism preserving k matchings. Not all weak homomorphism preserving k matchings, however, can be constructed in our manner. We will, therefore, determine the size of maximum sized elements among all weak homomorphims preserving k matching within the respective graph products, provided that the matchings in the factors satisfy some general assumptions.


A flux vector splitting scheme for the shallow water equations extended to high order on unstructured meshes. We present an advection pressure flux vector splitting method for the one and two dimensional shallow water equations following the approach first proposed by Toro and V 'azquez for the compressible Euler equations. The resulting first order schemes turn out to be exceedingly simple, with accuracy and robustness comparable to that of the sophisticated Godunov upwind method used in conjunction with complete non linear Riemann solvers. The technique splits the full system into two subsystems, namely an advection system and a pressure system. The sought numerical flux results from fluxes for each of the subsystems. The basic methodology, extended on 2D unstructured meshes, constitutes the building block for the construction of numerical schemes of very high order of accuracy following the ADER approach. The presented numerical schemes are systematically assessed on a carefully selected suite of test problems with reference solutions, in one and two space dimensions.The applicabil ity of the schemes is illustrated through simulations of tsunami wave propagation in the Pacific Ocean.


An explicit estimate of the Bergman kernel for positive line bundles. We shall give an explicit estimate of the lower bound of the Bergman kernel associated to a positive line bundle. In the compact Riemann surface case, our result can be seen as an explicit version of Tian's partial C 0 estimate.


Energy and Randic' energy of special graphs. In this paper, we determine the Randic' energy of the m splitting graph, the m shadow graph and the m duplicate graph of a given graph, m being an arbitrary integer. Our results allow the construction of an infinite sequence of graphs having the same Randic' energy. Further, we determine some graph invariants like the degree Kirchhoff index, the Kemeny's constant and the number of spanning trees of some special graphs. From our results, we indicate how to obtain infinitely many pairs of equienergetic graphs, Randic' equienergetic graphs and also, infinite families of integral graphs.


ML4ML Automated Invariance Testing for Machine Learning Models. In machine learning workflows, determining invariance qualities of a model is a common testing procedure. In this paper, we propose an automatic testing framework that is applicable to a variety of invariance qualities. We draw an analogy between invariance testing and medical image analysis and propose to use variance matrices as imagery'' testing data. This enables us to employ machine learning techniques for analysing such imagery'' testing data automatically, hence facilitating ML4ML (machine learning for machine learning). We demonstrate the effectiveness and feasibility of the proposed framework by developing ML4ML models (assessors) for determining rotation , brightness , and size variances of a collection of neural networks. Our testing results show that the trained ML4ML assessors can perform such analytical tasks with sufficient accuracy.


Modularity and uniformization of a higher genus algebraic space curve, its distinct arithmetical realizations by cohomology groups and E 6 , E 7 , E 8 singularities. We prove the modularity for an algebraic space curve Y of genus 50 in mathbb P 5 , which consists of 21 quartic polynomials in six variables, by means of an explicit modular parametrization by theta constants of order 13 . This provides an example of modularity, explicit uniformization and hyperbolic uniformization of arithmetic type for a higher genus algebraic space curve. In particular, it gives a new example for Hilbert's 22nd problem. This gives 21 modular equations of order 13 , which greatly improve the result of Ramanujan and Evans on the construction of modular equations of order 13 . We show that Y is isomorphic to the modular curve X(13) . The corresponding ideal I(Y) is invariant under the action of text SL (2, 13) , which leads to a 21 dimensional reducible representation of text SL (2, 13) , whose decomposition as the direct sum of 1 , 7 and 13 dimensional representations gives two distinct arithmetical realizations of X(13) by character fields mathbb Q ( chi) mathbb Q ( zeta 7 zeta 7 1 ) or mathbb Q ( chi) mathbb Q ( sqrt 13 ) of irreducible representations of text SL (2, 13) corresponding to the decompositions of cohomology groups of a projective or affine variety with values in a coherent algebraic sheaf on X(13) as well as the geometric construction of Y , the geometric realization of the degenerate principal series and the Steinberg representation of text SL (2, 13) . The projection Y rightarrow Y text SL (2, 13) (identified with mathbb CP 1 ) is a Galois covering whose generic fibre is interpreted as the Galois resolvent of the modular equation Phi 13 ( cdot, j) 0 of level 13 . The ring of invariant polynomials ( mathbb C z 1, z 2, z 3, z 4, z 5, z 6 I(Y)) text SL (2, 13) over X(13) leads to a new perspective on the theory of E 6 , E 7 and E 8 singularities.


Unsupervised Video Summarization via Multi source Features. Video summarization aims at generating a compact yet representative visual summary that conveys the essence of the original video. The advantage of unsupervised approaches is that they do not require human annotations to learn the summarization capability and generalize to a wider range of domains. Previous work relies on the same type of deep features, typically based on a model pre trained on ImageNet data. Therefore, we propose the incorporation of multiple feature sources with chunk and stride fusion to provide more information about the visual content. For a comprehensive evaluation on the two benchmarks TVSum and SumMe, we compare our method with four state of the art approaches. Two of these approaches were implemented by ourselves to reproduce the reported results. Our evaluation shows that we obtain state of the art results on both datasets, while also highlighting the shortcomings of previous work with regard to the evaluation methodology. Finally, we perform error analysis on videos for the two benchmark datasets to summarize and spot the factors that lead to misclassifications.


Generalized Equivariance and Preferential Labeling for GNN Node Classification. Existing graph neural networks (GNNs) largely rely on node embeddings, which represent a node as a vector by its identity, type, or content. However, graphs with unattributed nodes widely exist in real world applications (e.g., anonymized social networks). Previous GNNs either assign random labels to nodes (which introduces artefacts to the GNN) or assign one embedding to all nodes (which fails to explicitly distinguish one node from another). Further, when these GNNs are applied to unattributed node classification problems, they have an undesired equivariance property, which are fundamentally unable to address the data with multiple possible outputs. In this paper, we analyze the limitation of existing approaches to node classification problems. Inspired by our analysis, we propose a generalized equivariance property and a Preferential Labeling technique that satisfies the desired property asymptotically. Experimental results show that we achieve high performance in several unattributed node classification tasks.


Graph Convolutional Network for Swahili News Classification. This work empirically demonstrates the ability of Text Graph Convolutional Network (Text GCN) to outperform traditional natural language processing benchmarks for the task of semi supervised Swahili news classification. In particular, we focus our experimentation on the sparsely labelled semi supervised context which is representative of the practical constraints facing low resourced African languages. We follow up on this result by introducing a variant of the Text GCN model which utilises a bag of words embedding rather than a naive one hot encoding to reduce the memory footprint of Text GCN whilst demonstrating similar predictive performance.


A Serverless Distributed Ledger for Enterprises. Enterprises have been attracted by the capability of blockchains to provide a single source of truth for workloads that span companies, geographies, and clouds while retaining the independence of each party's IT operations. However, so far production applications have remained rare, stymied by technical limitations of existing blockchain technologies and challenges with their integration into enterprises' IT systems. In this paper, we collect enterprises' requirements on distributed ledgers for data sharing and integration from a technical perspective, argue that they are not sufficiently addressed by available blockchain frameworks, and propose a novel distributed ledger design that is "serverless", i.e., built on cloud native resources. We evaluate its qualitative and quantitative properties and give evidence that enterprises already heavily reliant on cloud service providers would consider such an approach acceptable, particularly if it offers ease of deployment, low transactional cost structure, and a combination of latency and scalability aligned with real time IT application needs.


Electrostatic solitary waves in the Earth's bow shock nature, properties, lifetimes and origin. We present a statistical analysis of more than two thousand bipolar electrostatic solitary waves (ESW) collected from ten quasi perpendicular Earth's bow shock crossings by Magnetospheric Multiscale spacecraft. We developed and implemented a correction procedure for reconstruction of actual electric fields, velocities, and other properties of ESW from measurements, whose spatial scales are typically comparable with or smaller than spatial distance between voltage sensitive probes. We determined the optimal ratio between frequency response factors of axial and spin plane antennas to be around 1.65 1.8. We found that more than 95 of the ESW in the Earth's bow shock are of negative polarity and present an in depth analysis of properties of these ESW. They have spatial scales of about 10 100 m that is within a range of lambda D to 10 lambda D , amplitudes typically below a few Volts that is below 0.1 of local electron temperature, and velocities below a few hundreds km s in spacecraft and plasma rest frames that is on the order of local ion acoustic speed. The spatial scales of ESW are distinctly correlated with local Debye length lambda D . ESW with amplitudes of 5 30 V or 0.1 0.3 Te have the occurrence rate of a few percent. The ESW have electric fields generally oblique to local magnetic field and propagate highly oblique to shock normal bf N more than 80 of ESW propagate within 30 circ of the shock plane. In the shock plane, ESW typically propagate within a few tens of degrees of local magnetic field projection bf B rm LM onto the shock plane and preferentially opposite to bf N times bf B rm LM . We argue that the ESW of negative polarity are ion phase space holes produced in a nonlinear stage of ion ion ion streaming instabilities. We estimated lifetimes of the ion holes to be 10 100 ms, or 1 10 km in terms of spatial distance.


Multiview Video Compression Using Advanced HEVC Screen Content Coding. The paper presents a new approach to multiview video coding using Screen Content Coding. It is assumed that for a time instant the frames corresponding to all views are packed into a single frame, i.e. the frame compatible approach to multiview coding is applied. For such coding scenario, the paper demonstrates that Screen Content Coding can be efficiently used for multiview video coding. Two approaches are considered the first using standard HEVC Screen Content Coding, and the second using Advanced Screen Content Coding. The latter is the original proposal of the authors that exploits quarter pel motion vectors and other nonstandard extensions of HEVC Screen Content Coding. The experimental results demonstrate that multiview video coding even using standard HEVC Screen Content Coding is much more efficient than simulcast HEVC coding. The proposed Advanced Screen Content Coding provides virtually the same coding efficiency as MV HEVC, which is the state of the art multiview video compression technique. The authors suggest that Advanced Screen Content Coding can be efficiently used within the new Versatile Video Coding (VVC) technology. Nevertheless a reference multiview extension of VVC does not exist yet, therefore, for VVC based coding, the experimental comparisons are left for future work.


IQ Learn Inverse soft Q Learning for Imitation. In many sequential decision making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount of expert data can be challenging in high dimensional environments with complex dynamics. Behavioral cloning is a simple method that is widely used due to its simplicity of implementation and stable convergence but doesn't utilize any information involving the environment's dynamics. Many existing methods that exploit dynamics information are difficult to train in practice due to an adversarial optimization process over reward and policy approximators or biased, high variance gradient estimators. We introduce a method for dynamics aware IL which avoids adversarial training by learning a single Q function, implicitly representing both reward and policy. On standard benchmarks, the implicitly learned rewards show a high positive correlation with the ground truth rewards, illustrating our method can also be used for inverse reinforcement learning (IRL). Our method, Inverse soft Q learning (IQ Learn) obtains state of the art results in offline and online imitation learning settings, significantly outperforming existing methods both in the number of required environment interactions and scalability in high dimensional spaces, often by more than 3x.


Some characterizations for Markov processes at first passage. Real Markov processes whose Laplace transforms of their first passage times downwards have a certain multiplicative structure that is to say, admit evaluation in terms of a family of so called scale functions, are characterized as those which a.s. have no negative jumps. In turn, said scale functions are identified through a martingale and a generator eigenvalue problem. Continuous state branching processes, self similar Markov processes of the spectrally positive type on the real line, and possibly killed spectrally positive L 'evy processes are all characterized in terms of the forms that the mentioned Laplace transforms take and each law separately within these classes is shown to be uniquely determined by the precise family of laws of its first passage times downwards.


From centre to centres polycentric structures in individual mobility. The availability of large scale datasets collected via mobile phones has opened up opportunities to study human mobility at an individual level. The granular nature of these datasets calls for the design of summary statistics that can be used to describe succinctly mobility patterns. In this work, we show that the radius of gyration, a popular summary statistic to quantify the extent of an individual's whereabouts, suffers from a sensitivity to outliers, and is incapable of capturing mobility organised around multiple centres. We propose a natural generalisation of the radius of gyration to a polycentric setting, as well as a novel metric to assess the quality of its description. With these notions, we propose a method to identify the centres in an individual's mobility and apply it to two large mobility datasets with socio demographic features, showing that a polycentric description can capture features that a monocentric model is incapable of.


Genes predisposing to type 1 diabetes mellitus and pathophysiology a narrative review. The possibility of targeting the causal genes along with the mechanisms of pathogenically complex diseases has led to numerous studies on the genetic etiology of some diseases. In particular, studies have added more genes to the list of type 1 diabetes mellitus (T1DM) suspect genes, necessitating an update for the interest of all stakeholders. Therefore this review articulates T1DM suspect genes and their pathophysiology. Notable electronic databases, including Medline, Scopus, PubMed, and Google Scholar were searched for relevant information. The search identified over 73 genes suspected in the pathogenesis of T1DM, with human leukocyte antigen, insulin gene, and cytotoxic T lymphocyte associated antigen 4 accounting for most of the cases. Mutations in these genes, along with environmental factors, may produce a defective immune response in the pancreas, resulting in b eta cell autoimmunity, insulin deficiency, and hyperglycemia. The mechanisms leading to these cellular reactions are gene specific and, if targeted in diabetic individuals, may lead to improved treatment. Medical practitioners are advised to formulate treatment procedures that target these genes in patients with T1DM.


Rethinking Semantic Segmentation Evaluation for Explainability and Model Selection. Semantic segmentation aims to robustly predict coherent class labels for entire regions of an image. It is a scene understanding task that powers real world applications (e.g., autonomous navigation). One important application, the use of imagery for automated semantic understanding of pedestrian environments, provides remote mapping of accessibility features in street environments. This application (and others like it) require detailed geometric information of geographical objects. Semantic segmentation is a prerequisite for this task since it maps contiguous regions of the same class as single entities. Importantly, semantic segmentation uses like ours are not pixel wise outcomes however, most of their quantitative evaluation metrics (e.g., mean Intersection Over Union) are based on pixel wise similarities to a ground truth, which fails to emphasize over and under segmentation properties of a segmentation model. Here, we introduce a new metric to assess region based over and under segmentation. We analyze and compare it to other metrics, demonstrating that the use of our metric lends greater explainability to semantic segmentation model performance in real world applications.


Reducing Target Group Bias in Hate Speech Detectors. The ubiquity of offensive and hateful content on online fora necessitates the need for automatic solutions that detect such content competently across target groups. In this paper we show that text classification models trained on large publicly available datasets despite having a high overall performance, may significantly under perform on several protected groups. On the citet vidgen2020learning dataset, we find the accuracy to be 37 lower on an under annotated Black Women target group and 12 lower on Immigrants, where hate speech involves a distinct style. To address this, we propose to perform token level hate sense disambiguation, and utilize tokens' hate sense representations for detection, modeling more general signals. On two publicly available datasets, we observe that the variance in model accuracy across target groups drops by at least 30 , improving the average target group performance by 4 and worst case performance by 13 .


Robotic needle steering in deformable tissues with extreme learning machines. Control strategies for robotic needle steering in soft tissues must account for complex interactions between the needle and the tissue to achieve accurate needle tip positioning. Recent findings show faster robotic command rate can improve the control stability in realistic scenarios. This study proposes the use of Extreme Learning Machines to provide fast commands for robotic needle steering. A synthetic dataset based on the inverse finite element simulation control framework is used to train the model. Results show the model is capable to infer commands 66 faster than the inverse simulation and reaches acceptable precision even on previously unseen trajectories.


Follow the Scent Defeating IPv6 Prefix Rotation Privacy. IPv6's large address space allows ample freedom for choosing and assigning addresses. To improve client privacy and resist IP based tracking, standardized techniques leverage this large address space, including privacy extensions and provider prefix rotation. Ephemeral and dynamic IPv6 addresses confound not only tracking and traffic correlation attempts, but also traditional network measurements, logging, and defense mechanisms. We show that the intended anti tracking capability of these widely deployed mechanisms is unwittingly subverted by edge routers using legacy IPv6 addressing schemes that embed unique identifiers. We develop measurement techniques that exploit these legacy devices to make tracking such moving IPv6 clients feasible by combining intelligent search space reduction with modern high speed active probing. Via an Internet wide measurement campaign, we discover more than 9M affected edge routers and approximately 13k 48 prefixes employing prefix rotation in hundreds of ASes worldwide. We mount a six week campaign to characterize the size and dynamics of these deployed IPv6 rotation pools, and demonstrate via a case study the ability to remotely track client address movements over time. We responsibly disclosed our findings to equipment manufacturers, at least one of which subsequently changed their default addressing logic.


Holistic Hardware Security Assessment Framework A Microarchitectural Perspective. Our goal is to enable holistic hardware security evaluation from the microarchitectural point of view. To achieve this, we propose a framework that categorizes threat models based on the microarchitectural components being targeted, and provides a generic security metric that can be used to assess the vulnerability of components, as well as the system as a whole.


Motives and the Pfaffian Grassmannian equivalence. We consider the Pfaffian Grassmannian equivalence from the motivic point of view. The main result is that under certain numerical conditions, both sides of the equivalence are related on the level of Chow motives. The consequences include a verification of Orlov's conjecture for Borisov's Calabi Yau threefolds, and verifications of Kimura's finite dimensionality conjecture, Voevodsky's smash conjecture and the Hodge conjecture for certain linear sections of Grassmannians. We also obtain new examples of Fano varieties with infinite dimensional Griffiths group.


A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images. Collateral circulation results from specialized anastomotic channels which are capable of providing oxygenated blood to regions with compromised blood flow caused by ischemic injuries. The quality of collateral circulation has been established as a key factor in determining the likelihood of a favorable clinical outcome and goes a long way to determine the choice of stroke care model that is the decision to transport or treat eligible patients immediately. Though there exist several imaging methods and grading criteria for quantifying collateral blood flow, the actual grading is mostly done through manual inspection of the acquired images. This approach is associated with a number of challenges. First, it is time consuming the clinician needs to scan through several slices of images to ascertain the region of interest before deciding on what severity grade to assign to a patient. Second, there is a high tendency for bias and inconsistency in the final grade assigned to a patient depending on the experience level of the clinician. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data. First, we formulate a region of interest detection task as a reinforcement learning problem and train a deep learning network to automatically detect the occluded region within the 3D MR perfusion volumes. Second, we extract radiomic features from the obtained region of interest through local image descriptors and denoising auto encoders. Finally, we apply a convolutional neural network and other machine learning classifiers to the extracted radiomic features to automatically predict the collateral flow grading of the given patient volume as one of three severity classes no flow (0), moderate flow (1), and good flow (2)...


Space Time Analyticity of Weak Solutions to Semilinear Parabolic Systems with Variable Coefficients. Analytic smooth solutions of a general, strongly parabolic semi linear Cauchy problem of 2m th order in mathbb R N times (0,T) with analytic coefficients (in space and time variables) and analytic initial data (in space variables) are investigated. They are expressed in terms of holomorphic continuation of global (weak) solutions to the system valued in a suitable Besov interpolation space of B s p,p type at every time moment t in 0,T . Given 0 T' T leq infty , it is proved that any B s p,p type solution u colon mathbb R N times (0,T) to mathbb C M with analytic initial data possesses a bounded holomorphic continuation u(x mathrm i y, sigma mathrm i tau) into a complex domain in mathbb C N times mathbb C defined by (x, sigma) in mathbb R N times (T',T) , y A' and tau B' , where A', B' 0 are constants depending upon T' . The proof uses the extension of a weak solution to a B s p,p type solution in a domain in mathbb C N times mathbb C , such that this extension satisfies the Cauchy Riemann equations. The holomorphic extension is obtained with a help from holomorphic semigroups and maximal regularity theory for parabolic problems in Besov interpolation spaces of B s p,p type imbedded (densely and continuously) into an L p type Lebesgue space. Applications include risk models for European options in Mathematical Finance.


Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attention. Visual Question Answering (VQA) models have achieved significant success in recent times. Despite the success of VQA models, they are mostly black box models providing no reasoning about the predicted answer, thus raising questions for their applicability in safety critical such as autonomous systems and cyber security. Current state of the art fail to better complex questions and thus are unable to exploit compositionality. To minimize the black box effect of these models and also to make them better exploit compositionality, we propose a Dynamic Neural Network (DMN), which can understand a particular question and then dynamically assemble various relatively shallow deep learning modules from a pool of modules to form a network. We incorporate compositional temporal attention to these deep learning based modules to increase compositionality exploitation. This results in achieving better understanding of complex questions and also provides reasoning as to why the module predicts a particular answer. Experimental analysis on the two benchmark datasets, VQA2.0 and CLEVR, depicts that our model outperforms the previous approaches for Visual Question Answering task as well as provides better reasoning, thus making it reliable for mission critical applications like safety and security.


Performance Evaluation of Mixed Precision Runge Kutta Methods. Additive Runge Kutta methods designed for preserving highly accurate solutions in mixed precision computation were proposed and analyzed in 8 . These specially designed methods use reduced precision or the implicit computations and full precision for the explicit computations. We develop a FORTRAN code to solve a nonlinear system of ordinary differential equations using the mixed precision additive Runge Kutta (MP ARK) methods on IBM POWER9 and Intel x86 64 chips. The convergence, accuracy, runtime, and energy consumption of these methods is explored. We show that these MP ARK methods efficiently produce accurate solutions with significant reductions in runtime (and by extension energy consumption).


Analysis on numerical stability and convergence of RANS turbulence models from the perspective of coupling modes. Reynolds averaged Navier Stokes simulations are still the main method to study complex flows in engineering. However, traditional turbulence models cannot accurately predict flow fields with separations. In such situation, machine learning methods provide an effective way to build new data driven turbulence closure models. Nevertheless, a bottleneck that the data driven turbulence models encounter is how to ensure the stability and convergence of the RANS equations in posterior iterations. This paper studies the effects of different coupling modes on the convergence and stability between the RANS equations and turbulence models. Numerical results demonstrate that the frozen coupling mode, commonly used in machine learning turbulence models, may lead to divergence and instability in posterior iterations while the mutual coupling mode can maintain good convergence and stability in the process of iterations. This research can provide a new perspective to the coupling mode for machine learning turbulence models with RANS equations in posterior iterations.


Learning from Executions for Semantic Parsing. Semantic parsing aims at translating natural language (NL) utterances onto machine interpretable programs, which can be executed against a real world environment. The expensive annotation of utterance program pairs has long been acknowledged as a major bottleneck for the deployment of contemporary neural models to real life applications. In this work, we focus on the task of semi supervised learning where a limited amount of annotated data is available together with many unlabeled NL utterances. Based on the observation that programs which correspond to NL utterances must be always executable, we propose to encourage a parser to generate executable programs for unlabeled utterances. Due to the large search space of executable programs, conventional methods that use approximations based on beam search such as self training and top k marginal likelihood training, do not perform as well. Instead, we view the problem of learning from executions from the perspective of posterior regularization and propose a set of new training objectives. Experimental results on Overnight and GeoQuery show that our new objectives outperform conventional methods, bridging the gap between semi supervised and supervised learning.


Simplifying Software Defect Prediction (via the "early bird" Heuristic). Before researchers rush to reason across all available data or try complex methods, perhaps it is prudent to first check for simpler alternatives. Specifically, if the historical data has the most information in some small region, then perhaps a model learned from that region would suffice for the rest of the project. To support this claim, we offer a case study with 240 GitHub projects, where we find that the information in those projects "clumped" towards the earliest parts of the project. A defect prediction model learned from just the first 150 commits works as well, or better than state of the art alternatives. Using just this early life cycle data, we can build models very quickly, very early in the software project life cycle. Moreover, using this method, we have shown that a simple model (with just two features) generalizes to hundreds of software projects. Based on this experience, we doubt that prior work on generalizing software engineering defect prediction models may have needlessly complicated an inherently simple process. Further, prior work that focused on later life cycle data needs to be revisited since their conclusions were drawn from relatively uninformative regions. Replication note all our data and scripts are online at https github.com snaraya7 simplifying software analytics


Biomedical Question Answering A Survey of Approaches and Challenges. Automatic Question Answering (QA) has been successfully applied in various domains such as search engines and chatbots. Biomedical QA (BQA), as an emerging QA task, enables innovative applications to effectively perceive, access and understand complex biomedical knowledge. There have been tremendous developments of BQA in the past two decades, which we classify into 5 distinctive approaches classic, information retrieval, machine reading comprehension, knowledge base and question entailment approaches. In this survey, we introduce available datasets and representative methods of each BQA approach in detail. Despite the developments, BQA systems are still immature and rarely used in real life settings. We identify and characterize several key challenges in BQA that might lead to this issue, and discuss some potential future directions to explore.


TubeR Tubelet Transformer for Video Action Detection. We propose TubeR a simple solution for spatio temporal video action detection. Different from existing methods that depend on either an off line actor detector or hand designed actor positional hypotheses like proposals or anchors, we propose to directly detect an action tubelet in a video by simultaneously performing action localization and recognition from a single representation. TubeR learns a set of tubelet queries and utilizes a tubelet attention module to model the dynamic spatio temporal nature of a video clip, which effectively reinforces the model capacity compared to using actor positional hypotheses in the spatio temporal space. For videos containing transitional states or scene changes, we propose a context aware classification head to utilize short term and long term context to strengthen action classification, and an action switch regression head for detecting the precise temporal action extent. TubeR directly produces action tubelets with variable lengths and even maintains good results for long video clips. TubeR outperforms the previous state of the art on commonly used action detection datasets AVA, UCF101 24 and JHMDB51 21.


Applications of Teaching Secondary Mathematics in Undergraduate Mathematics Courses. Robust preparation of future secondary mathematics teachers requires attention to the acquisition of mathematical knowledge for teaching. Many future teachers learn mathematics content primarily through mathematics major courses that are taught by mathematicians who do not specialize in teacher preparation. How can mathematics education researchers assist mathematicians in making explicit connections between the content of undergraduate mathematics courses and the content of secondary mathematics? We present an articulation of five types of connections that can be used in secondary mathematics teacher preparation and give examples of question prompts that mathematicians can use as applications of teaching secondary mathematics in undergraduate mathematics courses.


To Trust or Not to Trust a Regressor Estimating and Explaining Trustworthiness of Regression Predictions. In hybrid human AI systems, users need to decide whether or not to trust an algorithmic prediction while the true error in the prediction is unknown. To accommodate such settings, we introduce RETRO VIZ, a method for (i) estimating and (ii) explaining trustworthiness of regression predictions. It consists of RETRO, a quantitative estimate of the trustworthiness of a prediction, and VIZ, a visual explanation that helps users identify the reasons for the (lack of) trustworthiness of a prediction. We find that RETRO scores negatively correlate with prediction error across 117 experimental settings, indicating that RETRO provides a useful measure to distinguish trustworthy predictions from untrustworthy ones. In a user study with 41 participants, we find that VIZ explanations help users identify whether a prediction is trustworthy or not on average, 95.1 of participants correctly select the more trustworthy prediction, given a pair of predictions. In addition, an average of 75.6 of participants can accurately describe why a prediction seems to be (not) trustworthy. Finally, we find that the vast majority of users subjectively experience RETRO VIZ as a useful tool to assess the trustworthiness of algorithmic predictions.


Nichtnegativstellens "atze for definable functions in o minimal structures. This paper addresses to Nichtnegativstellens "atze for definable functions in o minimal structures on ( mathbb R , , cdot). Namely, let f, g 1, ldots, g l colon mathbb R n to mathbb R be definable C p functions ( p ge 2 ) and assume that f is non negative on S x in mathbb R n g 1(x) ge 0, ldots, g l(x) ge 0 . Under some natural hypotheses on zeros of f in S, we show that f is expressible in the form f phi 0 sum i 1 l phi i g i, where each phi i is a sum of squares of definable C p 2 functions. As a consequence, we derive global optimality conditions which generalize the Karush Kuhn Tucker optimality conditions for nonlinear optimization.


RefBERT Compressing BERT by Referencing to Pre computed Representations. Recently developed large pre trained language models, e.g., BERT, have achieved remarkable performance in many downstream natural language processing applications. These pre trained language models often contain hundreds of millions of parameters and suffer from high computation and latency in real world applications. It is desirable to reduce the computation overhead of the models for fast training and inference while keeping the model performance in downstream applications. Several lines of work utilize knowledge distillation to compress the teacher model to a smaller student model. However, they usually discard the teacher's knowledge when in inference. Differently, in this paper, we propose RefBERT to leverage the knowledge learned from the teacher, i.e., facilitating the pre computed BERT representation on the reference sample and compressing BERT into a smaller student model. To guarantee our proposal, we provide theoretical justification on the loss function and the usage of reference samples. Significantly, the theoretical result shows that including the pre computed teacher's representations on the reference samples indeed increases the mutual information in learning the student model. Finally, we conduct the empirical evaluation and show that our RefBERT can beat the vanilla TinyBERT over 8.1 and achieves more than 94 of the performance of BERTBASE on the GLUE benchmark. Meanwhile, RefBERT is 7.4x smaller and 9.5x faster on inference than BERT rm BASE .


Finding Second Order Stationary Point for Nonconvex Strongly Concave Minimax Problem. We study the smooth minimax optimization problem min bf x max bf y f( bf x , bf y ) , where f is ell smooth, strongly concave in bf y but possibly nonconvex in bf x . Most of existing works focus on finding the first order stationary point of the function f( bf x , bf y ) or its primal function P( bf x ) triangleq max bf y f( bf x , bf y ) , but few of them focus on achieving the second order stationary point. , which is essential to nonconvex problems. In this paper, we propose a novel approach for minimax optimization, called Minimax Cubic Newton (MCN), which could find an mathcal O left( varepsilon, kappa 1.5 sqrt rho varepsilon right) second order stationary point of P( bf x ) with calling mathcal O left( kappa 1.5 sqrt rho varepsilon 1.5 right) times of second order oracles and tilde mathcal O left( kappa 2 sqrt rho varepsilon 1.5 right) times of first order oracles, where kappa is the condition number and rho is the Lipschitz continuous constant for the Hessian of f( bf x , bf y ) . In addition, we propose an inexact variant of MCN for high dimensional problems to avoid calling the expensive second order oracles. Instead, our method solves the cubic sub problem inexactly via gradient descent and matrix Chebyshev expansion. This strategy still obtains the desired approximate second order stationary point with high probability but only requires tilde mathcal O left( kappa 1.5 ell varepsilon 2 right) Hessian vector oracle calls and tilde mathcal O left( kappa 2 sqrt rho varepsilon 1.5 right) first order oracle calls. To the best of our knowledge, this is the first work that considers the non asymptotic convergence behavior of finding second order stationary points for minimax problems without the convex concave assumptions.


RBUE A ReLU Based Uncertainty Estimation Method of Deep Neural Networks. Deep neural networks (DNNs) have successfully learned useful data representations in various tasks. However, assessing the reliability of these representations remains a challenge. Deep Ensemble is widely considered the state of the art method which can estimate the uncertainty with higher quality, but it is very expensive to train and test. MC Dropout is another popular method, which is less expensive but lacks the diversity of predictions. To estimate the uncertainty with higher quality in less time, we introduce a ReLU Based Uncertainty Estimation (RBUE) method. Instead of randomly dropping some neurons of the network as in MC Dropout or using the randomness of the initial weights of networks as in Deep Ensemble, RBUE adds randomness to the activation function module, making the outputs diverse. Under the method, we propose two strategies, MC DropReLU and MC RReLU, to estimate uncertainty. We analyze and compare the output diversity of MC Dropout and our method from the variance perspective and obtain the relationship between the hyperparameters and predictive diversity in the two methods. Moreover, our method is simple to implement and does not need to modify the existing model. We experimentally validate the RBUE on three widely used datasets, CIFAR10, CIFAR100, and TinyImageNet. The experiments demonstrate that our method has competitive performance but is more favorable in training time and memory requirements.


P4COM In Network Computation with Programmable Switches. Traditionally, switches only provide forwarding services and have no credits on computation in distributed computing frameworks. The emerging programmable switches make in network computing (INC) possible, i.e., offloading some computation to the switch data plane. While some proposals have attempted to offload computation onto special hardwares (e.g., NetFPGA), many practical issues have not been addressed. Therefore, we propose P4COM a user friendly, memory efficient, and fault tolerant framework realizing in network computation (e.g., MapReduce) with programmable switches. P4COM consists of three modules. First, P4COM automatically translates application logic to switch data plane programs with a lightweight interpreter. Second, P4COM adopts a memory management policy to efficiently utilize the limited switch on chip memory. Third, P4COM provides a cutting payload mechanism to handle packet losses. We have built a P4COM prototype with a Barefoot Tofino switch and multiple commodity servers. Through a combination of testbed experiments and large scale simulations, we show that P4COM is able to achieve line rate processing at 10Gbps links, and can increase the data shuffling throughput by 2 5 times for the MapReduce style applications.


GGT Graph Guided Testing for Adversarial Sample Detection of Deep Neural Network. Deep Neural Networks (DNN) are known to be vulnerable to adversarial samples, the detection of which is crucial for the wide application of these DNN models. Recently, a number of deep testing methods in software engineering were proposed to find the vulnerability of DNN systems, and one of them, i.e., Model Mutation Testing (MMT), was used to successfully detect various adversarial samples generated by different kinds of adversarial attacks. However, the mutated models in MMT are always huge in number (e.g., over 100 models) and lack diversity (e.g., can be easily circumvented by high confidence adversarial samples), which makes it less efficient in real applications and less effective in detecting high confidence adversarial samples. In this study, we propose Graph Guided Testing (GGT) for adversarial sample detection to overcome these aforementioned challenges. GGT generates pruned models with the guide of graph characteristics, each of them has only about 5 parameters of the mutated model in MMT, and graph guided models have higher diversity. The experiments on CIFAR10 and SVHN validate that GGT performs much better than MMT with respect to both effectiveness and efficiency.


Near field light bending photonic switch physics of switching based on three dimensional Poynting vector analysis. Photonic hook is a high intensity bent light focus with a proportional curvature to the wavelength of the incident light. Based on this unique light bending phenomenon, a novel near field photonic switch by means of a right trapezoid dielectric Janus particle lens embedded in the core of a planar waveguide is proposed for switching the photonic signals at two common optical communication wavelengths 1310 nm and 1550 nm by using numerical simulations. The signals at these two wavelengths can be guided to different routes according to their oppositely bent photonic hooks to realise wavelength selective switching. The switching mechanism is analysed by an in house developed three dimensional (3D) Poynting vector visualisation technology. It demonstrates that the 3D distribution and number of Poynting vector vortexes produced by the particle highly affect the shapes and bending directions of the photonic hooks causing the near field switching, and multiple independent high magnitude areas matched by the regional Poynting vector streamlines can form these photonic hooks. The corresponding mechanism can only be represented by 3D Poynting vector distributions and is being reported for the first time.


Engineering Knowledge Graph from Patent Database. We propose a large, scalable engineering knowledge graph, comprising sets of (entity, relationship, entity) triples that are real world engineering facts found in the patent database. We apply a set of rules based on the syntactic and lexical properties of claims in a patent document to extract facts. We aggregate these facts within each patent document and integrate the aggregated sets of facts across the patent database to obtain the engineering knowledge graph. Such a knowledge graph is expected to support inference, reasoning, and recalling in various engineering tasks. The knowledge graph has a greater size and coverage in comparison with the previously used knowledge graphs and semantic networks in the engineering literature.


On the Alleged Use of Keplerian Telescopes in Naples in the 1610s. The alleged use of Keplerian telescopes by Fabio Colonna (1567 1640), in Naples, since as early as October 1614, as claimed in some recent papers, is shown to be in fact untenable and due to a misconception.


De Pois An Attack Agnostic Defense against Data Poisoning Attacks. Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by injecting a fraction of malicious samples into the training dataset. Existing defense techniques against poisoning attacks are largely attack specific they are designed for one specific type of attacks but do not work for other types, mainly due to the distinct principles they follow. Yet few general defense strategies have been developed. In this paper, we propose De Pois, an attack agnostic defense against poisoning attacks. The key idea of De Pois is to train a mimic model the purpose of which is to imitate the behavior of the target model trained by clean samples. We take advantage of Generative Adversarial Networks (GANs) to facilitate informative training data augmentation as well as the mimic model construction. By comparing the prediction differences between the mimic model and the target model, De Pois is thus able to distinguish the poisoned samples from clean ones, without explicit knowledge of any ML algorithms or types of poisoning attacks. We implement four types of poisoning attacks and evaluate De Pois with five typical defense methods on different realistic datasets. The results demonstrate that De Pois is effective and efficient for detecting poisoned data against all the four types of poisoning attacks, with both the accuracy and F1 score over 0.9 on average.


Explaining Representation by Mutual Information. Science is used to discover the law of world. Machine learning can be used to discover the law of data. In recent years, there are more and more research about interpretability in machine learning community. We hope the machine learning methods are safe, interpretable, and they can help us to find meaningful pattern in data. In this paper, we focus on interpretability of deep representation. We propose a interpretable method of representation based on mutual information, which summarizes the interpretation of representation into three types of information between input data and representation. We further proposed MI LR module, which can be inserted into the model to estimate the amount of information to explain the model's representation. Finally, we verify the method through the visualization of the prototype network.


F CAD A Framework to Explore Hardware Accelerators for Codec Avatar Decoding. Creating virtual avatars with realistic rendering is one of the most essential and challenging tasks to provide highly immersive virtual reality (VR) experiences. It requires not only sophisticated deep neural network (DNN) based codec avatar decoders to ensure high visual quality and precise motion expression, but also efficient hardware accelerators to guarantee smooth real time rendering using lightweight edge devices, like untethered VR headsets. Existing hardware accelerators, however, fail to deliver sufficient performance and efficiency targeting such decoders which consist of multi branch DNNs and require demanding compute and memory resources. To address these problems, we propose an automation framework, called F CAD (Facebook Codec avatar Accelerator Design), to explore and deliver optimized hardware accelerators for codec avatar decoding. Novel technologies include 1) a new accelerator architecture to efficiently handle multi branch DNNs 2) a multi branch dynamic design space to enable fine grained architecture configurations and 3) an efficient architecture search for picking the optimized hardware design based on both application specific demands and hardware resource constraints. To the best of our knowledge, F CAD is the first automation tool that supports the whole design flow of hardware acceleration of codec avatar decoders, allowing joint optimization on decoder designs in popular machine learning frameworks and corresponding customized accelerator design with cycle accurate evaluation. Results show that the accelerators generated by F CAD can deliver up to 122.1 frames per second (FPS) and 91.6 hardware efficiency when running the latest codec avatar decoder. Compared to the state of the art designs, F CAD achieves 4.0X and 2.8X higher throughput, 62.5 and 21.2 higher efficiency than DNNBuilder and HybridDNN by targeting the same hardware device.


Defining, Evaluating, Preparing for and Responding to a Cyber Pearl Harbor. Despite not having a clear meaning, public perception and awareness makes the term cyber Pearl Harbor an important part of the public discourse. This paper considers what the term has meant and proposes its decomposition based on three different aspects of the historical Pearl Harbor attack, allowing the lessons from Pearl Harbor to be applied to threats and subjects that may not align with all aspects of the 1941 attack. Using these three definitions, prior attacks and current threats are assessed and preparation for and response to cyber Pearl Harbor events is discussed.


Steklov type 1D inequalities (a survey). We give a survey of classical and recent results on sharp constants and symmetry asymmetry of extremal functions in 1 dimensional functional inequalities.


L series of harmonic Maass forms and a summation formula for harmonic lifts. We introduce an L series associated with harmonic Maass forms and prove their functional equations. We establish converse theorems for these L series and, as an application, we formulate and prove a summation formula for the holomorphic part of a harmonic lift of a given cusp form.


"How to think like Sherlock Holmes". A method to study Mathematics. Children can take many paths to become scientists. But they undoubtedly include the following steps Play, play and play Observe Ask (themselves). In this paper I will talk about some of my experiences teaching girls and boys, teenagers and my students in the science school at UNAM, as well as High school teachers in my course "How to think like Sherlock Holmes".


Efficient Quantum Vibrational Spectroscopy of Water with High Order Path Integrals from Bulk to Interfaces. Vibrational spectroscopy is key for probing the interplay between the structure and dynamics of aqueous systems. In order to map different regions of experimental spectra to the microscopic structure of a system, it is important to combine them with first principles atomistic simulations that incorporate the quantum nature of nuclei. Here, we show that the large cost of calculating quantum vibrational spectra of aqueous systems can be dramatically reduced compared to standard path integral methods by using approximate quantum dynamics based on high order path integrals. Together with state of the art machine learned electronic properties, our approach gives an excellent description of the infrared and Raman spectra of bulk water, but also of 2D correlation and more challenging sum frequency generation spectra of the water air interface. This paves the way for understanding complex interfaces such as water encapsulated between or in contact with hydrophobic and hydrophilic materials, through robust and inexpensive surface sensitive and multidimensional spectra with first principles accuracy.


A Pairwise T Way Test Suite Generation Strategy Using Gravitational Search Algorithm. Software faults are commonly occurred due to interactions between one or more input parameters in complex software systems. Software test design techniques can be implemented to ensure the quality of the developed software. Exhaustive testing tests all possible test configurations however, it is infeasible considering time and resource constraints. Pairwise t way testing is a sampling strategy that focuses on testing every pair of parameter combination, effectively reducing the generated test size as opposed to testing exhaustively. In this paper, we propose a new pairwise t way strategy called Pairwise Gravitational Search Algorithm Strategy (PGSAS). PGSAS utilizes Gravitational Search Algorithm (GSA) for generating optimal pairwise test suites. The performance of PGSAS is benchmarked against existing t way strategies in terms of test suite size. Preliminary results showcase that PGSAS provides competitive results in most configurations and outshines other strategies in some cases.


q rm RS t A probabilistic Robinson Schensted correspondence for Macdonald polynomials (extended abstract). We present a probabilistic generalization of the Robinson Schensted correspondence in which a permutation maps to several different pairs of standard Young tableaux with nonzero probability. The probabilities depend on two parameters q and t , and the correspondence gives a new proof of the squarefree part of the Cauchy identity for Macdonald polynomials. By specializing q and t in various ways, one recovers both the row and column insertion versions of the Robinson Schensted correspondence, as well as several q and t deformations of row and column insertion which have been introduced in recent years in connection with integrable probability.


Nefness of the direct images of pluricanonical bundles. Given a fibration f between two projective manifolds X and Y , we provide a sufficient condition such that the direct images f ast (K X Y otimes L otimes mathscr I (f, L )) is nef, where L is a holomorphic line bundle with non negative relative Iitaka dimension and mathscr I (f, L ) is the relative asymptotic multiplier ideal sheaf.


The variable step L1 scheme preserving a compatible energy law for time fractional Allen Cahn equation. In this work, we revisit the adaptive L1 time stepping scheme for solving the time fractional Allen Cahn equation in the Caputo's form. The L1 implicit scheme is shown to preserve a variational energy dissipation law on arbitrary nonuniform time meshes by using the recent discrete analysis tools, i.e., the discrete orthogonal convolution kernels and discrete complementary convolution kernels. Then the discrete embedding techniques and the fractional Gr "onwall inequality were applied to establish an L 2 norm error estimate on nonuniform time meshes. An adaptive time stepping strategy according to the dynamical feature of the system is presented to capture the multi scale behaviors and to improve the computational performance.


Leray's plane stationary solutions at small Reynolds numbers. In the celebrated paper by Jean Leray, published in JMPA journal in 1933, the invading domains method was proposed to construct D solutions for the stationary Navier Stokes flow around obstacle problem. In two dimensions, whether Leray's D solution achieves the prescribed limiting velocity at spatial infinity became a major open problem since then. In this paper, we solve this problem at small Reynolds numbers. The proof builds on a novel blow down argument which rescales the invading domains to the unit disc, and the ideas developed in a recent paper Korobkov Pileckas Russo2020 , where the nontriviality of Leray solutions in the general case was proved, and Korobkov Ren 2021 , where the uniqueness result for small Reynolds number was established.


Evaluation of Multivariate Integrals based on a Duality Identity for the Stieltjes Transform. A detailed study of a double integral representation of the Catalan constant allows us to identify a duality identity for the Stieltjes transform on which it is based. This duality identity is then extended to an arbitrary dimensional integral and several special cases are deduced. On the way, we also highlight a relationship with some multivariate generalizations of the Riemann zeta function.


Sequential Linear Integer Programming for Integer Optimal Control with Total Variation Regularization. We propose a trust region method that solves a sequence of linear integer programs to tackle integer optimal control problems regularized with a total variation penalty. The total variation penalty allows us to prove the existence of minimizers of the integer optimal control problem. We introduce a local optimality concept for the problem, which arises from the infinite dimensional perspective. In the case of a one dimensional domain of the control function, we prove convergence of the iterates produced by our algorithm to points that satisfy first order stationarity conditions for local optimality. We demonstrate the theoretical findings on a computational example.


Integral basis of pure fields with square free parameter. Let m neq0, pm1 and n geq 2 be integers. The ring of algebraic integers of the pure fields of type mathbb Q ( sqrt n m ) is explicitly known for n 2,3,4 . It is well known that for n 2 , an integral basis of the pure quadratic fields can be given parametrically, by using the remainder of the square free part of m modulo 4. Such characterisation of an integral basis also exists for cubic and quartic pure fields, but for higher degree pure fields there are only results for special cases. In this paper we explicitly give an integral basis of the field mathbb Q ( sqrt n m ) , where m neq pm1 is square free. Furthermore, we show that similarly to the quadratic case, an integral basis of mathbb Q ( sqrt n m ) is repeating periodically in m with period length depending on n .


Designing and Analyzing the PID and Fuzzy Control System for an Inverted Pendulum. The inverted pendulum is a non linear unbalanced system that needs to be controlled using motors to achieve stability and equilibrium. The inverted pendulum is constructed with Lego and using the Lego Mindstorm NXT, which is a programmable robot capable of completing many different functions. In this paper, an initial design of the inverted pendulum is proposed and the performance of different sensors, which are compatible with the Lego Mindstorm NXT was studied. Furthermore, the ability of computer vision to achieve the stability required to maintain the system is also investigated. The inverted pendulum is a conventional cart that can be controlled using a Fuzzy Logic controller that produces a self tuning PID control for the cart to move on. The fuzzy logic and PID are simulated in MATLAB and Simulink, and the program for the robot is developed in the LabVIEW software.


On Linear Stochastic Flows. We study the existence of the stochastic flow associated to a linear stochastic evolution equation d X AX ,d t sum k B k X ,d W k, on a Hilbert space. Our first result covers the case where A is the generator of a C 0 semigroup, and (B k) is a sequence of bounded linear operators such that sum k B k infty . We also provide sufficient conditions for the existence of stochastic flows in the Schatten classes beyond the space of Hilbert Schmidt operators. Some new results and examples concerning the so called commutative case are presented as well.


Local Access to Random Walks. For a graph G on n vertices, naively sampling the position of a random walk of at time t requires work Omega(t) . We desire local access algorithms supporting text position (G,s,t) queries, which return the position of a random walk from some start vertex s at time t , where the joint distribution of returned positions is 1 text poly (n) close to the uniform distribution over such walks in ell 1 distance. We first give an algorithm for local access to walks on undirected regular graphs with widetilde O ( frac 1 1 lambda sqrt n ) runtime per query, where lambda is the second largest eigenvalue in absolute value. Since random d regular graphs are expanders with high probability, this gives an widetilde O ( sqrt n ) algorithm for G(n,d) , which improves on the naive method for small numbers of queries. We then prove that no that algorithm with sub constant error given probe access to random d regular graphs can have runtime better than Omega( sqrt n log(n)) per query in expectation, obtaining a nearly matching lower bound. We further show an Omega(n 1 4 ) runtime per query lower bound even with an oblivious adversary (i.e. when the query sequence is fixed in advance). We then show that for families of graphs with additional group theoretic structure, dramatically better results can be achieved. We give local access to walks on small degree abelian Cayley graphs, including cycles and hypercubes, with runtime text polylog (n) per query. This also allows for efficient local access to walks on text polylog degree expanders. We extend our results to graphs constructed using the tensor product (giving local access to walks on degree n epsilon graphs for any epsilon in (0,1 ) and Cartesian product.


Cyclic and Linear Graph Partitions and Normal Ordering. The Stirling number of a simple graph is the number of partitions of its vertex set into a specific number of non empty independent sets. In 2015, Engbers et al. showed that the coefficients in the normal ordering of a word w in the alphabet x,D subject to the relation Dx xD 1 are equal to the Stirling number of certain graphs constructed from w . In this paper, we introduce graphical versions of the Stirling numbers of the first kind and the Lah numbers and show how they occur as coefficients in other normal ordering settings. Identities involving their q analogues are also obtained.


Improving Ethical Outcomes with Machine in the Loop Broadening Human Understanding of Data Annotations. We introduce a machine in the loop pipeline that aims to address root causes of unwanted bias in natural language based supervised machine learning tasks in the education domain. Learning from the experiences of students is foundational for education researchers, and academic administrators. 21st century skills learned from experience are becoming a core part of college and career readiness as well as the hiring process in the new knowledge economy. Minoritized students demonstrate these skills in their daily lives, but documenting, assessing, and validating these skills is a huge problem for educational institutions. As an equity focused online platform, LivedX translates minoritized students' lived experiences into the 21st century skills, issues micro credentials, and creates personal 21st century skills portfolio. To automate the micro credential mining from the natural language texts received from the students' submitted essays, we employed a bag of word model to construct a multi output classifier. Despite our goal, our model initially exacerbated disparate impact on minoritized students. We used a machine in the loop model development pipeline to address the problem and refine the aforementioned model to ensure fairness in its prediction.


An Empirical Study of UMLS Concept Extraction from Clinical Notes using Boolean Combination Ensembles. Our objective in this study is to investigate the behavior of Boolean operators on combining annotation output from multiple Natural Language Processing (NLP) systems across multiple corpora and to assess how filtering by aggregation of Unified Medical Language System (UMLS) Metathesaurus concepts affects system performance for Named Entity Recognition (NER) of UMLS concepts. We used three corpora annotated for UMLS concepts 2010 i2b2 VA challenge set (31,161 annotations), Multi source Integrated Platform for Answering Clinical Questions (MiPACQ) corpus (17,457 annotations including UMLS concept unique identifiers), and Fairview Health Services corpus (44,530 annotations). Our results showed that for UMLS concept matching, Boolean ensembling of the MiPACQ corpus trended towards higher performance over individual systems. Use of an approximate grid search can help optimize the precision recall tradeoff and can provide a set of heuristics for choosing an optimal set of ensembles.


Deep Hedging under Rough Volatility. We investigate the performance of the Deep Hedging framework under training paths beyond the (finite dimensional) Markovian setup. In particular we analyse the hedging performance of the original architecture under rough volatility models with view to existing theoretical results for those. Furthermore, we suggest parsimonious but suitable network architectures capable of capturing the non Markoviantity of time series. Secondly, we analyse the hedging behaviour in these models in terms of P L distributions and draw comparisons to jump diffusion models if the the rebalancing frequency is realistically small.


On Gegenbauer Point Processes on the unit interval. In this note we compute the logarithmic energy of points in the unit interval 1,1 chosen from different Gegenbauer Determinantal Point Processes. We check that all the different families of Gegenbauer polynomials yield the same asymptotic result to third order, we compute exactly the value for Chebyshev polynomials and we give a closed expresion for the minimal possible logarithmic energy. The comparison suggests that DPPs cannot match the value of the minimum beyond the third asymptotic term.


Strong stabilization of (almost) impedance passive systems by static output feedback. The plant to be stabilized is a system node Sigma with generating triple (A,B,C) and transfer function bf G , where A generates a contraction semigroup on the Hilbert space X . The control and observation operators B and C may be unbounded and they are not assumed to be admissible. The crucial assumption is that there exists a bounded operator E such that, if we replace bf G (s) by bf G (s) E , the new system Sigma E becomes impedance passive. An easier case is when bf G is already impedance passive and a special case is when mm Sigma has colocated sensors and actuators. Such systems include many wave, beam and heat equations with sensors and actuators on the boundary. It has been shown for many particular cases that the feedback u kappa y v , where u is the input of the plant and kappa 0 , stabilizes Sigma , strongly or even exponentially. Here, y is the output of m Sigma and v is the new input. Our main result is that if for some E in mathcal L (U) , Sigma E is impedance passive, and m Sigma is approximately observable or approximately controllable in infinite time, then for sufficiently small kappa the closed loop system is weakly stable. If, moreover, sigma(A) cap i mathbb R is countable, then the closed loop semigroup and its dual are both strongly stable.


Inspiration through Observation Demonstrating the Influence of Automatically Generated Text on Creative Writing. Getting machines to generate text perceived as creative is a long pursued goal. A growing body of research directs this goal towards augmenting the creative writing abilities of human authors. In this paper, we pursue this objective by analyzing how observing examples of automatically generated text influences writing. In particular, we examine a task referred to as sentence infilling, which involves transforming a list of words into a complete sentence. We emphasize "storiability" as a desirable feature of the resulting sentences, where "storiable" sentences are those that suggest a story a reader would be curious to hear about. Both humans and an automated system (based on a neural language model) performed this sentence infilling task. In one setting, people wrote sentences on their own in a different setting, people observed the sentences produced by the model while writing their own sentences. Readers then assigned storiability preferences to the resulting sentences in a subsequent evaluation. We find that human authored sentences were judged as more storiable when authors observed the generated examples, and that storiability increased as authors derived more semantic content from the examples. This result gives evidence of an "inspiration through observation" paradigm for human computer collaborative writing, through which human writing can be enhanced by text generation models without directly copying their output.


EXTRA Explanation Ranking Datasets for Explainable Recommendation. Recently, research on explainable recommender systems has drawn much attention from both academia and industry, resulting in a variety of explainable models. As a consequence, their evaluation approaches vary from model to model, which makes it quite difficult to compare the explainability of different models. To achieve a standard way of evaluating recommendation explanations, we provide three benchmark datasets for EXplanaTion RAnking (denoted as EXTRA), on which explainability can be measured by ranking oriented metrics. Constructing such datasets, however, poses great challenges. First, user item explanation triplet interactions are rare in existing recommender systems, so how to find alternatives becomes a challenge. Our solution is to identify nearly identical sentences from user reviews. This idea then leads to the second challenge, i.e., how to efficiently categorize the sentences in a dataset into different groups, since it has quadratic runtime complexity to estimate the similarity between any two sentences. To mitigate this issue, we provide a more efficient method based on Locality Sensitive Hashing (LSH) that can detect near duplicates in sub linear time for a given query. Moreover, we make our code publicly available to allow researchers in the community to create their own datasets.


Automatically Locating ARM Instructions Deviation between Real Devices and CPU Emulators. Emulator is widely used to build dynamic analysis frameworks due to its fine grained tracing capability, full system monitoring functionality, and scalability of running on different operating systemsand architectures. However, whether the emulator is consistent with real devices is unknown. To understand this problem, we aim to automatically locate inconsistent instructions, which behave differently between emulators and real devices. We target ARM architecture, which provides machine readable specification. Based on the specification, we propose a test case generator by designing and implementing the first symbolic execution engine for ARM architecture specification language (ASL). We generate 2,774,649 representative instruction streams and conduct differential testing with these instruction streams between four ARM real devices in different architecture versions (i.e., ARMv5, ARMv6, ARMv7 a, and ARMv8 a) and the state of the art emulators (i.e., QEMU). We locate 155,642 inconsistent instruction streams, which cover 30 of all instruction encodings and 47.8 of the instructions. We find undefined implementation in ARM manual and implementation bugs of QEMU are the major causes of inconsistencies. Furthermore, we discover four QEMU bugs, which are confirmed and patched by thedevelopers, covering 13 instruction encodings including the most commonly used ones (e.g.,STR,BLX). With the inconsistent instructions, we build three security applications and demonstrate thecapability of these instructions on detecting emulators, anti emulation, and anti fuzzing.


The Credibility Cryptocurrency Valuation Statistical Learning Analysis for Influencer Tweets. Cryptocurrency has attracted significant attention. Considering the number of individuals investing in bitcoin, their motivations are comparatively less clear than traditional investment decisions. As of December 2020, the market has continuously increased in cryptocurrency. Especially, the spike of joke Dogecoin shows the weirdness of the modern meme economy with the support of Elon Musk, whom himself appointed as "Dogefather". In this paper, we analysis the impact of tweets by Elon musk and present some statistical analyze with event study.


Level generation and style enhancement deep learning for game development overview. We present practical approaches of using deep learning to create and enhance level maps and textures for video games desktop, mobile, and web. We aim to present new possibilities for game developers and level artists. The task of designing levels and filling them with details is challenging. It is both time consuming and takes effort to make levels rich, complex, and with a feeling of being natural. Fortunately, recent progress in deep learning provides new tools to accompany level designers and visual artists. Moreover, they offer a way to generate infinite worlds for game replayability and adjust educational games to players' needs. We present seven approaches to create level maps, each using statistical methods, machine learning, or deep learning. In particular, we include Generative Adversarial Networks for creating new images from existing examples (e.g. ProGAN). Super resolution techniques for upscaling images while preserving crisp detail (e.g. ESRGAN). Neural style transfer for changing visual themes. Image translation turning semantic maps into images (e.g. GauGAN). Semantic segmentation for turning images into semantic masks (e.g. U Net). Unsupervised semantic segmentation for extracting semantic features (e.g. Tile2Vec). Texture synthesis creating large patterns based on a smaller sample (e.g. InGAN).


Dominating occupancy processes by the independent site approximation. Occupancy processes are a broad class of discrete time Markov chains on 0,1 n encompassing models from diverse areas. This model is compared to a collection of n independent Markov chains on 0,1 , which we call the independent site model. We establish conditions under which an occupancy process is smaller in the lower orthant order than the independent site model. An analogous result for spin systems follows by a limiting argument.


TLSAN Time aware Long and Short term Attention Network for Next item Recommendation. Recently, deep neural networks are widely applied in recommender systems for their effectiveness in capturing modeling users' preferences. Especially, the attention mechanism in deep learning enables recommender systems to incorporate various features in an adaptive way. Specifically, as for the next item recommendation task, we have the following three observations 1) users' sequential behavior records aggregate at time positions ("time aggregation"), 2) users have personalized taste that is related to the "time aggregation" phenomenon ("personalized time aggregation"), and 3) users' short term interests play an important role in the next item prediction recommendation. In this paper, we propose a new Time aware Long and Short term Attention Network (TLSAN) to address those observations mentioned above. Specifically, TLSAN consists of two main components. Firstly, TLSAN models "personalized time aggregation" and learn user specific temporal taste via trainable personalized time position embeddings with category aware correlations in long term behaviors. Secondly, long and short term feature wise attention layers are proposed to effectively capture users' long and short term preferences for accurate recommendation. Especially, the attention mechanism enables TLSAN to utilize users' preferences in an adaptive way, and its usage in long and short term layers enhances TLSAN's ability of dealing with sparse interaction data. Extensive experiments are conducted on Amazon datasets from different fields (also with different size), and the results show that TLSAN outperforms state of the art baselines in both capturing users' preferences and performing time sensitive next item recommendation.


Modelling wave propagation in elastic solids via high order accurate implicit mesh discontinuous Galerkin methods. A high order accurate implicit mesh discontinuous Galerkin framework for wave propagation in single phase and bi phase solids is presented. The framework belongs to the embedded boundary techniques and its novelty regards the spatial discretization, which enables boundary and interface conditions to be enforced with high order accuracy on curved embedded geometries. High order accuracy is achieved via high order quadrature rules for implicitly defined domains and boundaries, whilst a cell merging strategy addresses the presence of small cut cells. The framework is used to discretize the governing equations of elastodynamics, written using a first order hyperbolic momentum strain formulation, and an exact Riemann solver is employed to compute the numerical flux at the interface between dissimilar materials with general anisotropic properties. The space discretized equations are then advanced in time using explicit high order Runge Kutta algorithms. Several two and three dimensional numerical tests including dynamic adaptive mesh refinement are presented to demonstrate the high order accuracy and the capability of the method in the elastodynamic analysis of single and bi phases solids containing complex geometries.


Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoring. Predictive monitoring of business processes is a subfield of process mining that aims to predict, among other things, the characteristics of the next event or the sequence of next events. Although multiple approaches based on deep learning have been proposed, mainly recurrent neural networks and convolutional neural networks, none of them really exploit the structural information available in process models. This paper proposes an approach based on graph convolutional networks and recurrent neural networks that uses information directly from the process model. An experimental evaluation on real life event logs shows that our approach is more consistent and outperforms the current state of the art approaches.


Collective behavior in the North Rhine Westphalia motorway network. To understand the dynamics on complex networks, measurement of correlations is indispensable. In a motorway network, it is not sufficient to collect information on fluxes and velocities on all individual links, i.e. parts of the freeways between ramps and highway crosses. The interdependencies and mutual connections are also of considerable interest. We analyze correlations in the complete motorway network in North Rhine Westphalia, the most populous state in Germany. We view the motorway network as a complex system consisting of road sections which interact via the motion of vehicles, implying structures in the corresponding correlation matrices. In particular, we focus on collective behavior, i.e. coherent motion in the whole network or in large parts of it. To this end, we study the eigenvalue and eigenvector statistics and identify significant sections in the motorway network. We find collective behavior in these significant sections and further explore its causes. We show that collectivity throughout the network cannot directly be related to the traffic states (free, synchronous and congested) in Kerner's three phase theory. Hence, the degree of collectivity provides a new, complementary observable to characterize the motorway network.


Mean Value Inequalities and Characterizations of Sobolev spaces on graded groups. We develop some characterizations for Sobolev spaces on the setting of graded Lie groups. A key role is played by several mean value inequalities that may be of independent interest.


Model Guided Road Intersection Classification. Understanding complex scenarios from in vehicle cameras is essential for safely operating autonomous driving systems in densely populated areas. Among these, intersection areas are one of the most critical as they concentrate a considerable number of traffic accidents and fatalities. Detecting and understanding the scene configuration of these usually crowded areas is then of extreme importance for both autonomous vehicles and modern ADAS aimed at preventing road crashes and increasing the safety of vulnerable road users. This work investigates inter section classification from RGB images using well consolidate neural network approaches along with a method to enhance the results based on the teacher student training paradigm. An extensive experimental activity aimed at identifying the best input configuration and evaluating different network parameters on both the well known KITTI dataset and the new KITTI 360 sequences shows that our method outperforms current state of the art approaches on a per frame basis and prove the effectiveness of the proposed learning scheme.


Block sparse signal recovery via minimizing the block q ratio sparsity. In this paper, we propose a method for block sparse signal recovery that minimizes the block q ratio sparsity left( lVert z rVert 2,1 lVert z rVert 2,q right) frac q q 1 with q in 0, infty . For the case of 1 q leq infty , we present the theoretical analyses and the computing algorithms for both cases of the ell 2 bounded and ell 2, infty bounded noises. The corresponding unconstrained model is also investigated. Its superior performance in block sparse signal reconstruction is demonstrated by numerical experiments.


Generalization Bounds and Algorithms for Learning to Communicate over Additive Noise Channels. An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem of choosing a codebook and possibly also a generalized minimal distance decoder (which is parameterized by a covariance matrix) is addressed. High probability generalization bounds for the error probability loss function, as well as for a hinge type surrogate loss function are provided. A stochastic gradient based alternating minimization algorithm for the latter loss function is proposed. In addition, a Gibbs based algorithm that gradually expurgates an initial codebook from codewords in order to obtain a smaller codebook with improved error probability is proposed, and bounds on its average empirical error and generalization error, as well as a high probability generalization bound, are stated. Various experiments demonstrate the performance of the proposed algorithms. For coded systems, the problem of maximizing the mutual information between the input and the output with respect to the input distribution is addressed, and uniform convergence bounds for two different classes of input distributions are obtained.


The Impact of Time Delay and Angiogenesis in a Tumor Model. We consider a free boundary tumor model under the presence of angiogenesis and time delays in the process of proliferation, in which the cell location is incorporated. It is assumed that the tumor attracts blood vessels at a rate proportional to alpha , and a parameter mu is proportional to the aggressiveness' of the tumor. In this paper, we first prove that there exists a unique radially symmetric stationary solution left( sigma , p , R right) for all positive alpha , mu . Then a threshold value mu ast is found such that the radially symmetric stationary solution is linearly stable if mu mu ast and linearly unstable if mu mu ast . Our results indicate that the increase of the angiogenesis parameter alpha would result in the reduction of the threshold value mu ast adding the time delay would not alter the threshold value mu ast , but result in a larger stationary tumor, and the larger the tumor aggressiveness parameter mu is, the greater impact of time delay would have on the size of the stationary tumor.


Diversity in Sociotechnical Machine Learning Systems. There has been a surge of recent interest in sociocultural diversity in machine learning (ML) research, with researchers (i) examining the benefits of diversity as an organizational solution for alleviating problems with algorithmic bias, and (ii) proposing measures and methods for implementing diversity as a design desideratum in the construction of predictive algorithms. Currently, however, there is a gap between discussions of measures and benefits of diversity in ML, on the one hand, and the broader research on the underlying concepts of diversity and the precise mechanisms of its functional benefits, on the other. This gap is problematic because diversity is not a monolithic concept. Rather, different concepts of diversity are based on distinct rationales that should inform how we measure diversity in a given context. Similarly, the lack of specificity about the precise mechanisms underpinning diversity's potential benefits can result in uninformative generalities, invalid experimental designs, and illicit interpretations of findings. In this work, we draw on research in philosophy, psychology, and social and organizational sciences to make three contributions First, we introduce a taxonomy of different diversity concepts from philosophy of science, and explicate the distinct epistemic and political rationales underlying these concepts. Second, we provide an overview of mechanisms by which diversity can benefit group performance. Third, we situate these taxonomies of concepts and mechanisms in the lifecycle of sociotechnical ML systems and make a case for their usefulness in fair and accountable ML. We do so by illustrating how they clarify the discourse around diversity in the context of ML systems, promote the formulation of more precise research questions about diversity's impact, and provide conceptual tools to further advance research and practice.


De Biased Modelling of Search Click Behavior with Reinforcement Learning. Users' clicks on Web search results are one of the key signals for evaluating and improving web search quality and have been widely used as part of current state of the art Learning To Rank(LTR) models. With a large volume of search logs available for major search engines, effective models of searcher click behavior have emerged to evaluate and train LTR models. However, when modeling the users' click behavior, considering the bias of the behavior is imperative. In particular, when a search result is not clicked, it is not necessarily chosen as not relevant by the user, but instead could have been simply missed, especially for lower ranked results. These kinds of biases in the click log data can be incorporated into the click models, propagating the errors to the resulting LTR ranking models or evaluation metrics. In this paper, we propose the De biased Reinforcement Learning Click model (DRLC). The DRLC model relaxes previously made assumptions about the users' examination behavior and resulting latent states. To implement the DRLC model, convolutional neural networks are used as the value networks for reinforcement learning, trained to learn a policy to reduce bias in the click logs. To demonstrate the effectiveness of the DRLC model, we first compare performance with the previous state of art approaches using established click prediction metrics, including log likelihood and perplexity. We further show that DRLC also leads to improvements in ranking performance. Our experiments demonstrate the effectiveness of the DRLC model in learning to reduce bias in click logs, leading to improved modeling performance and showing the potential for using DRLC for improving Web search quality.


Eye Tracking to Understand Impact of Aging on Mobile Phone Applications. Usage of smartphones and tablets have been increasing rapidly with multi touch interaction and powerful configurations. Performing tasks on mobile phones become more complex as people age, thereby increasing their cognitive workload. In this context, we conducted an eye tracking study with 50 participants between the age of 20 to 60 years and above, living in Bangalore, India. This paper focuses on visual nature of interaction with mobile user interfaces. The study aims to investigate how aging affects user experience on mobile phones while performing complex tasks, and estimate cognitive workload using eye tracking metrics. The study consisted of five tasks that were performed on an android mobile phone under naturalistic scenarios using eye tracking glasses. We recorded ocular parameters like fixation rate, saccadic rate, average fixation duration, maximum fixation duration and standard deviation of pupil dilation for left and right eyes respectively for each participant. Results from our study show that aging has a bigger effect on performance of using mobile phones irrespective of any complex task given to them. We noted that, participants aged between 50 to 60 years had difficulties in completing tasks and showed increased cognitive workload. They took longer fixation duration to complete tasks which involved copy paste operations. Further, we identifed design implications and provided design recommendations for designers and manufacturers.


Non simple polarised abelian surfaces. We study the space of non simple polarised abelian surfaces. Specifically, we describe the locus of polarised abelian surfaces of type (1,d) that contain an elliptic curve of exponent n and characterise its irreducible components. We find a condition on the complementary exponent m and show that the locus of surfaces containing complementary elliptic curves of exponents m,n is irreducible. We also find equations for this locus in the Siegel space.


Collision Replay What Does Bumping Into Things Tell You About Scene Geometry?. What does bumping into things in a scene tell you about scene geometry? In this paper, we investigate the idea of learning from collisions. At the heart of our approach is the idea of collision replay, where we use examples of a collision to provide supervision for observations at a past frame. We use collision replay to train convolutional neural networks to predict a distribution over collision time from new images. This distribution conveys information about the navigational affordances (e.g., corridors vs open spaces) and, as we show, can be converted into the distance function for the scene geometry. We analyze this approach with an agent that has noisy actuation in a photorealistic simulator.


Transforming space with non Hermitian dielectrics. Coordinate transformations are a versatile tool to mould the flow of light, enabling a host of astonishing phenomena such as optical cloaking with metamaterials. Moving away from the usual restriction that links isotropic materials with conformal transformations, we show how non conformal distortions of optical space are intimately connected to the complex refractive index distribution of an isotropic non Hermitian medium. Remarkably, this insight can be used to circumvent the material requirement of working with refractive indices below unity, which limits the applications of transformation optics. We apply our approach to design a broadband unidirectional dielectric cloak, which relies on non conformal coordinate transformations to tailor the nonHermitian refractive index profile around a cloaked object. Our insights bridge the fields of two dimensional transformation optics and non Hermitian photonics.


Lightweight machine unlearning in neural network. In recent years, machine learning neural network has penetrated deeply into people's life. As the price of convenience, people's private information also has the risk of disclosure. The "right to be forgotten" was introduced in a timely manner, stipulating that individuals have the right to withdraw their consent from personal information processing activities based on their consent. To solve this problem, machine unlearning is proposed, which allows the model to erase all memory of private information. Previous studies, including retraining and incremental learning to update models, often take up extra storage space or are difficult to apply to neural networks. Our method only needs to make a small perturbation of the weight of the target model and make it iterate in the direction of the model trained with the remaining data subset until the contribution of the unlearning data to the model is completely eliminated. In this paper, experiments on five datasets prove the effectiveness of our method for machine unlearning, and our method is 15 times faster than retraining.