Ultrafast Proton Transport between a Hydroxy Acid and a Nitrogen Base along Solvent Bridges Governed by Hydroxide Methoxide Transfer Mechanism. Aqueous proton transport plays a key role in acid base neutralization, and energy transport through biological membranes and hydrogen fuel cells. Extensive experimental and theoretical studies have resulted in a highly detailed elucidation of one of the underlying microscopic mechanisms for aqueous excess proton transport, known as the von Grotthuss mechanism, involving different hydrated proton configurations with associated high fluxional structural dynamics. Hydroxide transport, with approximately two fold lower bulk diffusion rates than those of excess protons, has received much less attention. We present femtosecond UV IR pump probe experiments and ab initio molecular dynamics simulations of different proton transport pathways of the bifunctional photoacid 7 hydroxyquinoline (7HQ) in water methanol mixtures. For 7HQ solvent dependent photoacidity, free energy reactivity correlation behaviour and QM MM trajectories point to a dominant OH CH3O transport pathway, for all water methanol mixing ratios investigated. This provides conclusive evidence for the hydrolysis methanolysis acid base neutralization pathway formulated by Manfred Eigen half a century ago.


COVID 19 Modeling A Review. The SARS CoV 2 virus and COVID 19 disease have posed unprecedented and overwhelming demand, challenges and opportunities to domain, model and data driven modeling. This paper provides a comprehensive review of the challenges, tasks, methods, progress, gaps and opportunities in relation to modeling COVID 19 problems, data and objectives. It constructs a research landscape of COVID 19 modeling tasks and methods, and further categorizes, summarizes, compares and discusses the related methods and progress of modeling COVID 19 epidemic transmission processes and dynamics, case identification and tracing, infection diagnosis and medical treatments, non pharmaceutical interventions and their effects, drug and vaccine development, psychological, economic and social influence and impact, and misinformation, etc. The modeling methods involve mathematical and statistical models, domain driven modeling by epidemiological compartmental models, medical and biomedical analysis, AI and data science in particular shallow and deep machine learning, simulation modeling, social science methods, and hybrid modeling.


Real Time LSM Trees for HTAP Workloads. Real time data analytics systems such as SAP HANA, MemSQL, and IBM Wildfire employ hybrid data layouts, in which data are stored in different formats throughout their lifecycle. Recent data are stored in a row oriented format to serve OLTP workloads and support high data rates, while older data are transformed to a column oriented format for OLAP access patterns. We observe that a Log Structured Merge (LSM) Tree is a natural fit for a lifecycle aware storage engine due to its high write throughput and level oriented structure, in which records propagate from one level to the next over time. To build a lifecycle aware storage engine using an LSM Tree, we make a crucial modification to allow different data layouts in different levels, ranging from purely row oriented to purely column oriented, leading to a Real Time LSM Tree. We give a cost model and an algorithm to design a Real Time LSM Tree that is suitable for a given workload, followed by an experimental evaluation of LASER a prototype implementation of our idea built on top of the RocksDB key value store. In our evaluation, LASER is almost 5x faster than Postgres (a pure row store) and two orders of magnitude faster than MonetDB (a pure column store) for real time data analytics workloads.


Heteroclinic orbits for a system of amplitude equations for orthogonal domain walls. Using a variational method, we prove the existence of heteroclinic solutions for a 6dimensional system of ordinary differential equations. We derive this system from the classical B 'e nard Rayleigh problem near the convective instability threshold. The constructed heteroclinic solutions provide first order approximations for domain walls between two orthogonal convective rolls.


Types are Internal infty Groupoids. By extending type theory with a universe of definitionally associative and unital polynomial monads, we show how to arrive at a definition of opetopic type which is able to encode a number of fully coherent algebraic structures. In particular, our approach leads to a definition of infty groupoid internal to type theory and we prove that the type of such infty groupoids is equivalent to the universe of types. That is, every type admits the structure of an infty groupoid internally, and this structure is unique.


Gorenstein syzygy objects in extriangulated categories. We give the definition of Gorenstein syzygy objects in extriangulated categories and obtain a characterization. For a recollement of extriangulated categories, we mainly show that Gorenstein syzygy objects induce a new Gorenstein syzygy objects under certain conditions, and prove that Gorenstein syzygy objects induce a new Gorenstein syzygy objects under certain conditions.


Estimating the Expected Influence Capacities of Nodes in Complex Networks under the Susceptible Infectious Recovered (SIR) Model. In recent years, epidemic modeling in complex networks has found many applications, including modeling of information or gossip spread in online social networks, modeling of malware spread in communication networks, and the most recent model of the COVID 19 pandemic. If the information disseminated is accurate, for example, maximizing its distribution is desirable, whereas if it is a rumor or a virus, its spread should be minimized. In this context, it is very important to identify super spreaders that maximize or minimize propagation. Lately, studies for detecting super spreaders have gained momentum. Most of the studies carried out aim to distinguish the influences of nodes under a specific propagation model (such as SIR) using network centrality measures and subsequently, to rank the nodes accordingly. However, in this study, we developed an algorithm that approximates the expected influence of nodes under the popular SIR model. By considering the behavior of the SIR model and only the shortest paths between nodes, the algorithm ranks the nodes according to this approximated value. Our developed algorithm is named the Expected Value Estimation (EVE). We compared the performance of EVE, using different SIR settings on real datasets, with that of many current well known centrality measures. The experimental studies demonstrated that the solution quality (ranking capability) of EVE is superior to that of its competitors.


Physical Side Channel Attacks on Embedded Neural Networks A Survey. During the last decade, Deep Neural Networks (DNN) have progressively been integrated on all types of platforms, from data centers to embedded systems including low power processors and, recently, FPGAs. Neural Networks (NN) are expected to become ubiquitous in IoT systems by transforming all sorts of real world applications, including applications in the safety critical and security sensitive domains. However, the underlying hardware security vulnerabilities of embedded NN implementations remain unaddressed. In particular, embedded DNN implementations are vulnerable to Side Channel Analysis (SCA) attacks, which are especially important in the IoT and edge computing contexts where an attacker can usually gain physical access to the targeted device. A research field has therefore emerged and is rapidly growing in terms of the use of SCA including timing, electromagnetic attacks and power attacks to target NN embedded implementations. Since 2018, research papers have shown that SCA enables an attacker to recover inference models architectures and parameters, to expose industrial IP and endangers data confidentiality and privacy. Without a complete review of this emerging field in the literature so far, this paper surveys state of the art physical SCA attacks relative to the implementation of embedded DNNs on micro controllers and FPGAs in order to provide a thorough analysis on the current landscape. It provides a taxonomy and a detailed classification of current attacks. It first discusses mitigation techniques and then provides insights for future research leads.


Modeling of Graphene Oxide Memory based on Hybridization State Modulation. Graphene oxide (GO) based resistive random access memory (RRAM) is one of the most promising emerging non volatile memories for flexible electronics because of its simple structure and low fabrication cost. The reported switching mechanism can be classified into either localized or bulk effect. The localized effect is commonly observed in GO RRAM with active electrode e.g. Cu and Al. The switching mechanism includes metallic conduction filament evolution or modification of interfacial resistance between GO layer and electrodes. On the other hand, the bulk effect involves hybridization state change of the entire GO layer and is typically observed in devices with inert electrode e.g. Pt and Au. Numerous compact models have been proposed for RRAM that are based on localized switching mechanism. However, compact modeling of GO RRAM based on bulk mechanism is still lacking. Thus, this paper presents a compact model for GO RRAM that relies on hybridization state modulation. The proposed model associates the resistance switching mechanism with the electricaldriven modification of sp2 clusters density in the switching layer. A SPICE model incorporating the proposed compact model is developed for parameter calibration. The simulated I V characteristic exhibits strong correlation with the experimental data. Hereby, we regard the proposed compact model as an acceptable and close description of GO RRAM operation that depends on the bulk switching mechanism.


On Declare MAX SAT and a finite Herbrand Base for data aware logs. This technical report provides some lightweight introduction motivating the definition of an alignment of log traces against Data Aware Declare Models potentially containing correlation conditions. This technical report is only providing the intuition of the logical framework as a feasibility study for a future formalization and experiment section.


Submodular Optimization for Coupled Task Allocation and Intermittent Deployment Problems. In this paper, we demonstrate a formulation for optimizing coupled submodular maximization problems with provable sub optimality bounds. In robotics applications, it is quite common that optimization problems are coupled with one another and therefore cannot be solved independently. Specifically, we consider two problems coupled if the outcome of the first problem affects the solution of a second problem that operates over a longer time scale. For example, in our motivating problem of environmental monitoring, we posit that multi robot task allocation will potentially impact environmental dynamics and thus influence the quality of future monitoring, here modeled as a multi robot intermittent deployment problem. The general theoretical approach for solving this type of coupled problem is demonstrated through this motivating example. Specifically, we propose a method for solving coupled problems modeled by submodular set functions with matroid constraints. A greedy algorithm for solving this class of problem is presented, along with sub optimality guarantees. Finally, practical optimality ratios are shown through Monte Carlo simulations to demonstrate that the proposed algorithm can generate near optimal solutions with high efficiency.


An optimization model for renewal scheduling and traffic flow routing. This document is the third sub report from the research project SATT (Samplanering av trafikp aa verkande aa tg "arder och trafikfl "oden, modellstudie Coordinated planning of temporary capacity restrictions and traffic flows, model study). The report summarizes the modelling alternatives that have been considered. The main result of the model study is that we propose a bi level approach for handling the two parts of the problem, i.e. the scheduling of renewal projects and the subsequent adjustments of railway traffic flow. The contributions are (1) a mixed integer formulation for scheduling project tasks, and (2) a network flow formulation for establishing the possible volumes of railway traffic during the imposed capacity restrictions of these project tasks. The intended usage of the model is for economical planning of a specific production year, which takes place before the timetabling process starts. This document introduces the problem and gives a full description of (1) along with results from computational experiments that have been conducted with this model. An accompanying report gives the details of the final formulation of (2).


FedSAE A Novel Self Adaptive Federated Learning Framework in Heterogeneous Systems. Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource constrained, FL is encountered with systems heterogeneity which causes a lot of stragglers directly and then leads to significantly accuracy reduction indirectly. To solve the problems caused by systems heterogeneity, we introduce a novel self adaptive federated framework FedSAE which adjusts the training task of devices automatically and selects participants actively to alleviate the performance degradation. In this work, we 1) propose FedSAE which leverages the complete information of devices' historical training tasks to predict the affordable training workloads for each device. In this way, FedSAE can estimate the reliability of each device and self adaptively adjust the amount of training load per client in each round. 2) combine our framework with Active Learning to self adaptively select participants. Then the framework accelerates the convergence of the global model. In our framework, the server evaluates devices' value of training based on their training loss. Then the server selects those clients with bigger value for the global model to reduce communication overhead. The experimental result indicates that in a highly heterogeneous system, FedSAE converges faster than FedAvg, the vanilla FL framework. Furthermore, FedSAE outperforms than FedAvg on several federated datasets FedSAE improves test accuracy by 26.7 and reduces stragglers by 90.3 on average.


Decomposition of integrally closed ideals in Arf rings. This study investigates the structure of Arf rings. From the perspective of ring extensions, a decomposition of integrally closed ideals is given. Using this, we present a kind of their prime ideal decomposition in Arf rings, and determine their structure in the case where both R and the integral closure of R are local rings.


Digestive System Dynamics in Molecular Communication Perspectives. Consumption of food in excess of the required optimal nutritional requirements has already resulted in a global crisis and this is from the perspective of human health, such as obesity, as well as food waste and sustainability. In order to minimize the impact of these issues, there is a need to develop novel innovative and effective solutions that can optimally match the food consumption to the demand. This requires accurate understanding of the food digestion dynamics and its impact on each individual's physiological characteristics. This study proposes a model to characterize digestive system dynamics by using concepts from the field of Molecular Communications (MC), and this includes integrating advection diffusion and reaction mechanisms and its role in characterizing the digestion process as a communication system. The model is then used to explore starch digestion dynamics by using communication system metrics such as delay and path loss. Our simulations found that the long gastric emptying time increases the delay in starch digestion and in turn the glucose production and absorption into the blood stream. At the same time, the enzyme activity on the hydrolyzed starch directly impacts the path loss, as higher reaction rates and lower half saturation concentration of starch results in lower path loss. Our work can lead to provide insights formulated for each individuals by creating a digital twin digestion model


e ACJ Accurate Junction Extraction For Event Cameras. Junctions reflect the important geometrical structure information of the image, and are of primary significance to applications such as image matching and motion analysis. Previous event based feature extraction methods are mainly focused on corners, which mainly find their locations, however, ignoring the geometrical structure information like orientations and scales of edges. This paper adapts the frame based a contrario junction detector(ACJ) to event data, proposing the event based a contrario junction detector(e ACJ), which yields junctions' locations while giving the scales and orientations of their branches. The proposed method relies on an a contrario model and can operate on asynchronous events directly without generating synthesized event frames. We evaluate the performance on public event datasets. The result shows our method successfully finds the orientations and scales of branches, while maintaining high accuracy in junction's location.


Architecture of Automated Crypto Finance Agent. We present the cognitive architecture of an autonomous agent for active portfolio management in decentralized finance, involving activities such as asset selection, portfolio balancing, liquidity provision, and trading. Partial implementation of the architecture is provided and supplied with preliminary results and conclusions.


Event based Motion Segmentation by Cascaded Two Level Multi Model Fitting. Among prerequisites for a synthetic agent to interact with dynamic scenes, the ability to identify independently moving objects is specifically important. From an application perspective, nevertheless, standard cameras may deteriorate remarkably under aggressive motion and challenging illumination conditions. In contrast, event based cameras, as a category of novel biologically inspired sensors, deliver advantages to deal with these challenges. Its rapid response and asynchronous nature enables it to capture visual stimuli at exactly the same rate of the scene dynamics. In this paper, we present a cascaded two level multi model fitting method for identifying independently moving objects (i.e., the motion segmentation problem) with a monocular event camera. The first level leverages tracking of event features and solves the feature clustering problem under a progressive multi model fitting scheme. Initialized with the resulting motion model instances, the second level further addresses the event clustering problem using a spatio temporal graph cut method. This combination leads to efficient and accurate event wise motion segmentation that cannot be achieved by any of them alone. Experiments demonstrate the effectiveness and versatility of our method in real world scenes with different motion patterns and an unknown number of independently moving objects.


The Teichm "uller problem for L p means of distortion. Teichm "uller's problem from 1944 is this Given x in 0,1) find and describe the extremal quasiconformal map f ID to ID , f partial ID identity and f(0) x leq 0 . We consider this problem in the setting of minimisers of L p mean distortion. The classical result is that there is an extremal map of Teichm "uller type with associated holomorphic quadratic differential having a pole of order one at x , if x neq 0 . For the L p norm, when p 1 it is known that there can be no locally quasiconformal minimiser unless x 0 . Here we show that for 1 leq p infty there is a minimiser in a weak class and an associated Ahlfors Hopf holomorphic quadratic differential with a pole of order 1 at f(0) r . However, this minimiser cannot be in W 1,2 loc ( ID) unless r 0 and f identity . Hence there is no locally quasiconformal minimiser. A similar statement holds for minimsers of the exponential norm of distortion. We also use our earlier work to show that as p to infty , the weak L p minimisers converge locally uniformly in ID to the extremal quasiconformal mapping, and that as p to 1 the weak L p minimisers converge locally uniformly in ID to the identity.


SSPC Net Semi supervised Semantic 3D Point Cloud Segmentation Network. Point cloud semantic segmentation is a crucial task in 3D scene understanding. Existing methods mainly focus on employing a large number of annotated labels for supervised semantic segmentation. Nonetheless, manually labeling such large point clouds for the supervised segmentation task is time consuming. In order to reduce the number of annotated labels, we propose a semi supervised semantic point cloud segmentation network, named SSPC Net, where we train the semantic segmentation network by inferring the labels of unlabeled points from the few annotated 3D points. In our method, we first partition the whole point cloud into superpoints and build superpoint graphs to mine the long range dependencies in point clouds. Based on the constructed superpoint graph, we then develop a dynamic label propagation method to generate the pseudo labels for the unsupervised superpoints. Particularly, we adopt a superpoint dropout strategy to dynamically select the generated pseudo labels. In order to fully exploit the generated pseudo labels of the unsupervised superpoints, we furthermore propose a coupled attention mechanism for superpoint feature embedding. Finally, we employ the cross entropy loss to train the semantic segmentation network with the labels of the supervised superpoints and the pseudo labels of the unsupervised superpoints. Experiments on various datasets demonstrate that our semi supervised segmentation method can achieve better performance than the current semi supervised segmentation method with fewer annotated 3D points. Our code is available at https github.com MMCheng SSPC Net.


Ensemble manifold based regularized multi modal graph convolutional network for cognitive ability prediction. Objective Multi modal functional magnetic resonance imaging (fMRI) can be used to make predictions about individual behavioral and cognitive traits based on brain connectivity networks. Methods To take advantage of complementary information from multi modal fMRI, we propose an interpretable multi modal graph convolutional network (MGCN) model, incorporating the fMRI time series and the functional connectivity (FC) between each pair of brain regions. Specifically, our model learns a graph embedding from individual brain networks derived from multi modal data. A manifold based regularization term is then enforced to consider the relationships of subjects both within and between modalities. Furthermore, we propose the gradient weighted regression activation mapping (Grad RAM) and the edge mask learning to interpret the model, which is used to identify significant cognition related biomarkers. Results We validate our MGCN model on the Philadelphia Neurodevelopmental Cohort to predict individual wide range achievement test (WRAT) score. Our model obtains superior predictive performance over GCN with a single modality and other competing approaches. The identified biomarkers are cross validated from different approaches. Conclusion and Significance This paper develops a new interpretable graph deep learning framework for cognitive ability prediction, with the potential to overcome the limitations of several current data fusion models. The results demonstrate the power of MGCN in analyzing multi modal fMRI and discovering significant biomarkers for human brain studies.


On sketching approximations for symmetric Boolean CSPs. A Boolean maximum constraint satisfaction problem, Max CSP( f ), is specified by a predicate f 1,1 k to 0,1 . An n variable instance of Max CSP( f ) consists of a list of constraints, each of which applies f to k distinct literals drawn from the n variables. For k 2 , Chou, Golovnev, and Velusamy CGV20, FOCS 2020 obtained explicit ratios characterizing the sqrt n space streaming approximability of every predicate. For k geq 3 , Chou, Golovnev, Sudan, and Velusamy CGSV21, arXiv 2102.12351 proved a general dichotomy theorem for sqrt n space sketching algorithms For every f , there exists alpha(f) in (0,1 such that for every epsilon 0 , Max CSP( f ) is ( alpha(f) epsilon) approximable by an O( log n) space linear sketching algorithm, but ( alpha(f) epsilon) approximation sketching algorithms require Omega( sqrt n ) space. In this work, we give closed form expressions for the sketching approximation ratios of multiple families of symmetric Boolean functions. Letting alpha' k 2 (k 1) (1 k 2 ) (k 1) 2 , we show that for odd k geq 3 , alpha(k AND ) alpha' k , and for even k geq 2 , alpha(k AND ) 2 alpha' k 1 . We also resolve the ratio for the "at least (k 1) 1 's" function for all even k the "exactly frac k 1 2 1 's" function for odd k in 3, ldots,51 and fifteen other functions. We stress here that for general f , according to CGSV21 , closed form expressions for alpha(f) need not have existed a priori. Separately, for all threshold functions, we give optimal "bias based" approximation algorithms generalizing CGV20 while simplifying CGSV21 . Finally, we investigate the sqrt n space streaming lower bounds in CGSV21 , and show that they are incomplete for 3 AND.


Explaining with Examples Lessons Learned from Crowdsourced Introductory Description of Information Visualizations. Data visualizations have been increasingly used in oral presentations to communicate data patterns to the general public. Clear verbal introductions of visualizations to explain how to interpret the visually encoded information are essential to convey the takeaways and avoid misunderstandings. We contribute a series of studies to investigate how to effectively introduce visualizations to the audience with varying degrees of visualization literacy. We begin with understanding how people are introducing visualizations. We crowdsource 110 introductions of visualizations and categorize them based on their content and structures. From these crowdsourced introductions, we identify different introduction strategies and generate a set of introductions for evaluation. We conduct experiments to systematically compare the effectiveness of different introduction strategies across four visualizations with 1,080 participants. We find that introductions explaining visual encodings with concrete examples are the most effective. Our study provides both qualitative and quantitative insights into how to construct effective verbal introductions of visualizations in presentations, inspiring further research in data storytelling.


Multi scale Self calibrated Network for Image Light Source Transfer. Image light source transfer (LLST), as the most challenging task in the domain of image relighting, has attracted extensive attention in recent years. In the latest research, LLST is decomposed three sub tasks scene reconversion, shadow estimation, and image re rendering, which provides a new paradigm for image relighting. However, many problems for scene reconversion and shadow estimation tasks, including uncalibrated feature information and poor semantic information, are still unresolved, thereby resulting in insufficient feature representation. In this paper, we propose novel down sampling feature self calibrated block (DFSB) and up sampling feature self calibrated block (UFSB) as the basic blocks of feature encoder and decoder to calibrate feature representation iteratively because the LLST is similar to the recalibration of image light source. In addition, we fuse the multi scale features of the decoder in scene reconversion task to further explore and exploit more semantic information, thereby providing more accurate primary scene structure for image re rendering. Experimental results in the VIDIT dataset show that the proposed approach significantly improves the performance for LLST.


Forward backward stochastic differential equations driven by G Brownian motion. In this paper, we study the existence and uniqueness of solutions to the fully coupled nonlinear forward backward stochastic differential equations driven by G Brownian motion. Assuming that the diffusion coefficient sigma is uniformly elliptic and all coefficients are differentiable, combining the results of fully nonlinear PDEs, we prove the existence and uniqueness of solutions to these equations.


Proof complexity of positive branching programs. We investigate the proof complexity of systems based on positive branching programs, i.e. non deterministic branching programs (NBPs) where, for any 0 transition between two nodes, there is also a 1 transition. Positive NBPs compute monotone Boolean functions, just like negation free circuits or formulas, but constitute a positive version of (non uniform) NL, rather than P or NC1, respectively. The proof complexity of NBPs was investigated in previous work by Buss, Das and Knop, using extension variables to represent the dag structure, over a language of (non deterministic) decision trees, yielding the system eLNDT. Our system eLNDT is obtained by restricting their systems to a positive syntax, similarly to how the 'monotone sequent calculus' MLK is obtained from the usual sequent calculus LK by restricting to negation free formulas. Our main result is that eLNDT polynomially simulates eLNDT over positive sequents. Our proof method is inspired by a similar result for MLK by Atserias, Galesi and Pudl 'ak, that was recently improved to a bona fide polynomial simulation via works of Je v r 'abek and Buss, Kabanets, Kolokolova and Kouck 'y. Along the way we formalise several properties of counting functions within eLNDT by polynomial size proofs and, as a case study, give explicit polynomial size poofs of the propositional pigeonhole principle.


Natural Language Processing Accurately Categorizes Indications, Findings and Pathology Reports from Multicenter Colonoscopy. Colonoscopy is used for colorectal cancer (CRC) screening. Extracting details of the colonoscopy findings from free text in electronic health records (EHRs) can be used to determine patient risk for CRC and colorectal screening strategies. We developed and evaluated the accuracy of a deep learning model framework to extract information for the clinical decision support system to interpret relevant free text reports, including indications, pathology, and findings notes. The Bio Bi LSTM CRF framework was developed using Bidirectional Long Short term Memory (Bi LSTM) and Conditional Random Fields (CRF) to extract several clinical features from these free text reports including indications for the colonoscopy, findings during the colonoscopy, and pathology of resected material. We trained the Bio Bi LSTM CRF and existing Bi LSTM CRF models on 80 of 4,000 manually annotated notes from 3,867 patients. These clinical notes were from a group of patients over 40 years of age enrolled in four Veterans Affairs Medical Centers. A total of 10 of the remaining annotated notes were used to train hyperparameter and the remaining 10 were used to evaluate the accuracy of our model Bio Bi LSTM CRF and compare to Bi LSTM CRF.


Negation Instance Based Evaluation of End to End Negation Resolution. In this paper, we revisit the task of negation resolution, which includes the subtasks of cue detection (e.g. "not", "never") and scope resolution. In the context of previous shared tasks, a variety of evaluation metrics have been proposed. Subsequent works usually use different subsets of these, including variations and custom implementations, rendering meaningful comparisons between systems difficult. Examining the problem both from a linguistic perspective and from a downstream viewpoint, we here argue for a negation instance based approach to evaluating negation resolution. Our proposed metrics correspond to expectations over per instance scores and hence are intuitively interpretable. To render research comparable and to foster future work, we provide results for a set of current state of the art systems for negation resolution on three English corpora, and make our implementation of the evaluation scripts publicly available.


Quantitative de Giorgi Methods in Kinetic Theory. We consider hypoelliptic equations of kinetic Fokker Planck type, also known as Kolmogorov or ultraparabolic equations, with rough coefficients in the drift diffusion operator. We give novel short quantitative proofs of the De Giorgi intermediate value Lemma as well as weak Harnack and Harnack inequalities. This implies H "o lder continuity with quantitative estimates. The paper is self contained.


Blockchain Based Accounts Payable Platform for Goods Trade. Goods trade is a supply chain transaction that involves shippers buying goods from suppliers and carriers providing goods transportation. Shippers are issued invoices from suppliers and carriers. Shippers carry out goods receiving and invoice processing before payment processing of bills for suppliers and carriers, where invoice processing includes tasks like processing claims and adjusting the bill payments. Goods receiving involves verification of received goods by the Shipper's receiving team. Invoice processing is carried out by the Shipper's accounts payable team, which in turn is verified by the accounts receivable teams of suppliers and carriers. This paper presents a blockchain based accounts payable system that generates claims for the deficiency in the goods received and accordingly adjusts the payment in the bills for suppliers and carriers. Primary motivations for these supply chain organizations to adopt blockchain based accounts payable systems are to eliminate the process redundancies (accounts payable vs. accounts receivable), to reduce the number of disputes among the transacting participants, and to accelerate the accounts payable processes via optimizations in the claims generation and blockchain based dispute reconciliation.


Dwell time stability conditions for infinite dimensional impulsive systems. We consider nonlinear impulsive systems on Banach spaces subjected to disturbances and look for dwell time conditions guaranteeing the the ISS property. In contrary to many existing results our conditions cover the case where both continuous and discrete dynamics can be unstable simultaneously. Lyapunov type methods are use for this purpose. The effectiveness of our approach is illustrated on a rather nontrivial example, which is feedback connection of an ODE and a PDE systems.


Clock Synchronization in Virtualized Distributed Real Time Systems using IEEE 802.1AS and ACRN. Virtualization of distributed real time systems enables the consolidation of mixed criticality functions on a shared hardware platform thus easing system integration. Time triggered communication and computation can act as an enabler of safe hard real time systems. A time triggered hypervisor that activates virtual CPUs according to a global schedule can provide the means to allow for a resource efficient implementation of the time triggered paradigm in virtualized distributed real time systems. A prerequisite of time triggered virtualization for hard real time systems is providing access to a global time base to VMs as well as to the hypervisor. A global time base is the result of clock synchronization with an upper bound on the clock synchronization precision. We present a formalization of the notion of time in virtualized real time systems. We use this formalization to propose a virtual clock condition that enables us to test the suitability of a virtual clock for the design of virtualized time triggered real time systems. We discuss and model how virtualization, in particular resource consolidation versus resource partitioning, degrades clock synchronization precision. Finally, we apply our insights to model the IEEE 802.1AS clock synchronization protocol and derive an upper bound on the clock synchronization precision of IEEE 802.1AS. We present our implementation of a dependent clock for ACRN that can be synchronized to a grandmaster clock. The results of our experiments illustrate that a type 1 hypervisor implementing a dependent clock yields native clock synchronization precision. Furthermore, we show that the upper bound derived from our model holds for a series of experiments featuring native as well as virtualized setups.


On non compact p adic definable groups. Peterzil and Steinhorn proved that if a group G definable in an o minimal structure is not definably compact, then G contains a definable torsion free subgroup of dimension one. We prove here a p adic analogue of the Peterzil Steinhorn theorem, in the special case of abelian groups. Let G be an abelian group definable in a p adically closed field M . If G is not definably compact then there is a definable subgroup H of dimension one which is not definably compact. In a future paper we will generalize this to non abelian G .


Utilizing Shannon's Entropy to Create Privacy Aware Architectures. Privacy is an individual choice to determine which personal details can be collected, used and shared. Individual consent and transparency are the core tenets for earning customers trust and this motivates the organizations to adopt privacy enhancing practices while creating the systems. The goal of a privacy aware design is to protect information in a way that does not increase an adversary's existing knowledge about an individual beyond what is permissible. This becomes critical when these data elements can be linked with the wealth of auxiliary information available outside the system to identify an individual. Privacy regulations around the world provide directives to protect individual privacy but are generally complex and vague, making their translation into actionable and technical privacy friendly architectures challenging. In this paper, we utilize Shannon's Entropy to create an objective metric that can help simplify the state of the art Privacy Design Strategies proposed in the literature and aid our key technical design decisions to create privacy aware architectures.


Fano enhancement of second harmonic field via dark bright plasmon coupling. Surface plasmon resonances, the coherent oscillation of free electrons, can concentrate incident field into small volumes much smaller than the incident wavelength. The intense fields at these textit hot spots enhance the light matter interactions and may lead to the appearance of nonlinearity. Controlling such nonlinearities is significant for various practical applications. Here we report that by coupling dark modes to the first and the generated second harmonic modes separately, one can gain control over both fields. We find that by engineering path interferences (Fano resonances) between bright and dark plasmon modes it is possible to enhance the fundamental mode without increasing the nonlinear field, enhance the nonlinear field without modifying the fundamental mode, and enhance the second harmonic field with enhanced fundamental mode.


Interviewer Candidate Role Play Towards Developing Real World NLP Systems. Standard NLP tasks do not incorporate several common real world scenarios such as seeking clarifications about the question, taking advantage of clues, abstaining in order to avoid incorrect answers, etc. This difference in task formulation hinders the adoption of NLP systems in real world settings. In this work, we take a step towards bridging this gap and present a multi stage task that simulates a typical human human questioner responder interaction such as an interview. Specifically, the system is provided with question simplifications, knowledge statements, examples, etc. at various stages to improve its prediction when it is not sufficiently confident. We instantiate the proposed task in Natural Language Inference setting where a system is evaluated on both in domain and out of domain (OOD) inputs. We conduct comprehensive experiments and find that the multi stage formulation of our task leads to OOD generalization performance improvement up to 2.29 in Stage 1, 1.91 in Stage 2, 54.88 in Stage 3, and 72.02 in Stage 4 over the standard unguided prediction. However, our task leaves a significant challenge for NLP researchers to further improve OOD performance at each stage.


Domain Adaptation for Learning Generator from Paired Few Shot Data. We propose a Paired Few shot GAN (PFS GAN) model for learning generators with sufficient source data and a few target data. While generative model learning typically needs large scale training data, our PFS GAN not only uses the concept of few shot learning but also domain shift to transfer the knowledge across domains, which alleviates the issue of obtaining low quality generator when only trained with target domain data. The cross domain datasets are assumed to have two properties (1) each target domain sample has its source domain correspondence and (2) two domains share similar content information but different appearance. Our PFS GAN aims to learn the disentangled representation from images, which composed of domain invariant content features and domain specific appearance features. Furthermore, a relation loss is introduced on the content features while shifting the appearance features to increase the structural diversity. Extensive experiments show that our method has better quantitative and qualitative results on the generated target domain data with higher diversity in comparison to several baselines.


Class Balanced Distillation for Long Tailed Visual Recognition. Real world imagery is often characterized by a significant imbalance of the number of images per class, leading to long tailed distributions. An effective and simple approach to long tailed visual recognition is to learn feature representations and a classifier separately, with instance and class balanced sampling, respectively. In this work, we introduce a new framework, by making the key observation that a feature representation learned with instance sampling is far from optimal in a long tailed setting. Our main contribution is a new training method, referred to as Class Balanced Distillation (CBD), that leverages knowledge distillation to enhance feature representations. CBD allows the feature representation to evolve in the second training stage, guided by the teacher learned in the first stage. The second stage uses class balanced sampling, in order to focus on under represented classes. This framework can naturally accommodate the usage of multiple teachers, unlocking the information from an ensemble of models to enhance recognition capabilities. Our experiments show that the proposed technique consistently outperforms the state of the art on long tailed recognition benchmarks such as ImageNet LT, iNaturalist17 and iNaturalist18.


Higher Order Mandelbrot Sets and their Varying Shapes. Mandelbrot set arose from the pioneering work of French mathematician Gaston Julia in the field of complex dynamics at the beginning of the 20th century. French American mathematician Benoit Mandelbrot used computers to calculate iterations of complex polynomials of second order and displayed intricate images of fractal geometry. While studying fundamental properties of the Mandelbrot set, little attention has been paid to study the relationship between the degree of the generating polynomials and the shape of the main body of the Mandelbrot set. This paper extends the work from generating polynomials of second degree to polynomials of higher degrees using basic principles of complex numbers and calculus and shows that the number of primary lobes in the Mandelbrot set corresponding to a polynomial of nth degree is n 1 and as n tends to infinity the shape of the primary lobe tends to a circle of unit radius. It is also shown that the arguments of the points where secondary lobes are attached to the primary lobes are given by the roots of unity. These results provide an easy way to predict shapes of the main lobes of Mandelbrot sets and the locations of the points where secondary lobes are attached to the main lobe and may be helpful in understanding features of the Mandelbrot set.


Simulating SQL Injection Vulnerability Exploitation Using Q Learning Reinforcement Learning Agents. In this paper, we propose a formalization of the process of exploitation of SQL injection vulnerabilities. We consider a simplification of the dynamics of SQL injection attacks by casting this problem as a security capture the flag challenge. We model it as a Markov decision process, and we implement it as a reinforcement learning problem. We then deploy reinforcement learning agents tasked with learning an effective policy to perform SQL injection we design our training in such a way that the agent learns not just a specific strategy to solve an individual challenge but a more generic policy that may be applied to perform SQL injection attacks against any system instantiated randomly by our problem generator. We analyze the results in terms of the quality of the learned policy and in terms of convergence time as a function of the complexity of the challenge and the learning agent's complexity. Our work fits in the wider research on the development of intelligent agents for autonomous penetration testing and white hat hacking, and our results aim to contribute to understanding the potential and the limits of reinforcement learning in a security environment.


Operationalizing Framing to Support Multiperspective Recommendations of Opinion Pieces. Diversity in personalized news recommender systems is often defined as dissimilarity, and based on topic diversity (e.g., corona versus farmers strike). Diversity in news media, however, is understood as multiperspectivity (e.g., different opinions on corona measures), and arguably a key responsibility of the press in a democratic society. While viewpoint diversity is often considered synonymous with source diversity in communication science domain, in this paper, we take a computational view. We operationalize the notion of framing, adopted from communication science. We apply this notion to a re ranking of topic relevant recommended lists, to form the basis of a novel viewpoint diversification method. Our offline evaluation indicates that the proposed method is capable of enhancing the viewpoint diversity of recommendation lists according to a diversity metric from literature. In an online study, on the Blendle platform, a Dutch news aggregator platform, with more than 2000 users, we found that users are willing to consume viewpoint diverse news recommendations. We also found that presentation characteristics significantly influence the reading behaviour of diverse recommendations. These results suggest that future research on presentation aspects of recommendations can be just as important as novel viewpoint diversification methods to truly achieve multiperspectivity in online news environments.


Understanding charging dynamics of fully electrified taxi services using large scale trajectory data. An accurate understanding of "when, where and why" of charging activities is crucial for the optimal planning and operation of E shared mobility services. In this study, we leverage a unique trajectory of a city wide fully electrified taxi fleet in Shenzhen, China, and we present one of the first studies to investigate charging behavioral dynamics of a fully electrified shared mobility system from both system level and individual driver perspectives. The electric taxi (ET) trajectory data contain detailed travel information of over 20,000 ETs over one month period. By combing the trajectory and charging infrastructure data, we reveal remarkable regularities in infrastructure utilization, temporal and spatial charging dynamics as well as individual driver level charging preferences. Specifically, we report that both temporal and spatial distributions of system level charging activities present strong within day and daily regularities, and most charging activities are induced from drivers' shift schedules. Further, with 425 charging stations, we observe that the drivers show strong preferences over a small subset of charging stations, and the power law distribution can well characterize the charging frequency at each charging station. Finally, we show that drivers' shift schedules also dominate the individual charging behavior, and there are strikingly stable daily charging patterns at the individual level. The results and findings of our study represent lessons and insights that may be carried over to the planning and operation of E shared mobility in other cities and deliver important justifications for future studies on the modeling of E shared mobility services.


Classification of Influenza Hemagglutinin Protein Sequences using Convolutional Neural Networks. The Influenza virus can be considered as one of the most severe viruses that can infect multiple species with often fatal consequences to the hosts. The Hemagglutinin (HA) gene of the virus can be a target for antiviral drug development realised through accurate identification of its sub types and possible the targeted hosts. This paper focuses on accurately predicting if an Influenza type A virus can infect specific hosts, and more specifically, Human, Avian and Swine hosts, using only the protein sequence of the HA gene. In more detail, we propose encoding the protein sequences into numerical signals using the Hydrophobicity Index and subsequently utilising a Convolutional Neural Network based predictive model. The Influenza HA protein sequences used in the proposed work are obtained from the Influenza Research Database (IRD). Specifically, complete and unique HA protein sequences were used for avian, human and swine hosts. The data obtained for this work was 17999 human host proteins, 17667 avian host proteins and 9278 swine host proteins. Given this set of collected proteins, the proposed method yields as much as 10 higher accuracy for an individual class (namely, Avian) and 5 higher overall accuracy than in an earlier study. It is also observed that the accuracy for each class in this work is more balanced than what was presented in this earlier study. As the results show, the proposed model can distinguish HA protein sequences with high accuracy whenever the virus under investigation can infect Human, Avian or Swine hosts.


EXMA A Genomics Accelerator for Exact Matching. Genomics is the foundation of precision medicine, global food security and virus surveillance. Exact match is one of the most essential operations widely used in almost every step of genomics such as alignment, assembly, annotation, and compression. Modern genomics adopts Ferragina Manzini Index (FM Index) augmenting space efficient Burrows Wheeler transform (BWT) with additional data structures to permit ultra fast exact match operations. However, FM Index is notorious for its poor spatial locality and random memory access pattern. Prior works create GPU , FPGA , ASIC and even process in memory (PIM) based accelerators to boost FM Index search throughput. Though they achieve the state of the art FM Index search throughput, the same as all prior conventional accelerators, FM Index PIMs process only one DNA symbol after each DRAM row activation, thereby suffering from poor memory bandwidth utilization. In this paper, we propose a hardware accelerator, EXMA, to enhance FM Index search throughput. We first create a novel EXMA table with a multi task learning (MTL) based index to process multiple DNA symbols with each DRAM row activation. We then build an accelerator to search over an EXMA table. We propose 2 stage scheduling to increase the cache hit rate of our accelerator. We introduce dynamic page policy to improve the row buffer hit rate of DRAM main memory. We also present CHAIN compression to reduce the data structure size of EXMA tables. Compared to state of the art FM Index PIMs, EXMA improves search throughput by 4.9 times , and enhances search throughput per Watt by 4.8 times .


On two notions of expansiveness for continuous semiflows. We study two notions of expansiveness for continuous semiflows expansiveness in the sense of Alves, Carvalho and Siqueira (2017), and an adaptation of positive expansiveness in the sense of Artigue (2014). We prove that if X is a metric space and phi is an expansive semiflow on X according to the first definition, then the semiflow phi is trivial and the space X is uniformly discrete. In particular, if X is compact then it is finite. With respect to the second definition, we prove that if X is a compact metric space and phi is a positive expansive semiflow on it, then X is a union of at most finitely many closed orbits, unbranched tails and isolated singularities.


Reduction cohomology of Riemann surfaces. We study the algebraic conditions leading to the chain property of complexes for vertex operator algebra n point functions with differential being defined through reduction formulas. The notion of the reduction cohomology of Riemann surfaces is introduced. Algebraic, geometrical, and cohomological meanings of reduction formulas is clarified. A counterpart of the Bott Segal theorem for Riemann surfaces in terms of the reductions cohomology is proven. It is shown that the reduction cohomology is given by the cohomology of n point connections over the vertex operator algebra bundle defined on a genus g Riemann surface Sigma (g) . The reduction cohomology for a vertex operator algebra with formal parameters identified with local coordinates around marked points on Sigma (g) is found in terms of the space of analytical continuations of solutions to Knizhnik Zamolodchikov equations. For the reduction cohomology, the Euler Poincare formula is derived. Examples for various genera and vertex operator cluster algebras are provided.


A Fast and Accurate Splitting Method for Optimal Transport Analysis and Implementation. We develop a fast and reliable method for solving large scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas Rachford splitting technique, our method tackles the original OT problem directly instead of solving an approximate regularized problem, as many state of the art techniques do. This allows us to provide sparse transport plans and avoid numerical issues of methods that use entropic regularization. The algorithm has the same cost per iteration as the popular Sinkhorn method, and each iteration can be executed efficiently, in parallel. The proposed method enjoys an iteration complexity O(1 epsilon) compared to the best known O(1 epsilon 2) of the Sinkhorn method. In addition, we establish a linear convergence rate for our formulation of the OT problem. We detail an efficient GPU implementation of the proposed method that maintains a primal dual stopping criterion at no extra cost. Substantial experiments demonstrate the effectiveness of our method, both in terms of computation times and robustness.


DefGraspSim Simulation based grasping of 3D deformable objects. Robotic grasping of 3D deformable objects (e.g., fruits vegetables, internal organs, bottles boxes) is critical for real world applications such as food processing, robotic surgery, and household automation. However, developing grasp strategies for such objects is uniquely challenging. In this work, we efficiently simulate grasps on a wide range of 3D deformable objects using a GPU based implementation of the corotational finite element method (FEM). To facilitate future research, we open source our simulated dataset (34 objects, 1e5 Pa elasticity range, 6800 grasp evaluations, 1.1M grasp measurements), as well as a code repository that allows researchers to run our full FEM based grasp evaluation pipeline on arbitrary 3D object models of their choice. We also provide a detailed analysis on 6 object primitives. For each primitive, we methodically describe the effects of different grasp strategies, compute a set of performance metrics (e.g., deformation, stress) that fully capture the object response, and identify simple grasp features (e.g., gripper displacement, contact area) measurable by robots prior to pickup and predictive of these performance metrics. Finally, we demonstrate good correspondence between grasps on simulated objects and their real world counterparts.


On behavior of conductors, Picard schemes, and Jacobian numbers of varieties over imperfect fields. Let X be a regular geometrically integral variety over an imperfect field K . Unlike the case of characteristic 0 , X' X times mathrm Spec ,K mathrm Spec ,K' may have singular points for a (necessarily inseparable) field extension K' K . In this paper, we define new invariants of the local rings of codimension 1 points of X' , and use these invariants for the calculation of delta invariants (, which relate to genus changes,) and conductors of such points. As a corollary, we give refinements of Tate's genus change theorem and the Patakfalvi Waldron Theorem. Moreover, when X is a curve, we show that the Jacobian number of X is 2p (p 1) times of the genus change by using the above calculation. In this case, we also relate the structure of the Picard scheme of X with invariants of singular points of X . To prove such a relation, we give a characterization of the geometrical normality of algebras over fields of positive characteristic.


Analysis of the diffuse interface method for the Stokes Darcy coupled problem. We consider the interaction between a free flowing fluid and a porous medium flow, where the free flowing fluid is described using the time dependent Stokes equations, and the porous medium flow is described using Darcy's law in the primal formulation. To solve this problem numerically, we use the diffuse interface approach, where the weak form of the coupled problem is written on an extended domain which contains both Stokes and Darcy regions. This is achieved using a phase field function which equals one in the Stokes region and zero in the Darcy region, and smoothly transitions between these two values on a diffuse region of width epsilon around the Stokes Darcy interface. We prove the convergence of the diffuse interface formulation to the standard, sharp interface formulation, and derive the rates of the convergence. This is performed by analyzing the modeling error of the diffuse interface approach at the continuous level, and by deriving the a priori error estimates for the diffuse interface method at the discrete level. The convergence rates are also derived computationally in a numerical example.


Tensor product theorem for parabolic lambda connections. We establish a tensor product theorem for slope semistable parabolic lambda connections over smooth projective varieties in arbitrary characteristic.


DocAMR Multi Sentence AMR Representation and Evaluation. Despite extensive research on parsing of English sentences into Abstraction Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full document parsing into a unified graph representation lacks well defined representation and evaluation. Taking advantage of a super sentential level of coreference annotation from previous work, we introduce a simple algorithm for deriving a unified graph representation, avoiding the pitfalls of information loss from over merging and lack of coherence from under merging. Next, we describe improvements to the Smatch metric to make it tractable for comparing document level graphs, and use it to re evaluate the best published document level AMR parser. We also present a pipeline approach combining the top performing AMR parser and coreference resolution systems, providing a strong baseline for future research.


B n 1 bundles on the flag variety, I. We show that each orbit of a Borel subgroup B n 1 of GL(n 1) (respectively SO(n 1)) on the flag variety of GL(n) (respectively of SO(n)) is a bundle over a B n 1 orbit on a generalized flag variety of GL(n 1) (respectively SO(n 1)), with fiber isomorphic to an orbit of an analogous subgroup on a smaller flag variety. As a consequence, we develop an inductive procedure to classify B n 1 orbits on the flag variety. Our method is essentially uniform in the two cases. As further consequences, in the sequel to this paper we give an explicit combinatorial classification of orbits and determine completely the closure relation between orbit closures. This further develops work of Hashimoto in the general linear group case.


MTGLS Multi Task Gaze Estimation with Limited Supervision. Robust gaze estimation is a challenging task, even for deep CNNs, due to the non availability of large scale labeled data. Moreover, gaze annotation is a time consuming process and requires specialized hardware setups. We propose MTGLS a Multi Task Gaze estimation framework with Limited Supervision, which leverages abundantly available non annotated facial image data. MTGLS distills knowledge from off the shelf facial image analysis models, and learns strong feature representations of human eyes, guided by three complementary auxiliary signals (a) the line of sight of the pupil (i.e. pseudo gaze) defined by the localized facial landmarks, (b) the head pose given by Euler angles, and (c) the orientation of the eye patch (left right eye). To overcome inherent noise in the supervisory signals, MTGLS further incorporates a noise distribution modelling approach. Our experimental results show that MTGLS learns highly generalized representations which consistently perform well on a range of datasets. Our proposed framework outperforms the unsupervised state of the art on CAVE (by 6.43 ) and even supervised state of the art methods on Gaze360 (by 6.59 ) datasets.


A new approach to the inverse discrete transmission eigenvalue problem. A discrete analog is considered for the inverse transmission eigenvalue problem, having applications in acoustics. We provide a well posed inverse problem statement, develop a constructive procedure for solving this problem, prove uniqueness of solution, global solvability, local solvability, and stability. Our approach is based on the reduction of the discrete transmission eigenvalue problem to a linear system with polynomials of the spectral parameter in the boundary condition.


Spanning trees of a claw free graph whose reducible stems have few leaves. Let T be a tree, a vertex of degree one is a leaf of T and a vertex of degree at least three is a branch vertex of T . For two distinct vertices u,v of T , let P T u,v denote the unique path in T connecting u and v. For a leaf x of T , let y x denote the nearest branch vertex to x . For every leaf x of T , we remove the path P T x, y x) from T , where P T x, y x) denotes the path connecting x to y x in T but not containing y x . The resulting subtree of T is called the it reducible stem of T . In this paper, we first use a new technique of Gould and Shull to state a new short proof for a result of Kano et al. on the spanning tree with a bounded number of leaves in a claw free graph. After that, we use that proof to give a sharp sufficient condition for a claw free graph having a spanning tree whose reducible stem has few leaves.


Developers perception on the severity of test smells an empirical study. Unit testing is an essential component of the software development life cycle. A developer could easily and quickly catch and fix software faults introduced in the source code by creating and running unit tests. Despite their importance, unit tests are subject to bad design or implementation decisions, the so called test smells. These might decrease software systems quality from various aspects, making it harder to understand, more complex to maintain, and more prone to errors and bugs. Many studies discuss the likely effects of test smells on test code. However, there is a lack of studies that capture developers perceptions of such issues. This study empirically analyzes how developers perceive the severity of test smells in the test code they develop. Severity refers to the degree to how a test smell may negatively impact the test code. We selected six open source software projects from GitHub and interviewed their developers to understand whether and how the test smells affected the test code. Although most of the interviewed developers considered the test smells as having a low severity to their code, they indicated that test smells might negatively impact the project, particularly in test code maintainability and evolution. Also, detecting and removing test smells from the test code may be positive for the project.


Analysis and classification of main risk factors causing stroke in Shanxi Province. In China, stroke is the first leading cause of death in recent years. It is a major cause of long term physical and cognitive impairment, which bring great pressure on the National Public Health System. Evaluation of the risk of getting stroke is important for the prevention and treatment of stroke in China. A data set with 2000 hospitalized stroke patients in 2018 and 27583 residents during the year 2017 to 2020 is analyzed in this study. Due to data incompleteness, inconsistency, and non structured formats, missing values in the raw data are filled with 1 as an abnormal class. With the cleaned features, three models on risk levels of getting stroke are built by using machine learning methods. The importance of "8 2" factors from China National Stroke Prevention Project (CSPP) is evaluated via decision tree and random forest models. Except for "8 2" factors the importance of features and SHAP1 values for lifestyle information, demographic information, and medical measurement are evaluated and ranked via a random forest model. Furthermore, a logistic regression model is applied to evaluate the probability of getting stroke for different risk levels. Based on the census data in both communities and hospitals from Shanxi Province, we investigate different risk factors of getting stroke and their ranking with interpretable machine learning models. The results show that Hypertension (Systolic blood pressure, Diastolic blood pressure), Physical Inactivity (Lack of sports), and Overweight (BMI) are ranked as the top three high risk factors of getting stroke in Shanxi province. The probability of getting stroke for a person can also be predicted via our machine learning model.


Transformer Ensembles for Sexism Detection. This document presents in detail the work done for the sexism detection task at EXIST2021 workshop. Our methodology is built on ensembles of Transformer based models which are trained on different background and corpora and fine tuned on the provided dataset from the EXIST2021 workshop. We report accuracy of 0.767 for the binary classification task (task1), and f1 score 0.766, and for the multi class task (task2) accuracy 0.623 and f1 score 0.535.


Graph Traversal with Tensor Functionals A Meta Algorithm for Scalable Learning. Graph Representation Learning (GRL) methods have impacted fields from chemistry to social science. However, their algorithmic implementations are specialized to specific use cases e.g.message passing methods are run differently from node embedding ones. Despite their apparent differences, all these methods utilize the graph structure, and therefore, their learning can be approximated with stochastic graph traversals. We propose Graph Traversal via Tensor Functionals(GTTF), a unifying meta algorithm framework for easing the implementation of diverse graph algorithms and enabling transparent and efficient scaling to large graphs. GTTF is founded upon a data structure (stored as a sparse tensor) and a stochastic graph traversal algorithm (described using tensor operations). The algorithm is a functional that accept two functions, and can be specialized to obtain a variety of GRL models and objectives, simply by changing those two functions. We show for a wide class of methods, our algorithm learns in an unbiased fashion and, in expectation, approximates the learning as if the specialized implementations were run directly. With these capabilities, we scale otherwise non scalable methods to set state of the art on large graph datasets while being more efficient than existing GRL libraries with only a handful of lines of code for each method specialization. GTTF and its various GRL implementations are on https github.com isi usc edu gttf.


Stochastic partial differential equations arising in self organized criticality. Scaling limits for the weakly driven Zhang and the Bak Tang Wiesenfeld (BTW) model for self organized criticality are considered. It is shown that the weakly driven Zhang model converges to a stochastic PDE with singular degenerate diffusion. In addition, the deterministic BTW model is proved to converge to a singular degenerate PDE. Alternatively, the proof of convergence can be understood as a proof of convergence of a finite difference discretization for singular degenerate stochastic PDE. This extends recent work on finite difference approximation of (deterministic) quasilinear diffusion equations to discontinuous diffusion coefficients and stochastic PDE.


Understanding the Perceived Relevance of Capability Measures A Survey of Agile Software Development Practitioners. Context In the light of the swift and iterative nature of Agile Software Development (ASD) practices, establishing deeper insights into capability measurement within the context of team formation is crucial, as the capability of individuals and teams can affect team performance and productivity. Although a former Systematic Literature Review (SLR) synthesized the state of the art in relation to capability measurement in ASD with a focus on selecting individuals to agile teams, and capabilities related to team performance and success, determining to what degree the SLR's results apply to practice can provide progressive insights to both research and practice. Objective Our study investigates how agile practitioners perceive the relevance of individual and team level measures for characterizing the capability of an agile team and its members. Furthermore, to scrutinize variations in practitioners' perceptions, our study further analyzes perceptions across stratified demographic groups. Method We undertook a Web based survey using a questionnaire built based on the capability measures identified from a previously conducted SLR. Results Our survey responses (60) indicate that 127 individual and 28 team capability measures were considered as relevant by the majority of practitioners. We also identified seven individual and one team capability measure that have not been previously characterized by our SLR. The surveyed practitioners suggested that an agile team member's responsibility and questioning skills significantly represent the member's capability. Conclusion Results from our survey align with our SLR's findings. Measures associated with social aspects were observed to be dominant compared to technical and innovative aspects. Our results can support agile practitioners in their team composition decisions.


ACNet Mask Aware Attention with Dynamic Context Enhancement for Robust Acne Detection. Computer aided diagnosis has recently received attention for its advantage of low cost and time efficiency. Although deep learning played a major role in the recent success of acne detection, there are still several challenges such as color shift by inconsistent illumination, variation in scales, and high density distribution. To address these problems, we propose an acne detection network which consists of three components, specifically Composite Feature Refinement, Dynamic Context Enhancement, and Mask Aware Multi Attention. First, Composite Feature Refinement integrates semantic information and fine details to enrich feature representation, which mitigates the adverse impact of imbalanced illumination. Then, Dynamic Context Enhancement controls different receptive fields of multi scale features for context enhancement to handle scale variation. Finally, Mask Aware Multi Attention detects densely arranged and small acne by suppressing uninformative regions and highlighting probable acne regions. Experiments are performed on acne image dataset ACNE04 and natural image dataset PASCAL VOC 2007. We demonstrate how our method achieves the state of the art result on ACNE04 and competitive performance with previous state of the art methods on the PASCAL VOC 2007.


Unbiased Asymmetric Reinforcement Learning under Partial Observability. In partially observable reinforcement learning, offline training gives access to latent information which is not available during online training and or execution, such as the system state. Asymmetric actor critic methods exploit such information by training a history based policy via a state based critic. However, many asymmetric methods lack theoretical foundation, and are only evaluated on limited domains. We examine the theory of asymmetric actor critic methods which use state based critics, and expose fundamental issues which undermine the validity of a common variant, and limit its ability to address partial observability. We propose an unbiased asymmetric actor critic variant which is able to exploit state information while remaining theoretically sound, maintaining the validity of the policy gradient theorem, and introducing no bias and relatively low variance into the training process. An empirical evaluation performed on domains which exhibit significant partial observability confirms our analysis, demonstrating that unbiased asymmetric actor critic converges to better policies and or faster than symmetric and biased asymmetric baselines.


Leveraging Code Clones and Natural Language Processing for Log Statement Prediction. Software developers embed logging statements inside the source code as an imperative duty in modern software development as log files are necessary for tracking down runtime system issues and troubleshooting system management tasks. Prior research has emphasized the importance of logging statements in the operation and debugging of software systems. However, the current logging process is mostly manual and ad hoc, and thus, proper placement and content of logging statements remain as challenges. To overcome these challenges, methods that aim to automate log placement and log content, i.e., 'where, what, and how to log', are of high interest. Thus, we propose to accomplish the goal of this research, that is "to predict the log statements by utilizing source code clones and natural language processing (NLP)", as these approaches provide additional context and advantage for log prediction. We pursue the following four research objectives (RO1) investigate whether source code clones can be leveraged for log statement location prediction, (RO2) propose a clone based approach for log statement prediction, (RO3) predict log statement's description with code clone and NLP models, and (RO4) examine approaches to automatically predict additional details of the log statement, such as its verbosity level and variables. For this purpose, we perform an experimental analysis on seven open source java projects, extract their method level code clones, investigate their attributes, and utilize them for log location and description prediction. Our work demonstrates the effectiveness of log aware clone detection for automated log location and description prediction and outperforms the prior work.


Analytical and computational properties of the variable symmetric division deg index. The aim of this work is to obtain new inequalities for the variable symmetric division deg index SDD alpha(G) sum uv in E(G) (d u alpha d v alpha d v alpha d u alpha) , and to characterize graphs extremal with respect to them. Here, uv denotes the edge of the graph G connecting the vertices u and v , d u is the degree of the vertex u , and alpha in mathbb R . Some of these inequalities generalize and improve previous results for the symmetric division deg index. In addition, we computationally apply the SDD alpha(G) index on random graphs and show that the ratio left langle SDD alpha(G) right rangle n ( n being the order of the graph) depends only on the average degree left langle d right rangle .


Weight metamorphosis of varifolds and the LDDMM Fisher Rao metric. This paper introduces and studies a metamorphosis framework for geometric measures known as varifolds, which extends the diffeomorphic registration model for objects such as curves, surfaces and measures by complementing diffeomorphic deformations with a transformation process on the varifold weights. We consider two classes of cost functionals to penalize those combined transformations, in particular the LDDMM Fisher Rao energy which, as we show, leads to a well defined Riemannian metric on the space of varifolds with existence of corresponding geodesics. We further introduce relaxed formulations of the respective optimal control problems, study their well posedness and derive optimality conditions for the solutions. From these, we propose a numerical approach to compute optimal metamorphoses between discrete varifolds and illustrate the interest of this model in the situation of partially missing data.


A Study of Automatic Metrics for the Evaluation of Natural Language Explanations. As transparency becomes key for robotics and AI, it will be necessary to evaluate the methods through which transparency is provided, including automatically generated natural language (NL) explanations. Here, we explore parallels between the generation of such explanations and the much studied field of evaluation of Natural Language Generation (NLG). Specifically, we investigate which of the NLG evaluation measures map well to explanations. We present the ExBAN corpus a crowd sourced corpus of NL explanations for Bayesian Networks. We run correlations comparing human subjective ratings with NLG automatic measures. We find that embedding based automatic NLG evaluation methods, such as BERTScore and BLEURT, have a higher correlation with human ratings, compared to word overlap metrics, such as BLEU and ROUGE. This work has implications for Explainable AI and transparent robotic and autonomous systems.


Development and validation of an optimal GATE model for proton pencil beam scanning delivery. Objective To develop and validate an independent Monet Carlo dose calculation engine to support for software verification of treatment planning systems and quality assurance workflow. Method GATE Monte Carlo toolkit was employed to simulate a fixed horizontal active scan based proton beam delivery. Within the nozzle, two primary and secondary dose monitors have been designed allowing to compare the accuracy of dose estimation from MC simulation with respect to physical quality assurance measurements. The developed beam model was validated against a series of commissioning measurements using pinpoint chambers and 2D array ionization chambers in terms of lateral profiles and depth dose distributions. Furthermore, beam delivery module and treatment planning has been validated against the literature deploying various clinical test cases of AAPM TG 119 and a prostate patient. Result MC simulation showed an excellent agreement with measurements in the lateral depth dose parameters and SOBP characteristics within maximum relative error of 0.95 in range, 3.4 in entrance to peak ratio, 2.3 in mean point to point, and 0.852 in peak location. Mean relative absolute difference between MC simulation and the measurement in terms of absorbed dose in SOBP region was 0.93 pm 0.88 . Clinical phantom study showed a good agreement compared to a commercial treatment planning system (relative error for TG 119 PTV D 95 mathrm sim 1.8 and for prostate PTV D 95 mathrm sim 0.6 ). Conclusion The results confirm the capability of GATE simulation as a reliable surrogate for verifying TPS dose maps prior to patient treatment.


A new parsimonious method for classifying Cancer Tissue of Origin Based on DNA Methylation 450K data. DNA methylation is a well studied genetic modification that regulates gene transcription of Eukaryotes. Its alternations have been recognized as a significant component of cancer development. In this study, we use the DNA methylation 450k data from The Cancer Genome Atlas to evaluate the efficacy of DNA methylation data on cancer classification for 30 cancer types. We propose a new method for gene selection in high dimensional data(over 450 thousand). Variance filtering is first introduced for dimension reduction and Recursive feature elimination (RFE) is then used for feature selection. We address the problem of selecting a small subsets of genes from large number of methylated sites, and our parsimonious model is demonstrated to be efficient, achieving an accuracy over 91 , outperforming other studies which use DNA micro arrays and RNA seq Data . The performance of 20 models, which are based on 4 estimators (Random Forest, Decision Tree, Extra Tree and Support Vector Machine) and 5 classifiers (k Nearest Neighbours, Support Vector Machine, XGboost, Light GBM and Multi Layer Perceptron), is compared and robustness of the RFE algorithm is examined. Results suggest that the combined model of extra tree plus catboost classifier offers the best performance in cancer identification, with an overall validation accuracy of 91 , 92.3 , 93.3 and 93.5 for 20, 30, 40 and 50 features respectively. The biological functions in cancer development of 50 selected genes is also explored through enrichment analysis and the results show that 12 out of 16 of our top features have already been identified to be specific with cancer and we also propose some more genes to be tested for future studies. Therefore, our method may be utilzed as an auxiliary diagnostic method to determine the actual clinicopathological status of a specific cancer.


Thermodynamic constraints on the assembly and diversity of microbial ecosystems are different near to and far from equilibrium. Non equilibrium thermodynamics has long been an area of substantial interest to ecologists because most fundamental biological processes, such as protein synthesis and respiration, are inherently energy consuming. Microbial communities are a natural system to decipher this mechanistic basis because their interactions in the form of substrate consumption, metabolite production, and cross feeding can be described explicitly in thermodynamic terms. Previous work has considered how thermodynamic constraints impact competition between pairs of species, but restrained from analysing how this manifests in complex dynamical systems. To address this gap, we develop a thermodynamic microbial community model with fully reversible reaction kinetics, which allows direct consideration of free energy dissipation. This also allows species to interact via products rather than just substrates, increasing the dynamical complexity, and allowing a more nuanced classification of interaction types to emerge. Using this model, we find that community diversity increases with substrate lability, because greater free energy availability allows for faster generation of niches. Thus, more niches are generated in the time frame of community establishment, leading to higher final species diversity. We also find that allowing species to make use of near to equilibrium reactions increases diversity in a low free energy regime. In such a regime, two new thermodynamic interaction types that we identify here reach comparable strengths to the conventional (competition and facilitation) types, emphasising the key role that thermodynamics plays in community dynamics. Our results suggest that accounting for realistic thermodynamic constraints is vital for understanding the dynamics of real world microbial communities.


Agglomeration based geometric multigrid schemes for the Virtual Element Method. In this paper we analyse the convergence properties of two level, W cycle and V cycle agglomeration based geometric multigrid schemes for the numerical solution of the linear system of equations stemming from the lowest order C 0 conforming Virtual Element discretization of two dimensional second order elliptic partial differential equations. The sequence of agglomerated tessellations are nested, but the corresponding multilevel virtual discrete spaces are generally non nested thus resulting into non nested multigrid algorithms. We prove the uniform convergence of the two level method with respect to the mesh size and the uniform convergence of the W cycle and the V cycle multigrid algorithms with respect to the mesh size and the number of levels. Numerical experiments confirm the theoretical findings.


Efficient CNN Building Blocks for Encrypted Data. Machine learning on encrypted data can address the concerns related to privacy and legality of sharing sensitive data with untrustworthy service providers. Fully Homomorphic Encryption (FHE) is a promising technique to enable machine learning and inferencing while providing strict guarantees against information leakage. Since deep convolutional neural networks (CNNs) have become the machine learning tool of choice in several applications, several attempts have been made to harness CNNs to extract insights from encrypted data. However, existing works focus only on ensuring data security and ignore security of model parameters. They also report high level implementations without providing rigorous analysis of the accuracy, security, and speed trade offs involved in the FHE implementation of generic primitive operators of a CNN such as convolution, non linear activation, and pooling. In this work, we consider a Machine Learning as a Service (MLaaS) scenario where both input data and model parameters are secured using FHE. Using the CKKS scheme available in the open source HElib library, we show that operational parameters of the chosen FHE scheme such as the degree of the cyclotomic polynomial, depth limitations of the underlying leveled HE scheme, and the computational precision parameters have a major impact on the design of the machine learning model (especially, the choice of the activation function and pooling method). Our empirical study shows that choice of aforementioned design parameters result in significant trade offs between accuracy, security level, and computational time. Encrypted inference experiments on the MNIST dataset indicate that other design choices such as ciphertext packing strategy and parallelization using multithreading are also critical in determining the throughput and latency of the inference process.


Ensemble Learning with Manifold Based Data Splitting for Noisy Label Correction. Label noise in training data can significantly degrade a model's generalization performance for supervised learning tasks. Here we focus on the problem that noisy labels are primarily mislabeled samples, which tend to be concentrated near decision boundaries, rather than uniformly distributed, and whose features should be equivocal. To address the problem, we propose an ensemble learning method to correct noisy labels by exploiting the local structures of feature manifolds. Different from typical ensemble strategies that increase the prediction diversity among sub models via certain loss terms, our method trains sub models on disjoint subsets, each being a union of the nearest neighbors of randomly selected seed samples on the data manifold. As a result, each sub model can learn a coarse representation of the data manifold along with a corresponding graph. Moreover, only a limited number of sub models will be affected by locally concentrated noisy labels. The constructed graphs are used to suggest a series of label correction candidates, and accordingly, our method derives label correction results by voting down inconsistent suggestions. Our experiments on real world noisy label datasets demonstrate the superiority of the proposed method over existing state of the arts.


Realisation of bending measured laminations by Kleinian surface groups. For geometrically finite Kleinian surface groups, Bonahon and Otal proved the existence part, and partly the uniqueness part of the bending lamination conjecture. In this paper, we generalise the existence part to general Kleinian surface groups including geometrically infinite ones. We furthermore prove the compactness of the set of Kleinian surface groups realising an arbitrarily fixed data of bending laminations and ending laminations. Our proof is independent of that of Bonahon and Otal.


Ruin Probabilities for Risk Process in a Regime Switching Environment. In this paper we give few expressions and asymptotics of ruin probabilities for a Markov modulated risk process for various regimes of a time horizon, initial reserves and a claim size distribution. We also consider few versions of the ruin time.


Dual Head Adversarial Training. Deep neural networks (DNNs) are known to be vulnerable to adversarial examples attacks, raising concerns about their reliability in safety critical applications. A number of defense methods have been proposed to train robust DNNs resistant to adversarial attacks, among which adversarial training has so far demonstrated the most promising results. However, recent studies have shown that there exists an inherent tradeoff between accuracy and robustness in adversarially trained DNNs. In this paper, we propose a novel technique Dual Head Adversarial Training (DH AT) to further improve the robustness of existing adversarial training methods. Different from existing improved variants of adversarial training, DH AT modifies both the architecture of the network and the training strategy to seek more robustness. Specifically, DH AT first attaches a second network head (or branch) to one intermediate layer of the network, then uses a lightweight convolutional neural network (CNN) to aggregate the outputs of the two heads. The training strategy is also adapted to reflect the relative importance of the two heads. We empirically show, on multiple benchmark datasets, that DH AT can bring notable robustness improvements to existing adversarial training methods. Compared with TRADES, one state of the art adversarial training method, our DH AT can improve the robustness by 3.4 against PGD40 and 2.3 against AutoAttack, and also improve the clean accuracy by 1.8 .


Pure Tensor Program Rewriting via Access Patterns (Representation Pearl). Tensor kernels in machine learning (ML) often correspond to pure mathematical expressions, making term rewriting an attractive strategy for optimization and mapping to specialized hardware accelerators. However, existing ML intermediate representations (IRs) tend to either be textit pure but high level , making low level rewrites to hardware targets inexpressible, or textit low level but impure , hampering the use of term rewriting altogether. This paper introduces Glenside, a pure IR whose core abstraction the textit access pattern enables low level, layout aware, hardware centric program rewrites. We demonstrate how term rewriting in Glenside can be used to map program fragments to hardware accelerator invocations and automatically discover classic data layout transformations like texttt im2col . Glenside establishes a new foundation for exploring further term rewriting techniques in optimizing low level tensor programs.


A Closer Look at Few Shot Video Classification A New Baseline and Benchmark. The existing few shot video classification methods often employ a meta learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on learning effective representations, and heavily rely on the ImageNet pre training, which might be unreasonable for the few shot recognition setting due to semantics overlap. In this paper, we aim to present an in depth study on few shot video classification by making three contributions. First, we perform a consistent comparative study on the existing metric based methods to figure out their limitations in representation learning. Accordingly, we propose a simple classifier based baseline without any temporal alignment that surprisingly outperforms the state of the art meta learning based methods. Second, we discover that there is a high correlation between the novel action class and the ImageNet object class, which is problematic in the few shot recognition setting. Our results show that the performance of training from scratch drops significantly, which implies that the existing benchmarks cannot provide enough base data. Finally, we present a new benchmark with more base data to facilitate future few shot video classification without pre training. The code will be made available at https github.com MCG NJU FSL Video.


Active Vapor Based Robotic Wiper. This paper presents a method of normal estimation for mirrors and transparent objects, which are difficult to recognize with a camera. To create a diffuse reflective surface, we propose to spray the water vapor onto the transparent or mirror surface. In the proposed method, we move an ultrasonic humidifier equipped on the tip of a robotic arm to apply the sprayed water vapor onto a plane of a target object so as to form a cross shaped misted area. Diffuse reflective surfaces are partially generated as the misted area, which allows the camera to detect a surface of the target object. The viewpoint of the gripper mounted camera is adjusted so that the extracted misted area appears as largest in the image, and finally the plane normal of the target object surface are estimated. We conducted normal estimation experiments to evaluate the effectiveness of the proposed method. The RMSEs of the azimuth estimation for a mirror and a transparent glass are about 4.2 and 5.8 degrees, respectively. Consequently, our robot experiments demonstrate that our robotic wiper can perform contact force regulated wiping motions for cleaning a transparent window as humans do.


Max Cuts in Triangle free Graphs. A well known conjecture by Erd H o s states that every triangle free graph on n vertices can be made bipartite by removing at most n 2 25 edges. This conjecture was known for graphs with edge density at least 0.4 and edge density at most 0.172 . Here, we will extend the edge density for which this conjecture is true we prove the conjecture for graphs with edge density at most 0.2486 and for graphs with edge density at least 0.3197 . Further, we prove that every triangle free graph can be made bipartite by removing at most n 2 23.5 edges improving the previously best bound of n 2 18 .


Location and audience selection for maximizing social influence. Viral marketing campaigns target primarily those individuals who are central in social networks and hence have social influence. Marketing events, however, may attract diverse audience. Despite the importance of event marketing, the influence of heterogeneous target groups is not well understood yet. In this paper, we define the Spreading Potential (SP) problem in which different sets of agents need to evaluated and compared based on their social influence. A typical application of SP is choosing locations for a series of marketing events. The SP problem is different from the well known Influence Maximization (IM) problem in two aspects. Firstly, it deals with sets rather than nodes. Secondly, the sets are diverse, composed by a mixture of influential and ordinary agents. Thus, SP needs to assess the contribution of ordinary agents too, while IM only aims to find top spreaders. We provide a systemic test for ranking influence measures in the SP problem based on node sampling and on a novel statistical method, the Sum of Ranking Differences. Using a Linear Threshold diffusion model on an online social network, we evaluate seven network measures of social influence. We demonstrate that the statistical assessment of these influence measures is remarkably different in the SP problem, when low ranked individuals are present, from the IM problem, when we focus on the algorithm's top choices exclusively.


Face Sketch Synthesis via Semantic Driven Generative Adversarial Network. Face sketch synthesis has made significant progress with the development of deep neural networks in these years. The delicate depiction of sketch portraits facilitates a wide range of applications like digital entertainment and law enforcement. However, accurate and realistic face sketch generation is still a challenging task due to the illumination variations and complex backgrounds in the real scenes. To tackle these challenges, we propose a novel Semantic Driven Generative Adversarial Network (SDGAN) which embeds global structure level style injection and local class level knowledge re weighting. Specifically, we conduct facial saliency detection on the input face photos to provide overall facial texture structure, which could be used as a global type of prior information. In addition, we exploit face parsing layouts as the semantic level spatial prior to enforce globally structural style injection in the generator of SDGAN. Furthermore, to enhance the realistic effect of the details, we propose a novel Adaptive Re weighting Loss (ARLoss) which dedicates to balance the contributions of different semantic classes. Experimentally, our extensive experiments on CUFS and CUFSF datasets show that our proposed algorithm achieves state of the art performance.