Counting isomorphism classes of superspecial curves. A superspecial curve is a (non singular) curve over a field of positive characteristic whose Jacobian variety is isomorphic to a product of supersingular elliptic curves over the algebraic closure. It is known that for given genus and characteristic, there exist only finitely many superspecial curves, up to isomorphism over an algebraically closed field. In this article, we give a brief survey on results of counting isomorphism classes of superspecial curves. In particular, this article summarizes some recent results in the case of genera four and five, obtained by the author and S. Harashita. We also survey results obtained in a joint work with Harashita and E. W. Howe, on the enumeration of superspecial curves in a certain class of non hyperelliptic curves of genus four.


Building extraction with vision transformer. As an important carrier of human productive activities, the extraction of buildings is not only essential for urban dynamic monitoring but also necessary for suburban construction inspection. Nowadays, accurate building extraction from remote sensing images remains a challenge due to the complex background and diverse appearances of buildings. The convolutional neural network (CNN) based building extraction methods, although increased the accuracy significantly, are criticized for their inability for modelling global dependencies. Thus, this paper applies the Vision Transformer for building extraction. However, the actual utilization of the Vision Transformer often comes with two limitations. First, the Vision Transformer requires more GPU memory and computational costs compared to CNNs. This limitation is further magnified when encountering large sized inputs like fine resolution remote sensing images. Second, spatial details are not sufficiently preserved during the feature extraction of the Vision Transformer, resulting in the inability for fine grained building segmentation. To handle these issues, we propose a novel Vision Transformer (BuildFormer), with a dual path structure. Specifically, we design a spatial detailed context path to encode rich spatial details and a global context path to capture global dependencies. Besides, we develop a window based linear multi head self attention to make the complexity of the multi head self attention linear with the window size, which strengthens the global context extraction by using large windows and greatly improves the potential of the Vision Transformer in processing large sized remote sensing images. The proposed method yields state of the art performance (75.74 IoU) on the Massachusetts building dataset. Code will be available.


Heteronuclear transfers from labile protons in biomolecular NMR Cross Polarization, revisited. INEPT and HMQC based pulse sequences are widely used to transfer polarization between heteronuclei, particularly in biomolecular spectroscopy they are easy to setup and involve low power deposition. Still, these short pulse polarization transfers schemes are challenged by fast solvent chemical exchange. An alternative to improve these heteronuclear transfers is J driven cross polarization (J CP), which transfers polarization by spin locking the coupled spins under Hartmann Hahn conditions. J CP provides certain immunity against chemical exchange and other T2 like relaxation effects, a behavior that is here examined in depth by both Liouville space numerical and analytical derivations describing the transfer efficiency. While superior to INEPT based transfers, fast exchange may also slow down these J CP transfers, hurting their efficiency. This study therefore explores the potential of repeated projective operations to improve 1H 15N and 1H 15N 13C J CP transfers in the presence of fast solvent chemical exchanges. It is found that while repeating J CP provides little 1H 15N transfer advantages over a prolonged CP, multiple contacts that keep both the water and the labile protons effectively spin locked can improve 1H 15N 13C transfers in the presence of chemical exchange. The ensuing Looped, Concatenated Cross Polarization (L CCP) compensates for single J CP losses by relying on the 13C longer lifetimes, leading to a kind of algorithmic cooling that can provide high polarization for the 15N as well as carbonyl and alpha 13Cs. This can facilitate certain experiments, as demonstrated with triple resonance experiments on intrinsically disordered proteins involving labile, chemically exchanging protons.


Scaled, inexact and adaptive generalized FISTA for strongly convex optimization. We consider a variable metric and inexact version of the FISTA type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed algorithm is combined with an adaptive (non monotone) backtracking strategy, which allows for the adjustment of the algorithmic step size along the iterations in order to improve the convergence speed. We prove a linear convergence result for the function values, which depends on both the strong convexity moduli of the two functions and the upper and lower bounds on the spectrum of the variable metric operators. We validate the proposed algorithm, named Scaled Adaptive GEneralized FISTA (SAGE FISTA), on exemplar image denoising and deblurring problems where edge preserving Total Variation (TV) regularization is combined with Kullback Leibler type fidelity terms, as it is common in applications where signal dependent Poisson noise is assumed in the data.


Code switched inspired losses for generic spoken dialog representations. Spoken dialog systems need to be able to handle both multiple languages and multilinguality inside a conversation ( textit e.g in case of code switching). In this work, we introduce new pretraining losses tailored to learn multilingual spoken dialog representations. The goal of these losses is to expose the model to code switched language. To scale up training, we automatically build a pretraining corpus composed of multilingual conversations in five different languages (French, Italian, English, German and Spanish) from texttt OpenSubtitles , a huge multilingual corpus composed of 24.3G tokens. We test the generic representations on texttt MIAM , a new benchmark composed of five dialog act corpora on the same aforementioned languages as well as on two novel multilingual downstream tasks ( textit i.e multilingual mask utterance retrieval and multilingual inconsistency identification). Our experiments show that our new code switched inspired losses achieve a better performance in both monolingual and multilingual settings.


Limit pretrees for free group automorphisms existence. To any free group automorphism, we associate a real pretree with several nice properties. First, it has a rigid non nesting action of the free group. Secondly, the loxodromic elements are exactly those whose (conjugacy class) length grows exponentially under iteration of the automorphism thus, the action on the real pretree is able to detect the growth type of an element. Finally and crucially, there is an expanding pretree automorphism of the real pretree that is equivariant with respect to the free group automorphism. This construction extends the theory of metric trees that has been used to study free group automorphisms. The new idea is that one can equivariantly blow up an isometric action on a real tree with respect to other real trees and get a rigid action on a treelike structure known as a real pretree. Topology plays no role in this construction as all the work is done in the language of pretrees.


Non isomorphic 2 groups with isomorphic modular group algebras. We provide non isomorphic finite 2 groups which have isomorphic group algebras over any field of characteristic 2, thus settling the Modular Isomorphism Problem.


Electron drag force in EUV induced pulsed hydrogen plasmas. Extreme ultraviolet (EUV) induced pulsed plasma is unique due to its transient characteristics the plasma switches between non thermal state (when EUV power is ON at the beginning of the pulse) and thermal state (end of the pulse at 20 us). It is shown that although electron drag force acting on nm size particles in hydrogen plasma is negligible compared to the ion drag force at the beginning of the pulse, however it can be dominant at the end of the pulse and can play important role in particle transport leading to defectivity issues for semiconductor chip production technologies.


Visual Understanding of Complex Table Structures from Document Images. Table structure recognition is necessary for a comprehensive understanding of documents. Tables in unstructured business documents are tough to parse due to the high diversity of layouts, varying alignments of contents, and the presence of empty cells. The problem is particularly difficult because of challenges in identifying individual cells using visual or linguistic contexts or both. Accurate detection of table cells (including empty cells) simplifies structure extraction and hence, it becomes the prime focus of our work. We propose a novel object detection based deep model that captures the inherent alignments of cells within tables and is fine tuned for fast optimization. Despite accurate detection of cells, recognizing structures for dense tables may still be challenging because of difficulties in capturing long range row column dependencies in presence of multi row column spanning cells. Therefore, we also aim to improve structure recognition by deducing a novel rectilinear graph based formulation. From a semantics perspective, we highlight the significance of empty cells in a table. To take these cells into account, we suggest an enhancement to a popular evaluation criterion. Finally, we introduce a modestly sized evaluation dataset with an annotation style inspired by human cognition to encourage new approaches to the problem. Our framework improves the previous state of the art performance by a 2.7 average F1 score on benchmark datasets.


Asymptotic behavior of positive solutions of semilinear elliptic problems with increasing powers. We prove existence results of two solutions of the problem begin cases L(u) u m 1 lambda u p 1 text in Omega , quad u 0 text in Omega , quad u 0 text on partial Omega , end cases where L(v) rm div (M(x) nabla v) is a linear operator, p in (2,2 and lambda and m sufficiently large. Then their asymptotical limit as m to infty is investigated showing different behaviors.


ADNet Temporal Anomaly Detection in Surveillance Videos. Anomaly detection in surveillance videos is an important research problem in computer vision. In this paper, we propose ADNet, an anomaly detection network, which utilizes temporal convolutions to localize anomalies in videos. The model works online by accepting consecutive windows consisting of fixed number of video clips. Features extracted from video clips in a window are fed to ADNet, which allows to localize anomalies in videos effectively. We propose the AD Loss function to improve abnormal segment detection performance of ADNet. Additionally, we propose to use F1 k metric for temporal anomaly detection. F1 k is a better evaluation metric than AUC in terms of not penalizing minor shifts in temporal segments and punishing short false positive temporal segment predictions. Furthermore, we extend UCF Crime dataset by adding two more anomaly classes and providing temporal anomaly annotations for all classes. Finally, we thoroughly evaluate our model on the extended UCF Crime dataset. ADNet produces promising results with respect to F1 k metric. Dataset extensions and code will be publicly available upon publishing


Automatic Generation of Interpolants for Lattice Samplings Part I Theory and Analysis. Interpolation is a fundamental technique in scientific computing and is at the heart of many scientific visualization techniques. There is usually a trade off between the approximation capabilities of an interpolation scheme and its evaluation efficiency. For many applications, it is important for a user to be able to navigate their data in real time. In practice, the evaluation efficiency (or speed) outweighs any incremental improvements in reconstruction fidelity. In this two part work, we first analyze from a general standpoint the use of compact piece wise polynomial basis functions to efficiently interpolate data that is sampled on a lattice. In the sequel, we detail how we generate efficient implementations via automatic code generation on both CPU and GPU architectures. Specifically, in this paper, we propose a general framework that can produce a fast evaluation scheme by analyzing the algebro geometric structure of the convolution sum for a given lattice and basis function combination. We demonstrate the utility and generality of our framework by providing fast implementations of various box splines on the Body Centered and Face Centered Cubic lattices, as well as some non separable box splines on the Cartesian lattice. We also provide fast implementations for certain Voronoi splines that have not yet appeared in the literature. Finally, we demonstrate that this framework may also be used for non Cartesian lattices in 4D.


Selective Intervention Planning using Restless Multi Armed Bandits to Improve Maternal and Child Health Outcomes. India has a maternal mortality ratio of 113 and child mortality ratio of 2830 per 100,000 live births. Lack of access to preventive care information is a major contributing factor for these deaths, especially in low resource households. We partner with ARMMAN, a non profit based in India employing a call based information program to disseminate health related information to pregnant women and women with recent child deliveries. We analyze call records of over 300,000 women registered in the program created by ARMMAN and try to identify women who might not engage with these call programs that are proven to result in positive health outcomes. We built machine learning based models to predict the long term engagement pattern from call logs and beneficiaries' demographic information, and discuss the applicability of this method in the real world through a pilot validation. Through a pilot service quality improvement study, we show that using our model's predictions to make interventions boosts engagement metrics by 61.37 . We then formulate the intervention planning problem as restless multi armed bandits (RMABs), and present preliminary results using this approach.


How Great is the Great Firewall? Measuring China's DNS Censorship. The DNS filtering apparatus of China's Great Firewall (GFW) has evolved considerably over the past two decades. However, most prior studies of China's DNS filtering were performed over short time periods, leading to unnoticed changes in the GFW's behavior. In this study, we introduce GFWatch, a large scale, longitudinal measurement platform capable of testing hundreds of millions of domains daily, enabling continuous monitoring of the GFW's DNS filtering behavior. We present the results of running GFWatch over a nine month period, during which we tested an average of 411M domains per day and detected a total of 311K domains censored by GFW's DNS filter. To the best of our knowledge, this is the largest number of domains tested and censored domains discovered in the literature. We further reverse engineer regular expressions used by the GFW and find 41K innocuous domains that match these filters, resulting in overblocking of their content. We also observe bogus IPv6 and globally routable IPv4 addresses injected by the GFW, including addresses owned by US companies, such as Facebook, Dropbox, and Twitter. Using data from GFWatch, we studied the impact of GFW blocking on the global DNS system. We found 77K censored domains with DNS resource records polluted in popular public DNS resolvers, such as Google and Cloudflare. Finally, we propose strategies to detect poisoned responses that can (1) sanitize poisoned DNS records from the cache of public DNS resolvers, and (2) assist in the development of circumvention tools to bypass the GFW's DNS censorship.


Ricci curvature integrals, local functionals, and the Ricci flow. Consider a Riemannian manifold (M m , g) whose volume is the same as the standard sphere (S m , g round ) . If p frac m 2 and int M left Rc (m 1)g right p dv is sufficiently small, we show that the normalized Ricci flow initiated from (M m , g) will exist immortally and converge to the standard sphere. The choice of p is optimal.


Measure theoretic entropy of random substitution subshifts. Subshifts of deterministic substitutions are ubiquitous objects in dynamical systems. Two of their most appealing features are that they have low complexity (zero topological entropy) and are uniquely ergodic. Random substitutions are a generalisation of deterministic substitutions where the substituted image of a letter is determined by a Markov process. In stark contrast to their deterministic counterparts, subshifts of random substitution often have positive topological entropy, and support uncountably many ergodic measures, known as frequency measures. Here, we develop techniques for computing and studying the entropy of these frequency measures. As an application of our results, we obtain closed form formulas for the entropy of frequency measures for a wide range of random substitution subshifts and show that in many cases there exists a frequency measure of maximal entropy. Further, for a class of random substitution subshifts, we prove that this measure is the unique measure of maximal entropy.


Exact observability properties of subelliptic wave and Schr "o dinger equations. In this survey paper, we report on recent works concerning exact observability (and, by duality, exact controllability) properties of subelliptic wave and Schr "o dinger type equations. These results illustrate the slowdown of propagation in directions transverse to the horizontal distribution. The proofs combine sub Riemannian geometry, semi classical analysis, spectral theory and non commutative harmonic analysis.


Applying Personal Knowledge Graphs to Health. Knowledge graphs that encapsulate personal health information, or personal health knowledge graphs (PHKG), can help enable personalized health care in knowledge driven systems. In this paper we provide a short survey of existing work surrounding the emerging paradigm of PHKGs and highlight the major challenges that remain. We find that while some preliminary exploration exists on the topic of personal knowledge graphs, development of PHKGs remains under explored. A range of challenges surrounding the collection, linkage, and maintenance of personal health knowledge remains to be addressed to fully realize PHKGs.


Learning Domain Specialised Representations for Cross Lingual Biomedical Entity Linking. Injecting external domain specific knowledge (e.g., UMLS) into pretrained language models (LMs) advances their capability to handle specialised in domain tasks such as biomedical entity linking (BEL). However, such abundant expert knowledge is available only for a handful of languages (e.g., English). In this work, by proposing a novel cross lingual biomedical entity linking task (XL BEL) and establishing a new XL BEL benchmark spanning 10 typologically diverse languages, we first investigate the ability of standard knowledge agnostic as well as knowledge enhanced monolingual and multilingual LMs beyond the standard monolingual English BEL task. The scores indicate large gaps to English performance. We then address the challenge of transferring domain specific knowledge in resource rich languages to resource poor ones. To this end, we propose and evaluate a series of cross lingual transfer methods for the XL BEL task, and demonstrate that general domain bitext helps propagate the available English knowledge to languages with little to no in domain data. Remarkably, we show that our proposed domain specific transfer methods yield consistent gains across all target languages, sometimes up to 20 Precision 1 points, without any in domain knowledge in the target language, and without any in domain parallel data.


Understanding Character Recognition using Visual Explanations Derived from the Human Visual System and Deep Networks. Human observers engage in selective information uptake when classifying visual patterns. The same is true of deep neural networks, which currently constitute the best performing artificial vision systems. Our goal is to examine the congruence, or lack thereof, in the information gathering strategies of the two systems. We have operationalized our investigation as a character recognition task. We have used eye tracking to assay the spatial distribution of information hotspots for humans via fixation maps and an activation mapping technique for obtaining analogous distributions for deep networks through visualization maps. Qualitative comparison between visualization maps and fixation maps reveals an interesting correlate of congruence. The deep learning model considered similar regions in character, which humans have fixated in the case of correctly classified characters. On the other hand, when the focused regions are different for humans and deep nets, the characters are typically misclassified by the latter. Hence, we propose to use the visual fixation maps obtained from the eye tracking experiment as a supervisory input to align the model's focus on relevant character regions. We find that such supervision improves the model's performance significantly and does not require any additional parameters. This approach has the potential to find applications in diverse domains such as medical analysis and surveillance in which explainability helps to determine system fidelity.


Cycle class maps for Chow groups of zero cycles with modulus. For a quasi projective smooth scheme X of pure dimension d over a field k and an effective Cartier divisor D on X whose support is a simple normal crossing divisor, we construct a cycle class map from the Chow group of zero cycles with modulus to the top cohomology of the dth relative Milnor K sheaf.


Discrete Time Linear Quadratic Regulation via Optimal Transport. In this paper, we consider a discrete time stochastic control problem with uncertain initial and target states. We first discuss the connection between optimal transport and stochastic control problems of this form. Next, we formulate a linear quadratic regulator problem where the initial and terminal states are distributed according to specified probability densities. A closed form solution for the optimal transport map in the case of linear time varying systems is derived, along with an algorithm for computing the optimal map. Two numerical examples pertaining to swarm deployment demonstrate the practical applicability of the model, and performance of the numerical method.


The second vanishing theorem for Stanley Reisner ring and its generalization. For regular local ring, the "second vanishing theorem" or "SVT" of local cohomology has been proved in several cases. In this paper, we extend the result of the SVT to Stanley Reisner ring with an interpretation from combinatorial topology. Finally, in this context, we generalize the result of SVT.


Gait analysis with curvature maps A simulation study. Gait analysis is an important aspect of clinical investigation for detecting neurological and musculoskeletal disorders and assessing the global health of a patient. In this paper we propose to focus our attention on extracting relevant curvature information from the body surface provided by a depth camera. We assumed that the 3D mesh was made available in a previous step and demonstrated how curvature maps could be useful to assess asymmetric anomalies with two simple simulated abnormal gaits compared with a normal one. This research set the grounds for the future development of a curvature based gait analysis system for healthcare professionals.


Exercise? I thought you said 'Extra Fries' Leveraging Sentence Demarcations and Multi hop Attention for Meme Affect Analysis. Today's Internet is awash in memes as they are humorous, satirical, or ironic which make people laugh. According to a survey, 33 of social media users in age bracket 13 35 send memes every day, whereas more than 50 send every week. Some of these memes spread rapidly within a very short time frame, and their virality depends on the novelty of their (textual and visual) content. A few of them convey positive messages, such as funny or motivational quotes while others are meant to mock hurt someone's feelings through sarcastic or offensive messages. Despite the appealing nature of memes and their rapid emergence on social media, effective analysis of memes has not been adequately attempted to the extent it deserves. In this paper, we attempt to solve the same set of tasks suggested in the SemEval'20 Memotion Analysis competition. We propose a multi hop attention based deep neural network framework, called MHA MEME, whose prime objective is to leverage the spatial domain correspondence between the visual modality (an image) and various textual segments to extract fine grained feature representations for classification. We evaluate MHA MEME on the 'Memotion Analysis' dataset for all three sub tasks sentiment classification, affect classification, and affect class quantification. Our comparative study shows sota performances of MHA MEME for all three tasks compared to the top systems that participated in the competition. Unlike all the baselines which perform inconsistently across all three tasks, MHA MEME outperforms baselines in all the tasks on average. Moreover, we validate the generalization of MHA MEME on another set of manually annotated test samples and observe it to be consistent. Finally, we establish the interpretability of MHA MEME.


KEA Tuning an Exabyte Scale Data Infrastructure. Microsoft's internal big data infrastructure is one of the largest in the world with over 300k machines running billions of tasks from over 0.6M daily jobs. Operating this infrastructure is a costly and complex endeavor, and efficiency is paramount. In fact, for over 15 years, a dedicated engineering team has tuned almost every aspect of this infrastructure, achieving state of the art efficiency ( 60 average CPU utilization across all clusters). Despite rich telemetry and strong expertise, faced with evolving hardware software workloads this manual tuning approach had reached its limit we had plateaued. In this paper, we present KEA, a multi year effort to automate our tuning processes to be fully data model driven. KEA leverages a mix of domain knowledge and principled data science to capture the essence of our cluster dynamic behavior in a set of machine learning (ML) models based on collected system data. These models power automated optimization procedures for parameter tuning, and inform our leadership in critical decisions around engineering and capacity management (such as hardware and data center design, software investments, etc.). We combine "observational" tuning (i.e., using models to predict system behavior without direct experimentation) with judicious use of "flighting" (i.e., conservative testing in production). This allows us to support a broad range of applications that we discuss in this paper. KEA continuously tunes our cluster configurations and is on track to save Microsoft tens of millions of dollars per year. At the best of our knowledge, this paper is the first to discuss research challenges and practical learnings that emerge when tuning an exabyte scale data infrastructure.


AutoTriggER Named Entity Recognition with Auxiliary Trigger Extraction. Deep neural models for low resource named entity recognition (NER) have shown impressive results by leveraging distant super vision or other meta level information (e.g. explanation). However, the costs of acquiring such additional information are generally prohibitive, especially in domains where existing resources (e.g. databases to be used for distant supervision) may not exist. In this paper, we present a novel two stage framework (AutoTriggER) to improve NER performance by automatically generating and leveraging "entity triggers" which are essentially human readable clues in the text that can help guide the model to make better decisions. Thus, the framework is able to both create and leverage auxiliary supervision by itself. Through experiments on three well studied NER datasets, we show that our automatically extracted triggers are well matched to human triggers, and AutoTriggER improves performance over a RoBERTa CRFarchitecture by nearly 0.5 F1 points on average and much more in a low resource setting.


Collaborative AI Needs Stronger Assurances Driven by Risks. Collaborative AI systems (CAISs) aim at working together with humans in a shared space to achieve a common goal. This critical setting yields hazardous circumstances that could harm human beings. Thus, building such systems with strong assurances of compliance with requirements, domain specific standards and regulations is of greatest importance. Only few scale impact has been reported so far for such systems since much work remains to manage possible risks. We identify emerging problems in this context and then we report our vision, as well as the progress of our multidisciplinary research team composed of software systems, and mechatronics engineers to develop a risk driven assurance process for CAISs.


Impact of Attention on Adversarial Robustness of Image Classification Models. Adversarial attacks against deep learning models have gained significant attention and recent works have proposed explanations for the existence of adversarial examples and techniques to defend the models against these attacks. Attention in computer vision has been used to incorporate focused learning of important features and has led to improved accuracy. Recently, models with attention mechanisms have been proposed to enhance adversarial robustness. Following this context, this work aims at a general understanding of the impact of attention on adversarial robustness. This work presents a comparative study of adversarial robustness of non attention and attention based image classification models trained on CIFAR 10, CIFAR 100 and Fashion MNIST datasets under the popular white box and black box attacks. The experimental results show that the robustness of attention based models may be dependent on the datasets used i.e. the number of classes involved in the classification. In contrast to the datasets with less number of classes, attention based models are observed to show better robustness towards classification.


Generalising via Meta Examples for Continual Learning in the Wild. Future deep learning systems call for techniques that can deal with the evolving nature of temporal data and scarcity of annotations when new problems occur. As a step towards this goal, we present FUSION (Few shot UnSupervIsed cONtinual learning), a learning strategy that enables a neural network to learn quickly and continually on streams of unlabelled data and unbalanced tasks. The objective is to maximise the knowledge extracted from the unlabelled data stream (unsupervised), favor the forward transfer of previously learnt tasks and features (continual) and exploit as much as possible the supervised information when available (few shot). The core of FUSION is MEML Meta Example Meta Learning that consolidates a meta representation through the use of a self attention mechanism during a single inner loop in the meta optimisation stage. To further enhance the capability of MEML to generalise from few data, we extend it by creating various augmented surrogate tasks and by optimising over the hardest. An extensive experimental evaluation on public computer vision benchmarks shows that FUSION outperforms existing state of the art solutions both in the few shot and continual learning experimental settings.


Extending Properly n REA Sets. In 5 Soare and Stob prove that if A is an r.e. set which isn't computable then there is a set of the form A oplus W A e which isn't of r.e. Turing degree. If we define a properly n 1 REA set to be an n 1 REA set which isn't Turing equivalent to any n REA set (and identify 0 REA sets with the computable sets) this result shows that every properly 1 REA set can be extended to a properly 2 REA set. This result was extended in 1 by Cholak and Hinman who proved that every 2 REA set can be extended to a properly 3 REA set. This leads naturally to the hypothesis that every properly n REA set can be extended to a properly n 1 REA set. In this paper, we show this hypothesis is false and that there is a properly 3 REA set which can't be extended to a properly 4 REA set.


Optically reconfigurable quasi phase matching in silicon nitride microresonators. Bringing efficient second order nonlinear effects in integrated photonics is an important task motivated by the prospect of enabling all possible optical functionalities on chip. Such task has proved particularly challenging in silicon photonics, as materials best suited for photonic integration lack second order susceptibility ( chi (2) ). Methods for inducing effective chi (2) in such materials have recently opened new opportunities. Here, we present optically reconfigurable quasi phase matching in large radius Si 3 N 4 microresonators resulting in mW level on chip second harmonic generated powers. Most importantly we show that such all optical poling can occur unconstrained from intermodal phase matching, leading to widely tunable second harmonic generation. We confirm the phenomenon by two photon imaging of the inscribed chi (2) grating structures within the microresonators as well as by dynamic tracking of both the pump and second harmonic mode resonances. These results unambiguously establish that the photogalvanic effect, responsible for all optical poling, can overcome phase mismatch constraints even in resonant systems, and simultaneously allow for the combined record of output power and tunability.


Generalized Matrix Spectral Factorization with Symmetry and Applications to Symmetric Quasi Tight Framelets. Factorization of matrices of Laurent polynomials plays an important role in mathematics and engineering such as wavelet frame construction and filter bank design. Wavelet frames (a.k.a. framelets) are useful in applications such as signal and image processing. Motivated by the recent development of quasi tight framelets, we study and characterize generalized spectral factorizations with symmetry for 2 times 2 matrices of Laurent polynomials. Applying our result on generalized matrix spectral factorization, we establish a necessary and sufficient condition for the existence of symmetric quasi tight framelets with two generators. The proofs of all our main results are constructive and therefore, one can use them as construction algorithms. We provide several examples to illustrate our theoretical results on generalized matrix spectral factorization and quasi tight framelets with symmetry.


A Scalable and Reproducible System on Chip Simulation for Reinforcement Learning. Deep Reinforcement Learning (DRL) underlies in a simulated environment and optimizes objective goals. By extending the conventional interaction scheme, this paper proffers gym ds3, a scalable and reproducible open environment tailored for a high fidelity Domain Specific System on Chip (DSSoC) application. The simulation corroborates to schedule hierarchical jobs onto heterogeneous System on Chip (SoC) processors and bridges the system to reinforcement learning research. We systematically analyze the representative SoC simulator and discuss the primary challenging aspects that the system (1) continuously generates indefinite jobs at a rapid injection rate, (2) optimizes complex objectives, and (3) operates in steady state scheduling. We provide exemplary snippets and experimentally demonstrate the run time performances on different schedulers that successfully mimic results achieved from the standard DS3 framework and real world embedded systems.


Weisfeiler Leman and Graph Spectra. We devise a hierarchy of spectral graph invariants, generalising the adjacency spectra and Laplacian spectra, which are commensurate in power with the hierarchy of combinatorial graph invariants generated by the Weisfeiler Leman (WL) algorithm. More precisely, we provide a spectral characterisation of k WL indistinguishability after d iterations, for k,d in mathbb N . Most of the well known spectral graph invariants such as adjacency or Laplacian spectra lie in the regime between 1 WL and 2 WL. We show that individualising one vertex plus running 1 WL is already more powerful than all such spectral invariants in terms of their ability to distinguish non isomorphic graphs. Building on this result, we resolve an open problem of F "urer (2010) about spectral invariants and strengthen a result due to Godsil (1981) about commute distances.


Measure scaling quasi isometries. A measure scaling quasi isometry between two connected graphs is a quasi isometry that is quasi kappa to one in a natural sense for some kappa 0 . For non amenable graphs, all quasi isometries are quasi kappa to one for any kappa 0 , while for amenable ones there exists at most one possible such kappa . For an amenable graph X , we show that the set of possible kappa forms a subgroup of mathbb R 0 that we call the (measure )scaling group of X . This group is invariant under measure scaling quasi isometries. In the context of Cayley graphs, this implies for instance that two uniform lattices in a given locally compact group have same scaling groups. We compute the scaling group in a number of cases. For instance it is all of mathbb R 0 for lattices in Carnot groups, SOL or solvable Baumslag Solitar groups, but is a (strict) subgroup mathbb Q 0 for lamplighter groups over finitely presented amenable groups.


Weakly Supervised Volumetric Segmentation via Self taught Shape Denoising Model. Weakly supervised segmentation is an important problem in medical image analysis due to the high cost of pixelwise annotation. Prior methods, while often focusing on weak labels of 2D images, exploit few structural cues of volumetric medical images. To address this, we propose a novel weakly supervised segmentation strategy capable of better capturing 3D shape prior in both model prediction and learning. Our main idea is to extract a self taught shape representation by leveraging weak labels, and then integrate this representation into segmentation prediction for shape refinement. To this end, we design a deep network consisting of a segmentation module and a shape denoising module, which are trained by an iterative learning strategy. Moreover, we introduce a weak annotation scheme with a hybrid label design for volumetric images, which improves model learning without increasing the overall annotation cost. The empirical experiments show that our approach outperforms existing SOTA strategies on three organ segmentation benchmarks with distinctive shape properties. Notably, we can achieve strong performance with even 10 labeled slices, which is significantly superior to other methods.


Local invertibility and sensitivity of atomic structure feature mappings. The increasingly common applications of machine learning schemes to atomic scale simulations have triggered efforts to better understand the mathematical properties of the mapping between the Cartesian coordinates of the atoms and the variety of representations that can be used to convert them into a finite set of symmetric descriptors or features. Here, we analyze the sensitivity of the mapping to atomic displacements, showing that the combination of symmetry and smoothness leads to mappings that have singular points at which the Jacobian has one or more null singular values (besides those corresponding to infinitesimal translations and rotations). This is in fact desirable, because it enforces physical symmetry constraints on the values predicted by regression models constructed using such representations. However, besides these symmetry induced singularities, there are also spurious singular points, that we find to be linked to the incompleteness of the mapping, i.e. the fact that, for certain classes of representations, structurally distinct configurations are not guaranteed to be mapped onto different feature vectors. Additional singularities can be introduced by a too aggressive truncation of the infinite basis set that is used to discretize the representations.


Optimal Path Planning using CAMIS a Continuous Anisotropic Model for Inclined Surfaces. The optimal traverse of irregular terrains made by ground mobile robots heavily depends on the adequacy of the cost models used to plan the path they follow. The criteria to define optimality may be based on minimizing energy consumption and or preserving the robot stability. This entails the proper assessment of anisotropy to account for the robot driving on top of slopes with different directions. To fulfill this demand, this paper presents the Continuous Anisotropic Model for Inclined Surfaces, a cost model compatible with anisotropic path planners like the bi directional Ordered Upwind Method. This model acknowledges how the orientation of the robot with respect to any slope determines its energetic cost, considering the action of gravity and terramechanic effects such as the slippage. Moreover, the proposed model can be tuned to define a trade off between energy minimization and Roll angle reduction. The results from two simulation tests demonstrate how, to find the optimal path in scenarios containing slopes, in certain situations the use of this model can be more advantageous than relying on isotropic cost functions. Finally, the outcome of a field experiment involving a skid steering robot that drives on top of a real slope is also discussed.


Backward Error of Matrix Rational Function. We consider a minimal realization of a rational matrix functions. We perturb the polynomial part and one of the constant matrices from the realization part. We derive explicit computable expressions of backward errors of approximate eigenvalue of rational matrix function. We also determine minimal perturbations for which approximate eigenvalue are exact eigenvalue of the perturbed matrix rational functions.


Minimal order H(div) conforming velocity vorticity approximations for incompressible fluids. We introduce a novel minimal order hybrid Discontinuous Galerkin (HDG) and a novel mass conserving mixed stress (MCS) method for the approximation of incompressible flows. For this we employ the H( operatorname div ) conforming linear Brezzi Douglas Marini space and the lowest order Raviart Thomas space for the approximation of the velocity and the vorticity, respectively. Our methods are based on the physically correct diffusive flux nu varepsilon(u) and provide exactly divergence free discrete velocity solutions, optimal (pressure robust) error estimates and a minimal number of coupling degrees of freedom. For the stability analysis we introduce a new Korn like inequality for vector valued element wise H 1 and normal continuous functions. Numerical examples conclude the work where the theoretical findings are validated and the novel methods are compared in terms of condition numbers with respect to discrete stability parameters.


L DQN An Asynchronous Limited Memory Distributed Quasi Newton Method. This work proposes a distributed algorithm for solving empirical risk minimization problems, called L DQN, under the master worker communication model. L DQN is a distributed limited memory quasi Newton method that supports asynchronous computations among the worker nodes. Our method is efficient both in terms of storage and communication costs, i.e., in every iteration the master node and workers communicate vectors of size O(d) , where d is the dimension of the decision variable, and the amount of memory required on each node is O(md) , where m is an adjustable parameter. To our knowledge, this is the first distributed quasi Newton method with provable global linear convergence guarantees in the asynchronous setting where delays between nodes are present. Numerical experiments are provided to illustrate the theory and the practical performance of our method.


BabelCalib A Universal Approach to Calibrating Central Cameras. Existing calibration methods occasionally fail for large field of view cameras due to the non linearity of the underlying problem and the lack of good initial values for all parameters of the used camera model. This might occur because a simpler projection model is assumed in an initial step, or a poor initial guess for the internal parameters is pre defined. A lot of the difficulties of general camera calibration lie in the use of a forward projection model. We side step these challenges by first proposing a solver to calibrate the parameters in terms of a back projection model and then regress the parameters for a target forward model. These steps are incorporated in a robust estimation framework to cope with outlying detections. Extensive experiments demonstrate that our approach is very reliable and returns the most accurate calibration parameters as measured on the downstream task of absolute pose estimation on test sets. The code is released at https github.com ylochman babelcalib.


Effects of Smart Traffic Signal Control on Air Quality. Adaptive traffic signal control (ATSC) in urban traffic networks poses a challenging task due to the complicated dynamics arising in traffic systems. In recent years, several approaches based on multi agent deep reinforcement learning (MARL) have been studied experimentally. These approaches propose distributed techniques in which each signalized intersection is seen as an agent in a stochastic game whose purpose is to optimize the flow of vehicles in its vicinity. In this setting, the systems evolves towards an equilibrium among the agents that shows beneficial for the whole traffic network. A recently developed multi agent variant of the well established advantage actor critic (A2C) algorithm, called MA2C (multi agent A2C) exploits the promising idea of some communication among the agents. In this view,the agents share their strategies with other neighbor agents, thereby stabilizing the learning process even when the agents grow in number and variety. We experimented MA2C in two traffic networks located in Bologna (Italy) and found that its action translates into a significant decrease of the amount of pollutants released into the environment.


Dependence of the source deactivation factor on the earthquake magnitude. Three fundamental laws of the physics of earthquakes, bearing the names of their discoverers Omori, Gutenberg, Richter and Bath, are widely used in original, review, monographic, and encyclopedic literature. In this paper, we have tried to look at laws from an unusual point of view. The idea behind our approach is as follows. Each of the three laws was established in the course of work on solving a specific research problem, and the result was expressed in a specific mathematical form. We asked ourselves whether it is possible to modify the statement of the problem, and or modify the form of expression of the law in order to see new facets of a well known scientific statement? The result was successful in relation to Omori's law, according to which the frequency of aftershocks hyperbolically decreases over time. The modified formulation of the problem was to find a differential equation describing the time evolution of aftershocks. We found a simple differential model, within the framework of which the concept of deactivation of the earthquake source is introduced. The question of dependence of the deactivation factor on the magnitude of main shock is analyzed theoretically and experimentally. A monotonic decrease in the deactivation factor with an increase in the magnitude of the main shock has been reliably established. Other possible applications of the proposed methodological technique are considered. In particular, it is indicated how to overcome the contradiction between the Omori law and the law of energy conservation. Keywords Omori law, Gutenberg Richter law, Bath law, main shock, aftershock, deactivation factor, Omori epoch, differential equation of evolution.


Cyclist Trajectory Forecasts by Incorporation of Multi View Video Information. This article presents a novel approach to incorporate visual cues from video data from a wide angle stereo camera system mounted at an urban intersection into the forecast of cyclist trajectories. We extract features from image and optical flow (OF) sequences using 3D convolutional neural networks (3D ConvNet) and combine them with features extracted from the cyclist's past trajectory to forecast future cyclist positions. By the use of additional information, we are able to improve positional accuracy by about 7.5 for our test dataset and by up to 22 for specific motion types compared to a method solely based on past trajectories. Furthermore, we compare the use of image sequences to the use of OF sequences as additional information, showing that OF alone leads to significant improvements in positional accuracy. By training and testing our methods using a real world dataset recorded at a heavily frequented public intersection and evaluating the methods' runtimes, we demonstrate the applicability in real traffic scenarios. Our code and parts of our dataset are made publicly available.


Sidewalk Measurements from Satellite Images Preliminary Findings. Large scale analysis of pedestrian infrastructures, particularly sidewalks, is critical to human centric urban planning and design. Benefiting from the rich data set of planimetric features and high resolution orthoimages provided through the New York City Open Data portal, we train a computer vision model to detect sidewalks, roads, and buildings from remote sensing imagery and achieve 83 mIoU over held out test set. We apply shape analysis techniques to study different attributes of the extracted sidewalks. More specifically, we do a tile wise analysis of the width, angle, and curvature of sidewalks, which aside from their general impacts on walkability and accessibility of urban areas, are known to have significant roles in the mobility of wheelchair users. The preliminary results are promising, glimpsing the potential of the proposed approach to be adopted in different cities, enabling researchers and practitioners to have a more vivid picture of the pedestrian realm.


SemiFed Semi supervised Federated Learning with Consistency and Pseudo Labeling. Federated learning enables multiple clients, such as mobile phones and organizations, to collaboratively learn a shared model for prediction while protecting local data privacy. However, most recent research and applications of federated learning assume that all clients have fully labeled data, which is impractical in real world settings. In this work, we focus on a new scenario for cross silo federated learning, where data samples of each client are partially labeled. We borrow ideas from semi supervised learning methods where a large amount of unlabeled data is utilized to improve the model's accuracy despite limited access to labeled examples. We propose a new framework dubbed SemiFed that unifies two dominant approaches for semi supervised learning consistency regularization and pseudo labeling. SemiFed first applies advanced data augmentation techniques to enforce consistency regularization and then generates pseudo labels using the model's predictions during training. SemiFed takes advantage of the federation so that for a given image, the pseudo label holds only if multiple models from different clients produce a high confidence prediction and agree on the same label. Extensive experiments on two image benchmarks demonstrate the effectiveness of our approach under both homogeneous and heterogeneous data distribution settings


Improving EFX Guarantees through Rainbow Cycle Number. We study the problem of fairly allocating a set of indivisible goods among n agents with additive valuations. Envy freeness up to any good (EFX) is arguably the most compelling fairness notion in this context. However, the existence of EFX allocations has not been settled and is one of the most important problems in fair division. Towards resolving this problem, many impressive results show the existence of its relaxations, e.g., the existence of 0.618 EFX allocations, and the existence of EFX at most n 1 unallocated goods. The latter result was recently improved for three agents, in which the two unallocated goods are allocated through an involved procedure. Reducing the number of unallocated goods for arbitrary number of agents is a systematic way to settle the big question. In this paper, we develop a new approach, and show that for every varepsilon in (0,1 2 , there always exists a (1 varepsilon) EFX allocation with sublinear number of unallocated goods and high Nash welfare. For this, we reduce the EFX problem to a novel problem in extremal graph theory. We introduce the notion of rainbow cycle number R( cdot) . For all d in mathbb N , R(d) is the largest k such that there exists a k partite digraph G ( cup i in k V i, E) , in which 1) each part has at most d vertices, i.e., lvert V i rvert leq d for all i in k , 2) for any two parts V i and V j , each vertex in V i has an incoming edge from some vertex in V j and vice versa, and 3) there exists no cycle in G that contains at most one vertex from each part. We show that any upper bound on R(d) directly translates to a sublinear bound on the number of unallocated goods. We establish a polynomial upper bound on R(d) , yielding our main result. Furthermore, our approach is constructive, which also gives a polynomial time algorithm for finding such an allocation.


Playing the Blame Game with Robots. Recent research shows somewhat astonishingly that people are willing to ascribe moral blame to AI driven systems when they cause harm 1 4 . In this paper, we explore the moral psychological underpinnings of these findings. Our hypothesis was that the reason why people ascribe moral blame to AI systems is that they consider them capable of entertaining inculpating mental states (what is called mens rea in the law). To explore this hypothesis, we created a scenario in which an AI system runs a risk of poisoning people by using a novel type of fertilizer. Manipulating the computational (or quasi cognitive) abilities of the AI system in a between subjects design, we tested whether people's willingness to ascribe knowledge of a substantial risk of harm (i.e., recklessness) and blame to the AI system. Furthermore, we investigated whether the ascription of recklessness and blame to the AI system would influence the perceived blameworthiness of the system's user (or owner). In an experiment with 347 participants, we found (i) that people are willing to ascribe blame to AI systems in contexts of recklessness, (ii) that blame ascriptions depend strongly on the willingness to attribute recklessness and (iii) that the latter, in turn, depends on the perceived "cognitive" capacities of the system. Furthermore, our results suggest (iv) that the higher the computational sophistication of the AI system, the more blame is shifted from the human user to the AI system.


Cross polarized surface lattice resonances in a rectangular lattice plasmonic metasurface. Multiresonant metasurfaces could enable many applications in filtering, sensing and nonlinear optics. However, developing a metasurface with more than one high quality factor or high Q resonance at designated resonant wavelengths is challenging. Here, we experimentally demonstrate a plasmonic metasurface exhibiting different, narrow surface lattice resonances by exploiting the polarization degree of freedom where different lattice modes propagate along different dimensions of the lattice. The surface consists of aluminum nanostructures in a rectangular periodic lattice. The resulting surface lattice resonances were measured around 630 nm and 1160 nm with Q factors of 50 and 800, respectively. The latter is a record high plasmonic Q factor within the near infrared type II window. Such metasurfaces could benefit applications such as frequency conversion and all optical switching.


Text Searching Allowing for Non Overlapping Adjacent Unbalanced Translocations. In this paper we investigate the emph approximate string matching problem when the allowed edit operations are emph non overlapping unbalanced translocations of adjacent factors . Such kind of edit operations take place when two adjacent sub strings of the text swap, resulting in a modified string. The two involved substrings are allowed to be of different lengths. Such large scale modifications on strings have various applications. They are among the most frequent chromosomal alterations, accounted for 30 of all losses of heterozygosity, a major genetic event causing inactivation of cancer suppressor genes. In addition, among other applications, they are frequent modifications accounted in musical or in natural language information retrieval. However, despite of their central role in so many fields of text processing, little attention has been devoted to the problem of matching strings allowing for this kind of edit operation. In this paper we present three algorithms for solving the problem, all of them with a bigO(nm 3) worst case and a bigO(m 2) space complexity, where m and n are the length of the pattern and of the text, respectively. In particular, our first algorithm is based on the dynamic programming approach. Our second solution improves the previous one by making use of the Directed Acyclic Word Graph of the pattern. Finally our third algorithm is based on an alignment procedure. We also show that under the assumptions of equiprobability and independence of characters, our second algorithm has a bigO(n log 2 sigma m) average time complexity, for an alphabet of size sigma geq 4 .


Superdensity and super micro uniformity in non integrable flat systems. We show that on any non integrable finite polysquare translation surface, superdensity, an optimal form of time quantitative density, leads to an optimal form of time quantitative uniformity that we call super micro uniformity.


The photothermal nonlinearity in plasmon assisted photocatalysis. Understanding the intricate relation between illumination and temperature in metallic nano particles is crucial for elucidating the role of illumination in various physical processes which rely on plasmonic enhancement but are also sensitive to temperature. Recent studies have shown that the temperature rise in optically thick ensembles of metal nanoparticles under intense illumination is dominated by the thermal conductivity of the host, rather than by the optical properties of the metal or the host. Here, we show that the temperature dependence of the thermal conductivity of the host dominates the nonlinear photothermal response of these systems. In particular, this dependence typically causes the temperature rise to become strongly sublinear, reaching even several tens of percent. We then show that this can explain experimental observations in several recent plasmon assisted photocatalysis experiments. This shows that any claim for dominance of non thermal electrons in plasmon assisted photocatalysis must account first for this photothermal nonlinear mechanism.


SHORING Design Provable Conditional High Order Interaction Network via Symbolic Testing. Deep learning provides a promising way to extract effective representations from raw data in an end to end fashion and has proven its effectiveness in various domains such as computer vision, natural language processing, etc. However, in domains such as content product recommendation and risk management, where sequence of event data is the most used raw data form and experts derived features are more commonly used, deep learning models struggle to dominate the game. In this paper, we propose a symbolic testing framework that helps to answer the question of what kinds of expert derived features could be learned by a neural network. Inspired by this testing framework, we introduce an efficient architecture named SHORING, which contains two components textit event network and textit sequence network . The textit event network learns arbitrarily yet efficiently high order textit event level embeddings via a provable reparameterization trick, the textit sequence network aggregates from sequence of textit event level embeddings. We argue that SHORING is capable of learning certain standard symbolic expressions which the standard multi head self attention network fails to learn, and conduct comprehensive experiments and ablation studies on four synthetic datasets and three real world datasets. The results show that SHORING empirically outperforms the state of the art methods.


Chevron pattern equations exponential attractor and global stabilization. The initial boundary value problem for a nonlinear system of equations modeling the chevron patterns is studied in one and two spatial dimensions. The existence of an exponential attractor and the stabilization of the zero steady state solution through application of a finite dimensional feedback control is proved in two spatial dimensions. The stabilization of an arbitrary fixed solution is shown in one spatial dimension along with relevant numerical results.


A Role Selected Sharing Network for Joint Machine Human Chatting Handoff and Service Satisfaction Analysis. Chatbot is increasingly thriving in different domains, however, because of unexpected discourse complexity and training data sparseness, its potential distrust hatches vital apprehension. Recently, Machine Human Chatting Handoff (MHCH), predicting chatbot failure and enabling human algorithm collaboration to enhance chatbot quality, has attracted increasing attention from industry and academia. In this study, we propose a novel model, Role Selected Sharing Network (RSSN), which integrates both dialogue satisfaction estimation and handoff prediction in one multi task learning framework. Unlike prior efforts in dialog mining, by utilizing local user satisfaction as a bridge, global satisfaction detector and handoff predictor can effectively exchange critical information. Specifically, we decouple the relation and interaction between the two tasks by the role information after the shared encoder. Extensive experiments on two public datasets demonstrate the effectiveness of our model.


Norm inequalities for the spectral spread of Hermitian operators. In this work we introduce a new measure of dispersion of the eigenvalues of a Hermitian (self adjoint) compact operator, that we call spectral spread. Then, we obtain several inequalities for unitarily invariant norms involving the spectral spread of self adjoint compact operators, that are related with Bhatia Davis's and Corach Porta Recht's work on Arithmetic Geometric mean inequalities, Zhan's inequality for the difference of positive compact operators, Tao's inequalities for anti diagonal blocks of positive compact operators and Kittaneh's commutator inequalities for positive operators.


CoinPrune Shrinking Bitcoin's Blockchain Retrospectively. Popular cryptocurrencies continue to face serious scalability issues due to their ever growing blockchains. Thus, modern blockchain designs began to prune old blocks and rely on recent snapshots for their bootstrapping processes instead. Unfortunately, established systems are often considered incapable of adopting these improvements. In this work, we present CoinPrune, our block pruning scheme with full Bitcoin compatibility, to revise this popular belief. CoinPrune bootstraps joining nodes via snapshots that are periodically created from Bitcoin's set of unspent transaction outputs (UTXO set). Our scheme establishes trust in these snapshots by relying on CoinPrune supporting miners to mutually reaffirm a snapshot's correctness on the blockchain. This way, snapshots remain trustworthy even if adversaries attempt to tamper with them. Our scheme maintains its retrospective deployability by relying on positive feedback only, i.e., blocks containing invalid reaffirmations are not rejected, but invalid reaffirmations are outpaced by the benign ones created by an honest majority among CoinPrune supporting miners. Already today, CoinPrune reduces the storage requirements for Bitcoin nodes by two orders of magnitude, as joining nodes need to fetch and process only 6 GiB instead of 271 GiB of data in our evaluation, reducing the synchronization time of powerful devices from currently 7 h to 51 min, with even larger potential drops for less powerful devices. CoinPrune is further aware of higher level application data, i.e., it conserves otherwise pruned application data and allows nodes to obfuscate objectionable and potentially illegal blockchain content from their UTXO set and the snapshots they distribute.


Near Optimal Spanners for General Graphs in (Nearly) Linear Time. Let G (V,E,w) be a weighted undirected graph on V n vertices and E m edges, let k ge 1 be any integer, and let epsilon 1 be any parameter. We present the following results on fast constructions of spanners with near optimal sparsity and lightness, which culminate a long line of work in this area. (By near optimal we mean optimal under Erd H o s' girth conjecture and disregarding the epsilon dependencies.) There are (deterministic) algorithms for constructing (2k 1)(1 epsilon) spanners for G with a near optimal sparsity of O(n 1 k log(1 epsilon) epsilon)) . The first algorithm can be implemented in the pointer machine model within time O(m alpha(m,n) log(1 epsilon) epsilon) SORT(m)) , where alpha( , ) is the two parameter inverse Ackermann function and SORT(m) is the time needed to sort m integers. The second algorithm can be implemented in the WORD RAM model within time O(m log(1 epsilon) epsilon)) . There is a (deterministic) algorithm for constructing a (2k 1)(1 epsilon) spanner for G that achieves a near optimal bound of O(n 1 k mathrm poly (1 epsilon)) on both sparsity and lightness. This algorithm can be implemented in the pointer machine model within time O(m alpha(m,n) mathrm poly (1 epsilon) SORT(m)) and in the WORD RAM model within time O(m alpha(m,n) mathrm poly (1 epsilon)) . The previous fastest constructions of (2k 1)(1 epsilon) spanners with near optimal sparsity incur a runtime of is O( min m(n 1 1 k ) n log n,k n 2 1 k ) , even regardless of the lightness. Importantly, the greedy spanner for stretch 2k 1 has sparsity O(n 1 k ) with no epsilon dependence whatsoever, but its runtime is O(m(n 1 1 k n log n)) . Moreover, the state of the art lightness bound of any (2k 1) spanner is poor, even regardless of the sparsity and runtime.


Pyramid Transform of Manifold Data via Subdivision Operators. Multiscale transforms have become a key ingredient in many data processing tasks. With technological development, we observe a growing demand for methods to cope with non linear data structures such as manifold values. In this paper, we propose a multiscale approach for analyzing manifold valued data using a pyramid transform. The transform uses a unique class of downsampling operators that enable a non interpolating subdivision schemes as upsampling operators. We describe this construction in detail and present its analytical properties, including stability and coefficient decay. Next, we numerically demonstrate the results and show the application of our method to denoising and anomaly detection.


Russian Troll Account Classification with Twitter and Facebook Data. In this analysis, we work with the data set that was compiled by Darren Linvill and Patrick Warren, along with a representative sample of Facebook ads that were released by the House Intelligence Committee Minority. The goal of this analysis is to use the categories defined by Linvill and Warren in the Twitter data and investigate if these categories exist in Facebook ads. This begin to give us insights to the tactics used between the two social media services. Further, we try to replicate Linvill and Warren's original categorization of the Twitter data. Lastly, we investigate what categories may exist in the Facebook data.


On a realization of motion and similarity group equivalence classes of labeled points in mathbb R k with applications to computer vision. We study a realization of motion and similarity group equivalence classes of n geq 1 labeled points in mathbb R k, , k geq 1 as a metric space with a computable metric. Our study is motivated by applications in computer vision.


Analyzing Curriculum Learning for Sentiment Analysis along Task Difficulty, Pacing and Visualization Axes. While Curriculum Learning (CL) has recently gained traction in Natural language Processing Tasks, it is still not adequately analyzed. Previous works only show their effectiveness but fail short to explain and interpret the internal workings fully. In this paper, we analyze curriculum learning in sentiment analysis along multiple axes. Some of these axes have been proposed by earlier works that need more in depth study. Such analysis requires understanding where curriculum learning works and where it does not. Our axes of analysis include Task difficulty on CL, comparing CL pacing techniques, and qualitative analysis by visualizing the movement of attention scores in the model as curriculum phases progress. We find that curriculum learning works best for difficult tasks and may even lead to a decrement in performance for tasks with higher performance without curriculum learning. We see that One Pass curriculum strategies suffer from catastrophic forgetting and attention movement visualization within curriculum pacing. This shows that curriculum learning breaks down the challenging main task into easier sub tasks solved sequentially.


Sparse Oblique Decision Trees A Tool to Understand and Manipulate Neural Net Features. The widespread deployment of deep nets in practical applications has lead to a growing desire to understand how and why such black box methods perform prediction. Much work has focused on understanding what part of the input pattern (an image, say) is responsible for a particular class being predicted, and how the input may be manipulated to predict a different class. We focus instead on understanding which of the internal features computed by the neural net are responsible for a particular class. We achieve this by mimicking part of the neural net with an oblique decision tree having sparse weight vectors at the decision nodes. Using the recently proposed Tree Alternating Optimization (TAO) algorithm, we are able to learn trees that are both highly accurate and interpretable. Such trees can faithfully mimic the part of the neural net they replaced, and hence they can provide insights into the deep net black box. Further, we show we can easily manipulate the neural net features in order to make the net predict, or not predict, a given class, thus showing that it is possible to carry out adversarial attacks at the level of the features. These insights and manipulations apply globally to the entire training and test set, not just at a local (single instance) level. We demonstrate this robustly in the MNIST and ImageNet datasets with LeNet5 and VGG networks.


A local C 2 Hermite interpolation scheme with PH quintic splines for 3D data streams. The construction of smooth spatial paths with Pythagorean hodograph (PH) quintic spline biarcs is proposed. To facilitate real time computations of C 2 PH quintic splines, an efficient local data stream interpolation algorithm is introduced. Each spline segment interpolates second and first order Hermite data at the initial and final end point, respectively. In the spline extension of the scheme a C 2 smooth connection between successive spline segments is obtained by taking the locally required second order derivative information from the previous segment. Consequently, the data stream spline interpolant is globally C 2 continuous and can be constructed for arbitrary C 1 Hermite data configurations. A simple and effective selection of the free parameters that arise in the interpolation problem is proposed. The developed theoretical analysis proves the fourth approximation order of the local scheme while a selection of numerical examples confirms the same accuracy of its spline extension. In addition, the performances of the algorithm are also validated by considering its application to point stream interpolation with automatically generated first order derivative information.


Single Event Transient Fault Analysis of ELEPHANT cipher. In this paper, we propose a novel fault attack termed as Single Event Transient Fault Analysis (SETFA) attack, which is well suited for hardware implementations. The proposed approach pinpoints hotspots in the cypher's Sbox combinational logic circuit that significantly reduce the key entropy when subjected to faults. ELEPHANT is a parallel authenticated encryption and associated data (AEAD) scheme targeted to hardware implementations, a finalist in the Lightweight cryptography (LWC) competition launched by NIST. In this work, we investigate vulnerabilities of ELEPHANT against fault analysis. We observe that the use of 128 bit random nonce makes it resistant against many cryptanalysis techniques like differential, linear, etc., and their variants. However, the relaxed nature of Statistical Fault Analysis (SFA) methods makes them widely applicable in restrictive environments. We propose a SETFA based key recovery attack on Elephant. We performed Single experiments with random plaintexts and keys, on Dumbo, a Sponge based instance of the Elephant AEAD scheme. Our proposed approach could recover the secret key in 85 250 ciphertexts. In essence, this work investigates new vulnerabilities towards fault analysis that may require to be addressed to ensure secure computations and communications in IoT scenarios.


A Machine Assisted Proof of G "odel's Incompleteness Theorems for the Theory of Hereditarily Finite Sets. A formalisation of G "odel's incompleteness theorems using the Isabelle proof assistant is described. This is apparently the first mechanical verification of the second incompleteness theorem. The work closely follows 'S wierczkowski (2003), who gave a detailed proof using hereditarily finite set theory. The adoption of this theory is generally beneficial, but it poses certain technical issues that do not arise for Peano arithmetic. The formalisation itself should be useful to logicians, particularly concerning the second incompleteness theorem, where existing proofs are lacking in detail.


Scalable and Modular Robustness Analysis of Deep Neural Networks. As neural networks are trained to be deeper and larger, the scalability of neural network analyzers is urgently required. The main technical insight of our method is modularly analyzing neural networks by segmenting a network into blocks and conduct the analysis for each block. In particular, we propose the network block summarization technique to capture the behaviors within a network block using a block summary and leverage the summary to speed up the analysis process. We instantiate our method in the context of a CPU version of the state of the art analyzer DeepPoly and name our system as Bounded Block Poly (BBPoly). We evaluate BBPoly extensively on various experiment settings. The experimental result indicates that our method yields comparable precision as DeepPoly but runs faster and requires less computational resources. For example, BBPoly can analyze really large neural networks like SkipNet or ResNet which contain up to one million neurons in less than around 1 hour per input image, while DeepPoly needs to spend even 40 hours to analyze one image.


Attaining the exponent 5 4 for the sum product problem in finite fields. We improve the exponent in the finite field sum product problem from 11 9 to 5 4 , improving the results of Rudnev, Shakan and Shkredov. That is, we show that if A subset mathbb F p has cardinality A ll p 1 2 then max A pm A , AA gtrsim A frac54 and max A pm A , A A gtrsim A frac54 ,.


On the representation of the natural numbers by powers of the golden mean. In a base phi representation a natural number is written as a sum of powers of the golden mean varphi . There are many ways to do this. Well known is the standard representation, introduced by George Bergman in 1957, where a unique representation is obtained by requiring that no consecutive powers varphi n and varphi n 1 do occur in the representation. In this paper we introduce a new representation by allowing that the powers varphi 0 and varphi 1 may occur at the same time, but no other consecutive powers. We then argue that this representation is much closer to the classical representation of the natural numbers by powers of an integer than Bergman's standard representation.


MultiPath Efficient Information Fusion and Trajectory Aggregation for Behavior Prediction. Predicting the future behavior of road users is one of the most challenging and important problems in autonomous driving. Applying deep learning to this problem requires fusing heterogeneous world state in the form of rich perception signals and map information, and inferring highly multi modal distributions over possible futures. In this paper, we present MultiPath , a future prediction model that achieves state of the art performance on popular benchmarks. MultiPath improves the MultiPath architecture by revisiting many design choices. The first key design difference is a departure from dense image based encoding of the input world state in favor of a sparse encoding of heterogeneous scene elements MultiPath consumes compact and efficient polylines to describe road features, and raw agent state information directly (e.g., position, velocity, acceleration). We propose a context aware fusion of these elements and develop a reusable multi context gating fusion component. Second, we reconsider the choice of pre defined, static anchors, and develop a way to learn latent anchor embeddings end to end in the model. Lastly, we explore ensembling and output aggregation techniques common in other ML domains and find effective variants for our probabilistic multimodal output representation. We perform an extensive ablation on these design choices, and show that our proposed model achieves state of the art performance on the Argoverse Motion Forecasting Competition and the Waymo Open Dataset Motion Prediction Challenge.


Stratifying the space of barcodes using Coxeter complexes. We use tools from geometric group theory to produce a stratification of the space mathcal B n of barcodes with n bars. The top dimensional strata are indexed by permutations associated to barcodes as defined by Kanari, Garin and Hess. More generally, the strata correspond to marked double cosets of parabolic subgroups of the symmetric group Sym n . This subdivides mathcal B n into regions that consist of barcodes with the same averages and standard deviations of birth and death times and the same permutation type. We obtain coordinates that form a new invariant of barcodes, extending the one of Kanari Garin Hess. This description also gives rise to metrics on mathcal B n that coincide with modified versions of the bottleneck and Wasserstein metrics.


Boosting Transferability of Targeted Adversarial Examples via Hierarchical Generative Networks. Transfer based adversarial attacks can effectively evaluate model robustness in the black box setting. Though several methods have demonstrated impressive transferability of untargeted adversarial examples, targeted adversarial transferability is still challenging. The existing methods either have low targeted transferability or sacrifice computational efficiency. In this paper, we develop a simple yet practical framework to efficiently craft targeted transfer based adversarial examples. Specifically, we propose a conditional generative attacking model, which can generate the adversarial examples targeted at different classes by simply altering the class embedding and share a single backbone. Extensive experiments demonstrate that our method improves the success rates of targeted black box attacks by a significant margin over the existing methods it reaches an average success rate of 29.6 against six diverse models based only on one substitute white box model in the standard testing of NeurIPS 2017 competition, which outperforms the state of the art gradient based attack methods (with an average success rate of 2 ) by a large margin. Moreover, the proposed method is also more efficient beyond an order of magnitude than gradient based methods.


IoT Virtualization with ML based Information Extraction. For IoT to reach its full potential, the sharing and reuse of information in different applications and across verticals is of paramount importance. However, there are a plethora of IoT platforms using different representations, protocols and interaction patterns. To address this issue, the Fed4IoT project has developed an IoT virtualization platform that, on the one hand, integrates information from many different source platforms and, on the other hand, makes the information required by the respective users available in the target platform of choice. To enable this, information is translated into a common, neutral exchange format. The format of choice is NGSI LD, which is being standardized by the ETSI Industry Specification Group on Context Information Management (ETSI ISG CIM). Thing Visors are the components that translate the source information to NGSI LD, which is then delivered to the target platform and translated into the target format. ThingVisors can be implemented by hand, but this requires significant human effort, especially considering the heterogeneity of low level information produced by a multitude of sensors. Thus, supporting the human developer and, ideally, fully automating the process of extracting and enriching data and translating it to NGSI LD is a crucial step. Machine learning is a promising approach for this, but it typically requires large amounts of hand labelled data for training, an effort that makes it unrealistic in many IoT scenarios. A programmatic labelling approach called knowledge infusion that encodes expert knowledge is used for matching a schema or ontology extracted from the data with a target schema or ontology, providing the basis for annotating the data and facilitating the translation to NGSI LD.


Symbolic Regression by Exhaustive Search Reducing the Search Space Using Syntactical Constraints and Efficient Semantic Structure Deduplication. Symbolic regression is a powerful system identification technique in industrial scenarios where no prior knowledge on model structure is available. Such scenarios often require specific model properties such as interpretability, robustness, trustworthiness and plausibility, that are not easily achievable using standard approaches like genetic programming for symbolic regression. In this chapter we introduce a deterministic symbolic regression algorithm specifically designed to address these issues. The algorithm uses a context free grammar to produce models that are parameterized by a non linear least squares local optimization procedure. A finite enumeration of all possible models is guaranteed by structural restrictions as well as a caching mechanism for detecting semantically equivalent solutions. Enumeration order is established via heuristics designed to improve search efficiency. Empirical tests on a comprehensive benchmark suite show that our approach is competitive with genetic programming in many noiseless problems while maintaining desirable properties such as simple, reliable models and reproducibility.


Off Diagonal Two Weight Bumps for Fractional Sparse Operators. In this paper, we continue some recent work on two weight boundedness of sparse operators to the "off diagonal" setting. We use the new "entropy bumps" introduced in by Treil Volberg ( 21 ) and improved by Lacey Spencer ( 9 ) and the "direct comparison bumps" introduced by Rahm Spencer ( 19 ) and improved by Lerner ( 10 ). Our results are "sharp" in the sense that they are sharp in various particular cases. A feature is that given the current machinery, the proofs are almost trivial.


SASICM A Multi Task Benchmark For Subtext Recognition. Subtext is a kind of deep semantics which can be acquired after one or more rounds of expression transformation. As a popular way of expressing one's intentions, it is well worth studying. In this paper, we try to make computers understand whether there is a subtext by means of machine learning. We build a Chinese dataset whose source data comes from the popular social media (e.g. Weibo, Netease Music, Zhihu, and Bilibili). In addition, we also build a baseline model called SASICM to deal with subtext recognition. The F1 score of SASICMg, whose pretrained model is GloVe, is as high as 64.37 , which is 3.97 higher than that of BERT based model, 12.7 higher than that of traditional methods on average, including support vector machine, logistic regression classifier, maximum entropy classifier, naive bayes classifier and decision tree and 2.39 higher than that of the state of the art, including MARIN and BTM. The F1 score of SASICMBERT, whose pretrained model is BERT, is 65.12 , which is 0.75 higher than that of SASICMg. The accuracy rates of SASICMg and SASICMBERT are 71.16 and 70.76 , respectively, which can compete with those of other methods which are mentioned before.


Accelerated Steady State Electrostatic Particle in Cell Simulation of Langmuir Probes. First principles particle in cell (PIC) simulation is a powerful tool for understanding plasma behavior, but this power often comes at great computational expense. Artificially reducing the ion electron mass ratio is a time honored practice to reduce simulation costs. Usually, this is a severe approximation. However, for steady state collisionless, electrostatic (Vlasov Poisson) systems, the solution with reduced mass ratio can be scaled to the solution for the real mass ratio, with no approximation. This 'scaled mass' method, which works with already existing PIC codes, can reduce the computation time for a large class of electrostatic PIC simulations by the square root of the mass ratio. The particle distributions of the resulting steady state must be trivially rescaled to yield the true distributions, but the self consistent electrostatic field is independent of the mass ratio. This method is equivalent to 'numerical timestepping,' an approach that evolves electron and ion populations with different timesteps. Numerical timestepping can be viewed as a special case of the speed limited PIC (SLPIC) method, which is not restricted to steady state phenomena. Although the scaled mass approach is simplest, numerical timestepping and SLPIC more easily generalize to include other effects, such as collisions. The equivalence of these new approaches is demonstrated by applying them to simulate a cylindrical Langmuir probe in electron argon plasma, speeding up simulation by two orders of magnitude. Methods such as SLPIC can therefore play an invaluable role in interpreting probe measurements by including geometric effects, collisions, secondary emission, and non Maxwellian distributions.


The Threat of Offensive AI to Organizations. AI has provided us with the ability to automate tasks, extract information from vast amounts of data, and synthesize media that is nearly indistinguishable from the real thing. However, positive tools can also be used for negative purposes. In particular, cyber adversaries can use AI (such as machine learning) to enhance their attacks and expand their campaigns. Although offensive AI has been discussed in the past, there is a need to analyze and understand the threat in the context of organizations. For example, how does an AI capable adversary impact the cyber kill chain? Does AI benefit the attacker more than the defender? What are the most significant AI threats facing organizations today and what will be their impact on the future? In this survey, we explore the threat of offensive AI on organizations. First, we present the background and discuss how AI changes the adversary's methods, strategies, goals, and overall attack model. Then, through a literature review, we identify 33 offensive AI capabilities which adversaries can use to enhance their attacks. Finally, through a user study spanning industry and academia, we rank the AI threats and provide insights on the adversaries.


Convergence of a class of fully non linear parabolic equations on Hermitian manifolds. We consider a class of fully non linear parabolic equations on compact Hermitian manifolds involving symmetric functions of partial Laplacians. Under fairly general assumptions, we show the long time existence and convergence of solutions. We also derive a Harnack inequality for the linearized equation which is used in the proof of convergence.


Searching by Generating Flexible and Efficient One Shot NAS with Architecture Generator. In one shot NAS, sub networks need to be searched from the supernet to meet different hardware constraints. However, the search cost is high and N times of searches are needed for N different constraints. In this work, we propose a novel search strategy called architecture generator to search sub networks by generating them, so that the search process can be much more efficient and flexible. With the trained architecture generator, given target hardware constraints as the input, N good architectures can be generated for N constraints by just one forward pass without re searching and supernet retraining. Moreover, we propose a novel single path supernet, called unified supernet, to further improve search efficiency and reduce GPU memory consumption of the architecture generator. With the architecture generator and the unified supernet, we propose a flexible and efficient one shot NAS framework, called Searching by Generating NAS (SGNAS). With the pre trained supernt, the search time of SGNAS for N different hardware constraints is only 5 GPU hours, which is 4N times faster than previous SOTA single path methods. After training from scratch, the top1 accuracy of SGNAS on ImageNet is 77.1 , which is comparable with the SOTAs. The code is available at https github.com eric8607242 SGNAS.


Laplace Beltrami spectrum of ellipsoids that are close to spheres and analytic perturbation theory. We study the spectrum of the Laplace Beltrami operator on ellipsoids. For ellipsoids that are close to the sphere, we use analytic perturbation theory to estimate the eigenvalues up to two orders. We show that for biaxial ellipsoids sufficiently close to the sphere, the first N eigenvalues have multiplicity at most two, and characterize those that are simple. For the triaxial ellipsoids sufficiently close to the sphere that are not biaxial, we show that at least the first sixteen eigenvalues are all simple. We also give the results of various numerical experiments, including comparisons to our results from the analytic perturbation theory, and approximations for the eigenvalues of ellipsoids that degenerate into infinite cylinders or two dimensional disks. We propose a conjecture on the exact number of nodal domains of near sphere ellipsoids.


Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation. In this paper, we tackle the problem of novel visual category discovery, i.e., grouping unlabelled images from new classes into different semantic partitions by leveraging a labelled dataset that contains images from other different but relevant categories. This is a more realistic and challenging setting than conventional semi supervised learning. We propose a two branch learning framework for this problem, with one branch focusing on local part level information and the other branch focusing on overall characteristics. To transfer knowledge from the labelled data to the unlabelled, we propose using dual ranking statistics on both branches to generate pseudo labels for training on the unlabelled data. We further introduce a mutual knowledge distillation method to allow information exchange and encourage agreement between the two branches for discovering new categories, allowing our model to enjoy the benefits of global and local features. We comprehensively evaluate our method on public benchmarks for generic object classification, as well as the more challenging datasets for fine grained visual recognition, achieving state of the art performance.


Kim independence in positive logic. An important dividing line in the class of unstable theories is being NSOP 1 , which is more general than being simple. In NSOP 1 theories forking independence may not be as well behaved as in stable or simple theories, so it is replaced by another independence notion, called Kim independence. We generalise Kim independence over models in NSOP 1 theories to positive logic a proper generalisation of first order logic where negation is not built in, but can be added as desired. For example, an important application is that we can add hyperimaginary sorts to a positive theory to get another positive theory, preserving NSOP 1 and various other properties. We prove that, in a thick positive NSOP 1 theory, Kim independence over existentially closed models has all the nice properties that it is known to have in a first order NSOP 1 theory. We also provide a Kim Pillay style theorem, characterising which thick positive theories are NSOP 1 by the existence of a certain independence relation. Furthermore, this independence relation must then be the same as Kim independence. Thickness is the mild assumption that being an indiscernible sequence is type definable. In first order logic Kim independence is defined in terms of Morley sequences in global invariant types. These may not exist in thick positive theories. We solve this by working with Morley sequences in global Lascar invariant types, which do exist in thick positive theories. We also simplify certain tree constructions that were used in the study of Kim independence in first order theories. In particular, we only work with trees of finite height.


Singular McKean Vlasov SDEs Well Posedness, Regularities and Wangs Harnack Inequality. The well posedness and regularity estimates in initial distributions are derived for singular McKean Vlasov SDEs, where the drift contains a locally standard integrable term and a superlinear term in the spatial variable, and is Lipchitz continuous in the distribution variable with respect to a weighted variation distance. When the superlinear term is strengthened to be Lipschitz continuous, Wangs Harnack inequality is established. These results are new also for the classical Ito SDEs where the coefficients are distribution independent.


INTERN A New Learning Paradigm Towards General Vision. Enormous waves of technological innovations over the past several years, marked by the advances in AI technologies, are profoundly reshaping the industry and the society. However, down the road, a key challenge awaits us, that is, our capability of meeting rapidly growing scenario specific demands is severely limited by the cost of acquiring a commensurate amount of training data. This difficult situation is in essence due to limitations of the mainstream learning paradigm we need to train a new model for each new scenario, based on a large quantity of well annotated data and commonly from scratch. In tackling this fundamental problem, we move beyond and develop a new learning paradigm named INTERN. By learning with supervisory signals from multiple sources in multiple stages, the model being trained will develop strong generalizability. We evaluate our model on 26 well known datasets that cover four categories of tasks in computer vision. In most cases, our models, adapted with only 10 of the training data in the target domain, outperform the counterparts trained with the full set of data, often by a significant margin. This is an important step towards a promising prospect where such a model with general vision capability can dramatically reduce our reliance on data, thus expediting the adoption of AI technologies. Furthermore, revolving around our new paradigm, we also introduce a new data system, a new architecture, and a new benchmark, which, together, form a general vision ecosystem to support its future development in an open and inclusive manner. See project website at https opengvlab.shlab.org.cn .


NP DRAW A Non Parametric Structured Latent Variable Model for Image Generation. In this paper, we present a non parametric structured latent variable model for image generation, called NP DRAW, which sequentially draws on a latent canvas in a part by part fashion and then decodes the image from the canvas. Our key contributions are as follows. 1) We propose a non parametric prior distribution over the appearance of image parts so that the latent variable what to draw'' per step becomes a categorical random variable. This improves the expressiveness and greatly eases the learning compared to Gaussians used in the literature. 2) We model the sequential dependency structure of parts via a Transformer, which is more powerful and easier to train compared to RNNs used in the literature. 3) We propose an effective heuristic parsing algorithm to pre train the prior. Experiments on MNIST, Omniglot, CIFAR 10, and CelebA show that our method significantly outperforms previous structured image models like DRAW and AIR and is competitive to other generic generative models. Moreover, we show that our model's inherent compositionality and interpretability bring significant benefits in the low data learning regime and latent space editing. Code is available at https github.com ZENGXH NPDRAW.


A surgical dataset from the da Vinci Research Kit for task automation and recognition. The use of datasets is getting more relevance in surgical robotics since they can be used to recognise and automate tasks. Also, this allows to use common datasets to compare different algorithms and methods. The objective of this work is to provide a complete dataset of three common training surgical tasks that surgeons perform to improve their skills. For this purpose, 12 subjects teleoperated the da Vinci Research Kit to perform these tasks. The obtained dataset includes all the kinematics and dynamics information provided by the da Vinci robot (both master and slave side) together with the associated video from the camera. All the information has been carefully timestamped and provided in a readable csv format. A MATLAB interface integrated with ROS for using and replicating the data is also provided.