A comparative analysis of local network similarity measurements application to author citation networks. Understanding the evolution of paper and author citations is of paramount importance for the design of research policies and evaluation criteria that can promote and accelerate scientific discoveries. Recently many studies on the evolution of science have been conducted in the context of the emergent science of science field. While many studies have probed the link problem in citation networks, only a few works have analyzed the temporal nature of link prediction in author citation networks. In this study we compared the performance of 10 well known local network similarity measurements to predict future links in author citations networks. Differently from traditional link prediction methods, the temporal nature of the predict links is relevant for our approach. Our analysis revealed interesting results. The Jaccard coefficient was found to be among the most relevant measurements. The preferential attachment measurement, conversely, displayed the worst performance. We also found that the extension of local measurements to their weighted version do not significantly improved the performance of predicting citations. Finally, we also found that a neural network approach summarizing the information from all 10 considered similarity measurements was not able to provide the highest prediction performance.


Positive definite functions of noncommuting contractions, Hua Bellman matrices, and a new distance metric. We study positive definite functions on noncommuting strict contractions. In particular, we study functions that induce positive definite Hua Bellman matrices (i.e., matrices of the form det(I A i A j) alpha ij where A i and A j are strict contractions and alpha in mathbb C ). We start by revisiting a 1959 work of citeauthor bellman1959 (R. Bellman emph Representation theorems and inequalities for Hermitian matrices Duke Mathematical J., 26(3), 1959) that studies Hua Bellman matrices and claims a strengthening of citeauthor hua1955 's representation theoretic results on their positive definiteness (L. K. Hua, emph Inequalities involving determinants Acta Mathematica Sinica, 5(1955), pp. 463 470). We uncover a critical error in Bellman's proof that has surprisingly escaped notice to date. We "fix" this error and provide conditions under which det(I A B) alpha is a positive definite function our conditions correct Bellman's claim and subsume both Bellman's and Hua's prior results. Subsequently, we build on our result and introduce a new hyperbolic like geometry on noncommuting contractions, and remark on its potential applications.


Asymptotic genealogies for a class of generalized Wright Fisher models. We study a class of Cannings models with population size N having a mixed multinomial offspring distribution with random success probabilities W 1, ldots,W N induced by independent and identically distributed positive random variables X 1,X 2, ldots via W i X i S N , i in 1, ldots,N , where S N X 1 cdots X N . The ancestral lineages are hence based on a sampling with replacement strategy from a random partition of the unit interval into N subintervals of lengths W 1, ldots,W N . Convergence results for the genealogy of these Cannings models are provided under regularly varying assumptions on the tail distribution of X 1 . In the limit several coalescent processes with multiple and simultaneous multiple collisions occur. The results extend those obtained by Huillet (2014) for the case when X 1 is Pareto distributed and complement those obtained by Schweinsberg (2003) for models where one samples without replacement from a supercritical branching process.


Enhance Multimodal Model Performance with Data Augmentation Facebook Hateful Meme Challenge Solution. Hateful content detection is one of the areas where deep learning can and should make a significant difference. The Hateful Memes Challenge from Facebook helps fulfill such potential by challenging the contestants to detect hateful speech in multi modal memes using deep learning algorithms. In this paper, we utilize multi modal, pre trained models VilBERT and Visual BERT. We improved models' performance by adding training datasets generated from data augmentation. Enlarging the training data set helped us get a more than 2 boost in terms of AUROC with the Visual BERT model. Our approach achieved 0.7439 AUROC along with an accuracy of 0.7037 on the challenge's test set, which revealed remarkable progress.


Assigning Confidence to Molecular Property Prediction. Introduction Computational modeling has rapidly advanced over the last decades, especially to predict molecular properties for chemistry, material science and drug design. Recently, machine learning techniques have emerged as a powerful and cost effective strategy to learn from existing datasets and perform predictions on unseen molecules. Accordingly, the explosive rise of data driven techniques raises an important question What confidence can be assigned to molecular property predictions and what techniques can be used for that purpose? Areas covered In this work, we discuss popular strategies for predicting molecular properties relevant to drug design, their corresponding uncertainty sources and methods to quantify uncertainty and confidence. First, our considerations for assessing confidence begin with dataset bias and size, data driven property prediction and feature design. Next, we discuss property simulation via molecular docking, and free energy simulations of binding affinity in detail. Lastly, we investigate how these uncertainties propagate to generative models, as they are usually coupled with property predictors. Expert opinion Computational techniques are paramount to reduce the prohibitive cost and timing of brute force experimentation when exploring the enormous chemical space. We believe that assessing uncertainty in property prediction models is essential whenever closed loop drug design campaigns relying on high throughput virtual screening are deployed. Accordingly, considering sources of uncertainty leads to better informed experimental validations, more reliable predictions and to more realistic expectations of the entire workflow. Overall, this increases confidence in the predictions and designs and, ultimately, accelerates drug design.


Laser Doppler holography of the anterior segment for blood flow imaging, eye tracking, and transparency assessment. Laser Doppler holography (LDH) is a full field blood flow imaging technique able to reveal human retinal and choroidal blood flow with high temporal resolution. We here report on using LDH in the anterior segment of the eye without making changes to the instrument. Blood flow in the bulbar conjunctiva and episclera as well as in corneal neovascularization can be effectively imaged. We additionally demonstrate simultaneous holographic imaging of the anterior and posterior segments by simply adapting the numerical propagation distance to the plane of interest. We used this feature to track the movements of the retina and pupil with high temporal resolution. Finally, we show that the light backscattered by the retina can be used for retro illumination of the anterior segment. Hence digital holography can reveal opacities caused by absorption or diffusion in the cornea and eye lens.


Analysing Wideband Absorbance Immittance in Normal and Ears with Otitis Media with Effusion Using Machine Learning. Wideband Absorbance Immittance (WAI) has been available for more than a decade, however its clinical use still faces the challenges of limited understanding and poor interpretation of WAI results. This study aimed to develop Machine Learning (ML) tools to identify the WAI absorbance characteristics across different frequency pressure regions in the normal middle ear and ears with otitis media with effusion (OME) to enable diagnosis of middle ear conditions automatically. Data analysis including pre processing of the WAI data, statistical analysis and classification model development, together with key regions extraction from the 2D frequency pressure WAI images are conducted in this study. Our experimental results show that ML tools appear to hold great potential for the automated diagnosis of middle ear diseases from WAI data. The identified key regions in the WAI provide guidance to practitioners to better understand and interpret WAI data and offer the prospect of quick and accurate diagnostic decisions.


The relative Riemann Hurwitz formula. For any nonconstant f,g in C(x) such that the numerator H(x,y) of f(x) g(y) is irreducible, we compute the genus of the normalization of the curve H(x,y) 0. We also prove an analogous formula in arbitrary characteristic when f and g have no common wildly ramified branch points, and generalize to (possibly reducible) fiber products of nonconstant morphisms of curves f A D and g B D.


Geometrical compactifications of geodesic flows and path structures. In this paper, we construct a geometrical compactification of the geodesic flow of non compact complete hyperbolic surfaces Sigma without cusps having finitely generated fundamental group. We study the dynamical properties of the compactified flow, for which we show the existence of attractive circles at infinity. The geometric structure of mathrm T 1 Sigma for which this compactification is realized is the pair of one dimensional distributions tangent to the stable and unstable horocyles of mathrm T 1 Sigma . This is a Kleinian path structure, that is a quotient of an open subset of the flag space by a discrete subgroup Gamma of mathrm PGL 3( mathbb R ) . Our study relies on a detailed description of the dynamics of mathrm PGL 3( mathbb R ) on the flag space, and on the construction of an explicit fundamental domain for the action of Gamma on its maximal open subset of discontinuity in the flag space.


Hamiltonicity of 3 tough (K 2 cup 3K 1) free graphs. Chv ' a tal conjectured in 1973 the existence of some constant t such that all t tough graphs with at least three vertices are hamiltonian. While the conjecture has been proven for some special classes of graphs, it remains open in general. We say that a graph is (K 2 cup 3K 1) free if it contains no induced subgraph isomorphic to K 2 cup 3K 1 , where K 2 cup 3K 1 is the disjoint union of an edge and three isolated vertices. In this paper, we show that every 3 tough (K 2 cup 3K 1) free graph with at least three vertices is hamiltonian.


Multimodal Semi Supervised Learning for 3D Objects. In recent years, semi supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper explores how the coherence of different modelities of 3D data (e.g. point cloud, image, and mesh) can be used to improve data efficiency for both 3D classification and retrieval tasks. We propose a novel multimodal semi supervised learning framework by introducing instance level consistency constraint and a novel multimodal contrastive prototype (M2CP) loss. The instance level consistency enforces the network to generate consistent representations for multimodal data of the same object regardless of its modality. The M2CP maintains a multimodal prototype for each class and learns features with small intra class variations by minimizing the feature distance of each object to its prototype while maximizing the distance to the others. Our proposed framework significantly outperforms all the state of the art counterparts for both classification and retrieval tasks by a large margin on the modelNet10 and ModelNet40 datasets.


Phage antibiotic synergy inhibited by temperate and chronic virus competition. As antibiotic resistance grows more frequent for common bacterial infections, alternative treatment strategies such as phage therapy have become more widely studied in the medical field. While many studies have explored the efficacy of antibiotics, phage therapy, or synergistic combinations of phages and antibiotics, the impact of virus competition on the efficacy of antibiotic treatment has not yet been considered. Here, we model the synergy between antibiotics and two viral types, temperate and chronic, in controlling bacterial infections. We demonstrate that while combinations of antibiotic and temperate viruses exhibit synergy, competition between temperate and chronic viruses inhibits bacterial control with antibiotics. In fact, our model reveals that antibiotic treatment may counterintuitively increase the bacterial load when a large fraction of the bacteria develop antibiotic resistance.


Predictive Geological Mapping with Convolution Neural Network Using Statistical Data Augmentation on a 3D Model. Airborne magnetic data are commonly used to produce preliminary geological maps. Machine learning has the potential to partly fulfill this task rapidly and objectively, as geological mapping is comparable to a semantic segmentation problem. Because this method requires a high quality dataset, we developed a data augmentation workflow that uses a 3D geological and magnetic susceptibility model as input. The workflow uses soft constrained Multi Point Statistics, to create many synthetic 3D geological models, and Sequential Gaussian Simulation algorithms, to populate the models with the appropriate magnetic distribution. Then, forward modeling is used to compute the airborne magnetic responses of the synthetic models, which are associated with their counterpart surficial lithologies. A Gated Shape Convolutional Neural Network algorithm was trained on a generated synthetic dataset to perform geological mapping of airborne magnetic data and detect lithological contacts. The algorithm also provides attention maps highlighting the structures at different scales, and clustering was applied to its high level features to do a semi supervised segmentation of the area. The validation conducted on a portion of the synthetic dataset and data from adjacent areas shows that the methodology is suitable to segment the surficial geology using airborne magnetic data. Especially, the clustering shows a good segmentation of the magnetic anomalies into a pertinent geological map. Moreover, the first attention map isolates the structures at low scales and shows a pertinent representation of the original data. Thus, our method can be used to produce preliminary geological maps of good quality and new representations of any area where a geological and petrophysical 3D model exists, or in areas sharing the same geological context, using airborne magnetic data only.


A closed form approximation for pricing geometric Istanbul options. The Istanbul options were first introduced by Michel Jacques in 1997. These derivatives are considered as an extension of the Asian options. In this paper, we propose an analytical approximation formula for a geometric Istanbul call option (GIC) under the Black Scholes model. Our approximate pricing formula is obtained in closed form using a second order Taylor expansion. We compare our theoretical results with those of Monte Carlo simulations using the control variates method. Finally, we study the effects of changes in the price of the underlying asset on the value of GIC.


Second Moment Closure Modeling and DNS of Stratified Shear Layers. Buoyant shear layers are encountered in many engineering and environmental applications and have been studied by researchers in the context of experiments and modeling for decades. Often, these flows have high Reynolds and Richardson numbers, and this leads to significant intractable space time resolution requirements for DNS or LES modeling. On the other hand, many of the important physical mechanisms in these systems, such as stress anisotropy, wake stabilization, and regime transition, inherently render eddy viscosity based RANS modeling inappropriate. Accordingly, we pursue second moment closure (SMC), i.e., full Reynolds stress flux variance modeling, for moderate Reynolds number non stratified and stratified shear layers for which DNS is possible. A range of sub model complexity is pursued for the diffusion of stresses, density fluxes and variance, pressure strain and scrambling, and dissipation. These sub models are evaluated in terms of how well they are represented by DNS in comparison to the exact Reynolds averaged terms, and how well they impact the accuracy of the full RANS closure. For the non stratified case, the SMC model predicts the shear layer growth rate and Reynolds shear stress profiles accurately. Stress anisotropy and budgets are captured only qualitatively. Comparing DNS of exact and modeled terms, inconsistencies in model performance and assumptions are observed, including inaccurate prediction of individual statistics, non negligible pressure diffusion, and dissipation anisotropy. For the stratified case, shear layer and gradient Richardson number growth rates, and stress, flux, and variance decay rates, are captured with less accuracy than corresponding flow parameters in the non stratified case. These studies lead to several recommendations for model improvement.


A Note on Squares in Binary Words. We consider words over a binary alphabet. A word w is overlap free if it does not have factors (blocks of consecutive letters) of the form uvuvu for nonempty u . Let M(w) denote the number of positions that are middle positions of squares in w . We show that for overlap free binary words, 2M(w) le w 3 , and that there are infinitely many overlap free binary words for which 2M(w) w 3 .


Well posedness for a stochastic Camassa Holm type equation with higher order nonlinearities. This paper aims at studying a generalized Camassa Holm equation under random perturbation. We establish a local well posedness result in the sense of Hadamard, i.e., existence, uniqueness and continuous dependence on initial data, as well as blow up criteria for pathwise solutions in the Sobolev spaces H s with s 3 2 for two cases, i.e., x in R and x in T ( R 2 pi Z) . The analysis on continuous dependence on initial data for nonlinear stochastic partial differential equations has gained less attention in the literature so far. In this work, we first show that the solution map is continuous. Then we introduce a notion of stability of exiting times. We provide an example showing that one cannot improve the stability of the exiting time and simultaneously improve the continuity of the dependence on initial data. Finally, we analyze the regularization effect of nonlinear noise in preventing blow up. Precisely, we demonstrate that global existence holds true almost surely provided that the noise is strong enough.


A finite volume coupled level set and volume of fluid method with a mass conservation step for simulating two phase flows. This paper presents a finite volume method for simulating two phase flows using a level set approach coupled with volume of fluid method capable of simulating sharp fluid interfaces. The efficiency of the method is a result of the fact that the interface is calculated in order to satisfy mass conservation with no explicit interface reconstruction step and the mass fluxes across cell faces are corrected to respect the recovered volume fraction. The mass conservation correction step proposed here, is utilised using an iterative algorithm which solves a reaction diffusion equation for the mass correction of the level set. The re sharpened volume fraction is used for the new volumetric fluxes at each cell which are calculated through the proposed algorithm that guarantees that they satisfy mass conservation. The algorithm is not limited in representing the interface with the 0.5 contour and is applicable for arbitrary polyhedral cells. Good accuracy and mass conservation are achieved when compared to other conservative approaches.


Backward stochastic Volterra integral equations with time delayed generators. In this paper, we study backward stochastic Volterra integral equations of type I with time delayed generators. Under some condition (small time horizon or a Lipschitz constant), we derive an existence and uniqueness results. Next, with the help of two examples of this BSVIEs we provide this condition is necessary. However, for special class of delayed generators, the previous existence and uniqueness result hold for an arbitrary time horizon and Lipschitz constant. We end this paper by establishing under an additive assumptions, a path continuity property.


Machine learning attack on copy detection patterns are 1x1 patterns cloneable?. Nowadays, the modern economy critically requires reliable yet cheap protection solutions against product counterfeiting for the mass market. Copy detection patterns (CDP) are considered as such solution in several applications. It is assumed that being printed at the maximum achievable limit of a printing resolution of an industrial printer with the smallest symbol size 1x1 elements, the CDP cannot be copied with sufficient accuracy and thus are unclonable. In this paper, we challenge this hypothesis and consider a copy attack against the CDP based on machine learning. The experimental based on samples produced on two industrial printers demonstrate that simple detection metrics used in the CDP authentication cannot reliably distinguish the original CDP from their fakes. Thus, the paper calls for a need of careful reconsideration of CDP cloneability and search for new authentication techniques and CDP optimization because of the current attack.


Minimizing network bandwidth under latency constraints The single node case. Datacenters have become a significant source of traffic, much of which is carried over private networks. The operators of those networks commonly have access to detailed traffic profiles and performance goals, which they seek to meet as efficiently as possible. Of interest are solutions for offering latency guarantees while minimizing the required network bandwidth. Of particular interest is the extent to which traffic (re)shaping can be of benefit. The paper focuses on the most basic network configuration, namely, a single node, single link network, with extensions to more general, multi node networks discussed in a companion paper. The main results are in the form of optimal solutions for different types of schedulers of varying complexity, and therefore cost. The results demonstrate how judicious traffic shaping can help lower complexity schedulers reduce the bandwidth they require, often performing as well as more complex ones.


Evaluating Deep Learning in SystemML using Layer wise Adaptive Rate Scaling(LARS) Optimizer. Increasing the batch size of a deep learning model is a challenging task. Although it might help in utilizing full available system memory during training phase of a model, it results in significant loss of test accuracy most often. LARS solved this issue by introducing an adaptive learning rate for each layer of a deep learning model. However, there are doubts on how popular distributed machine learning systems such as SystemML or MLlib will perform with this optimizer. In this work, we apply LARS optimizer to a deep learning model implemented using SystemML.We perform experiments with various batch sizes and compare the performance of LARS optimizer with textit Stochastic Gradient Descent . Our experimental results show that LARS optimizer performs significantly better than Stochastic Gradient Descent for large batch sizes even with the distributed machine learning framework, SystemML.


CloudPred Predicting Patient Phenotypes From Single cell RNA seq. Single cell RNA sequencing (scRNA seq) has the potential to provide powerful, high resolution signatures to inform disease prognosis and precision medicine. This paper takes an important first step towards this goal by developing an interpretable machine learning algorithm, CloudPred, to predict individuals' disease phenotypes from their scRNA seq data. Predicting phenotype from scRNA seq is challenging for standard machine learning methods the number of cells measured can vary by orders of magnitude across individuals and the cell populations are also highly heterogeneous. Typical analysis creates pseudo bulk samples which are biased toward prior annotations and also lose the single cell resolution. CloudPred addresses these challenges via a novel end to end differentiable learning algorithm which is coupled with a biologically informed mixture of cell types model. CloudPred automatically infers the cell subpopulation that are salient for the phenotype without prior annotations. We developed a systematic simulation platform to evaluate the performance of CloudPred and several alternative methods we propose, and find that CloudPred outperforms the alternative methods across several settings. We further validated CloudPred on a real scRNA seq dataset of 142 lupus patients and controls. CloudPred achieves AUROC of 0.98 while identifying a specific subpopulation of CD4 T cells whose presence is highly indicative of lupus. CloudPred is a powerful new framework to predict clinical phenotypes from scRNA seq data and to identify relevant cells.


SCEHR Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Records. Contrastive learning has demonstrated promising performance in image and text domains either in a self supervised or a supervised manner. In this work, we extend the supervised contrastive learning framework to clinical risk prediction problems based on longitudinal electronic health records (EHR). We propose a general supervised contrastive loss mathcal L text Contrastive Cross Entropy lambda mathcal L text Supervised Contrastive Regularizer for learning both binary classification (e.g. in hospital mortality prediction) and multi label classification (e.g. phenotyping) in a unified framework. Our supervised contrastive loss practices the key idea of contrastive learning, namely, pulling similar samples closer and pushing dissimilar ones apart from each other, simultaneously by its two components mathcal L text Contrastive Cross Entropy tries to contrast samples with learned anchors which represent positive and negative clusters, and mathcal L text Supervised Contrastive Regularizer tries to contrast samples with each other according to their supervised labels. We propose two versions of the above supervised contrastive loss and our experiments on real world EHR data demonstrate that our proposed loss functions show benefits in improving the performance of strong baselines and even state of the art models on benchmarking tasks for clinical risk predictions. Our loss functions work well with extremely imbalanced data which are common for clinical risk prediction problems. Our loss functions can be easily used to replace (binary or multi label) cross entropy loss adopted in existing clinical predictive models. The Pytorch code is released at url https github.com calvin zcx SCEHR .


BuRNN Buffer Region Neural Network Approach for Polarizable Embedding Neural Network Molecular Mechanics Simulations. Hybrid quantum mechanics molecular mechanics (QM MM) simulations have advanced the field of computational chemistry tremendously. However, they require the partitioning of a system into two different regions that are treated at different levels of theory, which can cause artefacts at the interface. Furthermore, they are still limited by high computational costs of quantum chemical calculations. In this work, we develop BuRNN, an alternative approach to existing QM MM schemes, which introduces a buffer region that experiences full electronic polarization by the inner QM region to minimize artefacts. The interactions between the QM and the buffer region are described by deep neural networks (NNs), which leads to high computational efficiency of this hybrid NN MM scheme while retaining quantum chemical accuracy. We demonstrate the BuRNN approach by performing NN MM simulations of the hexa aqua iron complex.


CT block a novel local and global features extractor for point cloud. Deep learning on the point cloud is increasingly developing. Grouping the point with its neighbors and conducting convolution like operation on them can learn the local feature of the point cloud, but this method is weak to extract the long distance global feature. Performing the attention based transformer on the whole point cloud can effectively learn the global feature of it, but this method is hardly to extract the local detailed feature. In this paper, we propose a novel module that can simultaneously extract and fuse local and global features, which is named as CT block. The CT block is composed of two branches, where the letter C represents the convolution branch and the letter T represents the transformer branch. The convolution branch performs convolution on the grouped neighbor points to extract the local feature. Meanwhile, the transformer branch performs offset attention process on the whole point cloud to extract the global feature. Through the bridge constructed by the feature transmission element in the CT block, the local and global features guide each other during learning and are fused effectively. We apply the CT block to construct point cloud classification and segmentation networks, and evaluate the performance of them by several public datasets. The experimental results show that, because the features learned by CT block are much expressive, the performance of the networks constructed by the CT block on the point cloud classification and segmentation tasks achieve state of the art.


LeViT UNet Make Faster Encoders with Transformer for Medical Image Segmentation. Medical image segmentation plays an essential role in developing computer assisted diagnosis and therapy systems, yet still faces many challenges. In the past few years, the popular encoder decoder architectures based on CNNs (e.g., U Net) have been successfully applied in the task of medical image segmentation. However, due to the locality of convolution operations, they demonstrate limitations in learning global context and long range spatial relations. Recently, several researchers try to introduce transformers to both the encoder and decoder components with promising results, but the efficiency requires further improvement due to the high computational complexity of transformers. In this paper, we propose LeViT UNet, which integrates a LeViT Transformer module into the U Net architecture, for fast and accurate medical image segmentation. Specifically, we use LeViT as the encoder of the LeViT UNet, which better trades off the accuracy and efficiency of the Transformer block. Moreover, multi scale feature maps from transformer blocks and convolutional blocks of LeViT are passed into the decoder via skip connection, which can effectively reuse the spatial information of the feature maps. Our experiments indicate that the proposed LeViT UNet achieves better performance comparing to various competing methods on several challenging medical image segmentation benchmarks including Synapse and ACDC. Code and models will be publicly available at https github.com apple1986 LeViT UNet.


Formulae for two variable Green functions. Based on results of Digne Michel Lehrer (2003) we give two formulae for two variable Green functions attached to Lusztig induction in a finite reductive group. We present applications to explicit computation of these Green functions, to conjectures of Malle and Rotilio, and to scalar products between Lusztig inductions of Gelfand Graev characters.


Zeus Locality aware Distributed Transactions. State of the art distributed in memory datastores (FaRM, FaSST, DrTM) provide strongly consistent distributed transactions with high performance and availability. Transactions in those systems are fully general they can atomically manipulate any set of objects in the store, regardless of their location. To achieve this, these systems use complex distributed transactional protocols. Meanwhile, many workloads have a high degree of locality. For such workloads, distributed transactions are an overkill as most operations only access objects located on the same server if sharded appropriately. In this paper, we show that for these workloads, a single node transactional protocol combined with dynamic object re sharding and asynchronously pipelined replication can provide the same level of generality with better performance, simpler protocols, and lower developer effort. We present Zeus, an in memory distributed datastore that provides general transactions by acquiring all objects involved in the transaction to the same server and executing a single node transaction on them. Zeus is fault tolerant and strongly consistent. At the heart of Zeus is a reliable dynamic object sharding protocol that can move 250K objects per second per server, allowing Zeus to process millions of transactions per second and outperform more traditional distributed transactions on a wide range of workloads that exhibit locality.


Physics Constrained Flow Neural Network for Short Timescale Predictions in Data Communications Networks. Machine learning is gaining growing momentum in various recent models for the dynamic analysis of information flows in data communications networks. These preliminary models often rely on off the shelf learning models to predict from historical statistics while disregarding the physics governing the generating behaviors of these flows. This paper instead introduces Flow Neural Network (FlowNN) to improve the feature representation with learned physical bias. This is implemented by an induction layer, working upon the embedding layer, to impose the physics connected data correlations, and a self supervised learning strategy with stop gradient to make the learned physics universal. For the short timescale network prediction tasks, FlowNN achieves 17 71 of loss decrease than the state of the art baselines on both synthetic and real world networking datasets, which shows the strength of this new approach. Code will be made available.


Adaptive projected SOR algorithms for nonnegative quadratic programming. The optimal value of the projected successive overrelaxation (PSOR) method for nonnegative quadratic programming problems is problem dependent. We present a novel adaptive PSOR algorithm that adaptively controls the relaxation parameter using the Wolfe conditions. The method and its variants can be applied to various problems without requiring a specific assumption regarding the matrix defining the objective function, and the cost for updating the parameter is negligible in the whole iteration. Numerical experiments show that the proposed methods often perform comparably to (or sometimes superior to) the PSOR method with a nearly optimal relaxation parameter.


Poisson groupoids and moduli spaces of flat bundles over surfaces. Let Sigma be a compact connected and oriented surface with nonempty boundary and let G be a Lie group equipped with a bi invariant pseudo Riemannian metric. The moduli space of flat principal G bundles over Sigma which are trivialized at a finite subset of partial Sigma carries a natural quasi Hamiltonian structure which was introduced by Li Bland and Severa. By a suitable restriction of the holonomy over partial Sigma and of the gauge action, which is called a decoration of partial Sigma , it is possible to obtain a number of interesting Poisson structures as subquotients of this family of quasi Hamiltonian structures. In this work we use this quasi Hamiltonian structure to construct Poisson and symplectic groupoids in a systematic fashion by means of two observations (1) gluing two copies of the same decorated surface along suitable subspaces of their boundaries determines a groupoid structure on the moduli space associated to the new surface, this procedure can be iterated by gluing four copies of the same surface, thereby inducing a double Poisson groupoid structure (2) on the other hand, we can suppose that G is a Lie 2 group, then the groupoid structure on G descends to a groupoid structure on the moduli space of flat G bundles over Sigma . These two observations can be combined to produce up to three distinct and compatible groupoid structures on the associated moduli spaces. We illustrate these methods by considering symplectic groupoids over Bruhat cells, twisted moduli spaces and Poisson 2 groups besides the classical examples.


On the mathrm H 4 configuration of points in mathbb P 3 . In the present note we give an example of a finite set of points in mathbb P 3 which has the so called geproci property, but it is neither a grid nor a half grid. This answers a question on the existence of such sets rised by Pokora, Szemberg and Szpond arXiv 2010.08863 .


SinSpell A Comprehensive Spelling Checker for Sinhala. We have built SinSpell, a comprehensive spelling checker for the Sinhala language which is spoken by over 16 million people, mainly in Sri Lanka. However, until recently, Sinhala had no spelling checker with acceptable coverage. Sinspell is still the only open source Sinhala spelling checker. SinSpell identifies possible spelling errors and suggests corrections. It also contains a module which auto corrects evident errors. To maintain accuracy, SinSpell was designed as a rule based system based on Hunspell. A set of words was compiled from several sources and verified. These were divided into morphological classes, and the valid roots, suffixes and prefixes for each class were identified, together with lists of irregular words and exceptions. The errors in a corpus of Sinhala documents were analysed and commonly misspelled words and types of common errors were identified. We found that the most common errors were in vowel length and similar sounding letters. Errors due to incorrect typing and encoding were also found. This analysis was used to develop the suggestion generator and auto corrector.


Comparison of Traditional and Hybrid Time Series Models for Forecasting COVID 19 Cases. Time series forecasting methods play critical role in estimating the spread of an epidemic. The coronavirus outbreak of December 2019 has already infected millions all over the world and continues to spread on. Just when the curve of the outbreak had started to flatten, many countries have again started to witness a rise in cases which is now being referred as the 2nd wave of the pandemic. A thorough analysis of time series forecasting models is therefore required to equip state authorities and health officials with immediate strategies for future times. This aims of the study are three fold (a) To model the overall trend of the spread (b) To generate a short term forecast of 10 days in countries with the highest incidence of confirmed cases (USA, India and Brazil) (c) To quantitatively determine the algorithm that is best suited for precise modelling of the linear and non linear features of the time series. The comparison of forecasting models for the total cumulative cases of each country is carried out by comparing the reported data and the predicted value, and then ranking the algorithms (Prophet, Holt Winters, LSTM, ARIMA, and ARIMA NARNN) based on their RMSE, MAE and MAPE values. The hybrid combination of ARIMA and NARNN (Nonlinear Auto Regression Neural Network) gave the best result among the selected models with a reduced RMSE, which proved to be almost 35.3 better than one of the most prevalent method of time series prediction (ARIMA). The results demonstrated the efficacy of the hybrid implementation of the ARIMA NARNN model over other forecasting methods such as Prophet, Holt Winters, LSTM, and the ARIMA model in encapsulating the linear as well as non linear patterns of the epidemical datasets.


Composite Re Ranking for Efficient Document Search with BERT. Although considerable efforts have been devoted to transformer based ranking models for document search, the relevance efficiency tradeoff remains a critical problem for ad hoc ranking. To overcome this challenge, this paper presents BECR (BERT based Composite Re Ranking), a composite re ranking scheme that combines deep contextual token interactions and traditional lexical term matching features. In particular, BECR exploits a token encoding mechanism to decompose the query representations into pre computable uni grams and skip n grams. By applying token encoding on top of a dual encoder architecture, BECR separates the attentions between a query and a document while capturing the contextual semantics of a query. In contrast to previous approaches, this framework does not perform expensive BERT computations during online inference. Thus, it is significantly faster, yet still able to achieve high competitiveness in ad hoc ranking relevance. Finally, an in depth comparison between BECR and other start of the art neural ranking baselines is described using the TREC datasets, thereby further demonstrating the enhanced relevance and efficiency of BECR.


Interpretable Distance Metric Learning for Handwritten Chinese Character Recognition. Handwriting recognition is of crucial importance to both Human Computer Interaction (HCI) and paperwork digitization. In the general field of Optical Character Recognition (OCR), handwritten Chinese character recognition faces tremendous challenges due to the enormously large character sets and the amazing diversity of writing styles. Learning an appropriate distance metric to measure the difference between data inputs is the foundation of accurate handwritten character recognition. Existing distance metric learning approaches either produce unacceptable error rates, or provide little interpretability in the results. In this paper, we propose an interpretable distance metric learning approach for handwritten Chinese character recognition. The learned metric is a linear combination of intelligible base metrics, and thus provides meaningful insights to ordinary users. Our experimental results on a benchmark dataset demonstrate the superior efficiency, accuracy and interpretability of our proposed approach.


Solid Phase Recrystallization and Dopant Activation in Arsenic Ion Implanted Silicon On Insulator by UV Laser Annealing. UV laser annealing (UV LA) enables surface localized high temperature thermal processing to form abrupt junctions in emerging monolithically stacked devices, where applicable thermal budget is restricted. In this work, UV LA is performed to regrow a SOI layer partially amorphized by arsenic ion implantation and to activate the dopants. In a microsecond scale ( 10 6 s to 10 5 s) UV LA process, monocrystalline solid phase recrystallization and dopant activation without junction deepening is evidenced, thus opening various applications in low thermal budget integration flows.


Common hypercyclic algebras for families of products of backward shifts. In this paper, we generalize to the context of algebras some recent results on the existence of common hypercyclic vectors for families of products of backward shift operators. We also give, in a multi dimensional setting, a positive answer to a question raised by F. Bayart, D. Papathanasiou and the author about the existence of a common hypercyclic algebra on ell 1( mathbb N ) with the convolution product for the family of backward shifts (B w( lambda) ) lambda 0 induced by the weights w n( lambda) 1 lambda n .


Finite Sigma Rickart modules. In this article, we study the notion of a finite Sigma Rickart module, as a module theoretic analogue of a right semi hereditary ring. A module M is called emph finite Sigma Rickart if every finite direct sum of copies of M is a Rickart module. It is shown that any direct summand and any direct sum of copies of a finite Sigma Rickart module are finite Sigma Rickart modules. We also provide generalizations in a module theoretic setting of the most common results of semi hereditary rings. Also, we have a characterization of a finite Sigma Rickart module in terms of its endomorphism ring. In addition, we introduce M coherent modules and provide a characterization of finite Sigma Rickart modules in terms of M coherent modules. At the end, we study when Sigma Rickart modules and finite Sigma Rickart modules coincide. Examples which delineate the concepts and results are provided.


Tactile Image to Image Disentanglement of Contact Geometry from Motion Induced Shear. Robotic touch, particularly when using soft optical tactile sensors, suffers from distortion caused by motion dependent shear. The manner in which the sensor contacts a stimulus is entangled with the tactile information about the geometry of the stimulus. In this work, we propose a supervised convolutional deep neural network model that learns to disentangle, in the latent space, the components of sensor deformations caused by contact geometry from those due to sliding induced shear. The approach is validated by reconstructing unsheared tactile images from sheared images and showing they match unsheared tactile images collected with no sliding motion. In addition, the unsheared tactile images give a faithful reconstruction of the contact geometry that is not possible from the sheared data, and robust estimation of the contact pose that can be used for servo control sliding around various 2D shapes. Finally, the contact geometry reconstruction in conjunction with servo control sliding were used for faithful full object reconstruction of various 2D shapes. The methods have broad applicability to deep learning models for robots with a shear sensitive sense of touch.


physics.optics physics.ao-ph physics.comp-ph physics.flu-dyn

Optical funnel to guide and focus virus particles for X ray laser imaging. The need for precise manipulation of nanoparticles in gaseous or near vacuum environments is encountered in many studies that include aerosol morphology, nanodroplet physics, nanoscale optomechanics, and biomolecular physics. Photophoretic forces, whereby momentum exchange between a particle and surrounding gas is induced with optical light, were recently shown to be a robust means of trapping and manipulating nanoparticles in air. We previously proposed a photophoretic "optical funnel" concept for the delivery of bioparticles to the focus of an x ray free electron laser (XFEL) beam for femtosecond x ray diffractive imaging. Here, we describe the formation of a high aspect ratio optical funnel and provide a first experimental demonstration of this concept by transversely compressing and concentrating a high speed beam of aerosolized viruses by a factor of three in a low pressure environment. These results pave the way toward improved sample delivery efficiency for XFEL imaging experiments as well as other forms of imaging and spectroscopy.


Wildfire smoke plume segmentation using geostationary satellite imagery. Wildfires have increased in frequency and severity over the past two decades, especially in the Western United States. Beyond physical infrastructure damage caused by these wildfire events, researchers have increasingly identified harmful impacts of particulate matter generated by wildfire smoke on respiratory, cardiovascular, and cognitive health. This inference is difficult due to the spatial and temporal uncertainty regarding how much particulate matter is specifically attributable to wildfire smoke. One factor contributing to this challenge is the reliance on manually drawn smoke plume annotations, which are often noisy representations limited to the United States. This work uses deep convolutional neural networks to segment smoke plumes from geostationary satellite imagery. We compare the performance of predicted plume segmentations versus the noisy annotations using causal inference methods to estimate the amount of variation each explains in Environmental Protection Agency (EPA) measured surface level particulate matter 2.5um in diameter ( textrm PM 2.5 ).


A Unifying Framework for Characterizing and Computing Width Measures. Algorithms for computing or approximating optimal decompositions for decompositional parameters such as treewidth or clique width have so far traditionally been tailored to specific width parameters. Moreover, for mim width, no efficient algorithms for computing good decompositions were known, even under highly restrictive parameterizations. In this work we identify F branchwidth as a class of generic decompositional parameters that can capture mim width, treewidth, clique width as well as other measures. We show that while there is an infinite number of F branchwidth parameters, only a handful of these are asymptotically distinct. We then develop fixed parameter and kernelization algorithms (under several structural parameterizations) that can compute every possible F branchwidth, providing a unifying framework that can efficiently obtain near optimal tree decompositions, k expressions, as well as optimal mim width decompositions.


Spectral instability of small amplitude periodic waves for hyperbolic non Fickian diffusion advection models with logistic source. A hyperbolic model for diffusion, nonlinear transport (or advection) and production of a scalar quantity, is considered. The model is based on a constitutive law of Cattaneo Maxwell type expressing non Fickian diffusion by means of a relaxation time relation. The production or source term is assumed to be of logistic type. This paper studies the existence and spectral stability properties of spatially periodic traveling wave solutions to this system. It is shown that a family of subcharacteristic periodic waves emerges from a local Hopf bifurcation around a critical value of the wave speed. These waves have bounded fundamental period and small amplitude. In addition, it is shown that these waves are spectrally unstable as solutions to the hyperbolic system. For that purpose, it is proved that the Floquet spectrum of the linearized operator around a wave can be approximated by a linear operator whose point spectrum intersects the unstable half plane of complex numbers with positive real part.


Learning to Learn Transferable Attack. Transfer adversarial attack is a non trivial black box adversarial attack that aims to craft adversarial perturbations on the surrogate model and then apply such perturbations to the victim model. However, the transferability of perturbations from existing methods is still limited, since the adversarial perturbations are easily overfitting with a single surrogate model and specific data pattern. In this paper, we propose a Learning to Learn Transferable Attack (LLTA) method, which makes the adversarial perturbations more generalized via learning from both data and model augmentation. For data augmentation, we adopt simple random resizing and padding. For model augmentation, we randomly alter the back propagation instead of the forward propagation to eliminate the effect on the model prediction. By treating the attack of both specific data and a modified model as a task, we expect the adversarial perturbations to adopt enough tasks for generalization. To this end, the meta learning algorithm is further introduced during the iteration of perturbation generation. Empirical results on the widely used dataset demonstrate the effectiveness of our attack method with a 12.85 higher success rate of transfer attack compared with the state of the art methods. We also evaluate our method on the real world online system, i.e., Google Cloud Vision API, to further show the practical potentials of our method.


Position Heaps for Cartesian tree Matching on Strings and Tries. The Cartesian tree pattern matching is a recently introduced scheme of pattern matching that detects fragments in a sequential data stream which have a similar structure as a query pattern. Formally, Cartesian tree pattern matching seeks all substrings S' of the text string S such that the Cartesian tree of S' and that of a query pattern P coincide. In this paper, we present a new indexing structure for this problem called the Cartesian tree Position Heap (CPH). Let n be the length of the input text string S , m the length of a query pattern P , and sigma the alphabet size. We show that the CPH of S , denoted mathsf CPH (S) , supports pattern matching queries in O(m ( sigma log ( min h, m )) occ) time with O(n) space, where h is the height of the CPH and occ is the number of pattern occurrences. We show how to build mathsf CPH (S) in O(n log sigma) time with O(n) working space. Further, we extend the problem to the case where the text is a labeled tree (i.e. a trie). Given a trie T with N nodes, we show that the CPH of T , denoted mathsf CPH (T) , supports pattern matching queries on the trie in O(m ( sigma 2 log ( min h, m )) occ) time with O(N sigma) space. We also show a construction algorithm for mathsf CPH (T) running in O(N sigma) time and O(N sigma) working space.


Multiple Convolutional Features in Siamese Networks for Object Tracking. Siamese trackers demonstrated high performance in object tracking due to their balance between accuracy and speed. Unlike classification based CNNs, deep similarity networks are specifically designed to address the image similarity problem, and thus are inherently more appropriate for the tracking task. However, Siamese trackers mainly use the last convolutional layers for similarity analysis and target search, which restricts their performance. In this paper, we argue that using a single convolutional layer as feature representation is not an optimal choice in a deep similarity framework. We present a Multiple Features Siamese Tracker (MFST), a novel tracking algorithm exploiting several hierarchical feature maps for robust tracking. Since convolutional layers provide several abstraction levels in characterizing an object, fusing hierarchical features allows to obtain a richer and more efficient representation of the target. Moreover, we handle the target appearance variations by calibrating the deep features extracted from two different CNN models. Based on this advanced feature representation, our method achieves high tracking accuracy, while outperforming the standard siamese tracker on object tracking benchmarks. The source code and trained models are available at https github.com zhenxili96 MFST.


Extracting functional programs from Coq, in Coq. We implement extraction of Coq programs to functional languages based on MetaCoq's certified erasure. We extend the MetaCoq erasure output language with typing information and use it as an intermediate representation, which we call lambda T square . We complement the extraction functionality with a full pipeline that includes several standard transformations (eta expansion, inlining, etc) implemented in a proof generating manner along with a verified optimisation pass removing unused arguments. We prove the pass correct wrt. a conventional call by value operational semantics of functional languages. From the optimised lambda T square representation, we obtain code in two functional smart contract languages (Liquidity and CameLIGO), the functional language Elm, and a subset of the multi paradigm language for systems programming Rust. Rust is currently gaining popularity as a language for smart contracts, and we demonstrate how our extraction can be used to extract smart contract code for the Concordium network. The development is done in the context of the ConCert framework that enables smart contract verification. We contribute with two verified real world smart contracts (boardroom voting and escrow), which we use, among other examples, to exemplify the applicability of the pipeline. In addition, we develop a verified web application and extract it to fully functional Elm code. In total, this gives us a way to write dependently typed programs in Coq, verify, and then extract them to several target languages while retaining a small trusted computing base of only MetaCoq and the pretty printers into these languages.


Homomorphisms of Fourier algebras and transference results. We prove that if rho A(H) to B(G) is a homomorphism between the Fourier algebra of a locally compact group H and the Fourier Stieltjes algebra of a locally compact group G induced by a mixed piecewise affine map alpha G to H , then rho extends to a w w continuous map between the corresponding L infty algebras if and only if alpha is an open map. Using techniques from TRO equivalence of masa bimodules we prove various transference results We show that when alpha is a group homomorphism which pushes forward the Haar measure of G to a measure absolutely continuous with respect to the Haar measure of H , then ( alpha times alpha) 1 preserves sets of compact operator synthesis, and conversely when alpha is onto. We also prove similar preservation properties for operator Ditkin sets and operator M sets, obtaining preservation properties for M sets as corollaries. Some of these results extend or complement existing results of Ludwig, Shulman, Todorov and Turowska.


On the number of heterochromatic trees in nice and beautiful colourings of complete graphs. We introduce classes of edge colourings of the complete graph that we call nice and beautiful and study how many heterochromatic spanning trees appear under such colourings. We prove that if the colouring is nice, there is at least a quadratic number of different heterochromatic trees and if the colouring is beautiful there is an exponential number of different such trees.


Quality Inspection Aspects of Hybrid Prototypes for the CMS Outer Tracker Upgrade at HL LHC. At the High Luminosity LHC (HL LHC), the CMS experiment will need to operate at up to 200 interactions per 25 ns beam crossing time and with up to 4000 fb 1 of integrated luminosity. To achieve the physics goals the experiment needs to improve the tracking resolution and the ability to selectively trigger on specific physics events. The CMS tracker upgrade requires designing a new detector to cope with the HL LHC conditions. The new Outer Tracker is based on two types of silicon modules (strip strip and pixel strip). Each module type has a few types of high density interconnect hybrid circuits which house the front end and auxiliary electronics. This paper introduces the technological choices for modules and hybrids and presents the quality inspection aspects of the first hybrid prototypes.


Risk Sensitive Path Integral Control for Infinite Horizon Problem Formulations. Path Integral Control methods were developed for stochastic optimal control covering a wide class of finite horizon formulations with control affine nonlinear dynamics. Characteristic for this class is that the HJB equation is linear and consequently the value function can be expressed as a conditional expectation of the exponentially weighted cost to go evaluated over trajectories with uncontrolled system dynamics, hence the name. Subsequently it was shown that under the same assumptions Path Integral Control generalises to finite horizon risk sensitive stochastic optimal control problems. Here we study whether the HJB of infinite horizon formulations can be made linear as well. Our interest in infinite horizon formulations is motivated by the stationarity of the associated value function and their inherent dynamic stability seeking nature. Technically a stationary value function may ease the solution of the associated linear HJB. Second we argue this may offer an interesting starting point for off linear Reinforcement Learning applications. We show formally that the discounted and average cost formulations are respectively intractable and tractable.


Bi Bimodal Modality Fusion for Correlation Controlled Multimodal Sentiment Analysis. Multimodal sentiment analysis aims to extract and integrate semantic information collected from multiple modalities to recognize the expressed emotions and sentiment in multimodal data. This research area's major concern lies in developing an extraordinary fusion scheme that can extract and integrate key information from various modalities. However, one issue that may restrict previous work to achieve a higher level is the lack of proper modeling for the dynamics of the competition between the independence and relevance among modalities, which could deteriorate fusion outcomes by causing the collapse of modality specific feature space or introducing extra noise. To mitigate this, we propose the Bi Bimodal Fusion Network (BBFN), a novel end to end network that performs fusion (relevance increment) and separation (difference increment) on pairwise modality representations. The two parts are trained simultaneously such that the combat between them is simulated. The model takes two bimodal pairs as input due to the known information imbalance among modalities. In addition, we leverage a gated control mechanism in the Transformer architecture to further improve the final output. Experimental results on three datasets (CMU MOSI, CMU MOSEI, and UR FUNNY) verifies that our model significantly outperforms the SOTA. The implementation of this work is available at https github.com declare lab multimodal deep learning.


On the role of density fluctuations in the core turbulent transport of Wendelstein 7 X. A recent characterization of core turbulence carried out with a Doppler reflectometer in the optimized stellarator Wendelstein 7 X (W7 X) found that discharges achieving high ion temperatures at the core featured an ITG like suppression of density fluctuations driven by a reduction of the gradient ratio eta i L n L T i D. Carralero et al., Nucl. Fusion, 2021 . In order to confirm the role of ITG turbulence in this process, we set out to establish experimentally the relation between core density fluctuations, turbulent heat flux and global confinement. With this aim, we consider the scenarios found in the previous work and carry out power balance analysis for a number of representative ones, including some featuring high ion temperature. As well, we evaluate the global energy confinement time and discuss it in the context of the ISS04 inter stellarator scaling. We find that, when turbulence is suppressed as a result of a reduction of eta i , there is a reduction of ion turbulent transport, and global performance is improved as a result. This is consistent with ITG turbulence limiting the ion temperature at the core of W7 X. In contrast, when turbulence is reduced following a decrease in collisionality, no changes are observed in transport or confinement. This could be explained by ITG modes being combined with TEM turbulence when the later is destabilized at low collisionalities.


Algorithm Selection on a Meta Level. The problem of selecting an algorithm that appears most suitable for a specific instance of an algorithmic problem class, such as the Boolean satisfiability problem, is called instance specific algorithm selection. Over the past decade, the problem has received considerable attention, resulting in a number of different methods for algorithm selection. Although most of these methods are based on machine learning, surprisingly little work has been done on meta learning, that is, on taking advantage of the complementarity of existing algorithm selection methods in order to combine them into a single superior algorithm selector. In this paper, we introduce the problem of meta algorithm selection, which essentially asks for the best way to combine a given set of algorithm selectors. We present a general methodological framework for meta algorithm selection as well as several concrete learning methods as instantiations of this framework, essentially combining ideas of meta learning and ensemble learning. In an extensive experimental evaluation, we demonstrate that ensembles of algorithm selectors can significantly outperform single algorithm selectors and have the potential to form the new state of the art in algorithm selection.


Logsig RNN a novel network for robust and efficient skeleton based action recognition. This paper contributes to the challenge of skeleton based human action recognition in videos. The key step is to develop a generic network architecture to extract discriminative features for the spatio temporal skeleton data. In this paper, we propose a novel module, namely Logsig RNN, which is the combination of the log signature layer and recurrent type neural networks (RNNs). The former one comes from the mathematically principled technology of signatures and log signatures as representations for streamed data, which can manage high sample rate streams, non uniform sampling and time series of variable length. It serves as an enhancement of the recurrent layer, which can be conveniently plugged into neural networks. Besides we propose two path transformation layers to significantly reduce path dimension while retaining the essential information fed into the Logsig RNN module. Finally, numerical results demonstrate that replacing the RNN module by the Logsig RNN module in SOTA networks consistently improves the performance on both Chalearn gesture data and NTU RGB D 120 action data in terms of accuracy and robustness. In particular, we achieve the state of the art accuracy on Chalearn2013 gesture data by combining simple path transformation layers with the Logsig RNN. Codes are available at https github.com steveliao93 GCN LogsigRNN.


MHT X Offline Multiple Hypothesis Tracking with Algorithm X. An efficient and versatile implementation of offline multiple hypothesis tracking with Algorithm X for optimal association search was developed using Python. The code is intended for scientific applications that do not require online processing. Directed graph framework is used and multiple scans with progressively increasing time window width are used for edge construction for maximum likelihood trajectories. The current version of the code was developed for applications in multiphase hydrodynamics, e.g. bubble and particle tracking, and is capable of resolving object motion, merges and splits. Feasible object associations and trajectory graph edge likelihoods are determined using weak mass and momentum conservation laws translated to statistical functions for object properties. The code is compatible with n dimensional motion with arbitrarily many tracked object properties. This framework is easily extendable beyond the present application by replacing the currently used heuristics with ones more appropriate for the problem at hand. The code is open source and will be continuously developed further.


Random walks with bounded first moment on finite volume spaces. Let G be a real Lie group, Lambda leq G a lattice, and Omega G Lambda . We study the equidistribution properties of the left random walk on Omega induced by a probability measure mu on G . It is assumed that mu has a finite first moment, and that the Zariski closure of the group generated by the support of mu in the adjoint representation is semisimple without compact factors. We show that for every starting point x in Omega , the mu walk with origin x has no escape of mass, and equidistributes in Ces aro averages toward some homogeneous measure. This extends several fundamental results due to Benoist Quint and Eskin Margulis for walks with finite exponential moment.


Invariant manifolds for stochastic partial differential equations in continuously embedded Hilbert spaces. We provide necessary and sufficient conditions for stochastic invariance of finite dimensional submanifolds for solutions of stochastic partial differential equations (SPDEs) in continuously embedded Hilbert spaces with non smooth coefficients. Furthermore, we establish a link between invariance of submanifolds for such SPDEs in Hermite Sobolev spaces and invariance of submanifolds for finite dimensional SDEs. This provides a new method for analyzing stochastic invariance of submanifolds for finite dimensional It o diffusions, which we will use in order to derive new invariance results for finite dimensional SDEs.


Bridging the gap between emotion and joint action. Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi agent component is largely missing from neuroscience based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.


Reducing numerical work in non linear parameter identification. The real life objective functions may have an unimaginable complexity of an M dimensional topography, where M is the number of the parameters. The required reliability conditions are the regularity at the unique global minimum, being an inner point of the parameter domain and the bounded sized parameter error domain. However, the non linear minimisation and the reliability testing are hindered by the complex topography, among others. It is shown that there is an underlying noise free objective function, called follower objective function, with much nicer topography. The follower objective function may determine the geometry of the real life objective function in case of relatively small noise on a large scale and can be used in non linear minimisation (with large step sized methods) and for the testing of the reliability of the solution of the inverse problem. It is shown that the hierarchical parameter identification based on the implicit function theorem may splits the problem. The first group of the parameters are eliminated with conditional minimisation, before each objective function value evaluation for the minimisation with respect to the remainder parameters. By the first minimisation a section is determined along the graph of an implicit function of the projection of the graph of the of the objective function, then this so called clever section of the objective function is minimised. The one dimensional clever sections of the objective functions can be used to bracket the global minimum, and to check the geometry of the global minimum. It can be used for regularization, to handle a quasi degenerate global minimum of the objective function, based on the injectivity of the coordinate functions.


CutDepth Edge aware Data Augmentation in Depth Estimation. It is difficult to collect data on a large scale in a monocular depth estimation because the task requires the simultaneous acquisition of RGB images and depths. Data augmentation is thus important to this task. However, there has been little research on data augmentation for tasks such as monocular depth estimation, where the transformation is performed pixel by pixel. In this paper, we propose a data augmentation method, called CutDepth. In CutDepth, part of the depth is pasted onto an input image during training. The method extends variations data without destroying edge features. Experiments objectively and subjectively show that the proposed method outperforms conventional methods of data augmentation. The estimation accuracy is improved with CutDepth even though there are few training data at long distances.


Effect of Gameplay Uncertainty, Display Type, and Age on Virtual Reality Exergames. Uncertainty is widely acknowledged as an engaging gameplay element but rarely used in exergames. In this research, we explore the role of uncertainty in exergames and introduce three uncertain elements (false attacks, misses, and critical hits) to an exergame. We conducted a study under two conditions (uncertain and certain), with two display types (virtual reality and large display) and across young and middle aged adults to measure their effect on game performance, experience, and exertion. Results show that (1) our designed uncertain elements are instrumental in increasing exertion levels (2) when playing a motion based first person perspective exergame, virtual reality can improve performance, while maintaining the same motion sickness level as a large display and (3) exergames for middle aged adults should be designed with age related declines in mind, similar to designing for elderly adults. We also framed two design guidelines for exergames that have similar features to the game used in this research.


Addressing phase curvature in Fourier ptychography. In Fourier ptychography, multiple low resolution images are captured and subsequently combined computationally into a high resolution, large field of view micrograph. A theoretical image formation model based on the assumption of plane wave illumination from various directions is commonly used, to stitch together the captured information into a high synthetic aperture. The underlying far field (Fraunhofer) diffraction assumption connects the source, sample, and pupil planes by Fourier transforms. While computationally simple, this assumption neglects phase curvature due to non planar illumination from point sources as well as phase curvature from finite conjugate microscopes (e.g., using a single lens for image formation). We describe a simple, efficient, and accurate extension of Fourier ptychography by embedding the effect of phase curvature into the underlying forward model. With the improved forward model proposed here, quantitative phase reconstruction is possible even for wide fields of views and without the need of image segmentation. Lastly, the proposed method is computationally efficient, requiring only two multiplications prior and following the reconstruction.


Hybrid Human AI Curriculum Development for Personalised Informal Learning Environments. Informal learning procedures have been changing extremely fast over the recent decades not only due to the advent of online learning, but also due to changes in what humans need to learn to meet their various life and career goals. Consequently, online, educational platforms are expected to provide personalized, up to date curricula to assist learners. Therefore, in this paper, we propose an Artificial Intelligence (AI) and Crowdsourcing based approach to create and update curricula for individual learners. We show the design of this curriculum development system prototype, in which contributors receive AI based recommendations to be able to define and update high level learning goals, skills, and learning topics together with associated learning content. This curriculum development system was also integrated into our personalized online learning platform. To evaluate our prototype we compared experts' opinion with our system's recommendations, and resulted in 89 , 79 , and 93 F1 scores when recommending skills, learning topics, and educational materials respectively. Also, we interviewed eight senior level experts from educational institutions and career consulting organizations. Interviewees agreed that our curriculum development method has high potential to support authoring activities in dynamic, personalized learning environments.


Learning effective stochastic differential equations from microscopic simulations combining stochastic numerics and deep learning. We identify effective stochastic differential equations (SDE) for coarse observables of fine grained particle or agent based simulations these SDE then provide coarse surrogate models of the fine scale dynamics. We approximate the drift and diffusivity functions in these effective SDE through neural networks, which can be thought of as effective stochastic ResNets. The loss function is inspired by, and embodies, the structure of established stochastic numerical integrators (here, Euler Maruyama and Milstein) our approximations can thus benefit from error analysis of these underlying numerical schemes. They also lend themselves naturally to "physics informed" gray box identification when approximate coarse models, such as mean field equations, are available. Our approach does not require long trajectories, works on scattered snapshot data, and is designed to naturally handle different time steps per snapshot. We consider both the case where the coarse collective observables are known in advance, as well as the case where they must be found in a data driven manner.


A Forward Backward Greedy approach for Sparse Multiscale Learning. Multiscale Models are known to be successful in uncovering and analyzing the structures in data at different resolutions. In the current work we propose a feature driven Reproducing Kernel Hilbert space (RKHS), for which the associated kernel has a weighted multiscale structure. For generating approximations in this space, we provide a practical forward backward algorithm that is shown to greedily construct a set of basis functions having a multiscale structure, while also creating sparse representations from the given data set, making representations and predictions very efficient. We provide a detailed analysis of the algorithm including recommendations for selecting algorithmic hyper parameters and estimating probabilistic rates of convergence at individual scales. Then we extend this analysis to multiscale setting, studying the effects of finite scale truncation and quality of solution in the inherent RKHS. In the last section, we analyze the performance of the approach on a variety of simulation and real data sets, thereby justifying the efficiency claims in terms of model quality and data reduction.


A hybrid partitioned deep learning methodology for moving interface and fluid structure interaction. We present a hybrid partitioned deep learning framework for the reduced order modeling of fluid structure interaction. Using the discretized Navier Stokes in the arbitrary Lagrangian Eulerian reference frame, we generate the full order flow snapshots and point cloud displacements as target data for the learning and inference of fluid structure dynamics. The hybrid operation of this methodology comes by combining two data driven models for fluid and solid subdomains via deep learning based reduced order models (DL ROMs). The proposed framework comprises the partitioned data driven drivers for unsteady flow and the moving point cloud displacements. At the fluid structure interface, the force information is exchanged between the two partitioned subdomain solvers. The first component of our framework relies on the proper orthogonal decomposition based recurrent neural network (POD RNN) as a DL ROM procedure to infer the point cloud with a moving interface. This model utilizes the POD basis modes to reduce dimensionality and evolve them in time via RNN. The second component employs the convolution based recurrent autoencoder network (CRAN) as a self supervised DL ROM procedure to infer the nonlinear flow dynamics at static Eulerian probes. We introduce these probes as spatially structured query nodes in the moving point cloud to treat the Lagrangian to Eulerian conflict together with convenience in training the CRAN driver. To determine these Eulerian probes, we construct a novel snapshot field transfer and load recovery algorithm. A popular prototypical fluid structure interaction problem of flow past a freely oscillating cylinder is considered to assess the efficacy of the proposed methodology for a different set of reduced velocities. The proposed framework tracks the interface description with acceptable accuracy and predicts the nonlinear wake dynamics over the chosen test data range.


Occupancy Estimation from Thermal Images. We propose a non intrusive, and privacy preserving occupancy estimation system for smart environments. The proposed scheme uses thermal images to detect the number of people in a given area. The occupancy estimation model is designed using the concepts of intensity based and motion based human segmentation. The notion of difference catcher, connected component labeling, noise filter, and memory propagation are utilized to estimate the occupancy number. We use a real dataset to demonstrate the effectiveness of the proposed system.


Lines on the secant cubic hypersurfaces of Severi varieties. The secant varieties of Severi varieties provide special examples of (singular) cubic hypersurfaces. An interesting question asks when a given cubic hypersurface is projectively equivalent to a secant cubic hypersurface. Inspired by the ''geometric'' Torelli theorem for smooth cubic hypersurfaces due to F. Charles, we study the geometry of lines on secant cubics and describe the Fano variety of lines. Then we verify the ''geometric'' Torelli theorem for the case of secant cubics. Namely, a cubic hypersurface is isomorphic to a secant cubic if and only if their Fano varieties of lines are isomorphic.


Quantifying the Conceptual Error in Dimensionality Reduction. Dimension reduction of data sets is a standard problem in the realm of machine learning and knowledge reasoning. They affect patterns in and dependencies on data dimensions and ultimately influence any decision making processes. Therefore, a wide variety of reduction procedures are in use, each pursuing different objectives. A so far not considered criterion is the conceptual continuity of the reduction mapping, i.e., the preservation of the conceptual structure with respect to the original data set. Based on the notion scale measure from formal concept analysis we present in this work a) the theoretical foundations to detect and quantify conceptual errors in data scalings b) an experimental investigation of our approach on eleven data sets that were respectively treated with a variant of non negative matrix factorization.


On the Convergence of Tsetlin Machines for the AND and the OR Operators. The Tsetlin Machine (TM) is a novel machine learning algorithm based on propositional logic, which has obtained state of the art performance on several pattern recognition problems. In previous studies, the convergence properties of TM for 1 bit operation and XOR operation have been analyzed. To make the analyses for the basic digital operations complete, in this article, we analyze the convergence when input training samples follow AND and OR operators respectively. Our analyses reveal that the TM can converge almost surely to reproduce AND and OR operators, which are learnt from training data over an infinite time horizon. The analyses on AND and OR operators, together with the previously analysed 1 bit and XOR operations, complete the convergence analyses on basic operators in Boolean algebra.


Towards Risk Modeling for Collaborative AI. Collaborative AI systems aim at working together with humans in a shared space to achieve a common goal. This setting imposes potentially hazardous circumstances due to contacts that could harm human beings. Thus, building such systems with strong assurances of compliance with requirements domain specific standards and regulations is of greatest importance. Challenges associated with the achievement of this goal become even more severe when such systems rely on machine learning components rather than such as top down rule based AI. In this paper, we introduce a risk modeling approach tailored to Collaborative AI systems. The risk model includes goals, risk events and domain specific indicators that potentially expose humans to hazards. The risk model is then leveraged to drive assurance methods that feed in turn the risk model through insights extracted from run time evidence. Our envisioned approach is described by means of a running example in the domain of Industry 4.0, where a robotic arm endowed with a visual perception component, implemented with machine learning, collaborates with a human operator for a production relevant task.


Off Policy Correction For Multi Agent Reinforcement Learning. Multi agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single agent case, multi agent problems are often harder to train and analyze theoretically. In this work, we propose MA Trace, a new on policy actor critic algorithm, which extends V Trace to the MARL setting. The key advantage of our algorithm is its high scalability in a multi worker setting. To this end, MA Trace utilizes importance sampling as an off policy correction method, which allows distributing the computations with no impact on the quality of training. Furthermore, our algorithm is theoretically grounded we prove a fixed point theorem that guarantees convergence. We evaluate the algorithm extensively on the StarCraft Multi Agent Challenge, a standard benchmark for multi agent algorithms. MA Trace achieves high performance on all its tasks and exceeds state of the art results on some of them.


ViewCLR Learning Self supervised Video Representation for Unseen Viewpoints. Learning self supervised video representation predominantly focuses on discriminating instances generated from simple data augmentation schemes. However, the learned representation often fails to generalize over unseen camera viewpoints. To this end, we propose ViewCLR, that learns self supervised video representation invariant to camera viewpoint changes. We introduce a view generator that can be considered as a learnable augmentation for any self supervised pre text tasks, to generate latent viewpoint representation of a video. ViewCLR maximizes the similarities between the latent viewpoint representation with its representation from the original viewpoint, enabling the learned video encoder to generalize over unseen camera viewpoints. Experiments on cross view benchmark datasets including NTU RGB D dataset show that ViewCLR stands as a state of the art viewpoint invariant self supervised method.


Kinetic simulation of electron cyclotron resonance assisted gas breakdown in split biased waveguides for ITER collective Thomson scattering diagnostic. For the measurement of the dynamics of fusion born alpha particles E alpha leq 3.5 MeV in ITER using collective Thomson scattering (CTS), safe transmission of a gyrotron beam at mm wavelength (1 MW, 60 GHz) passing the electron cyclotron resonance (ECR) in the in vessel tokamak port plug' vacuum is a prerequisite. Depending on neutral gas pressure and composition, ECR assisted gas breakdown may occur at the location of the resonance, which must be mitigated for diagnostic performance and safety reasons. The concept of a split electrically biased waveguide (SBWG) has been previously demonstrated in C.P. Moeller, U.S. Patent 4,687,616 (1987) . The waveguide is longitudinally split and a kV bias voltage applied between the two halves. Electrons are rapidly removed from the central region of high radio frequency electric field strength, mitigating breakdown. As a full scale experimental investigation of gas and electromagnetic field conditions inside the ITER equatorial port plugs is currently unattainable, a corresponding Monte Carlo simulation study is presented. Validity of the Monte Carlo electron model is demonstrated with a prediction of ECR breakdown and the mitigation pressure limits for the above quoted reference case with 1 H 2 (and pollutant high Z elements). For the proposed ITER CTS design with a 88.9 mm inner diameter SBWG, ECR breakdown is predicted to occur down to a pure 1 H 2 pressure of 0.3 Pa, while mitigation is shown to be effective at least up to 10 Pa using a bias voltage of 1 kV. The analysis is complemented by results for relevant electric magnetic field arrangements and limitations of the SBWG mitigation concept are addressed.


Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence Based Tabular Reasoning. Neural models command state of the art performance across NLP tasks, including ones involving "reasoning". Models claiming to reason about the evidence presented to them should attend to the correct parts of the input avoiding spurious patterns therein, be self consistent in their predictions across inputs, and be immune to biases derived from their pre training in a nuanced, context sensitive fashion. em Do the prevalent BERT family of models do so? In this paper, we study this question using the problem of reasoning on tabular data. Tabular inputs are especially well suited for the study they admit systematic probes targeting the properties listed above. Our experiments demonstrate that a RoBERTa based model, representative of the current state of the art, fails at reasoning on the following counts it (a) ignores relevant parts of the evidence, (b) is over sensitive to annotation artifacts, and (c) relies on the knowledge encoded in the pre trained language model rather than the evidence presented in its tabular inputs. Finally, through inoculation experiments, we show that fine tuning the model on perturbed data does not help it overcome the above challenges.


How Can Datacenters Join the Smart Grid to Address the Climate Crisis? Using simulation to explore power and cost effects of direct participation in the energy market. Amidst the climate crisis, the massive introduction of renewable energy sources has brought tremendous challenges to both the power grid and its surrounding markets. As datacenters have become ever larger and more powerful, they play an increasingly significant role in the energy arena. With their unique characteristics, datacenters have been proved to be well suited for regulating the power grid yet currently provide little, if any, such active response. This problem is due to issues such as unsuitability of the market design, high complexity of the currently proposed solutions, as well as the potential risks thereof. This work aims to provide individual datacenters with insights on the feasibility and profitability of directly participating in the energy market. By modelling the power system of datacenters, and by conducting simulations on real world datacenter traces, we demonstrate the substantial financial incentive for individual datacenters to directly participate in both the day ahead and the balancing markets. In turn, we suggest a new short term, direct scheme of market participation for individual datacenters in place of the current long term, inactive participation. Furthermore, we develop a novel proactive DVFS scheduling algorithm that can both reduce energy consumption and save energy costs during the market participation of datacenters. Also, in developing this scheduler, we propose an innovative combination of machine learning methods and the DVFS technology that can provide the power grid with indirect demand response (DR). Our experimental results strongly support that individual datacenters can and should directly participate in the energy market both to save their energy costs and to curb their energy consumption, whilst providing the power grid with indirect DR.


Estimating Egocentric 3D Human Pose in Global Space. Egocentric 3D human pose estimation using a single fisheye camera has become popular recently as it allows capturing a wide range of daily activities in unconstrained environments, which is difficult for traditional outside in motion capture with external cameras. However, existing methods have several limitations. A prominent problem is that the estimated poses lie in the local coordinate system of the fisheye camera, rather than in the world coordinate system, which is restrictive for many applications. Furthermore, these methods suffer from limited accuracy and temporal instability due to ambiguities caused by the monocular setup and the severe occlusion in a strongly distorted egocentric perspective. To tackle these limitations, we present a new method for egocentric global 3D body pose estimation using a single head mounted fisheye camera. To achieve accurate and temporally stable global poses, a spatio temporal optimization is performed over a sequence of frames by minimizing heatmap reprojection errors and enforcing local and global body motion priors learned from a mocap dataset. Experimental results show that our approach outperforms state of the art methods both quantitatively and qualitatively.


A Note on elementarity of virtual dendro morphisms for higher rank lattices. Let Gamma be a discrete countable group and let ( Omega, mu) be an ergodic standard Borel probability Gamma space. Given any non elementary virtual dendro morphism (that is a measurable cocycle in the automorphism group of a dendrite), we construct a unitary representation V with no invariant vectors such that text H 2 b( Gamma V) contains a non zero class. As a consequence, all virtual dendro morphisms of a higher rank lattice must be elementary.


Investigating the Reordering Capability in CTC based Non Autoregressive End to End Speech Translation. We study the possibilities of building a non autoregressive speech to text translation model using connectionist temporal classification (CTC), and use CTC based automatic speech recognition as an auxiliary task to improve the performance. CTC's success on translation is counter intuitive due to its monotonicity assumption, so we analyze its reordering capability. Kendall's tau distance is introduced as the quantitative metric, and gradient based visualization provides an intuitive way to take a closer look into the model. Our analysis shows that transformer encoders have the ability to change the word order and points out the future research direction that worth being explored more on non autoregressive speech translation.


Free representations of outer automorphism groups of free products via characteristic abelian coverings. Given a free product G , we investigate the existence of faithful free representations of the outer automorphism group text Out (G) , or in other words of embeddings of text Out (G) into text Out (F m) for some m . We base our work on a paper of Bridson and Vogtmann in which they construct embeddings of text Out (F n) into text Out (F m) for some values of n and m by interpreting text Out (F n) as the group of homotopy equivalences of a graph X of genus n , and by lifting homotopy equivalences of X to a characteristic abelian cover of genus m . In order to adapt their method to a free product G , we view G as the fundamental group of a graph of groups, and we explain how to obtain notions of homotopy and coverings for graphs of groups by considering the action on a Bass Serre tree. Using these notions, as well as a presentation of text Out (G) due to Fuchs Rabinovich, we show for instance that text Out (G) has a faithful free representation when G F d ast G d 1 ast cdots ast G n , with F d free of rank d and G i finite abelian of order coprime to n 1 .


Configuration Space Exploration for Digital Printing Systems. Within the printing industry, much of the variety in printed applications comes from the variety in finishing. Finishing comprises the processing of sheets of paper after being printed, e.g. to form books. The configuration space of finishers, i.e. all possible configurations given the available features and hardware capabilities, are large. Current control software minimally assists operators in finding useful configurations. Using a classical modelling and integration approach to support a variety of configuration spaces is suboptimal with respect to operatability, development time, and maintenance burden. In this paper, we explore the use of a modeling language for finishers to realize optimizing decision making over configuration parameters in a systematic way and to reduce development time by generating control software from models. We present CSX, a domain specific language for high level declarative specification of finishers that supports specification of the configuration parameters and the automated exploration of the configuration space of finishers. The language serves as an interface to constraint solving, i.e., we use low level SMT constraint solving to find configurations for high level specifications. We present a denotational semantics that expresses a translation of CSX specifications to SMT constraints. We describe the implementation of the CSX compiler and the CSX programming environment (IDE), which supports well formedness checking, inhabitance checking, and interactive configuration space exploration. We evaluate CSX by modelling two realistic finishers. Benchmarks show that CSX has practical performance ( 1s) for several scenarios of configuration space exploration.


An adaptive splitting method for the Cox Ingersoll Ross process. We propose a new splitting method for strong numerical solution of the Cox Ingersoll Ross model. For this method, applied over both deterministic and adaptive random meshes, we prove a uniform moment bound and strong error results of order 1 4 in L 1 and L 2 for the parameter regime kappa theta sigma 2 . Our scheme does not fall into the class analyzed in Hefter Herzwurm (2018) where convergence of maximum order 1 4 of a novel class of Milstein based methods over the full range of parameter values is shown. Hence we present a separate convergence analysis before we extend the new method to cover all parameter values by introducing a 'soft zero' region (where the deterministic flow determines the approximation) giving a hybrid type method to deal with the reflecting boundary. From numerical simulations we observe a rate of order 1 when kappa theta sigma 2 rather than 1 4 . Asymptotically, for large noise, we observe that the rates of convergence decrease similarly to those of other schemes but that the proposed method displays smaller error constants. Our results also serve as supporting numerical evidence that the conjecture of Hefter Jentzen (2019) holds true for methods with non uniform Wiener increments.