DeepEdge A Deep Reinforcement Learning based Task Orchestrator for Edge Computing. The improvements in the edge computing technology pave the road for diversified applications that demand real time interaction. However, due to the mobility of the end users and the dynamic edge environment, it becomes challenging to handle the task offloading with high performance. Moreover, since each application in mobile devices has different characteristics, a task orchestrator must be adaptive and have the ability to learn the dynamics of the environment. For this purpose, we develop a deep reinforcement learning based task orchestrator, DeepEdge, which learns to meet different task requirements without needing human interaction even under the heavily loaded stochastic network conditions in terms of mobile users and applications. Given the dynamic offloading requests and time varying communication conditions, we successfully model the problem as a Markov process and then apply the Double Deep Q Network (DDQN) algorithm to implement DeepEdge. To evaluate the robustness of DeepEdge, we experiment with four different applications including image rendering, infotainment, pervasive health, and augmented reality in the network under various loads. Furthermore, we compare the performance of our agent with the four different task offloading approaches in the literature. Our results show that DeepEdge outperforms its competitors in terms of the percentage of satisfactorily completed tasks.


LSTMs and Deep Residual Networks for Carbohydrate and Bolus Recommendations in Type 1 Diabetes Management. To avoid serious diabetic complications, people with type 1 diabetes must keep their blood glucose levels (BGLs) as close to normal as possible. Insulin dosages and carbohydrate consumption are important considerations in managing BGLs. Since the 1960s, models have been developed to forecast blood glucose levels based on the history of BGLs, insulin dosages, carbohydrate intake, and other physiological and lifestyle factors. Such predictions can be used to alert people of impending unsafe BGLs or to control insulin flow in an artificial pancreas. In past work, we have introduced an LSTM based approach to blood glucose level prediction aimed at "what if" scenarios, in which people could enter foods they might eat or insulin amounts they might take and then see the effect on future BGLs. In this work, we invert the "what if" scenario and introduce a similar architecture based on chaining two LSTMs that can be trained to make either insulin or carbohydrate recommendations aimed at reaching a desired BG level in the future. Leveraging a recent state of the art model for time series forecasting, we then derive a novel architecture for the same recommendation task, in which the two LSTM chain is used as a repeating block inside a deep residual architecture. Experimental evaluations using real patient data from the OhioT1DM dataset show that the new integrated architecture compares favorably with the previous LSTM based approach, substantially outperforming the baselines. The promising results suggest that this novel approach could potentially be of practical use to people with type 1 diabetes for self management of BGLs.


HumanGPS Geodesic PreServing Feature for Dense Human Correspondences. In this paper, we address the problem of building dense correspondences between human images under arbitrary camera viewpoints and body poses. Prior art either assumes small motion between frames or relies on local descriptors, which cannot handle large motion or visually ambiguous body parts, e.g., left vs. right hand. In contrast, we propose a deep learning framework that maps each pixel to a feature space, where the feature distances reflect the geodesic distances among pixels as if they were projected onto the surface of a 3D human scan. To this end, we introduce novel loss functions to push features apart according to their geodesic distances on the surface. Without any semantic annotation, the proposed embeddings automatically learn to differentiate visually similar parts and align different subjects into an unified feature space. Extensive experiments show that the learned embeddings can produce accurate correspondences between images with remarkable generalization capabilities on both intra and inter subjects.


Some arithmetic properties of P 'olya's urn. Following Hales (2018), the evolution of P 'olya's urn may be interpreted as a walk, a P 'olya walk, on the integer lattice mathbb N 2 . We study the visibility properties of P 'olya's walk or, equivalently, the divisibility properties of the composition of the urn. In particular, we are interested in the asymptotic average time that a P 'olya walk is visible from the origin, or, alternatively, in the asymptotic proportion of draws so that the resulting composition of the urn is coprime. Via de Finetti's exchangeability theorem, P 'olya's walk appears as a mixture of standard random walks. This paper is a follow up of Cilleruelo Fern 'andez Fern 'andez (2019), where similar questions were studied for standard random walks.


Fast High Quality Tabletop Rearrangement in Bounded Workspace. In this paper, we examine the problem of rearranging many objects on a tabletop in a cluttered setting using overhand grasps. Efficient solutions for the problem, which capture a common task that we solve on a daily basis, are essential in enabling truly intelligent robotic manipulation. In a given instance, objects may need to be placed at temporary positions ("buffers") to complete the rearrangement, but allocating these buffer locations can be highly challenging in a cluttered environment. To tackle the challenge, a two step baseline planner is first developed, which generates a primitive plan based on inherent combinatorial constraints induced by start and goal poses of the objects and then selects buffer locations assisted by the primitive plan. We then employ the "lazy" planner in a tree search framework which is further sped up by adapting a novel preprocessing routine. Simulation experiments show our methods can quickly generate high quality solutions and are more robust in solving large scale instances than existing state of the art approaches. source github.com arc l TRLB


Attend and Guide (AG Net) A Keypoints driven Attention based Deep Network for Image Recognition. This paper presents a novel keypoints based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their performance in discriminating fine grained changes is not at the same level. We address this by proposing an end to end CNN model, which learns meaningful features linking fine grained changes using our novel attention mechanism. It captures the spatial structures in images by identifying semantic regions (SRs) and their spatial distributions, and is proved to be the key to modelling subtle changes in images. We automatically identify these SRs by grouping the detected keypoints in a given image. The usefulness'' of these SRs for image recognition is measured using our innovative attentional mechanism focusing on parts of the image that are most relevant to a given task. This framework applies to traditional and fine grained image recognition tasks and does not require manually annotated regions (e.g. bounding box of body parts, objects, etc.) for learning and prediction. Moreover, the proposed keypoints driven attention mechanism can be easily integrated into the existing CNN models. The framework is evaluated on six diverse benchmark datasets. The model outperforms the state of the art approaches by a considerable margin using Distracted Driver V1 (Acc 3.39 ), Distracted Driver V2 (Acc 6.58 ), Stanford 40 Actions (mAP 2.15 ), People Playing Musical Instruments (mAP 16.05 ), Food 101 (Acc 6.30 ) and Caltech 256 (Acc 2.59 ) datasets.


Convergence of the uniaxial PML method for time domain electromagnetic scattering problems. In this paper, we propose and study the uniaxial perfectly matched layer (PML) method for three dimensional time domain electromagnetic scattering problems, which has a great advantage over the spherical one in dealing with problems involving anisotropic scatterers. The truncated uniaxial PML problem is proved to be well posed and stable, based on the Laplace transform technique and the energy method. Moreover, the L 2 norm and L infty norm error estimates in time are given between the solutions of the original scattering problem and the truncated PML problem, leading to the exponential convergence of the time domain uniaxial PML method in terms of the thickness and absorbing parameters of the PML layer. The proof depends on the error analysis between the EtM operators for the original scattering problem and the truncated PML problem, which is different from our previous work (SIAM J. Numer. Anal. 58(3) (2020), 1918 1940).


Some Applications of Dynamical Belyi Polynomials. We give necessary and sufficient conditions for post critically finite polynomials to have potential good reduction at a given prime. We also answer in the negative a question posed by Silverman about conservative polynomials. Both proofs rely on dynamical Belyi polynomials as exemplars of PCF (resp. conservative) maps.


The Basic de Rham Complex of a Singular Foliation. A singular foliation mathcal F gives a partition of a manifold M into leaves whose dimension may vary. Associated to a singular foliation are two complexes, that of the diffeological differential forms on the leaf space M mathcal F , and that of the basic differential forms on M . We prove the pullback by the quotient map provides an isomorphism of these complexes in the following cases when mathcal F is a regular foliation, when points in the leaves of the same dimension assemble into an embedded (more generally, diffeological) submanifold of M , and, as a special case of the latter, when mathcal F is induced by a linearizable Lie groupoid.


Conservation with moving meshes over orography. Adaptive meshes have the potential to improve the accuracy and efficiency of atmospheric modelling by increasing resolution where it is most needed. Mesh re distribution, or r adaptivity, adapts by moving the mesh without changing the connectivity. This avoids some of the challenges with h adaptivity (adding and removing points) the solution does not need to be mapped between meshes, which can be expensive and introduces errors, and there are no load balancing problems on parallel computers. A long standing problem with both forms of adaptivity has been changes in volume of the domain as resolution changes at an uneven boundary. We propose a solution to exact local conservation and maintenance of uniform fields while the mesh changes volume as it moves over orography. This is solved by introducing a volume adjustment parameter which tracks the true cell volumes without using expensive conservative mapping. A finite volume solution of the advection equation over orography on moving meshes is described and results are presented demonstrating improved accuracy for cost using moving meshes. Exact local conservation and maintenance of uniform fields is demonstrated and the corrected mesh volume is preserved. We use optimal transport to generate meshes which are guaranteed not to tangle and are equidistributed with respect to a monitor function. This leads to a Monge Amp e re equation which is solved with a Newton solver. The superiority of the Newton solver over other techniques is demonstrated in the appendix. However the Newton solver is only efficient if it is applied to the left hand side of the Monge Amp e re equation with fixed point iterations for the right hand side.


An explicit algorithm for normal forms in small overlap monoids. If mathcal P left langle A , ,R right rangle is a monoid presentation, then the relation words in mathcal P are just the set of words on the left or right hand side of any pair in R . A word w in A is said to be a piece of mathcal P if w is a factor of at least two distinct relation words, or w occurs more than once as a factor of a single relation word (possibly overlapping). A finitely presented monoid is a small overlap monoid if no relation word can be written as a product of fewer than 4 pieces. In this paper, we present a quadratic time algorithm for computing normal forms of words in small overlap monoids where the coefficients are sufficiently small to allow for practical computation. Additionally, we show that the uniform word problem for small overlap monoids can be solved in linear time.


On finite groups factorized by sigma nilpotent subgroups. Let G be a finite group and sigma sigma i i in I be a partition of the set of all primes mathbb P , that is, mathbb P bigcup i in I sigma i and sigma i cap sigma j emptyset for all i neq j . A chief factor H K of G is said to be sigma central in G , if the semidirect product (H K) rtimes(G C G(H K)) is a sigma i group for some i in I . The group G is said to be sigma nilpotent if either G 1 or every chief factor of G is sigma central. In this paper, we study the properties of a finite group G AB , factorized by two sigma nilpotent subgroups A and B , and also generalize some known results.


Contrastive Domain Adaptation. Recently, contrastive self supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains largely underexplored. In this paper, we propose to extend contrastive learning to a new domain adaptation setting, a particular situation occurring where the similarity is learned and deployed on samples following different probability distributions without access to labels. Contrastive learning learns by comparing and contrasting positive and negative pairs of samples in an unsupervised setting without access to source and target labels. We have developed a variation of a recently proposed contrastive learning framework that helps tackle the domain adaptation problem, further identifying and removing possible negatives similar to the anchor to mitigate the effects of false negatives. Extensive experiments demonstrate that the proposed method adapts well, and improves the performance on the downstream domain adaptation task.


Learning Generalizable Vision Tactile Robotic Grasping Strategy for Deformable Objects via Transformer. Reliable robotic grasping, especially with deformable objects such as fruits, remains a challenging task due to underactuated contact interactions with a gripper, unknown object dynamics and geometries. In this study, we propose a Transformer based robotic grasping framework for rigid grippers that leverage tactile and visual information for safe object grasping. Specifically, the Transformer models learn physical feature embeddings with sensor feedback through performing two pre defined explorative actions (pinching and sliding) and predict a grasping outcome through a multilayer perceptron (MLP) with a given grasping strength. Using these predictions, the gripper predicts a safe grasping strength via inference. Compared with convolutional recurrent networks (CNN), the Transformer models can capture the long term dependencies across the image sequences and process spatial temporal features simultaneously. We first benchmark the Transformer models on a public dataset for slip detection. Following that, we show that the Transformer models outperform a CNN LSTM model in terms of grasping accuracy and computational efficiency. We also collect our fruit grasping dataset and conduct online grasping experiments using the proposed framework for both seen and unseen fruits. Our codes and dataset are public on GitHub.


Semi Supervised Few Shot Intent Classification and Slot Filling. Intent classification (IC) and slot filling (SF) are two fundamental tasks in modern Natural Language Understanding (NLU) systems. Collecting and annotating large amounts of data to train deep learning models for such systems is not scalable. This problem can be addressed by learning from few examples using fast supervised meta learning techniques such as prototypical networks. In this work, we systematically investigate how contrastive learning and unsupervised data augmentation methods can benefit these existing supervised meta learning pipelines for jointly modelled IC SF tasks. Through extensive experiments across standard IC SF benchmarks (SNIPS and ATIS), we show that our proposed semi supervised approaches outperform standard supervised meta learning methods contrastive losses in conjunction with prototypical networks consistently outperform the existing state of the art for both IC and SF tasks, while data augmentation strategies primarily improve few shot IC by a significant margin.


Coupling streaming AI and HPC ensembles to achieve 100 1000x faster biomolecular simulations. The use of ML methods to dynamically steer ensemble based simulations promises significant improvements in the performance of scientific applications. We present DeepDriveMD, a tool for a range of prototypical ML driven HPC simulation scenarios, and use it to quantify improvements in the scientific performance of ML driven ensemble based applications. We discuss its design and characterize its performance. Motivated by the potential for further scientific improvements and applicability to more sophisticated physical systems, we extend the design of DeepDriveMD to support stream based communication between simulations and learning methods. It demonstrates a 100x speedup to fold proteins, and performs 1.6x more simulations per unit time, improving resource utilization compared to the sequential framework. Experiments are performed on leadership class platforms, at scales of up to O(1000) nodes, and for production workloads. We establish DeepDriveMD as a high performance framework for ML driven HPC simulation scenarios, that supports diverse simulation and ML back ends, and which enables new scientific insights by improving length and time scale accessed.


One Representative Shot Learning Using a Population Driven Template with Application to Brain Connectivity Classification and Evolution Prediction. Few shot learning presents a challenging paradigm for training discriminative models on a few training samples representing the target classes to discriminate. However, classification methods based on deep learning are ill suited for such learning as they need large amounts of training data let alone one shot learning. Recently, graph neural networks (GNNs) have been introduced to the field of network neuroscience, where the brain connectivity is encoded in a graph. However, with scarce neuroimaging datasets particularly for rare diseases and low resource clinical facilities, such data devouring architectures might fail in learning the target task. In this paper, we take a very different approach in training GNNs, where we aim to learn with one sample and achieve the best performance a formidable challenge to tackle. Specifically, we present the first one shot paradigm where a GNN is trained on a single population driven template namely a connectional brain template (CBT). A CBT is a compact representation of a population of brain graphs capturing the unique connectivity patterns shared across individuals. It is analogous to brain image atlases for neuroimaging datasets. Using a one representative CBT as a training sample, we alleviate the training load of GNN models while boosting their performance across a variety of classification and regression tasks. We demonstrate that our method significantly outperformed benchmark one shot learning methods with downstream classification and time dependent brain graph data forecasting tasks while competing with the train on all conventional training strategy. Our source code can be found at https github.com basiralab one representative shot learning.


Attack Prediction using Hidden Markov Model. It is important to predict any adversarial attacks and their types to enable effective defense systems. Often it is hard to label such activities as malicious ones without adequate analytical reasoning. We propose the use of Hidden Markov Model (HMM) to predict the family of related attacks. Our proposed model is based on the observations often agglomerated in the form of log files and from the target or the victim's perspective. We have built an HMM based prediction model and implemented our proposed approach using Viterbi algorithm, which generates a sequence of states corresponding to stages of a particular attack. As a proof of concept and also to demonstrate the performance of the model, we have conducted a case study on predicting a family of attacks called Action Spoofing.


From Universal Language Model to Downstream Task Improving RoBERTa Based Vietnamese Hate Speech Detection. Natural language processing is a fast growing field of artificial intelligence. Since the Transformer was introduced by Google in 2017, a large number of language models such as BERT, GPT, and ELMo have been inspired by this architecture. These models were trained on huge datasets and achieved state of the art results on natural language understanding. However, fine tuning a pre trained language model on much smaller datasets for downstream tasks requires a carefully designed pipeline to mitigate problems of the datasets such as lack of training data and imbalanced data. In this paper, we propose a pipeline to adapt the general purpose RoBERTa language model to a specific text classification task Vietnamese Hate Speech Detection. We first tune the PhoBERT on our dataset by re training the model on the Masked Language Model task then, we employ its encoder for text classification. In order to preserve pre trained weights while learning new feature representations, we further utilize different training techniques layer freezing, block wise learning rate, and label smoothing. Our experiments proved that our proposed pipeline boosts the performance significantly, achieving a new state of the art on Vietnamese Hate Speech Detection campaign with 0.7221 F1 score.


Homology concordance and knot Floer homology. We study the homology concordance group of knots in integer homology three spheres which bound integer homology four balls. Using knot Floer homology, we construct an infinite number of mathbb Z valued, linearly independent homology concordance homomorphisms which vanish for knots coming from S 3 . This shows that the homology concordance group modulo knots coming from S 3 contains an infinite rank summand. The techniques used here generalize the classification program established in previous papers regarding the local equivalence group of knot Floer complexes over mathbb F U, V (UV) . Our results extend this approach to complexes defined over a broader class of rings.


Sensitivity Analysis for Bottleneck Assignment Problems. In assignment problems, decision makers are often interested in not only the optimal assignment, but also the sensitivity of the optimal assignment to perturbations in the assignment weights. Typically, only perturbations to individual assignment weights are considered. We present a novel extension of the traditional sensitivity analysis by allowing for simultaneous variations in all assignment weights. Focusing on the bottleneck assignment problem, we provide two different methods of quantifying the sensitivity of the optimal assignment, and present algorithms for each. Numerical examples as well as a discussion of the complexity for all algorithms are provided.


Shift Invariance Can Reduce Adversarial Robustness. Shift invariance is a critical property of CNNs that improves performance on classification. However, we show that invariance to circular shifts can also lead to greater sensitivity to adversarial attacks. We first characterize the margin between classes when a shift invariant linear classifier is used. We show that the margin can only depend on the DC component of the signals. Then, using results about infinitely wide networks, we show that in some simple cases, fully connected and shift invariant neural networks produce linear decision boundaries. Using this, we prove that shift invariance in neural networks produces adversarial examples for the simple case of two classes, each consisting of a single image with a black or white dot on a gray background. This is more than a curiosity we show empirically that with real datasets and realistic architectures, shift invariance reduces adversarial robustness. Finally, we describe initial experiments using synthetic data to probe the source of this connection.


An extensive empirical study of inconsistent labels in multi version project defect data sets. The label quality of defect data sets has a direct influence on the reliability of defect prediction models. In this study, for multi version project defect data sets, we propose an approach to automatically detecting instances with inconsistent labels (i.e. the phenomena of instances having the same source code but different labels over multiple versions of a software project) and understand their influence on the evaluation and interpretation of defect prediction models. Based on five multi version project defect data sets (either widely used or the most up to date in the literature) collected by diverse approaches, we find that (1) most versions in the investigated defect data sets contain inconsistent labels with varying degrees (2) the existence of inconsistent labels in a training data set may considerably change the prediction performance of a defect prediction model as well as can lead to the identification of substantially different true defective modules and (3) the importance ranking of independent variables in a defect prediction model can be substantially shifted due to the existence of inconsistent labels. The above findings reveal that inconsistent labels in defect data sets can profoundly change the prediction ability and interpretation of a defect prediction model. Therefore, we strongly suggest that practitioners should detect and exclude inconsistent labels in defect data sets to avoid their potential negative influence on defect prediction models. What is more, it is necessary for researchers to improve existing defect label collection approaches to reduce inconsistent labels. Furthermore, there is a need to re examine the experimental conclusions of previous studies using multi version project defect data sets with a high ratio of inconsistent labels.


Deep learning for low frequency extrapolation of multicomponent data in elastic full waveform inversion. Full waveform inversion (FWI) strongly depends on an accurate starting model to succeed. This is particularly true in the elastic regime The cycle skipping phenomenon is more severe in elastic FWI compared to acoustic FWI, due to the short S wave wavelength. In this paper, we extend our work on extrapolated FWI (EFWI) by proposing to synthesize the low frequencies of multi component elastic seismic records, and use those "artificial" low frequencies to seed the frequency sweep of elastic FWI. Our solution involves deep learning we separately train the same convolutional neural network (CNN) on two training datasets, one with vertical components and one with horizontal components of particle velocities, to extrapolate the low frequencies of elastic data. The architecture of this CNN is designed with a large receptive field, by either large convolutional kernels or dilated convolution. Numerical examples on the Marmousi2 model show that the 2 4Hz low frequency data extrapolated from band limited data above 4Hz provide good starting models for elastic FWI of P wave and S wave velocities. Additionally, we study the generalization ability of the proposed neural network over different physical models. For elastic test data, collecting the training dataset by elastic simulation shows better extrapolation accuracy than acoustic simulation, i.e., a smaller generalization gap.


Detecting Anomalies in Software Execution Logs with Siamese Network. Logs are semi structured text files that represent software's execution paths and states during its run time. Therefore, detecting anomalies in software logs reflect anomalies in the software's execution path or state. So, it has become a notable concern in software engineering. We use LSTM like many prior works, and on top of LSTM, we propose a novel anomaly detection approach based on the Siamese network. This paper also provides an authentic validation of the approach on the Hadoop Distributed File System (HDFS) log dataset. To the best of our knowledge, the proposed approach outperforms other methods on the same dataset at the F1 score of 0.996, resulting in a new state of the art performance on the dataset. Along with the primary method, we introduce a novel training pair generation algorithm that reduces generated training pairs by the factor of 3000 while maintaining the F1 score, merely a modest decay from 0.996 to 0.995. Additionally, we propose a hybrid model by combining the Siamese network with a traditional feedforward neural network to make end to end training possible, reducing engineering effort in setting up a deep learning based log anomaly detector. Furthermore, we examine our method's robustness to log evolutions by evaluating the model on synthetically evolved log sequences we got the F1 score of 0.95 at the noise ratio of 20 . Finally, we dive deep into some of the side benefits of the Siamese network. Accordingly, we introduce a method of monitoring the evolutions of logs without label requirements at run time. Additionally, we present a visualization technique that facilitates human administrations of log anomaly detection.


Mutation Testing in Evolving Systems Studying the relevance of mutants to code evolution. When software evolves, opportunities for introducing faults appear. Therefore, it is important to test the evolved program behaviors during each evolution cycle. We conduct an exploratory study to investigate the properties of commit relevant mutants, i.e., the test elements of commit aware mutation testing, by offering a general definition and an experimental approach to identify them. We thus, aim at investigating the prevalence, location, comparative advantages of commit aware mutation testing over time (i.e., the program evolution) and the predictive power of several commit related features to understand the essential properties for its best effort application case. Our approach utilizes the impact of mutants and the effects of one mutant on another in capturing and analyzing the implicit interactions between the changed and unchanged code parts. The study analyses millions of mutants (over 10 million), 288 commits, five (5) different open source software projects involving over 68,213 CPU days of computation and sets a ground truth where we perform our analysis. Our analysis shows that commit relevant mutants are located mainly outside of program commit change (81 ), while an effective selection of commit relevant mutants can reduce the number of mutants by up to 93 . In addition, we demonstrate that commit relevant mutation testing is significantly more effective and efficient than state of the art baselines. Our analysis of the predictive power of mutants and commit related features in predicting commit relevant mutants found that most proxy features do not reliably predict commit relevant mutants. This empirical study highlights the properties of commit relevant mutants and demonstrates the importance of identifying and selecting commit relevant mutants when testing evolving software systems.


Characterization of Gromov type geodesics. The collection mathcal M of all isometry classes of compact metric spaces endowed with the Gromov Hausdorff distance d mathcal GH is known to be a geodesic space. However, there is no known structural characterization of geodesics in mathcal M . In this paper we provide two such characterizations. We first prove that every Gromov Hausdorff geodesic is in fact a geodesic in the Hausdorff hyperspace of some compact metric space, which we call a Hausdorff geodesic. Inspired by this characterization, we further elucidate a structural connection between Hausdorff geodesics and Wasserstein geodesics every Hausdorff geodesic is equivalent to a so called Hausdorff displacement interpolation. This equivalence allows us to establish that every Gromov Hausdorff geodesic is dynamic, a notion which we develop in analogy with dynamic optimal couplings in the theory of optimal transport. Besides geodesics in mathcal M , we also study geodesics on the collection mathcal M w of isomorphism classes of compact metric measure spaces. Sturm constructed a family of Gromov type distances on mathcal M w , which we denote d mathcal GW , p mathrm S (for p in 1, infty) ), and proved that ( mathcal M w,d mathcal GW , p mathrm S ) is also a geodesic space. We are interested in d mathcal GW , p mathrm S geodesics which are (essentially) Wasserstein geodesics. We prove the set of such geodesics is dense in the set of all d mathcal GW , p mathrm S geodesics and identify a rich class of such geodesics.


Domain Generalization with MixStyle. Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set of source domains a model that is generalizable to any unseen domain. In this paper, a novel approach is proposed based on probabilistically mixing instance level feature statistics of training samples across source domains. Our method, termed MixStyle, is motivated by the observation that visual domain is closely related to image style (e.g., photo vs. sketch images). Such style information is captured by the bottom layers of a CNN where our proposed style mixing takes place. Mixing styles of training instances results in novel domains being synthesized implicitly, which increase the domain diversity of the source domains, and hence the generalizability of the trained model. MixStyle fits into mini batch training perfectly and is extremely easy to implement. The effectiveness of MixStyle is demonstrated on a wide range of tasks including category classification, instance retrieval and reinforcement learning.


Moduli of elliptic curves in products of projective spaces. We exhibit a smooth compactification of the moduli space of elliptic curves in a product of projective spaces with tangency along a subset of its toric boundary divisors. This is a Vakil Zinger type of desingularization for maps to a product of projective spaces using ideas of elliptic singularities and logarithmic geometry, extending the recent work by Ranganathan Santos Parker Wise. We use this to construct the virtual fundamental classes of the spaces of genus 1 maps to a special class of simple normal crossings pairs.


Rational Matrix Valued Pick Functions of Several Variables. For a rational function of several variables with nonnegative imaginary part on the upper poly half plane, the matrix representations are obtained.


Idris 2 Quantitative Type Theory in Practice. Dependent types allow us to express precisely what a function is intended to do. Recent work on Quantitative Type Theory (QTT) extends dependent type systems with linearity, also allowing precision in expressing when a function can run. This is promising, because it suggests the ability to design and reason about resource usage protocols, such as we might find in distributed and concurrent programming, where the state of a communication channel changes throughout program execution. As yet, however, there has not been a full scale programming language with which to experiment with these ideas. Idris 2 is a new version of the dependently typed language Idris, with a new core language based on QTT, supporting linear and dependent types. In this paper, we introduce Idris 2, and describe how QTT has influenced its design. We give examples of the benefits of QTT in practice including expressing which data is erased at run time, at the type level and, resource tracking in the type system leading to type safe concurrent programming with session types.


MUFASA Multimodal Fusion Architecture Search for Electronic Health Records. One important challenge of applying deep learning to electronic health records (EHR) is the complexity of their multimodal structure. EHR usually contains a mixture of structured (codes) and unstructured (free text) data with sparse and irregular longitudinal features all of which doctors utilize when making decisions. In the deep learning regime, determining how different modality representations should be fused together is a difficult problem, which is often addressed by handcrafted modeling and intuition. In this work, we extend state of the art neural architecture search (NAS) methods and propose MUltimodal Fusion Architecture SeArch (MUFASA) to simultaneously search across multimodal fusion strategies and modality specific architectures for the first time. We demonstrate empirically that our MUFASA method outperforms established unimodal NAS on public EHR data with comparable computation costs. In addition, MUFASA produces architectures that outperform Transformer and Evolved Transformer. Compared with these baselines on CCS diagnosis code prediction, our discovered models improve top 5 recall from 0.88 to 0.91 and demonstrate the ability to generalize to other EHR tasks. Studying our top architecture in depth, we provide empirical evidence that MUFASA's improvements are derived from its ability to both customize modeling for each data modality and find effective fusion strategies.


On the combination of static analysis for software security assessment a case study of an open source e government project. Static Application Security Testing (SAST) is a popular quality assurance technique in software engineering. However, integrating SAST tools into industry level product development and security assessment poses various technical and managerial challenges. In this work, we reported a longitudinal case study of adopting SAST as a part of a human driven security assessment for an open source e government project. We described how SASTs are selected, evaluated, and combined into a novel approach for software security assessment. The approach was preliminarily evaluated using semi structured interviews. Our result shows that (1) while some SAST tools out perform others, it is possible to achieve better performance by combining more than one SAST tools and (2) SAST tools should be used towards a practical performance and in the combination with triangulated approaches for human driven vulnerability assessment in real world projects.


Get a Model! Model Hijacking Attack Against Machine Learning Models. Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning models, multiple attacks have emerged. One class of such attacks is training time attack, whereby an adversary executes their attack before or during the machine learning model training. In this work, we propose a new training time attack against computer vision based machine learning models, namely model hijacking attack. The adversary aims to hijack a target model to execute a different task than its original one without the model owner noticing. Model hijacking can cause accountability and security risks since a hijacked model owner can be framed for having their model offering illegal or unethical services. Model hijacking attacks are launched in the same way as existing data poisoning attacks. However, one requirement of the model hijacking attack is to be stealthy, i.e., the data samples used to hijack the target model should look similar to the model's original training dataset. To this end, we propose two different model hijacking attacks, namely Chameleon and Adverse Chameleon, based on a novel encoder decoder style ML model, namely the Camouflager. Our evaluation shows that both of our model hijacking attacks achieve a high attack success rate, with a negligible drop in model utility.


On a conjecture about contractive inequalities for weighted Bergman spaces. We are interested in the norm of the inclusion between the standard weighted Bergman spaces A 2 alpha and A p frac p 2 ( alpha 2) 2 , p 2 , which is conjectured to be contractive by O.F. Brevig, J. Ortega Cerd a, K. Seip and J. Zhao (in the limit case alpha 1 ) and E. Lieb and J.P. Solovej (for alpha 1 ). We provide some partial answers and improvements of some recent results.


Partial differential equation solver based on optimization methods. The numerical solution methods for partial differential equation (PDE) solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods usually have the restricted class of the equations, on which the convergence is proved. Only a small amount of "cheap and dirty" numerical methods converge on a wide class of equations with the lower approximation order price. In the article, we present a method that uses an optimization algorithm to obtain a solution that could be used as the initial guess for the wide class of equations.


Robust Connectivity of Graphs on Surfaces. Let Lambda(T) denote the set of leaves in a tree T . One natural problem is to look for a spanning tree T of a given graph G such that Lambda(T) is as large as possible. This problem is called maximum leaf number, and it is a well known NP hard problem. Throughout recent decades, this problem has received considerable attention, ranging from pure graph theoretic questions to practical problems related to the construction of wireless networks. Recently, a similar but stronger notion was defined by Bradshaw, Masa v r 'ik, and Stacho Flexible List Colorings in Graphs with Special Degeneracy Conditions, ISAAC 2020 . They introduced a new invariant for a graph G , called the robust connectivity and written kappa rho(G) , defined as the minimum value frac R cap Lambda (T) R taken over all nonempty subsets R subseteq V(G) , where T T(R) is a spanning tree on G chosen to maximize R cap Lambda(T) . Large robust connectivity was originally used to show flexible choosability in non regular graphs. In this paper, we investigate some interesting properties of robust connectivity for graphs embedded in surfaces. We prove a tight asymptotic bound of Omega( gamma frac 1 r ) for the robust connectivity of r connected graphs of Euler genus gamma . Moreover, we give a surprising connection between the robust connectivity of graphs with an edge maximal embedding in a surface and the surface connectivity of that surface, which describes to what extent large induced subgraphs of embedded graphs can be cut out from the surface without splitting the surface into multiple parts. For planar graphs, this connection provides an equivalent formulation of a long standing conjecture of Albertson and Berman A conjecture on planar graphs, 1979 , which states that every planar graph on n vertices contains an induced forest of size at least n 2 .


On the Convexity of Level sets of Probability Functions. In decision making problems under uncertainty, probabilistic constraints are a valuable tool to express safety of decisions. They result from taking the probability measure of a given set of random inequalities depending on the decision vector. Even if the original set of inequalities is convex, this favourable property is not immediately transferred to the probabilistically constrained feasible set and may in particular depend on the chosen safety level. In this paper, we provide results guaranteeing the convexity of feasible sets to probabilistic constraints when the safety level is greater than a computable threshold. Our results extend all the existing ones and also cover the case where decision vectors belong to Banach spaces. The key idea in our approach is to reveal the level of underlying convexity in the nominal problem data (e.g., concavity of the probability function) by auxiliary transforming functions. We provide several examples illustrating our theoretical developments.


Low regularity local well posedness for the zero energy Novikov Veselov equation. The initial value problem u(x,y,0) u 0(x,y) for the Novikov Veselov equation partial tu ( partial 3 overline partial 3)u 3( partial (u overline partial 1 partial u) overline partial (u partial 1 overline partial u)) 0 is investigated by the Fourier restriction norm method. Local well posedness is shown in the nonperiodic case for u 0 in H s( mathbb R 2) with s frac 3 4 and in the periodic case for data u 0 in H s 0( mathbb T 2) with mean zero, where s frac 1 5 . Both results rely on the structure of the nonlinearity, which becomes visible with a symmetrization argument. Additionally, for the periodic problem a bilinear Strichartz type estimate is derived.


Towards a Trusted Execution Environment via Reconfigurable FPGA. Trusted Execution Environments (TEEs) are used to protect sensitive data and run secure execution for security critical applications, by providing an environment isolated from the rest of the system. However, over the last few years, TEEs have been proven weak, as either TEEs built upon security oriented hardware extensions (e.g., Arm TrustZone) or resorting to dedicated secure elements were exploited multiple times. In this project, we introduce Trusted Execution Environments On Demand (TEEOD), a novel TEE design that leverages the programmable logic (PL) in the heterogeneous system on chips (SoC) as the secure execution environment. Unlike other TEE designs, TEEOD can provide high bandwidth connections and physical on chip isolation. We implemented a proof of concept (PoC) implementation targeting an Ultra96 V2 platform. The conducted evaluation demonstrated TEEOD can host up to 6 simultaneous enclaves with a resource usage per enclave of 7.0 , 3.8 , and 15.3 of the total LUTs, FFs, and BRAMS, respectively. To demonstrate the practicability of TEEOD in real world applications, we successfully run a legacy open source Bitcoin wallet.


The Online Pivot Lessons Learned from Teaching a Text and Data Mining Course in Lockdown, Enhancing online Teaching with Pair Programming and Digital Badges. In this paper we provide an account of how we ported a text and data mining course online in summer 2020 as a result of the COVID 19 pandemic and how we improved it in a second pilot run. We describe the course, how we adapted it over the two pilot runs and what teaching techniques we used to improve students' learning and community building online. We also provide information on the relentless feedback collected during the course which helped us to adapt our teaching from one session to the next and one pilot to the next. We discuss the lessons learned and promote the use of innovative teaching techniques applied to the digital such as digital badges and pair programming in break out rooms for teaching Natural Language Processing courses to beginners and students with different backgrounds.


Nonsmooth Implicit Differentiation for Machine Learning and Optimization. In view of training increasingly complex learning architectures, we establish a nonsmooth implicit function theorem with an operational calculus. Our result applies to most practical problems (i.e., definable problems) provided that a nonsmooth form of the classical invertibility condition is fulfilled. This approach allows for formal subdifferentiation for instance, replacing derivatives by Clarke Jacobians in the usual differentiation formulas is fully justified for a wide class of nonsmooth problems. Moreover this calculus is entirely compatible with algorithmic differentiation (e.g., backpropagation). We provide several applications such as training deep equilibrium networks, training neural nets with conic optimization layers, or hyperparameter tuning for nonsmooth Lasso type models. To show the sharpness of our assumptions, we present numerical experiments showcasing the extremely pathological gradient dynamics one can encounter when applying implicit algorithmic differentiation without any hypothesis.


Matching with Transformers in MELT. One of the strongest signals for automated matching of ontologies and knowledge graphs are the textual descriptions of the concepts. The methods that are typically applied (such as character or token based comparisons) are relatively simple, and therefore do not capture the actual meaning of the texts. With the rise of transformer based language models, text comparison based on meaning (rather than lexical features) is possible. In this paper, we model the ontology matching task as classification problem and present approaches based on transformer models. We further provide an easy to use implementation in the MELT framework which is suited for ontology and knowledge graph matching. We show that a transformer based filter helps to choose the correct correspondences given a high recall alignment and already achieves a good result with simple alignment post processing methods.


Integers that are sums of two rational sixth powers. We prove that 164634913 is the smallest positive integer that is a sum of two rational sixth powers but not a sum of two integer sixth powers. If C k is the curve x 6 y 6 k , we use the existence of morphisms from C k to elliptic curves, together with the Mordell Weil sieve, to rule out the existence of rational points on C k for various k .


Contrastive Explanations of Plans Through Model Restrictions. In automated planning, the need for explanations arises when there is a mismatch between a proposed plan and the user's expectation. We frame Explainable AI Planning in the context of the plan negotiation problem, in which a succession of hypothetical planning problems are generated and solved. The object of the negotiation is for the user to understand and ultimately arrive at a satisfactory plan. We present the results of a user study that demonstrates that when users ask questions about plans, those questions are contrastive, i.e. "why A rather than B?". We use the data from this study to construct a taxonomy of user questions that often arise during plan negotiation. We formally define our approach to plan negotiation through model restriction as an iterative process. This approach generates hypothetical problems and contrastive plans by restricting the model through constraints implied by user questions. We formally define model based compilations in PDDL2.1 of each constraint derived from a user question in the taxonomy, and empirically evaluate the compilations in terms of computational complexity. The compilations were implemented as part of an explanation framework that employs iterative model restriction. We demonstrate its benefits in a second user study.


Identifying COVID 19 Fake News in Social Media. The evolution of social media platforms have empowered everyone to access information easily. Social media users can easily share information with the rest of the world. This may sometimes encourage spread of fake news, which can result in undesirable consequences. In this work, we train models which can identify health news related to COVID 19 pandemic as real or fake. Our models achieve a high F1 score of 98.64 . Our models achieve second place on the leaderboard, tailing the first position with a very narrow margin 0.05 points.


Optimal pebbling of complete binary trees and a meta Fibonacci sequence. In this paper, we present a new method for determining the optimal pebbling number of a complete binary tree. This method reveals a curious connection between the optimal pebbling numbers of complete binary trees and the Conolly Fox sequence, a type of meta Fibonacci sequence.


Monte Carlo Tree Search for high precision manufacturing. Monte Carlo Tree Search (MCTS) has shown its strength for a lot of deterministic and stochastic examples, but literature lacks reports of applications to real world industrial processes. Common reasons for this are that there is no efficient simulator of the process available or there exist problems in applying MCTS to the complex rules of the process. In this paper, we apply MCTS for optimizing a high precision manufacturing process that has stochastic and partially observable outcomes. We make use of an expert knowledge based simulator and adapt the MCTS default policy to deal with the manufacturing process.


Iso geometric Integral Equation Solvers and their Compression via Manifold Harmonics. The state of art of electromagnetic integral equations has seen significant growth over the past few decades, overcoming some of the fundamental bottlenecks computational complexity, low frequency and dense discretization breakdown, preconditioning, and so on. Likewise, the community has seen extensive investment in development of methods for higher order analysis, in both geometry and physics. Unfortunately, these standard geometric descriptors are continuous, but their normals are discontinuous at the boundary between triangular tessellations of control nodes, or patches, with a few exceptions as a result, one needs to define additional mathematical infrastructure to define physical basis sets for vector problems. In stark contrast, the geometric representation used for design are second order differentiable almost everywhere on the surfaces. Using these description for analysis opens the door to several possibilities, and is the area we explore in this paper. Our focus is on Loop subdivision based isogeometric methods. In this paper, our goals are two fold (i) development of computational infrastructure for isogeometric analysis of electrically large simply connected objects, and (ii) to introduce the notion of manifold harmonics transforms and its utility in computational electromagnetics. Several results highlighting the efficacy of these two methods are presented.


Millimeter Wave Beamforming with Continuous Coverage for Mobile Interactive Virtual Reality. Contemporary Virtual Reality (VR) setups commonly consist of a Head Mounted Display (HMD) tethered to a content generating server. "Cutting the wire" in such setups and going truly wireless will require a wireless network capable of delivering enormous amounts of video data at an extremely low latency. Higher frequencies, such as the millimeter wave (mmWave) band, can support these requirements. Due to high attenuation and path loss in the mmWave frequencies, beamforming is essential. For VR setups, beamforming must adapt in real time to the user's head rotations, but can rely on the HMD's built in sensors providing accurate orientation estimates. In this work, we present coVRage, a beamforming solution tailored for VR HMDs. Based on past and current head orientations, the HMD predicts how the Angle of Arrival (AoA) from the access point will change in the near future, and covers this AoA trajectory with a dynamically shaped beam, synthesized using sub arrays. We show that this solution can cover such trajectories with consistently high gain, unlike regular single beam solutions.


Neural Optimization Understanding Trade offs with Pareto Theory. Nervous systems, like any organismal structure, have been shaped by evolutionary processes to increase fitness. The resulting neural 'bauplan' has to account for multiple objectives simultaneously, including computational function as well as additional factors like robustness to environmental changes and energetic limitations. Oftentimes these objectives compete and a quantification of the relative impact of individual optimization targets is non trivial. Pareto optimality offers a theoretical framework to decipher objectives and trade offs between them. We, therefore, highlight Pareto theory as a useful tool for the analysis of neurobiological systems, from biophysically detailed cells to large scale network structures and behavior. The Pareto approach can help to assess optimality, identify relevant objectives and their respective impact, and formulate testable hypotheses.


StRETcH a Soft to Resistive Elastic Tactile Hand. Soft optical tactile sensors enable robots to manipulate deformable objects by capturing important features such as high resolution contact geometry and estimations of object compliance. This work presents a variable stiffness soft tactile end effector called StRETcH, a Soft to Resistive Elastic Tactile Hand, that is easily manufactured and integrated with a robotic arm. An elastic membrane is suspended between two robotic fingers, and a depth sensor capturing the deformations of the elastic membrane enables sub millimeter accurate estimates of contact geometries. The parallel jaw gripper varies the stiffness of the membrane by uni axially stretching it, which controllably modulates StRETcH's effective modulus from approximately 4kPa to 9kPa. This work uses StRETcH to reconstruct the contact geometry of rigid and deformable objects, estimate the stiffness of four balloons filled with different substances, and manipulate dough into a desired shape.


A Robotic Approach towards Quantifying Epipelagic Bound Plastic Using Deep Visual Models. The quantification of positively buoyant marine plastic debris is critical to understanding how plastic litter accumulates across the world's oceans and is also crucial to identifying hotspots for targeted cleanup efforts. Currently, the most common method to quantify marine plastic is using manta trawls for manual sampling. However, this method is cost intensive and requires human labor. This study removes the need for manual sampling by using an autonomous method using neural networks and computer vision models, which trained on images captured from various layers of the ocean column to perform real time plastic quantification. The best performing model has a Mean Average Precision of 85 and an F1 Score of 0.89 while maintaining near real time processing speeds 2 ms img.


A Better Loss for Visual Textual Grounding. Given a textual phrase and an image, the visual grounding problem is the task of locating the content of the image referenced by the sentence. It is a challenging task that has several real world applications in human computer interaction, image text reference resolution, and video text reference resolution. In the last years, several works have addressed this problem by proposing more and more large and complex models that try to capture visual textual dependencies better than before. These models are typically constituted by two main components that focus on how to learn useful multi modal features for grounding and how to improve the predicted bounding box of the visual mention, respectively. Finding the right learning balance between these two sub tasks is not easy, and the current models are not necessarily optimal with respect to this issue. In this work, we propose a loss function based on bounding boxes classes probabilities that (i) improves the bounding boxes selection (ii) improves the bounding boxes coordinates prediction. Our model, although using a simple multi modal feature fusion component, is able to achieve a higher accuracy than state of the art models on two widely adopted datasets, reaching a better learning balance between the two sub tasks mentioned above.


BiblioDAP The 1st Workshop on Bibliographic Data Analysis and Processing. Automatic processing of bibliographic data becomes very important in digital libraries, data science and machine learning due to its importance in keeping pace with the significant increase of published papers every year from one side and to the inherent challenges from the other side. This processing has several aspects including but not limited to I) Automatic extraction of references from PDF documents, II) Building an accurate citation graph, III) Author name disambiguation, etc. Bibliographic data is heterogeneous by nature and occurs in both structured (e.g. citation graph) and unstructured (e.g. publications) formats. Therefore, it requires data science and machine learning techniques to be processed and analysed. Here we introduce BiblioDAP'21 The 1st Workshop on Bibliographic Data Analysis and Processing.


The First Chiral Homology Group. We study the first chiral homology group of elliptic curves with coefficients in vacuum insertions of a conformal vertex algebra V. We find finiteness conditions on V guaranteeing that these homologies are finite dimensional, generalizing the C 2 cofinite, or quasi lisse condition in the degree 0 case. We determine explicitly the flat connections that these homologies acquire under smooth variation of the elliptic curve, as insertions of the conformal vector and the Weierstrass zeta function. We construct linear functionals associated to self extensions of V modules and prove their convergence under said finiteness conditions. These linear functionals turn out to be degree 1 analogs of the n point functions in the degree 0 case. As a corollary we prove the vanishing of the first chiral homology group of an elliptic curve with values in several rational vertex algebras, including affine sl 2 at non negative integral level, the (2,2k 1) minimal models and arbitrary simple affine vertex algebras at level 1. Of independent interest, we prove a Fourier space version of the Borcherds formula.


A fast iterative PDE based algorithm for feedback controls of nonsmooth mean field control problems. A PDE based accelerated gradient algorithm is proposed to seek optimal feedback controls of McKean Vlasov dynamics subject to nonsmooth costs, whose coefficients involve mean field interactions both on the state and action. It exploits a forward backward splitting approach and iteratively refines the approximate controls based on the gradients of smooth costs, the proximal maps of nonsmooth costs, and dynamically updated momentum parameters. At each step, the state dynamics is realized via a particle approximation, and the required gradient is evaluated through a coupled system of nonlocal linear PDEs. The latter is solved by finite difference approximation or neural network based residual approximation, depending on the state dimension. Exhaustive numerical experiments for low and high dimensional mean field control problems, including sparse stabilization of stochastic Cucker Smale models, are presented, which reveal that our algorithm captures important structures of the optimal feedback control, and achieves a robust performance with respect to parameter perturbation.


Fully discrete spatial eigenanalysis of discontinuous spectral element methods insights into well resolved and under resolved vortical flows. This study presents a comprehensive spatial eigenanalysis of fully discrete discontinuous spectral element methods, now generalizing previous spatial eigenanalysis that did not include time integration errors. The influence of discrete time integration is discussed in detail for different explicit Runge Kutta (1st to 4th order accurate) schemes combined with either Discontinuous Galerkin (DG) or Spectral Difference (SD) methods, both here recovered from the Flux Reconstruction (FR) scheme. Selected numerical experiments using the improved SD method by Liang and Jameson 1 are performed to quantify the influence of time integration errors on actual simulations. These involve test cases of varied complexity, from one dimensional linear advection equation studies to well resolved and under resolved inviscid vortical flows. It is shown that, while both well resolved and under resolved simulations of linear problems correlate well with the eigenanalysis prediction of time integration errors, the correlation can be much worse for under resolved nonlinear problems. The effect of mesh regularity is also considered, where time integration errors are found to be, in the case of irregular grids, less pronounced than those of the spatial discretisation. In fact, for the under resolved vortical flows considered, the predominance of spatial errors made it practically impossible for time integration errors to be distinctly identified. Nevertheless, for well resolved nonlinear simulations, the effect of time integration errors could still be recognized. This highlights that the interaction between space and time discretisation errors is more complex than otherwise anticipated, contributing to the current understanding about when eigenanalysis can effectively predict the behaviour of numerical errors in practical under resolved nonlinear problems, including under resolved turbulence computations.


Using Knowledge Embedded Attention to Augment Pre trained Language Models for Fine Grained Emotion Recognition. Modern emotion recognition systems are trained to recognize only a small set of emotions, and hence fail to capture the broad spectrum of emotions people experience and express in daily life. In order to engage in more empathetic interactions, future AI has to perform textit fine grained emotion recognition, distinguishing between many more varied emotions. Here, we focus on improving fine grained emotion recognition by introducing external knowledge into a pre trained self attention model. We propose Knowledge Embedded Attention (KEA) to use knowledge from emotion lexicons to augment the contextual representations from pre trained ELECTRA and BERT models. Our results and error analyses outperform previous models on several datasets, and is better able to differentiate closely confusable emotions, such as afraid and terrified.


Data Placement for Multi Tenant Data Federation on the Cloud. Due to privacy concerns of users and law enforcement in data security and privacy, it becomes more and more difficult to share data among organizations. Data federation brings new opportunities to the data related cooperation among organizations by providing abstract data interfaces. With the development of cloud computing, organizations store data on the cloud to achieve elasticity and scalability for data processing. The existing data placement approaches generally only consider one aspect, which is either execution time or monetary cost, and do not consider data partitioning for hard constraints. In this paper, we propose an approach to enable data processing on the cloud with the data from different organizations. The approach consists of a data federation platform named FedCube and a Lyapunov based data placement algorithm. FedCube enables data processing on the cloud. We use the data placement algorithm to create a plan in order to partition and store data on the cloud so as to achieve multiple objectives while satisfying the constraints based on a multi objective cost model. The cost model is composed of two objectives, i.e., reducing monetary cost and execution time. We present an experimental evaluation to show our proposed algorithm significantly reduces the total cost (up to 69.8 ) compared with existing approaches.


Higher Dimensional Cardinal Characteristics for Sets of Functions II. We study the values of the higher dimensional cardinal characteristics for sets of functions f omega omega to omega omega introduced by the second author. We prove that while the bounding numbers for these cardinals can be strictly less than the continuum, the dominating numbers cannot. We compute the bounding numbers for the higher dimensional relations in many well known models of neg mathsf CH such as the Cohen, random and Sacks models and, as a byproduct show that, with possibly one exception, for the bounding numbers there are no mathsf ZFC relations between them beyond those in the higher dimensional Cicho ' n diagram. In the case of the dominating numbers we show that in fact they collapse in the sense that modding out by the ideal does not change their values. Moreover, they are closely related to the dominating numbers mathfrak d lambda kappa .


Diffusion Approximations for text Cox G t infty Queues In A Fast Oscillatory Random Environment. We study infinite server queues driven by Cox processes in a fast oscillatory random environment. While exact performance analysis is difficult, we establish diffusion approximations to the (re scaled) number in system process by proving functional central limit theorems (FCLTs) using a stochastic homogenization framework. This framework permits the establishment of quenched and annealed limits in a unified manner. At the quantitative level, we identity two parameter regimes, termed subcritical and supercritical indicating the relative dominance between the two underlying stochasticities driving our system the randomness in the arrival intensity and that in the serivce times. We show that while quenched FCLTs can only be established in the subcritical regime, annealed FCLTs can be proved in both cases. Furthermore, the limiting diffusions in the annealed FCLTs display qualitatively different diffusivity properties in the two regimes, even though the stochastic primitives are identical. In particular, when the service time distribution is heavy tailed, the diffusion is sub and super diffusive in the sub and super critical cases. The results illustrate intricate interactions between the underlying driving forces of our system.


Killing magnetic curves in non flat Lorentzian Heisenberg spaces. We obtain some explicit formulas for Killing magnetic curves in non flat Lorentzian Heisenberg spaces.


Low Complexity PIR Using Subfield Subcodes. A major drawback of many PIR schemes is the highcomputational cost at the servers. We present a scheme that usesonly operations in the prime field during response generation.For binary extension fields this leads to schemes that only needXOR operations at the servers to calculate the responses. This isachieved by restricting the queries to a subfield subcode or tracecode. We investigate possible parameter ranges and focus on theexample of GRS codes and subfield subcodes of these.


Robust Multi echo GRE Phase processing using a unity rank enforced complex exponential model. Purpose Develop a processing scheme for Gradient Echo (GRE) phase to enable restoration of susceptibility related (SuR) features in regions affected by imperfect phase unwrapping, background suppression and low signal to noise ratio (SNR) due to phase dispersion. Theory and Methods The predictable components sampled across the echo dimension in a multi echo GRE sequence are recovered by rank minimizing a Hankel matrix formed using the complex exponential of the background suppressed phase. To estimate the single frequency component that relates to the susceptibility induced field, it is required to maintain consistency with the measured phase after background suppression, penalized by a unity rank approximation (URA) prior. This is formulated as an optimization problem, implemented using the alternating direction method of multiplier (ADMM). Results With in vivo multi echo GRE data, the magnitude susceptibility weighted image (SWI) reconstructed using URA prior shows additional venous structures that are obscured due to phase dispersion and noise in regions subject to remnant non local field variations. The performance is compared with the susceptibility map weighted imaging (SMWI) and the standard SWI. It is also shown using numerical simulation that quantitative susceptibility map (QSM) computed from the reconstructed phase exhibits reduced artifacts and quantification error. In vivo experiments reveal iron depositions in insular, motor cortex and superior frontal gyrus that are not identified in standard QSM. Conclusion URA processed GRE phase is less sensitive to imperfections in the phase pre processing techniques, and thereby enable robust estimation of SWI and QSM.


Role of elasto inertial turbulence in viscoelastic drag reducing turbulence. Two kinds of nonlinearities coexist in viscoelastic fluid flows, i.e., inertia and elasticity, which can engender different types of chaotic states including IT, DRT, ET and EIT. The state of MDR, the ultimate state of DRT induced by adding polymers to Newtonian IT, is recently regarded as EIT. This letter quantitatively demonstrates the role of IT and EIT in DRT via the contributions of RSS and the nonlinear part of ESS to flow drag. The nature of DRT is re examined in a wide range of flow conditions covering a series of flow regimes from the onset of DR to MDR. We argue that EIT related dynamics appears in DRT long before settling to MDR regime and competitively coexists with IT in both spatial and temporal domain at moderate and high Re. More specifically, at low DR condition, EIT firstly emerges close to the channel walls. With the increase of elasticity, low drag EIT gradually replaces high drag IT from channel walls to center, resulting in a drastic decrease of flow drag comparing with IT. When EIT dynamics dominates the whole channel, MDR phenomenon is formed. Our findings provide evidences that DRT phenomenon is the result of IT and EIT interaction.


Robust Feedback Motion Policy Design Using Reinforcement Learning on a 3D Digit Bipedal Robot. In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade structure controller that combines the learning process with intuitive feedback regulations. This design allows the framework to realize robust and stable walking with a reduced dimension state and action spaces of the policy, significantly simplifying the design and reducing the sampling efficiency of the learning method. The inclusion of feedback regulation into the framework improves the robustness of the learned walking gait and ensures the success of the sim to real transfer of the proposed controller with minimal tuning. We specifically present a learning pipeline that considers hardware feasible initial poses of the robot within the learning process to ensure the initial state of the learning is replicated as close as possible to the initial state of the robot in hardware experiments. Finally, we demonstrate the feasibility of our method by successfully transferring the learned policy in simulation to the Digit robot hardware, realizing sustained walking gaits under external force disturbances and challenging terrains not included during the training process. To the best of our knowledge, this is the first time a learning based policy is transferred successfully to the Digit robot in hardware experiments without using dynamic randomization or curriculum learning.


Improve Agents without Retraining Parallel Tree Search with Off Policy Correction. Tree Search (TS) is crucial to some of the most influential successes in reinforcement learning. Here, we tackle two major challenges with TS that limit its usability textit distribution shift and textit scalability . We first discover and analyze a counter intuitive phenomenon action selection through TS and a pre trained value function often leads to lower performance compared to the original pre trained agent, even when having access to the exact state and reward in future steps. We show this is due to a distribution shift to areas where value estimates are highly inaccurate and analyze this effect using Extreme Value theory. To overcome this problem, we introduce a novel off policy correction term that accounts for the mismatch between the pre trained value and its corresponding TS policy by penalizing under sampled trajectories. We prove that our correction eliminates the above mismatch and bound the probability of sub optimal action selection. Our correction significantly improves pre trained Rainbow agents without any further training, often more than doubling their scores on Atari games. Next, we address the scalability issue given by the computational complexity of exhaustive TS that scales exponentially with the tree depth. We introduce Batch BFS a GPU breadth first search that advances all nodes in each depth of the tree simultaneously. Batch BFS reduces runtime by two orders of magnitude and, beyond inference, enables also training with TS of depths that were not feasible before. We train DQN agents from scratch using TS and show improvement in several Atari games compared to both the original DQN and the more advanced Rainbow.


Logarithmically complete monotonicity of reciprocal arctan function. We prove the conjecture stated in F. Qi and R. Agarwal, textit On complete monotonicity for several classes of functions related to ratios of gamma functions , J. Inequal. Appl. (2019), 1 42, that the function 1 arctan is logarithmically completely monotonic on (0, infty) , but not a Stieltjes transform.


Gamma integral structure for an invertible polynomial of chain type. The notion of the Gamma integral structure for the quantum cohomology of an algebraic variety was introduced by Iritani, Katzarkov Kontsevich Pantev. In this paper, we define the Gamma integral structure for an invertible polynomial of chain type. Based on the Gamma conjecture by Iritani, we prove that the Gamma integral structure is identified with the natural integral structure for the Berglund H " u bsch transposed polynomial by the mirror isomorphism.


OHPL One shot Hand eye Policy Learner. The control of a robot for manipulation tasks generally relies on object detection and pose estimation. An attractive alternative is to learn control policies directly from raw input data. However, this approach is time consuming and expensive since learning the policy requires many trials with robot actions in the physical environment. To reduce the training cost, the policy can be learned in simulation with a large set of synthetic images. The limit of this approach is the domain gap between the simulation and the robot workspace. In this paper, we propose to learn a policy for robot reaching movements from a single image captured directly in the robot workspace from a camera placed on the end effector (a hand eye camera). The idea behind the proposed policy learner is that view changes seen from the hand eye camera produced by actions in the robot workspace are analogous to locating a region of interest in a single image by performing sequential object localisation. This similar view change enables training of object reaching policies using reinforcement learning based sequential object localisation. To facilitate the adaptation of the policy to view changes in the robot workspace, we further present a dynamic filter that learns to bias an input state to remove irrelevant information for an action decision. The proposed policy learner can be used as a powerful representation for robotic tasks, and we validate it on static and moving object reaching tasks.


The Implicit Graph Conjecture is False. An efficient implicit representation of an n vertex graph G in a family mathcal F of graphs assigns to each vertex of G a binary code of length O( log n) so that the adjacency between every pair of vertices can be determined only as a function of their codes. This function can depend on the family but not on the individual graph. Every family of graphs admitting such a representation contains at most 2 O(n log(n)) graphs on n vertices, and thus has at most factorial speed of growth. The Implicit Graph Conjecture states that, conversely, every hereditary graph family with at most factorial speed of growth admits an efficient implicit representation. We refute this conjecture by establishing the existence of hereditary graph families with factorial speed of growth that require codes of length n Omega(1) .


An exact characterization of saturation for permutation matrices. A 0 1 matrix M contains a 0 1 matrix pattern P if we can obtain P from M by deleting rows and or columns and turning arbitrary 1 entries into 0s. The saturation function mathrm sat (P,n) for a 0 1 matrix pattern P indicates the minimum number of 1s in an n times n 0 1 matrix that does not contain P , but changing any 0 entry into a 1 entry creates an occurrence of P . Fulek and Keszegh recently showed that each pattern has a saturation function either in O(1) or in Theta(n) . We fully classify the saturation functions of permutation matrices.


Classification of the Chess Endgame problem using Logistic Regression, Decision Trees, and Neural Networks. In this study we worked on the classification of the Chess Endgame problem using different algorithms like logistic regression, decision trees and neural networks. Our experiments indicates that the Neural Networks provides the best accuracy (85 ) then the decision trees (79 ). We did these experiments using Microsoft Azure Machine Learning as a case study on using Visual Programming in classification. Our experiments demonstrates that this tool is powerful and save a lot of time, also it could be improved with more features that increase the usability and reduce the learning curve. We also developed an application for dataset visualization using a new programming language called Ring, our experiments demonstrates that this language have simple design like Python while integrates RAD tools like Visual Basic which is good for GUI development in the open source world


An unrecognized force in inertial microfluidics. Describing effects of small but finite inertia on suspended particles is a fundamental fluid dynamical problem that has never been solved in full generality. Modern microfluidics has turned this academic problem into a practical challenge through the use of high frequency oscillatory flows, perhaps the most efficient way to take advantage of inertial effects at low Reynolds numbers, to precisely manipulate particles, cells and vesicles without the need for charges or chemistry. The theoretical understanding of flow forces on particles has so far hinged on the pioneering work of Maxey and Riley (MR in the following), almost 40 years ago. We demonstrate here theoretically and computationally that oscillatory flows exert previously unexplained, significant and persistent forces, that these emerge from a combination of particle inertia and spatial flow variation, and that they can be quantitatively predicted through a generalization of MR.


Turing Church thesis, constructve mathematics and intuitionist logic. At a first glance the Theory of computation relies on potential infinity and an organization aimed at solving a problem. Under such aspect it is like Mendeleev theory of chemistry. Also its theoretical development reiterates that of this scientific theory it makes use of doubly negated propositions and its reasoning proceeds through ad absurdum proofs a final, universal predicate of equivalence of all definitions of a computations is translated into an equality one, and at the same time intuitionist logic into classical logic. Yet, the last step of this development of current theory includes both a misleading notion of thesis and intuitive notions (e.g. the partial computable function, as stressed by some scholars). A program for a rational re construction of the theory according to the theoretical development of the above mentioned theories is sketchy suggested.


A Survey on Extraction of Causal Relations from Natural Language Text. As an essential component of human cognition, cause effect relations appear frequently in text, and curating cause effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques include knowledge based, statistical machine learning(ML) based, and deep learning based approaches. Each method has its advantages and weaknesses. For example, knowledge based methods are understandable but require extensive manual domain knowledge and have poor cross domain applicability. Statistical machine learning methods are more automated because of natural language processing (NLP) toolkits. However, feature engineering is labor intensive, and toolkits may lead to error propagation. In the past few years, deep learning techniques attract substantial attention from NLP researchers because of its' powerful representation learning ability and the rapid increase in computational resources. Their limitations include high computational costs and a lack of adequate annotated training data. In this paper, we conduct a comprehensive survey of causality extraction. We initially introduce primary forms existing in the causality extraction explicit intra sentential causality, implicit causality, and inter sentential causality. Next, we list benchmark datasets and modeling assessment methods for causal relation extraction. Then, we present a structured overview of the three techniques with their representative systems. Lastly, we highlight existing open challenges with their potential directions.


A Computer Program for the Numerical Analysis of Economic Cycles Within the Framework of the Dubovsky Generalized Model. The article proposes a computer program for calculating economic crises according to the generalized mathematical model of S.V. Dubovsky. This model is represented by a system of ordinary nonlinear differential equations with fractional derivatives in the sense of Gerasimov Caputo with initial conditions. Furthermore, according to a numerical algorithm based on an explicit nonlocal finite difference scheme, oscillograms and phase trajectories were constructed. It is shown that changing the orders of fractional derivatives in the model can give rise to various modes, for example, damped modes with a steady state amplitude. It is concluded that the orders of fractional derivatives are responsible for the intensity of the process.


Random dynamical system generated by the 3D Navier Stokes equation with rough transport noise. We consider the Navier Stokes system in three dimensions perturbed by a transport noise which is sufficiently smooth in space and rough in time. The existence of a weak solution was proved recently, however, as in the deterministic setting the question of uniqueness remains a major open problem. An important feature of systems with uniqueness is the semigroup property satisfied by their solutions. Without uniqueness, this property cannot hold generally. We select a system of solutions satisfying the semigroup property with appropriately shifted rough path. In addition, the selected solutions respect the well accepted admissibility criterium for physical solutions, namely, maximization of the energy dissipation. Finally, under suitable assumptions on the driving rough path, we show that the Navier Stokes system generates a measurable random dynamical system. To the best of our knowledge, this is the first construction of a measurable single valued random dynamical system in the state space for an SPDE without uniqueness.


Deep CNN based Robotic Multi Class Under Canopy Weed Control in Precision Farming. Smart weeding systems to perform plant specific operations can contribute to the sustainability of agriculture and the environment. Despite monumental advances in autonomous robotic technologies for precision weed management in recent years, work on under canopy weeding in fields is yet to be realized. A prerequisite of such systems is reliable detection and classification of weeds to avoid mistakenly spraying and, thus, damaging the surrounding plants. Real time multi class weed identification enables species specific treatment of weeds and significantly reduces the amount of herbicide use. Here, our first contribution is the first adequately large realistic image dataset textit AIWeeds (one multiple kinds of weeds in one image), a library of about 10,000 annotated images of flax, and the 14 most common weeds in fields and gardens taken from 20 different locations in North Dakota, California, and Central China. Second, we provide a full pipeline from model training with maximum efficiency to deploying the TensorRT optimized model onto a single board computer. Based on textit AIWeeds and the pipeline, we present a baseline for classification performance using five benchmark CNN models. Among them, MobileNetV2, with both the shortest inference time and lowest memory consumption, is the qualified candidate for real time applications. Finally, we deploy MobileNetV2 onto our own compact autonomous robot textit SAMBot for real time weed detection. The 90 test accuracy realized in previously unseen scenes in flax fields (with a row spacing of 0.2 0.3 m), with crops and weeds, distortion, blur, and shadows, is a milestone towards precision weed control in the real world. We have publicly released the dataset and code to generate the results at url https github.com StructuresComp Multi class Weed Classification .


Full normalization for transfinite stacks. We describe the extension of normal iteration strategies with appropriate condensation properties to strategies for stacks of normal trees, with full normalization. Given a regular uncountable cardinal Omega and an (m, Omega 1) iteration strategy Sigma for a premouse M , such that Sigma and M both have appropriate condensation properties, we extend Sigma to a strategy Sigma for the (m, Omega, Omega 1) iteration game such that for all lambda Omega and all stacks vec mathcal T left mathcal T alpha right alpha lambda via Sigma , consisting of normal trees mathcal T alpha , each of length Omega , there is a corresponding normal tree mathcal X via Sigma with M vec mathcal T infty M mathcal X infty , along with agreement of iteration maps, when there are no drops in model or degree on main branches. The construction is the result of a combination of work of John Steel and of the author. We also establish some further useful properties of Sigma , and use the methods to analyze the comparison of multiple iterates via a common such strategy.


First Eigenvalue of the Laplacian of a Geodesic Ball and Area Based Symmetrization of its Metric Tensor. Given a Riemmanian manifold, we provide a new method to compute a sharp upper bound for the first eigenvalue of the Laplacian for the Dirichlet problem on a geodesic ball of radius less than the injectivity radius of the manifold. This upper bound is obtained by transforming the metric tensor into a rotationally symmetric metric tensor that preserves the area of the geodesic spheres. The provided upper bound can be computed using only the area function of the geodesic spheres contained in the geodesic ball and it is sharp in the sense that the first eigenvalue of geodesic ball coincides with our upper bound if and only if the mean curvature pointed inward of each geodesic sphere is a radial function.


To Point or Not to Point Understanding How Abstractive Summarizers Paraphrase Text. Abstractive neural summarization models have seen great improvements in recent years, as shown by ROUGE scores of the generated summaries. But despite these improved metrics, there is limited understanding of the strategies different models employ, and how those strategies relate their understanding of language. To understand this better, we run several experiments to characterize how one popular abstractive model, the pointer generator model of See et al. (2017), uses its explicit copy generation switch to control its level of abstraction (generation) vs extraction (copying). On an extractive biased dataset, the model utilizes syntactic boundaries to truncate sentences that are otherwise often copied verbatim. When we modify the copy generation switch and force the model to generate, only simple paraphrasing abilities are revealed alongside factual inaccuracies and hallucinations. On an abstractive biased dataset, the model copies infrequently but shows similarly limited abstractive abilities. In line with previous research, these results suggest that abstractive summarization models lack the semantic understanding necessary to generate paraphrases that are both abstractive and faithful to the source document.


Crowdsourced Databases and Sui Generis Rights. In this study we propose a new concept of databases (crowdsourced databases), adding a new conceptual approach to the debate on legal protection of databases in Europe. We also summarise the current legal framework and current indexing and web scraping practices it would not be prudent to suggest a new theory without contextualising it in the legal and practical context in which it is developed.


Investigating the Effect of Sensor Modalities in Multi Sensor Detection Prediction Models. Detection of surrounding objects and their motion prediction are critical components of a self driving system. Recently proposed models that jointly address these tasks rely on a number of sensors to achieve state of the art performance. However, this increases system complexity and may result in a brittle model that overfits to any single sensor modality while ignoring others, leading to reduced generalization. We focus on this important problem and analyze the contribution of sensor modalities towards the model performance. In addition, we investigate the use of sensor dropout to mitigate the above mentioned issues, leading to a more robust, better performing model on real world driving data.


An Accurate Non accelerometer based PPG Motion Artifact Removal Technique using CycleGAN. A photoplethysmography (PPG) is an uncomplicated and inexpensive optical technique widely used in the healthcare domain to extract valuable health related information, e.g., heart rate variability, blood pressure, and respiration rate. PPG signals can easily be collected continuously and remotely using portable wearable devices. However, these measuring devices are vulnerable to motion artifacts caused by daily life activities. The most common ways to eliminate motion artifacts use extra accelerometer sensors, which suffer from two limitations i) high power consumption and ii) the need to integrate an accelerometer sensor in a wearable device (which is not required in certain wearables). This paper proposes a low power non accelerometer based PPG motion artifacts removal method outperforming the accuracy of the existing methods. We use Cycle Generative Adversarial Network to reconstruct clean PPG signals from noisy PPG signals. Our novel machine learning based technique achieves 9.5 times improvement in motion artifact removal compared to the state of the art without using extra sensors such as an accelerometer.


Relations among Hamiltonian, area preserving, and non wandering flows on surfaces. Area preserving flows on compact surfaces are one of the classic examples of dynamical systems, also known as multi valued Hamiltonian flows. Though Hamiltonian, area preserving, and non wandering properties for flows are distinct, there are some equivalence relations among them in the low dimensional cases. In this paper, we describe equivalence and difference for continuous flows among Hamiltonian, divergence free, and non wandering properties topologically. More precisely, let v be a continuous flow with finitely many singular points on a compact surface. We show that v is Hamiltonian if and only if v is a non wandering flow without locally dense orbits whose extended orbit space is a directed graph without directed cycles. Moreover, non wandering, area preserving, and divergence free properties for v are equivalent to each other.


On the spanning structure hierarchy of 3 connected planar graphs. The prism over a graph G is the Cartesian product of G with the complete graph K 2 . G is prism hamiltonian if the prism over G has a Hamilton cycle. A good even cactus is a connected graph in which every block is either an edge or an even cycle, and every vertex is contained in at most two blocks. It is known that good even cacti are prism hamiltonian. Indeed, showing the existence of a spanning good even cactus has become one of the most common techniques in proving prism hamiltonicity. v S pacapan asked whether having a spanning good even cactus is equivalent to having a hamiltonian prism for 3 connected planar graphs. In this article we give a negative answer to this question by showing that there are infinitely many 3 connected planar prism hamiltonian graphs that have no spanning good even cactus. We also prove the existence of an infinite class of 3 connected planar graphs that have a spanning good even cactus but no spanning good even cactus with maximum degree three.


Through Foliage Tracking with Airborne Optical Sectioning. Detecting and tracking moving targets through foliage is difficult, and for many cases even impossible in regular aerial images and videos. We present an initial light weight and drone operated 1D camera array that supports parallel synthetic aperture aerial imaging. Our main finding is that color anomaly detection benefits significantly from image integration when compared to conventional raw images or video frames (on average 97 vs. 42 in precision in our field experiments). We demonstrate, that these two contributions can lead to the detection and tracking of moving people through densely occluding forest.


A multilevel clustering technique for community detection. A network is a composition of many communities, i.e., sets of nodes and edges with stronger relationships, with distinct and overlapping properties. Community detection is crucial for various reasons, such as serving as a functional unit of a network that captures local interactions among nodes. Communities come in various forms and types, ranging from biologically to technology induced ones. As technology induced communities, social media networks such as Twitter and Facebook connect a myriad of diverse users, leading to a highly connected and dynamic ecosystem. Although many algorithms have been proposed for detecting socially cohesive communities on Twitter, mining and related tasks remain challenging. This study presents a novel detection method based on a scalable framework to identify related communities in a network. We propose a multilevel clustering technique (MCT) that leverages structural and textual information to identify local communities termed microcosms. Experimental evaluation on benchmark models and datasets demonstrate the efficacy of the approach. This study contributes a new dimension for the detection of cohesive communities in social networks. The approach offers a better understanding and clarity toward describing how low level communities evolve and behave on Twitter. From an application point of view, identifying such communities can better inform recommendation, among other benefits.