SENSORIMOTOR GRAPH Action Conditioned Graph Neural Network for Learning Robotic Soft Hand Dynamics. Soft robotics is a thriving branch of robotics which takes inspiration from nature and uses affordable flexible materials to design adaptable non rigid robots. However, their flexible behavior makes these robots hard to model, which is essential for a precise actuation and for optimal control. For system modelling, learning based approaches have demonstrated good results, yet they fail to consider the physical structure underlying the system as an inductive prior. In this work, we take inspiration from sensorimotor learning, and apply a Graph Neural Network to the problem of modelling a non rigid kinematic chain (i.e. a robotic soft hand) taking advantage of two key properties 1) the system is compositional, that is, it is composed of simple interacting parts connected by edges, 2) it is order invariant, i.e. only the structure of the system is relevant for predicting future trajectories. We denote our model as the 'Sensorimotor Graph' since it learns the system connectivity from observation and uses it for dynamics prediction. We validate our model in different scenarios and show that it outperforms the non structured baselines in dynamics prediction while being more robust to configurational variations, tracking errors or node failures.


Is An Image Worth Five Sentences? A New Look into Semantics for Image Text Matching. The task of image text matching aims to map representations from different modalities into a common joint visual textual embedding. However, the most widely used datasets for this task, MSCOCO and Flickr30K, are actually image captioning datasets that offer a very limited set of relationships between images and sentences in their ground truth annotations. This limited ground truth information forces us to use evaluation metrics based on binary relevance given a sentence query we consider only one image as relevant. However, many other relevant images or captions may be present in the dataset. In this work, we propose two metrics that evaluate the degree of semantic relevance of retrieved items, independently of their annotated binary relevance. Additionally, we incorporate a novel strategy that uses an image captioning metric, CIDEr, to define a Semantic Adaptive Margin (SAM) to be optimized in a standard triplet loss. By incorporating our formulation to existing models, a emph large improvement is obtained in scenarios where available training data is limited. We also demonstrate that the performance on the annotated image caption pairs is maintained while improving on other non annotated relevant items when employing the full training set. Code with our metrics and adaptive margin formulation will be made public.


Almost o minimal structures and mathfrak X structures. We propose new structures called almost o minimal structures and mathfrak X structures. The former is a first order expansion of a dense linear order without endpoints such that the intersection of a definable set with a bounded open interval is a finite union of points and open intervals. The latter is a variant of van den Dries and Miller's analytic geometric categories and Shiota's mathfrak X sets and mathfrak Y sets. In them, the family of definable sets are closed only under proper projections unlike first order structures. We demonstrate that an mathfrak X expansion of an ordered divisible abelian group always contains an o minimal expansion of an ordered group such that all bounded mathfrak X definable sets are definable in the structure. Another contribution of this paper is a uniform local definable cell decomposition theorem for almost o minimal expansions of ordered groups mathcal M (M, ,0, , ldots) . Let A lambda lambda in Lambda be a finite family of definable subsets of M m n . Take an arbitrary positive element R in M and set B R,R n . Then, there exists a finite partition into definable sets begin equation M m times B X 1 cup ldots cup X k end equation such that B (X 1) b cup ldots cup (X k) b is a definable cell decomposition of B for any b in M m and either X i cap A lambda emptyset or X i subseteq A lambda for any 1 leq i leq k and lambda in Lambda . Here, the notation S b denotes the fiber of a definable subset S of M m n at b in M m . We introduce the notion of multi cells and demonstrate that any definable set is a finite union of multi cells in the course of the proof of the above theorem.


Time frequency mapping of two colour photoemission driven by harmonic radiation. The use of few femtosecond, extreme ultraviolet (XUV) pulses, produced by high order harmonic generation, in combination with few femtosecond infrared (IR) pulses in pump probe experiments has great potential to disclose ultrafast dynamics in molecules, nanostructures and solids. A crucial prerequisite is a reliable characterization of the temporal properties of the XUV and IR pulses. Several techniques have been developed. The majority of them applies phase reconstruction algorithms to a photoelectron spectrogram obtained by ionizing an atomic target in a pump probe fashion. If the ionizing radiation is a single harmonic, all the information is encoded in a two color two photon signal called sideband (SB). In this work, we present a simplified model to interpret the time frequency mapping of the SB signal and we show that the temporal dispersion of the pulses directly maps onto the shape of its spectrogram. Finally, we derive an analytical solution, which allows us to propose a novel procedure to estimate the second order dispersion of the XUV and IR pulses in real time and with no need for iterative algorithms.


Untargeted, Targeted and Universal Adversarial Attacks and Defenses on Time Series. Deep learning based models are vulnerable to adversarial attacks. These attacks can be much more harmful in case of targeted attacks, where an attacker tries not only to fool the deep learning model, but also to misguide the model to predict a specific class. Such targeted and untargeted attacks are specifically tailored for an individual sample and require addition of an imperceptible noise to the sample. In contrast, universal adversarial attack calculates a special imperceptible noise which can be added to any sample of the given dataset so that, the deep learning model is forced to predict a wrong class. To the best of our knowledge these targeted and universal attacks on time series data have not been studied in any of the previous works. In this work, we have performed untargeted, targeted and universal adversarial attacks on UCR time series datasets. Our results show that deep learning based time series classification models are vulnerable to these attacks. We also show that universal adversarial attacks have good generalization property as it need only a fraction of the training data. We have also performed adversarial training based adversarial defense. Our results show that models trained adversarially using Fast gradient sign method (FGSM), a single step attack, are able to defend against FGSM as well as Basic iterative method (BIM), a popular iterative attack.


Logarithmic models and meromorphic functions in dimension two. In this article we describe the construction of logarithmic models for germs of plane singular analytic foliations, both real and complex. A logarithmic model is a germ of closed meromorphic 1 form with simple poles produced upon some specified geometric data the structure of dicritical (non invariant) components in the exceptional divisor of its reduction of singularities, a prescribed finite set of separatrices invariant analytic branches at the origin and Camacho Sad indices with respect to these separatrices. As an application, we use logarithmic models in order to construct real and complex germs of meromorphic functions with a given indeterminacy structure and prescribed sets of zeroes and poles. Also, in the real case, logarithmic models are used in order to build germs of analytic vector fields with a given Bendixson's sectorial decomposition of a neighborhood of 0 in mathbb R 2 into hyperbolic, parabolic and elliptic sectors. This is carried out in the specific case where all trajectories accumulating to the origin are contained in analytic curves. As a consequence, we can produce real meromorphic functions with a prescribed sectorial decomposition.


Real Time Motion Planning of a Hydraulic Excavator using Trajectory Optimization and Model Predictive Control. Automation of excavation tasks requires real time trajectory planning satisfying various constraints. To guarantee both constraint feasibility and real time trajectory re plannability, we present an integrated framework for real time optimization based trajectory planning of a hydraulic excavator. The proposed framework is composed of two main modules a global planner and a real time local planner. The global planner computes the entire global trajectory considering excavation volume and energy minimization while the local counterpart tracks the global trajectory in a receding horizon manner, satisfying dynamic feasibility, physical constraints, and disturbance awareness. We validate the proposed planning algorithm in a simulation environment where two types of operations are conducted in the presence of emulated disturbance from hydraulic friction and soil bucket interaction shallow and deep excavation. The optimized global trajectories are obtained in an order of a second, which is tracked by the local planner at faster than 30 Hz. To the best of our knowledge, this work presents the first real time motion planning framework that satisfies constraints of a hydraulic excavator, such as force torque, power, cylinder displacement, and flow rate limits.


CLINE Contrastive Learning with Semantic Negative Examples for Natural Language Understanding. Despite pre trained language models have proven useful for learning high quality semantic representations, these models are still vulnerable to simple perturbations. Recent works aimed to improve the robustness of pre trained models mainly focus on adversarial training from perturbed examples with similar semantics, neglecting the utilization of different or even opposite semantics. Different from the image processing field, the text is discrete and few word substitutions can cause significant semantic changes. To study the impact of semantics caused by small perturbations, we conduct a series of pilot experiments and surprisingly find that adversarial training is useless or even harmful for the model to detect these semantic changes. To address this problem, we propose Contrastive Learning with semantIc Negative Examples (CLINE), which constructs semantic negative examples unsupervised to improve the robustness under semantically adversarial attacking. By comparing with similar and opposite semantic examples, the model can effectively perceive the semantic changes caused by small perturbations. Empirical results show that our approach yields substantial improvements on a range of sentiment analysis, reasoning, and reading comprehension tasks. And CLINE also ensures the compactness within the same semantics and separability across different semantics in sentence level.


Convergence Analysis and System Design for Federated Learning over Wireless Networks. Federated learning (FL) has recently emerged as an important and promising learning scheme in IoT, enabling devices to jointly learn a model without sharing their raw data sets. However, as the training data in FL is not collected and stored centrally, FL training requires frequent model exchange, which is largely affected by the wireless communication network. Therein, limited bandwidth and random package loss restrict interactions in training. Meanwhile, the insufficient message synchronization among distributed clients could also affect FL convergence. In this paper, we analyze the convergence rate of FL training considering the joint impact of communication network and training settings. Further by considering the training costs in terms of time and power, the optimal scheduling problems for communication networks are formulated. The developed theoretical results can be used to assist the system parameter selections and explain the principle of how the wireless communication system could influence the distributed training process and network scheduling.


Maximizing Marginal Fairness for Dynamic Learning to Rank. Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is considered as one of the key problems for modern IR systems. As conventional ranking frameworks that myopically sorts documents with their relevance will inevitably introduce unfair result exposure, recent studies on ranking fairness mostly focus on dynamic ranking paradigms where result rankings can be adapted in real time to support fairness in groups (i.e., races, genders, etc.). Existing studies on fairness in dynamic learning to rank, however, often achieve the overall fairness of document exposure in ranked lists by significantly sacrificing the performance of result relevance and fairness on the top results. To address this problem, we propose a fair and unbiased ranking method named Maximal Marginal Fairness (MMF). The algorithm integrates unbiased estimators for both relevance and merit based fairness while providing an explicit controller that balances the selection of documents to maximize the marginal relevance and fairness in top k results. Theoretical and empirical analysis shows that, with small compromises on long list fairness, our method achieves superior efficiency and effectiveness comparing to the state of the art algorithms in both relevance and fairness for top k rankings.


MAGE Nearly Zero Cost Virtual Memory for Secure Computation. Secure Computation (SC) is a family of cryptographic primitives for computing on encrypted data in single party and multi party settings. SC is being increasingly adopted by industry for a variety of applications. A significant obstacle to using SC for practical applications is the memory overhead of the underlying cryptography. We develop MAGE, an execution engine for SC that efficiently runs SC computations that do not fit in memory. We observe that, due to their intended security guarantees, SC schemes are inherently oblivious their memory access patterns are independent of the input data. Using this property, MAGE calculates the memory access pattern ahead of time and uses it to produce a memory management plan. This formulation of memory management, which we call memory programming, is a generalization of paging that allows MAGE to provide a highly efficient virtual memory abstraction for SC. MAGE outperforms the OS virtual memory system by up to an order of magnitude, and in many cases, runs SC computations that do not fit in memory at nearly the same speed as if the underlying machines had unbounded physical memory to fit the entire computation.


Label Verbalization and Entailment for Effective Zero and Few Shot Relation Extraction. Relation extraction systems require large amounts of labeled examples which are costly to annotate. In this work we reformulate relation extraction as an entailment task, with simple, hand made, verbalizations of relations produced in less than 15 min per relation. The system relies on a pretrained textual entailment engine which is run as is (no training examples, zero shot) or further fine tuned on labeled examples (few shot or fully trained). In our experiments on TACRED we attain 63 F1 zero shot, 69 with 16 examples per relation (17 points better than the best supervised system on the same conditions), and only 4 points short to the state of the art (which uses 20 times more training data). We also show that the performance can be improved significantly with larger entailment models, up to 12 points in zero shot, allowing to report the best results to date on TACRED when fully trained. The analysis shows that our few shot systems are specially effective when discriminating between relations, and that the performance difference in low data regimes comes mainly from identifying no relation cases.


CHARET Character centered Approach to Emotion Tracking in Stories. Autonomous agents that can engage in social interactions witha human is the ultimate goal of a myriad of applications. A keychallenge in the design of these applications is to define the socialbehavior of the agent, which requires extensive content creation.In this research, we explore how we can leverage current state of the art tools to make inferences about the emotional state ofa character in a story as events unfold, in a coherent way. Wepropose a character role labelling approach to emotion tracking thataccounts for the semantics of emotions. We show that by identifyingactors and objects of events and considering the emotional stateof the characters, we can achieve better performance in this task,when compared to end to end approaches.


Automatic Fake News Detection Are Models Learning to Reason?. Most fact checking models for automatic fake news detection are based on reasoning given a claim with associated evidence, the models aim to estimate the claim veracity based on the supporting or refuting content within the evidence. When these models perform well, it is generally assumed to be due to the models having learned to reason over the evidence with regards to the claim. In this paper, we investigate this assumption of reasoning, by exploring the relationship and importance of both claim and evidence. Surprisingly, we find on political fact checking datasets that most often the highest effectiveness is obtained by utilizing only the evidence, as the impact of including the claim is either negligible or harmful to the effectiveness. This highlights an important problem in what constitutes evidence in existing approaches for automatic fake news detection.


Double Adversarial Activation Anomaly Detection Adversarial Autoencoders are Anomaly Generators. Anomaly detection is a challenging task for machine learning algorithms due to the inherent class imbalance. It is costly and time demanding to manually analyse the observed data, thus usually only few known anomalies if any are available. Inspired by generative models and the analysis of the hidden activations of neural networks, we introduce a novel unsupervised anomaly detection method called DA3D. Here, we use adversarial autoencoders to generate anomalous counterexamples based on the normal data only. These artificial anomalies used during training allow the detection of real, yet unseen anomalies. With our novel generative approach, we transform the unsupervised task of anomaly detection to a supervised one, which is more tractable by machine learning and especially deep learning methods. DA3D surpasses the performance of state of the art anomaly detection methods in a purely data driven way, where no domain knowledge is required.


Revisit Multimodal Meta Learning through the Lens of Multi Task Learning. Multimodal meta learning is a recent problem that extends conventional few shot meta learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set of prior skills to learn new skills. Previous work has achieved encouraging performance. In particular, in spite of the diversity of the multimodal tasks, previous work claims that a single meta learner trained on a multimodal distribution can sometimes outperform multiple specialized meta learners trained on individual unimodal distributions. The improvement is attributed to knowledge transfer between different modes of task distributions. However, there is no deep investigation to verify and understand the knowledge transfer between multimodal tasks. Our work makes two contributions to multimodal meta learning. First, we propose a method to quantify knowledge transfer between tasks of different modes at a micro level. Our quantitative, task level analysis is inspired by the recent transference idea from multi task learning. Second, inspired by hard parameter sharing in multi task learning and a new interpretation of related work, we propose a new multimodal meta learner that outperforms existing work by considerable margins. While the major focus is on multimodal meta learning, our work also attempts to shed light on task interaction in conventional meta learning. The code for this project is available at https miladabd.github.io KML.


On the local times of noise reinforced Bessel processes. We investigate the effects of noise reinforcement on a Bessel process of dimension d in(0,2) , and more specifically on the asymptotic behavior of its additive functionals. This leads us to introduce a local time process and its inverse. We identify the latter as an increasing self similar (time homogeneous) Markov process, and from this, several explicit results can be deduced.


Probabilistic formulation of the Hadwiger Nelson problem. This is a slightly modified version of my MSc thesis from 2019. Supervisor was D "om "ot "or P 'alv "olgyi.


Hydrodynamic interactions and extreme particle clustering in turbulence. From new detailed experimental data, we found that the Radial Distribution Function (RDF) of inertial particles in turbulence grows explosively with r 6 scaling as the collision radius is approached. We corrected a theory by Yavuz et al. (Phys. Rev. Lett. 120, 244504 (2018)) based on hydrodynamic interactions between pairs of weakly inertial particles, and demonstrate that even this corrected theory cannot explain the observed RDF behavior. We explore several alternative mechanisms for the discrepancy that were not included in the theory and show that none of them are likely the explanation, suggesting new, yet to be identified physical mechanisms are at play.


A representation type of compression space of rank 2. In this paper, we proved that a compression space of rank 2 is equivalent to an irreducible representation over a Lie algebra.


Moderate deviation principle for the two dimensional stochastic Navier Stokes equations with anisotropic viscosity. In this paper, we prove a central limit theorem and establish a moderate deviation principle for the the two dimensional stochastic Navier Stokes equations with anisotropic viscosity. The proof for moderate deviation principle is based on the weak convergence approach.


Improving robustness against common corruptions with frequency biased models. CNNs perform remarkably well when the training and test distributions are i.i.d, but unseen image corruptions can cause a surprisingly large drop in performance. In various real scenarios, unexpected distortions, such as random noise, compression artefacts, or weather distortions are common phenomena. Improving performance on corrupted images must not result in degraded i.i.d performance a challenge faced by many state of the art robust approaches. Image corruption types have different characteristics in the frequency spectrum and would benefit from a targeted type of data augmentation, which, however, is often unknown during training. In this paper, we introduce a mixture of two expert models specializing in high and low frequency robustness, respectively. Moreover, we propose a new regularization scheme that minimizes the total variation (TV) of convolution feature maps to increase high frequency robustness. The approach improves on corrupted images without degrading in distribution performance. We demonstrate this on ImageNet C and also for real world corruptions on an automotive dataset, both for object classification and object detection.


Building an Efficient and Effective Retrieval based Dialogue System via Mutual Learning. Establishing retrieval based dialogue systems that can select appropriate responses from the pre built index has gained increasing attention from researchers. For this task, the adoption of pre trained language models (such as BERT) has led to remarkable progress in a number of benchmarks. There exist two common approaches, including cross encoders which perform full attention over the inputs, and bi encoders that encode the context and response separately. The former gives considerable improvements in accuracy but is often inapplicable in practice for large scale retrieval given the cost of the full attention required for each sample at test time. The latter is efficient for billions of indexes but suffers from sub optimal performance. In this work, we propose to combine the best of both worlds to build a retrieval system. Specifically, we employ a fast bi encoder to replace the traditional feature based pre retrieval model (such as BM25) and set the response re ranking model as a more complicated architecture (such as cross encoder). To further improve the effectiveness of our framework, we train the pre retrieval model and the re ranking model at the same time via mutual learning, which enables two models to learn from each other throughout the training process. We conduct experiments on two benchmarks and evaluation results demonstrate the efficiency and effectiveness of our proposed framework.


The homotopy type of a finite 2 complex with non minimal Euler characteristic. We resolve two long standing and closely related problems concerning stably free mathbb Z G modules and the homotopy type of finite 2 complexes. In particular, for all k ge 1 , we show that there exists a group G and a non free stably free mathbb Z G module of rank k . We use this to show that, for all k ge 0 , there exists homotopically distinct finite 2 complexes with fundamental group G and with Euler characteristic k greater than the minimal value over G . This provides a solution to Problem D5 in the 1979 Problems List of C. T. C. Wall.


Quantization of Generative Adversarial Networks for Efficient Inference a Methodological Study. Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of modern GANs comes together with massive amounts of computations performed during the inference and high energy consumption. That complicates, or even makes impossible, their deployment on edge devices. The problem can be reduced with quantization a neural network compression technique that facilitates hardware friendly inference by replacing floating point computations with low bit integer ones. While quantization is well established for discriminative models, the performance of modern quantization techniques in application to GANs remains unclear. GANs generate content of a more complex structure than discriminative models, and thus quantization of GANs is significantly more challenging. To tackle this problem, we perform an extensive experimental study of state of art quantization techniques on three diverse GAN architectures, namely StyleGAN, Self Attention GAN, and CycleGAN. As a result, we discovered practical recipes that allowed us to successfully quantize these models for inference with 4 8 bit weights and 8 bit activations while preserving the quality of the original full precision models.


Sensitivity Analysis for Optimizing Electrical Impedance Tomography Protocols. Electrical impedance tomography (EIT) is a noninvasive imaging method whereby electrical measurements on the boundary of a conductive medium (the data) are taken according to a prescribed protocol set and inverted to map the internal conductivity (the model). This paper introduces a sensitivity analysis method and corresponding inversion and protocol optimization that generalizes the criteria for tomographic inversion to minimize the model space dimensionality and maximize data importance. Sensitivity vectors, defined as rows of the Jacobian matrix in the linearized forward problem, are used to map targeted conductivity features from model space to data space, and a volumetric outer product of these vectors in model space called the sensitivity parallelotope volume provides a figure of merit for data protocol optimization. Orthonormal basis functions that accurately constrain the model space to features of interest can be defined from a priori information. By increasing the contact number to expand the number of possible measurements Dmax, and by reducing the model space to a minimal number M0 of basis functions that describe only the features of interest, the M0 Dmax sensitivity vectors of greatest length and maximal orthogonality that span this model space can be identified. The reduction in model space dimensionality accelerates the inversion by several orders of magnitude, and the enhanced sensitivity can tolerate noise levels up to 1,000 times larger than standard protocols.


Rational Periodic Points of x d c and Fermat Catalan Equations. We study rational periodic points of polynomial f d,c (x) x d c over the field of rational numbers, where d is an integer greater than 2. For period 2, we classify all possible periodic points for degrees d 4,6 . We also demonstrate the nonexistence of rational periodic points of exact period 2 for d 2k such that 3 mid 2k 1 and k has a prime factor greater than 3. Moreover, assuming the abc conjecture, we prove that f d,c has no rational periodic point of exact period greater than 1 for sufficiently large integer d and c neq 1 .


Event Based Automatic Differentiation of OpenMP with OpDiLib. We present the new software OpDiLib, a universal add on for classical operator overloading AD tools that enables the automatic differentiation (AD) of OpenMP parallelized code. With it, we establish support for OpenMP features in a reverse mode operator overloading AD tool to an extent that was previously only reported on in source transformation tools. We achieve this with an event based implementation ansatz that is unprecedented in AD. Combined with modern OpenMP features around OMPT, we demonstrate how it can be used to achieve differentiation without any additional modifications of the source code neither do we impose a priori restrictions on the data access patterns, which makes OpDiLib highly applicable. For further performance optimizations, restrictions like atomic updates on the adjoint variables can be lifted in a fine grained manner for any parts of the code. OpDiLib can also be applied in a semi automatic fashion via a macro interface, which supports compilers that do not implement OMPT. In a detailed performance study, we demonstrate the applicability of OpDiLib for a pure operator overloading approach in a hybrid parallel environment. We quantify the cost of atomic updates on the adjoint vector and showcase the speedup and scaling that can be achieved with the different configurations of OpDiLib in both the forward and the reverse pass.


Approximation properties of Residual Neural Networks for Kolmogorov PDEs. In recent years residual neural networks (ResNets) as introduced by He, K., Zhang, X., Ren, S., and Sun, J., Proceedings of the IEEE conference on computer vision and pattern recognition (2016), 770 778 have become very popular in a large number of applications, including in image classification and segmentation. They provide a new perspective in training very deep neural networks without suffering the vanishing gradient problem. In this article we show that ResNets are able to approximate solutions of Kolmogorov partial differential equations (PDEs) with constant diffusion and possibly nonlinear drift coefficients without suffering the curse of dimensionality, which is to say the number of parameters of the approximating ResNets grows at most polynomially in the reciprocal of the approximation accuracy varepsilon 0 and the dimension of the considered PDE d in mathbb N . We adapt a proof in Jentzen, A., Salimova, D., and Welti, T., Commun. Math. Sci. 19, 5 (2021), 1167 1205 who showed a similar result for feedforward neural networks (FNNs) to ResNets. In contrast to FNNs, the Euler Maruyama approximation structure of ResNets simplifies the construction of the approximating ResNets substantially. Moreover, contrary to the above work, in our proof using ResNets does not require the existence of an FNN (or a ResNet) representing the identity map, which enlarges the set of applicable activation functions.


SPEC Seeing People in the Wild with an Estimated Camera. Due to the lack of camera parameter information for in the wild images, existing 3D human pose and shape (HPS) estimation methods make several simplifying assumptions weak perspective projection, large constant focal length, and zero camera rotation. These assumptions often do not hold and we show, quantitatively and qualitatively, that they cause errors in the reconstructed 3D shape and pose. To address this, we introduce SPEC, the first in the wild 3D HPS method that estimates the perspective camera from a single image and employs this to reconstruct 3D human bodies more accurately. regress 3D human bodies. First, we train a neural network to estimate the field of view, camera pitch, and roll given an input image. We employ novel losses that improve the calibration accuracy over previous work. We then train a novel network that concatenates the camera calibration to the image features and uses these together to regress 3D body shape and pose. SPEC is more accurate than the prior art on the standard benchmark (3DPW) as well as two new datasets with more challenging camera views and varying focal lengths. Specifically, we create a new photorealistic synthetic dataset (SPEC SYN) with ground truth 3D bodies and a novel in the wild dataset (SPEC MTP) with calibration and high quality reference bodies. Both qualitative and quantitative analysis confirm that knowing camera parameters during inference regresses better human bodies. Code and datasets are available for research purposes at https spec.is.tue.mpg.de.


Interpretation of multi label classification models using shapley values. Multi label classification is a type of classification task, it is used when there are two or more classes, and the data point we want to predict may belong to none of the classes or all of them at the same time. In the real world, many applications are actually multi label involved, including information retrieval, multimedia content annotation, web mining, and so on. A game theory based framework known as SHapley Additive exPlanations (SHAP) has been applied to explain various supervised learning models without being aware of the exact model. Herein, this work further extends the explanation of multi label classification task by using the SHAP methodology. The experiment demonstrates a comprehensive comparision of different algorithms on well known multi label datasets and shows the usefulness of the interpretation.


Adaptive learning for financial markets mixing model based and model free RL for volatility targeting. Model Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model based RL is able to capture some fundamental and dynamical concepts of the environment but suffer from cognitive bias. In this work, we propose to combine the best of the two techniques by selecting various model based approaches thanks to Model Free Deep Reinforcement Learning. Using not only past performance and volatility, we include additional contextual information such as macro and risk appetite signals to account for implicit regime changes. We also adapt traditional RL methods to real life situations by considering only past data for the training sets. Hence, we cannot use future information in our training data set as implied by K fold cross validation. Building on traditional statistical methods, we use the traditional "walk forward analysis", which is defined by successive training and testing based on expanding periods, to assert the robustness of the resulting agent. Finally, we present the concept of statistical difference's significance based on a two tailed T test, to highlight the ways in which our models differ from more traditional ones. Our experimental results show that our approach outperforms traditional financial baseline portfolio models such as the Markowitz model in almost all evaluation metrics commonly used in financial mathematics, namely net performance, Sharpe and Sortino ratios, maximum drawdown, maximum drawdown over volatility.


CEAZ Accelerating Parallel I O Via Hardware Algorithm Co Designed Adaptive Lossy Compression. As parallel computers continue to grow to exascale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error bounded lossy compressors to reduce the data size and improve the I O performance. However, little work has been done for effectively offloading lossy compression onto FPGA based SmartNICs to reduce the compression overhead. In this paper, we propose a hardware algorithm co design for an efficient and adaptive lossy compressor for scientific data on FPGAs (called CEAZ), which is the first lossy compressor that can achieve high compression ratios and throughputs simultaneously. Specifically, we propose an efficient Huffman coding approach that can adaptively update Huffman codewords online based on codewords generated offline, from a variety of representative scientific datasets. Moreover, we derive a theoretical analysis to support a precise control of compression ratio under an error bounded compression mode, enabling accurate offline Huffman codewords generation. This also helps us create a fixed ratio compression mode for consistent throughput. In addition, we develop an efficient compression pipeline by adopting cuSZ's dual quantization algorithm to our hardware use cases. Finally, we evaluate CEAZ on five real world datasets with both a single FPGA board and 128 nodes (to accelerate parallel I O). Experiments show that CEAZ outperforms the second best FPGA based lossy compressor by 2X of throughput and 9.6X of ratio. It also improves MPI File write and MPI Gather throughputs by up to 28.1X and 36.9X, respectively.


NeoRL A Near Real World Benchmark for Offline Reinforcement Learning. Offline reinforcement learning (RL) aims at learning a good policy from a batch of collected data, without extra interactions with the environment during training. However, current offline RL benchmarks commonly have a large reality gap, because they involve large datasets collected by highly exploratory policies, and the trained policy is directly evaluated in the environment. In real world situations, running a highly exploratory policy is prohibited to ensure system safety, the data is commonly very limited, and a trained policy should be well validated before deployment. In this paper, we present a near real world offline RL benchmark, named NeoRL, which contains datasets from various domains with controlled sizes, and extra test datasets for policy validation. We evaluate existing offline RL algorithms on NeoRL and argue that the performance of a policy should also be compared with the deterministic version of the behavior policy, instead of the dataset reward. The empirical results demonstrate that the tested offline RL algorithms become less competitive to the deterministic policy on many datasets, and the offline policy evaluation hardly helps. The NeoRL suit can be found at http polixir.ai research neorl. We hope this work will shed some light on future research and draw more attention when deploying RL in real world systems.


Decorated sheaves and morphisms in tilted hearts. We identify limit stable pairs and stable framed sheaves as epimorphisms and monomorphisms, respectively, in tilts of the standard heart, under suitable conditions. We then identify the moduli spaces with the corresponding Quot spaces, obtaining the projectivity of the Quot spaces in these cases. We also prove a formula in a motivic Hall algebra relating the Quot spaces under a tilt.


Enhanced Isotropy Maximization Loss Seamless and High Performance Out of Distribution Detection Simply Replacing the SoftMax Loss. Current out of distribution detection approaches usually present special requirements (e.g., collecting outlier data and hyperparameter validation) and produce side effects (e.g., classification accuracy drop and slow inefficient inferences). Recently, entropic out of distribution detection has been proposed as a seamless approach (i.e., a solution that avoids all previously mentioned drawbacks). The entropic out of distribution detection solution uses the IsoMax loss for training and the entropic score for out of distribution detection. The IsoMax loss works as a drop in replacement of the SoftMax loss (i.e., the combination of the output linear layer, the SoftMax activation, and the cross entropy loss) because swapping the SoftMax loss with the IsoMax loss requires no changes in the model's architecture or training procedures hyperparameters. In this paper, we perform what we call an isometrization of the distances used in the IsoMax loss. Additionally, we propose replacing the entropic score with the minimum distance score. Experiments showed that these modifications significantly increase out of distribution detection performance while keeping the solution seamless. Besides being competitive with or outperforming all major current approaches, the proposed solution avoids all their current limitations, in addition to being much easier to use because only a simple loss replacement for training the neural network is required. The code to replace the SoftMax loss with the IsoMax loss and reproduce the results is available at https github.com dlmacedo entropic out of distribution detection.


Homogeneity and related topics An extended bibliography. We give a bibliography of works relating to homogeneous structures in the sense of Fra "iss 'e, and related topics, mainly through 2016, with some narrow updating through 2021. We first give a list arranged by topics, with references to the main bibliogrphay, which follows.


Imbalanced data preprocessing techniques utilizing local data characteristics. Data imbalance, that is the disproportion between the number of training observations coming from different classes, remains one of the most significant challenges affecting contemporary machine learning. The negative impact of data imbalance on traditional classification algorithms can be reduced by the data preprocessing techniques, methods that manipulate the training data to artificially reduce the degree of imbalance. However, the existing data preprocessing techniques, in particular SMOTE and its derivatives, which constitute the most prevalent paradigm of imbalanced data preprocessing, tend to be susceptible to various data difficulty factors. This is in part due to the fact that the original SMOTE algorithm does not utilize the information about majority class observations. The focus of this thesis is development of novel data resampling strategies natively utilizing the information about the distribution of both minority and majority class. The thesis summarizes the content of 12 research papers focused on the proposed binary data resampling strategies, their translation to the multi class setting, and the practical application to the problem of histopathological data classification.


An extension of a theorem of Bers and Finn on the removability of isolated singularities to the Euler Lagrange equations related to general linear growth problems. A famous theorem of Bers and Finn states that isolated singularities of solutions to the non parametric minimal surface equation are removable. We show that this result remains valid, if the area functional is replaced by a general functional of linear growth depending on the modulus of the gradient.


Hybrid Instance aware Temporal Fusion for Online Video Instance Segmentation. Recently, transformer based image segmentation methods have achieved notable success against previous solutions. While for video domains, how to effectively model temporal context with the attention of object instances across frames remains an open problem. In this paper, we propose an online video instance segmentation framework with a novel instance aware temporal fusion method. We first leverages the representation, i.e., a latent code in the global context (instance code) and CNN feature maps to represent instance and pixel level features. Based on this representation, we introduce a cropping free temporal fusion approach to model the temporal consistency between video frames. Specifically, we encode global instance specific information in the instance code and build up inter frame contextual fusion with hybrid attentions between the instance codes and CNN feature maps. Inter frame consistency between the instance codes are further enforced with order constraints. By leveraging the learned hybrid temporal consistency, we are able to directly retrieve and maintain instance identities across frames, eliminating the complicated frame wise instance matching in prior methods. Extensive experiments have been conducted on popular VIS datasets, i.e. Youtube VIS 19 21. Our model achieves the best performance among all online VIS methods. Notably, our model also eclipses all offline methods when using the ResNet 50 backbone.


Understanding and Enhancing the Use of Context for Machine Translation. To understand and infer meaning in language, neural models have to learn complicated nuances. Discovering distinctive linguistic phenomena from data is not an easy task. For instance, lexical ambiguity is a fundamental feature of language which is challenging to learn. Even more prominently, inferring the meaning of rare and unseen lexical units is difficult with neural networks. Meaning is often determined from context. With context, languages allow meaning to be conveyed even when the specific words used are not known by the reader. To model this learning process, a system has to learn from a few instances in context and be able to generalize well to unseen cases. The learning process is hindered when training data is scarce for a task. Even with sufficient data, learning patterns for the long tail of the lexical distribution is challenging. In this thesis, we focus on understanding certain potentials of contexts in neural models and design augmentation models to benefit from them. We focus on machine translation as an important instance of the more general language understanding problem. To translate from a source language to a target language, a neural model has to understand the meaning of constituents in the provided context and generate constituents with the same meanings in the target language. This task accentuates the value of capturing nuances of language and the necessity of generalization from few observations. The main problem we study in this thesis is what neural machine translation models learn from data and how we can devise more focused contexts to enhance this learning. Looking more in depth into the role of context and the impact of data on learning models is essential to advance the NLP field. Moreover, it helps highlight the vulnerabilities of current neural networks and provides insights into designing more robust models.


Transfer Learning with Ensembles of Deep Neural Networks for Skin Cancer Detection in Imbalanced Data Sets. Several machine learning techniques for accurate detection of skin cancer from medical images have been reported. Many of these techniques are based on pre trained convolutional neural networks (CNNs), which enable training the models based on limited amounts of training data. However, the classification accuracy of these models still tends to be severely limited by the scarcity of representative images from malignant tumours. We propose a novel ensemble based CNN architecture where multiple CNN models, some of which are pre trained and some are trained only on the data at hand, along with auxiliary data in the form of metadata associated with the input images, are combined using a meta learner. The proposed approach improves the model's ability to handle limited and imbalanced data. We demonstrate the benefits of the proposed technique using a dataset with 33126 dermoscopic images from 2056 patients. We evaluate the performance of the proposed technique in terms of the F1 measure, area under the ROC curve (AUC ROC), and area under the PR curve (AUC PR), and compare it with that of seven different benchmark methods, including two recent CNN based techniques. The proposed technique compares favourably in terms of all the evaluation metrics.


Interference fading suppression in Phi OTDR using space division multiplexed probes. We propose and experimentally demonstrate a novel interference fading suppression method for phase sensitive optical time domain reflectometry (Phi OTDR) using space division multiplexed (SDM) pulse probes in few mode fiber. The SDM probes consist of multiple different modes, and three spatial modes (LP01, LP11a and LP11b) are used in this work for proof of concept. Firstly, the Rayleigh backscattering light of different modes is experimentally characterized, and it turns out that the waveforms of Phi OTDR traces of distinct modes are all different from each other. Thanks to the spatial difference of fading positions of distinct modes, multiple probes from spatially multiplexed modes can be used to suppress the interference fading in Phi OTDR. Then, the performances of the Phi OTDR systems using single probe and multiple probes are evaluated and compared. Specifically, statistical analysis shows that both fading probabilities over fiber length and time are reduced significantly by using multiple SDM probes, which verifies the significant performance improvement on fading suppression. The proposed novel interference fading suppression method does not require complicated frequency or phase modulation, which has the advantages of simplicity, good effectiveness and high reliability.


Revisiting Design Choices in Offline Model Based Reinforcement Learning. Offline reinforcement learning enables agents to leverage large pre collected datasets of environment transitions to learn control policies, circumventing the need for potentially expensive or unsafe online data collection. Significant progress has been made recently in offline model based reinforcement learning, approaches which leverage a learned dynamics model. This typically involves constructing a probabilistic model, and using the model uncertainty to penalize rewards where there is insufficient data, solving for a pessimistic MDP that lower bounds the true MDP. Existing methods, however, exhibit a breakdown between theory and practice, whereby pessimistic return ought to be bounded by the total variation distance of the model from the true dynamics, but is instead implemented through a penalty based on estimated model uncertainty. This has spawned a variety of uncertainty heuristics, with little to no comparison between differing approaches. In this paper, we compare these heuristics, and design novel protocols to investigate their interaction with other hyperparameters, such as the number of models, or imaginary rollout horizon. Using these insights, we show that selecting these key hyperparameters using Bayesian Optimization produces superior configurations that are vastly different to those currently used in existing hand tuned state of the art methods, and result in drastically stronger performance.


RAM VO Less is more in Visual Odometry. Building vehicles capable of operating without human supervision requires the determination of the agent's pose. Visual Odometry (VO) algorithms estimate the egomotion using only visual changes from the input images. The most recent VO methods implement deep learning techniques using convolutional neural networks (CNN) extensively, which add a substantial cost when dealing with high resolution images. Furthermore, in VO tasks, more input data does not mean a better prediction on the contrary, the architecture may filter out useless information. Therefore, the implementation of computationally efficient and lightweight architectures is essential. In this work, we propose the RAM VO, an extension of the Recurrent Attention Model (RAM) for visual odometry tasks. RAM VO improves the visual and temporal representation of information and implements the Proximal Policy Optimization (PPO) algorithm to learn robust policies. The results indicate that RAM VO can perform regressions with six degrees of freedom from monocular input images using approximately 3 million parameters. In addition, experiments on the KITTI dataset demonstrate that RAM VO achieves competitive results using only 5.7 of the available visual information.


Exponentially convergent multiscale methods for high frequency heterogeneous Helmholtz equations. In this paper, we present a multiscale framework for solving the Helmholtz equation in heterogeneous media without scale separation and in the high frequency regime where the wavenumber k can be large. The main innovation is that our methods achieve a nearly exponential rate of convergence with respect to the computational degrees of freedom, using a coarse grid of mesh size O(1 k) without suffering from the well known pollution effect. The key idea is a coarse fine scale decomposition of the solution space that adapts to the media property and wavenumber this decomposition is inspired by the multiscale finite element method. We show that the coarse part is of low complexity in the sense that it can be approximated with a nearly exponential rate of convergence via local basis functions, while the fine part is local such that it can be computed efficiently using the local information of the right hand side. The combination of the two parts yields the overall nearly exponential rate of convergence. We demonstrate the effectiveness of our methods theoretically and numerically an exponential rate of convergence is consistently observed and confirmed. In addition, we observe the robustness of our methods regarding the high contrast in the media numerically.


The Baer Kaplansky theorem for all abelian groups and modules. It is shown that the Baer Kaplansky theorem can be extended to all abelian groups provided that the rings of endomorphisms of groups are replaced by trusses of endomorphisms of corresponding heaps. That is, every abelian group is determined up to isomorphism by its endomorphism truss and every isomorphism between two endomorphism trusses associated to some abelian groups G and H is induced by an isomorphism between G and H and an element from H . This correspondence is then extended to all modules over a ring by considering heaps of modules. It is proved that the truss of endomorphisms of a heap associated to a module M determines M as a module over its endomorphism ring.


Exotic families of symplectic manifolds with Milnor fibers of ADE type. In this paper, we give infinitely many diffeomorphic families of different Weinstein manifolds. The diffeomorphic families consist of the Milnor fibers of ADE type, and a Weinstein manifold constructed by gluing a cotangent bundle to the Milnor fiber of A type. The last mentioned members of the families have decomposable wrapped Fukaya categories.


Less is More Accelerating Faster Neural Networks Straight from JPEG. Most image data available are often stored in a compressed format, from which JPEG is the most widespread. To feed this data on a convolutional neural network (CNN), a preliminary decoding process is required to obtain RGB pixels, demanding a high computational load and memory usage. For this reason, the design of CNNs for processing JPEG compressed data has gained attention in recent years. In most existing works, typical CNN architectures are adapted to facilitate the learning with the DCT coefficients rather than RGB pixels. Although they are effective, their architectural changes either raise the computational costs or neglect relevant information from DCT inputs. In this paper, we examine different ways of speeding up CNNs designed for DCT inputs, exploiting learning strategies to reduce the computational complexity by taking full advantage of DCT inputs. Our experiments were conducted on the ImageNet dataset. Results show that learning how to combine all DCT inputs in a data driven fashion is better than discarding them by hand, and its combination with a reduction of layers has proven to be effective for reducing the computational costs while retaining accuracy.


Sentiment Analysis in Twitter for Macedonian. We present work on sentiment analysis in Twitter for Macedonian. As this is pioneering work for this combination of language and genre, we created suitable resources for training and evaluating a system for sentiment analysis of Macedonian tweets. In particular, we developed a corpus of tweets annotated with tweet level sentiment polarity (positive, negative, and neutral), as well as with phrase level sentiment, which we made freely available for research purposes. We further bootstrapped several large scale sentiment lexicons for Macedonian, motivated by previous work for English. The impact of several different pre processing steps as well as of various features is shown in experiments that represent the first attempt to build a system for sentiment analysis in Twitter for the morphologically rich Macedonian language. Overall, our experimental results show an F1 score of 92.16, which is very strong and is on par with the best results for English, which were achieved in recent SemEval competitions.


Fostering the Robustness of White Box Deep Neural Network Watermarks by Neuron Alignment. The wide application of deep learning techniques is boosting the regulation of deep learning models, especially deep neural networks (DNN), as commercial products. A necessary prerequisite for such regulations is identifying the owner of deep neural networks, which is usually done through the watermark. Current DNN watermarking schemes, particularly white box ones, are uniformly fragile against a family of functionality equivalence attacks, especially the neuron permutation. This operation can effortlessly invalidate the ownership proof and escape copyright regulations. To enhance the robustness of white box DNN watermarking schemes, this paper presents a procedure that aligns neurons into the same order as when the watermark is embedded, so the watermark can be correctly recognized. This neuron alignment process significantly facilitates the functionality of established deep neural network watermarking schemes.


On the Performance of the Primary and Secondary Links in a 3 D Underlay Cognitive Molecular Communication. Molecular communication often involves coexisting links where certain links may have priority over others. In this work, we consider a system in three dimensional (3 D) space with two coexisting communication links, each between a point transmitter and fully absorbing spherical receiver (FAR), where the one link (termed primary) has priority over the second link (termed secondary). The system implements the underlay cognitive communication strategy for the co existence of both links, which use the same type of molecules for information transfer. Mutual influence of FARs existing in the same communication medium results in competition for capturing the information carrying molecules. In this work, first, we derive an approximate hitting probability equation for a diffusion limited molecular communication system with two spherical FARs of different sizes considering the effect of molecular degradation. The derived equation is then used for the performance analysis of primary and secondary links in a cognitive molecular communication scenario. We show that the simple transmit control strategy at the secondary transmitter can improve the performance of the overall system. We study the influence of molecular degradation and decision threshold on the system performance. We also show that the systems parameters need to be carefully set to improve the performance of the system.


Learning Semantic Aware Dynamics for Video Prediction. We propose an architecture and training scheme to predict video frames by explicitly modeling dis occlusions and capturing the evolution of semantically consistent regions in the video. The scene layout (semantic map) and motion (optical flow) are decomposed into layers, which are predicted and fused with their context to generate future layouts and motions. The appearance of the scene is warped from past frames using the predicted motion in co visible regions dis occluded regions are synthesized with content aware inpainting utilizing the predicted scene layout. The result is a predictive model that explicitly represents objects and learns their class specific motion, which we evaluate on video prediction benchmarks.


How to Fairly Allocate Easy and Difficult Chores. A major open question in fair allocation of indivisible items is whether there always exists an allocation of chores that is Pareto optimal (PO) and envy free up to one item (EF1). We answer this question affirmatively for the natural class of bivalued utilities, where each agent partitions the chores into easy and difficult ones, and has cost p 1 for chores that are difficult for her and cost 1 for chores that are easy for her. Such an allocation can be found in polynomial time using an algorithm based on the Fisher market. We also show that for a slightly broader class of utilities, where each agent i can have a potentially different integer p i , an allocation that is maximin share fair (MMS) always exists and can be computed in polynomial time, provided that each p i is an integer. Our MMS arguments also hold when allocating goods instead of chores, and extend to another natural class of utilities, namely weakly lexicographic utilities.


Data Selection for Efficient Model Update in Federated Learning. The Federated Learning (FL) workflow of training a centralized model with distributed data is growing in popularity. However, until recently, this was the realm of contributing clients with similar computing capability. The fast expanding IoT space and data being generated and processed at the edge are encouraging more effort into expanding federated learning to include heterogeneous systems. Previous approaches distribute light weight models to clients are rely on knowledge transfer to distil the characteristic of local data in partitioned updates. However, their additional knowledge exchange transmitted through the network degrades the communication efficiency of FL. We propose to reduce the size of knowledge exchanged in these FL setups by clustering and selecting only the most representative bits of information from the clients. The partitioned global update adopted in our work splits the global deep neural network into a lower part for generic feature extraction and an upper part that is more sensitive to this selected client knowledge. Our experiments show that only 1.6 of the initially exchanged data can effectively transfer the characteristic of the client data to the global model in our FL approach, using split networks. These preliminary results evolve our understanding of federated learning by demonstrating efficient training using strategically selected training samples.


On the indecomposability of a remarkable new family of modules appearing in Galois theory. A powerful new perspective in the analysis of absolute Galois groups has recently emerged from the study of Galois modules related to classical parameterizing spaces of certain Galois extensions. The recurring trend in these decompositions is their stunning simplicity almost all summands are free over some quotient ring. The non free summands which appear are exceptional not only because they are different in form, but because they play the key role in controlling arithmetic conditions that allow the remaining summands to be easily described. In this way, these exceptional summands are the lynchpin for a bevy of new properties of absolute Galois groups that have been gleaned from these surprising decompositions. In one such recent decomposition, a remarkable new exceptional summand was discovered which exhibited interesting properties that have not been seen before. The exceptional summand is drawn from a particular finite family that has not yet been investigated. The main goal of this paper is to introduce this family of modules and verify their indecomposability. We believe this module will be of interest to people working in Galois theory, representation theory, combinatorics, and general algebra. The analysis of these modules includes some interesting new tools, including analogs of p adic expansions.


High resolution imaging of C He collisions using Zeeman deceleration and VUV detection. High resolution measurements of angular scattering distributions provide a sensitive test for theoretical descriptions of collision processes. Crossed beam experiments employing a decelerator and velocity map imaging have proven successful to probe collision cross sections with extraordinary resolution. However, a prerequisite to exploit these possibilities is the availability of a near threshold state selective ionization scheme to detect the collision products, which for many species is either absent or inefficient. We present the first implementation of recoil free vacuum ultraviolet (VUV) based detection in scattering experiments involving a decelerator and velocity map imaging. This allowed for high resolution measurements of state resolved angular scattering distributions for inelastic collisions between Zeeman decelerated carbon C( 3P 1 ) atoms and helium atoms. We fully resolved diffraction oscillations in the angular distributions, which showed excellent agreement with the distributions predicted by quantum scattering calculations. Our approach offers exciting prospects to investigate a large range of scattering processes with unprecedented precision.


TGRNet A Table Graph Reconstruction Network for Table Structure Recognition. A table arranging data in rows and columns is a very effective data structure, which has been widely used in business and scientific research. Considering large scale tabular data in online and offline documents, automatic table recognition has attracted increasing attention from the document analysis community. Though human can easily understand the structure of tables, it remains a challenge for machines to understand that, especially due to a variety of different table layouts and styles. Existing methods usually model a table as either the markup sequence or the adjacency matrix between different table cells, failing to address the importance of the logical location of table cells, e.g., a cell is located in the first row and the second column of the table. In this paper, we reformulate the problem of table structure recognition as the table graph reconstruction, and propose an end to end trainable table graph reconstruction network (TGRNet) for table structure recognition. Specifically, the proposed method has two main branches, a cell detection branch and a cell logical location branch, to jointly predict the spatial location and the logical location of different cells. Experimental results on three popular table recognition datasets and a new dataset with table graph annotations (TableGraph 350K) demonstrate the effectiveness of the proposed TGRNet for table structure recognition. Code and annotations will be made publicly available.


ReQuBiS Reconfigurable Quadrupedal Bipedal Snake Robots. The selection of mobility modes for robot navigation consists of various trade offs. Snake robots are ideal for traversing through constrained environments such as pipes, cluttered and rough terrain, whereas bipedal robots are more suited for structured environments such as stairs. Finally, quadruped robots are more stable than bipeds and can carry larger payloads than snakes and bipeds but struggle to navigate soft soil, sand, ice, and constrained environments. A reconfigurable robot can achieve the best of all worlds. Unfortunately, state of the art reconfigurable robots rely on the rearrangement of modules through complicated mechanisms to dissemble and assemble at different places, increasing the size, weight, and power (SWaP) requirements. We propose Reconfigurable Quadrupedal Bipedal Snake Robots (ReQuBiS), which can transform between mobility modes without rearranging modules. Hence, requiring just a single modification mechanism. Furthermore, our design allows the robot to split into two agents to perform tasks in parallel for biped and snake mobility. Experimental results demonstrate these mobility capabilities in snake, quadruped, and biped modes and transitions between them.


Terahertz Phonons coherently couple Ultrashort Solitons inside a Cavity. Ultrafast atomic vibrations mediate heat transport, serve as fingerprints for chemical bonds and drive phase transitions in condensed matter systems. Light pulses shorter than the atomic oscillation period can not only probe, but even stimulate and control collective excitations. In general, such interactions are performed with free propagating pulses. Here, we demonstrate intra cavity excitation and time domain sampling of coherent optical phonons inside an active laser oscillator. Employing real time spectral interferometry, we reveal that Terahertz beats of Raman active optical phonons can bind temporal solitons to bound states termed "Soliton molecules" and we resolve a coherent coupling mechanism of phonon and intra cavity soliton motion. Concurring electronic and nuclear nonlinearities generate distinct soliton trajectories and, effectively, enhance the coherent Raman signal. As a result, we observe that the inter soliton motion automatically performs highspeed time domain Raman spectroscopy of the gain medium. In particular, our results pinpoint the impact of Raman induced soliton interactions in crystalline laser media and microresonators, and offer unique perspectives towards ultrafast nonlinear phononics by exploiting the enhanced coupling of atomic motion and solitons inside a cavity.


Curriculum Learning A Regularization Method for Efficient and Stable Billion Scale GPT Model Pre Training. Recent works have demonstrated great success in training large autoregressive language models (e.g., GPT 3) on unlabeled text corpus for text generation. To reduce their expensive training cost, practitioners attempt to increase the batch sizes and learning rates. However, increasing them often cause training instabilities and poor generalization. On the other side, using smaller batch sizes or learning rates would reduce the training efficiency, significantly increasing training time and cost. We investigate this stability efficiency dilemma and identify that long sequence length is one of the main causes of training instability in large scale GPT model pre training. Based on our analysis, we present a novel sequence length warmup method that simultaneously improves training stability and efficiency. As a kind of curriculum learning approach, our method improves the training convergence speed of autoregressive models. More importantly, our in depth analysis shows that our method exerts a gradient variance reduction effect and regularizes early stages of training where the amount of training data is much smaller than the model capacity. This enables stable training with much larger batch sizes and learning rates, further improving the training speed. Evaluations show that our approach enables stable GPT 2 (117M and 1.5B) pre training with 8x larger batch size and 4x larger learning rate, whereas the baseline approach struggles with training instability. To achieve the same or better zero shot WikiText 103 LAMBADA evaluation results, our approach reduces the required number of pre training tokens and wall clock time by up to 55 and 73 , respectively.


Smart IoT Biofloc water management system using Decision regression tree. The conventional fishing industry has several difficulties water contamination, temperature instability, nutrition, area, expense, etc. In fish farming, Biofloc technology turns traditional farming into a sophisticated infrastructure that enables the utilization of leftover food by turning it into bacterial biomass. The purpose of our study is to propose an intelligent IoT Biofloc system that improves efficiency and production. This article introduced a system that gathers data from sensors, store data in the cloud, analyses it using a machine learning model such as a Decision regression tree model to predict the water condition, and provides real time monitoring through an android app. The proposed system has achieved a satisfactory accuracy of 79 during the experiment.


Fast Online Optimization for Terrain Blind Bipedal Robot Walking with a Decoupled Actuated SLIP Model. We present a highly reactive controller which enables bipedal robots to blindly walk over various kinds of uneven terrains while resisting pushes. The high level motion planner does fast online optimization for footstep locations and Center of Mass (CoM) height using the decoupled actuated Spring Loaded Inverted Pendulum (aSLIP) model. The decoupled aSLIP model simplifies the original aSLIP with Linear Inverted Pendulum (LIP) dynamics in horizontal states and spring dynamics in the vertical state. The motion planning can be formulated as a discrete time Model Predictive Control (MPC) and solved at a frequency of 1k HZ. The output of the motion planner using a reduced order model is fed into an inverse dynamics based whole body controller for execution on the robot. A key result of this controller is that the foot of the robot is compliant, which further extends the robot's ability to be robust to unobserved terrain changes. We evaluate our method in simulation with the bipedal robot SLIDER. Results show the robot can blindly walk over various uneven terrains including slopes, wave fields and stairs. It can also resist pushes while walking on uneven terrain.


Energy based Accounting Model for Heterogeneous Supercomputers. In this paper we present a new accounting model for heterogeneous supercomputers. An increasing number of supercomputing centres adopt heterogeneous architectures consisting of CPUs and hardware accelerators for their systems. Accounting models using the core hour as unit of measure are redefined to provide an appropriate charging rate based on the computing performance of different processing elements, as well as their energy efficiency and purchase price. In this paper we provide an overview of existing models and define a new model that, while retaining the core hour as a fundamental concept, takes into account the interplay among resources such as CPUs and RAM, and that bases the GPU charging rate on energy consumption. We believe that this model, designed for Pawsey Supercomputing Research Centre's next supercomputer Setonix, has a lot of advantages compared to other models, introducing carbon footprint as a primary driver in determining the allocation of computational workflow on heterogeneous resources.


Decomposing Convolutional Neural Networks into Reusable and Replaceable Modules. Training from scratch is the most common way to build a Convolutional Neural Network (CNN) based model. What if we can build new CNN models by reusing parts from previously build CNN models? What if we can improve a CNN model by replacing (possibly faulty) parts with other parts? In both cases, instead of training, can we identify the part responsible for each output class (module) in the model(s) and reuse or replace only the desired output classes to build a model? Prior work has proposed decomposing dense based networks into modules (one for each output class) to enable reusability and replaceability in various scenarios. However, this work is limited to the dense layers and based on the one to one relationship between the nodes in consecutive layers. Due to the shared architecture in the CNN model, prior work cannot be adapted directly. In this paper, we propose to decompose a CNN model used for image classification problems into modules for each output class. These modules can further be reused or replaced to build a new model. We have evaluated our approach with CIFAR 10, CIFAR 100, and ImageNet tiny datasets with three variations of ResNet models and found that enabling decomposition comes with a small cost (1.77 and 0.85 for top 1 and top 5 accuracy, respectively). Also, building a model by reusing or replacing modules can be done with a 2.3 and 0.5 average loss of accuracy. Furthermore, reusing and replacing these modules reduces CO2e emission by 37 times compared to training the model from scratch.


Uncertify Attacks Against Neural Network Certification. Certifiers for neural networks have made great progress towards provable robustness guarantees against evasion attacks using adversarial examples. However, introducing certifiers into deep learning systems also opens up new attack vectors, which need to be considered before deployment. In this work, we conduct the first systematic analysis of training time attacks against certifiers in practical application pipelines, identifying new threat vectors that can be exploited to degrade the overall system. Using these insights, we design two backdoor attacks against network certifiers, which can drastically reduce certified robustness. For example, adding 1 poisoned data points during training is sufficient to reduce certified robustness by up to 95 percentage points, effectively rendering the certifier useless. We analyze how such novel attacks can compromise the overall system's integrity or availability. Our extensive experiments across multiple datasets, model architectures, and certifiers demonstrate the wide applicability of these attacks. A first investigation into potential defenses shows that current approaches are insufficient to mitigate the issue, highlighting the need for new, more specific solutions.


Transfer Reinforcement Learning across Homotopy Classes. The ability for robots to transfer their learned knowledge to new tasks where data is scarce is a fundamental challenge for successful robot learning. While fine tuning has been well studied as a simple but effective transfer approach in the context of supervised learning, it is not as well explored in the context of reinforcement learning. In this work, we study the problem of fine tuning in transfer reinforcement learning when tasks are parameterized by their reward functions, which are known beforehand. We conjecture that fine tuning drastically underperforms when source and target trajectories are part of different homotopy classes. We demonstrate that fine tuning policy parameters across homotopy classes compared to fine tuning within a homotopy class requires more interaction with the environment, and in certain cases is impossible. We propose a novel fine tuning algorithm, Ease In Ease Out fine tuning, that consists of a relaxing stage and a curriculum learning stage to enable transfer learning across homotopy classes. Finally, we evaluate our approach on several robotics inspired simulated environments and empirically verify that the Ease In Ease Out fine tuning method can successfully fine tune in a sample efficient way compared to existing baselines.


An Anonymous On Street Parking Authentication Scheme via Zero Knowledge Set Membership Proof. The amount of information generated grows as more and more sensor and IoT devices are deployed in smart cities. It is of utmost importance for us to consider the privacy data leakage and compromised identity from both outside adversaries and inside abuse of data access privilege. The security assumption of the system should not solely rely on the fact that permission and access control were being implemented correctly. Quite the contrary, a system can be designed in a way that user's identity data and usage traces are not leaked even if the system had been compromised. Based upon our previous on street parking system utilizing Bluetooth Low Energy (BLE) beacons, we applied a cryptographic primitive called zero knowledge proof to our authentication system. A commitment scheme and Merkle tree is combined in the setup to achieve zero knowledge set membership proof. Doing so, the user is anonymous to the server between authentication sessions, while the server's still able to verify the legitimacy of such user. The on street parking system is therefore immune to privacy data leakage, as for now one cannot mass query and profile certain user's traces within the system.


Multi Perspective Trust Management Framework for Crowdsourced IoT Services. We propose a novel generic trust management framework for crowdsourced IoT services. The framework exploits a multi perspective trust model that captures the inherent characteristics of crowdsourced IoT services. Each perspective is defined by a set of attributes that contribute to the perspective's influence on trust. The attributes are fed into a machine learning based algorithm to generate a trust model for crowdsourced services in IoT environments. We demonstrate the effectiveness of our approach by conducting experiments on real world datasets.


New estimates for the maximal functions and applications. In this paper we study sharp pointwise inequalities for maximal operators. In particular, we strengthen DeVore's inequality for the moduli of smoothness and a logarithmic variant of Bennett DeVore Sharpley's inequality for rearrangements. As a consequence, we improve the classical Stein Zygmund embedding deriving dot B d p infty L p, infty ( mathbb R d) hookrightarrow text BMO ( mathbb R d) for 1 p infty . Moreover, these results are also applied to establish new Fefferman Stein inequalities, Calder 'on Scott type inequalities, and extrapolation estimates. Our approach is based on the limiting interpolation techniques.


Weakly saturated hypergraphs and a conjecture of Tuza. Given a fixed hypergraph H , let mbox wsat (n,H) denote the smallest number of edges in an n vertex hypergraph G , with the property that one can sequentially add the edges missing from G , so that whenever an edge is added, a new copy of H is created. The study of mbox wsat (n,H) was introduced by Bollob 'as in 1968, and turned out to be one of the most influential topics in extremal combinatorics. While for most H very little is known regarding mbox wsat (n,H) , Alon proved in 1985 that for every graph H there is a limiting constant C H so that mbox wsat (n,H) (C H o(1))n . Tuza conjectured in 1992 that Alon's theorem can be (appropriately) extended to arbitrary r uniform hypergraphs. In this paper we prove this conjecture.


Lipschitz geometry and combinatorics of abnormal surface germs. We study outer Lipschitz geometry of real semialgebraic or, more general, definable in a polynomially bounded o minimal structure over the reals, surface germs. In particular, any definable H "older triangle is either Lipschitz normally embedded or contains some "abnormal" arcs. We show that abnormal arcs constitute finitely many "abnormal zones" in the space of all arcs, and investigate geometric and combinatorial properties of abnormal surface germs. We establish a strong relation between geometry and combinatorics of abnormal H "older triangles.


Equivalent one dimensional first order linear hyperbolic systems and range of the minimal null control time with respect to the internal coupling matrix. In this paper, we are interested in the minimal null control time of one dimensional first order linear hyperbolic systems by one sided boundary controls. Our main result is an explicit characterization of the smallest and largest values that this minimal null control time can take with respect to the internal coupling matrix. In particular, we obtain a complete description of the situations where the minimal null control time is invariant with respect to all the possible choices of internal coupling matrices. The proof relies on the notion of equivalent systems, in particular the backstepping method, a canonical LU decomposition for boundary coupling matrices and a compactness uniqueness method adapted to the null controllability property.


Measuring HTTP 3 Adoption and Performance. The third version of the Hypertext Transfer Protocol (HTTP) is currently in its final standardization phase by the IETF. Besides better security and increased flexibility, it promises benefits in terms of performance. HTTP 3 adopts a more efficient header compression schema and replaces TCP with QUIC, a transport protocol carried over UDP, originally proposed by Google and currently under standardization too. Although HTTP 3 early implementations already exist and some websites announce its support, it has been subject to few studies. In this work, we provide a first measurement study on HTTP 3. We testify how, during 2020, it has been adopted by some of the leading Internet companies such as Google, Facebook and Cloudflare. We run a large scale measurement campaign toward thousands of websites adopting HTTP 3, aiming at understanding to what extent it achieves better performance than HTTP 2. We find that adopting websites often host most web page objects on third party servers, which support only HTTP 2 or even HTTP 1.1. Our experiments show that HTTP 3 provides sizable benefits only in scenarios with high latency or very poor bandwidth. Despite the adoption of QUIC, we do not find benefits in case of high packet loss, but we observe large diversity across website providers' infrastructures.


Interleaving Reconfigurable Interaction Separating Choice from Scheduling using Glue. Reconfigurable interaction induces another dimension of nondeterminism in concurrent systems which makes it hard to reason about the different choices of the system from a global perspective. Namely, (1) choices that correspond to concurrent execution of independent events and (2) forced interleaving (or scheduling) due to reconfiguration. Unlike linear order semantics of computations, partial order semantics recovers information about the interdependence among the different events for fixed interaction, but still is unable to handle reconfiguration. We introduce glued partial orders as a way to capture reconfiguration. Much like partial orders capture all possible choices for fixed systems, glued partial orders capture all possible choices alongside reconfiguration. We show that a glued partial order is sufficient to correctly capture all partial order computations that differ in forced interleaving due to reconfiguration. Furthermore, we show that computations belonging to different glued partial orders are only different due to non determinism.


Spatial Separated Curve Rendering Network for Efficient and High Resolution Image Harmonization. Image harmonization aims to modify the color of the composited region with respect to the specific background. Previous works model this task as a pixel wise image to image translation using UNet family structures. However, the model size and computational cost limit the ability of their models on edge devices and higher resolution images. To this end, we propose a novel spatial separated curve rendering network(S 2 CRNet) for efficient and high resolution image harmonization for the first time. In S 2 CRNet, we firstly extract the spatial separated embeddings from the thumbnails of the masked foreground and background individually. Then, we design a curve rendering module(CRM), which learns and combines the spatial specific knowledge using linear layers to generate the parameters of the piece wise curve mapping in the foreground region. Finally, we directly render the original high resolution images using the learned color curve. Besides, we also make two extensions of the proposed framework via the Cascaded CRM and Semantic CRM for cascaded refinement and semantic guidance, respectively. Experiments show that the proposed method reduces more than 90 parameters compared with previous methods but still achieves the state of the art performance on both synthesized iHarmony4 and real world DIH test sets. Moreover, our method can work smoothly on higher resolution images(eg., 2048 times2048 ) in 0.1 seconds with much lower GPU computational resources than all existing methods. The code will be made available at url http github.com stefanLeong S2CRNet .


GIFT Generalizable Interaction aware Functional Tool Affordances without Labels. Tool use requires reasoning about the fit between an object's affordances and the demands of a task. Visual affordance learning can benefit from goal directed interaction experience, but current techniques rely on human labels or expert demonstrations to generate this data. In this paper, we describe a method that grounds affordances in physical interactions instead, thus removing the need for human labels or expert policies. We use an efficient sampling based method to generate successful trajectories that provide contact data, which are then used to reveal affordance representations. Our framework, GIFT, operates in two phases first, we discover visual affordances from goal directed interaction with a set of procedurally generated tools second, we train a model to predict new instances of the discovered affordances on novel tools in a self supervised fashion. In our experiments, we show that GIFT can leverage a sparse keypoint representation to predict grasp and interaction points to accommodate multiple tasks, such as hooking, reaching, and hammering. GIFT outperforms baselines on all tasks and matches a human oracle on two of three tasks using novel tools.


Minimum Number of Bends of Paths of Trees in a Grid Embedding. We are interested in embedding trees T with maximum degree at most four in a rectangular grid, such that the vertices of T correspond to grid points, while edges of T correspond to non intersecting straight segments of the grid lines. Such embeddings are called straight models. While each edge is represented by a straight segment, a path of T is represented in the model by the union of the segments corresponding to its edges, which may consist of a path in the model having several bends. The aim is to determine a straight model of a given tree T minimizing the maximum number of bends over all paths of T. We provide a quadratic time algorithm for this problem. We also show how to construct straight models that have k as its minimum number of bends and with the least number of vertices possible. As an application of our algorithm, we provide an upper bound on the number of bends of EPG models of graphs that are both VPT and EPT.


Domain Generalization in Vision A Survey. Generalization to out of distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d. assumption on source target data, which is often violated in practice due to domain shift. Domain generalization (DG) aims to achieve OOD generalization by using only source data for model learning. Since first introduced in 2011, research in DG has made great progresses. In particular, intensive research in this topic has led to a broad spectrum of methodologies, e.g., those based on domain alignment, meta learning, data augmentation, or ensemble learning, just to name a few and has covered various vision applications such as object recognition, segmentation, action recognition, and person re identification. In this paper, for the first time a comprehensive literature review is provided to summarize the developments in DG for computer vision over the past decade. Specifically, we first cover the background by formally defining DG and relating it to other research fields like domain adaptation and transfer learning. Second, we conduct a thorough review into existing methods and present a categorization based on their methodologies and motivations. Finally, we conclude this survey with insights and discussions on future research directions.


Is CCSD(T) a proper standard for dipole moment calculations? An analysis considering diverse diatomic species. Coupled cluster with single, double, and perturbative triple excitations CCSD(T) has been extensively employed as the reference method in benchmarking different quantum chemistry methods. In this work, we test the accuracy of CCSD(T) calculating ground state electric dipole moments at the extrapolated complete basis set (CBS) limit. The calculated dipole moments have been compared to an experimental dataset consisted of diatomic molecules with various kinds of bond natures and spin configurations. As a result, to reach a satisfactory agreement with experimental dipole moments, core correlations should be included for some molecules. However, even when core correlations are included, the predicted dipole moment deviates considerably from the experimental values for molecules involving transition metal atoms.


Improving Dynamic Regret in Distributed Online Mirror Descent Using Primal and Dual Information. We consider the problem of distributed online optimization, with a group of learners connected via a dynamic communication graph. The goal of the learners is to track the global minimizer of a sum of time varying loss functions in a distributed manner. We propose a novel algorithm, termed Distributed Online Mirror Descent with Multiple Averaging Decision and Gradient Consensus (DOMD MADGC), which is based on mirror descent but incorporates multiple consensus averaging iterations over local gradients as well as local decisions. The key idea is to allow the local learners to collect a sufficient amount of global information, which enables them to more accurately approximation the time varying global loss, so that they can closely track the dynamic global minimizer over time. We show that the dynamic regret of DOMD MADGC is upper bounded by the path length, which is defined as the cumulative distance between successive minimizers. The resulting bound improves upon the bounds of existing distributed online algorithms and removes the explicit dependence on T .


Proving SIFA Protection of Masked Redundant Circuits. Implementation attacks like side channel and fault attacks pose a considerable threat to cryptographic devices that are physically accessible by an attacker. As a consequence, devices like smart cards implement corresponding countermeasures like redundant computation and masking. Recently, statistically ineffective fault attacks (SIFA) were shown to be able to circumvent these classical countermeasure techniques. We present a new approach for verifying the SIFA protection of arbitrary masked implementations in both hardware and software. The proposed method uses Boolean dependency analysis, factorization, and known properties of masked computations to show whether the fault detection mechanism of redundant masked circuits can leak information about the processed secret values. We implemented this new method in a tool called Danira, which can show the SIFA resistance of cryptographic implementations like AES S Boxes within minutes.


AIS Explorer Prioritization for watercraft inspections A decision support tool for aquatic invasive species management. Invasions of aquatic invasive species have imposed significant economic and ecological damage to global aquatic ecosystems. Once an invasive population has established in a new habitat, eradication can be financially and logistically impossible, motivating management strategies to rely heavily upon prevention measures aimed at reducing the introduction and spread. To be productive, on the ground management of aquatic invasive species requires effective decision making surrounding the allocation of limited resources. Watercraft inspections play an important role in managing aquatic invasive species by preventing the overland transport of invasive species between waterbodies and providing education to boaters. In this study, we developed and tested an interactive web based decision support tool, AIS Explorer Prioritization for Watercraft Inspections, to guide AIS managers in developing efficient watercraft inspection plans. The decision support tool is informed by a novel network model that maximized the number of inspected watercraft that move from AIS infested to uninfested waterbodies, within and outside of counties in Minnesota, USA. It was iteratively built with stakeholder feedback, including consultations with county managers, beta testing of the web based application, and workshops to educate and train end users. The co development and implementation of data driven decision support tools demonstrate how interdisciplinary methods can be used to connect science and management to support decision making. The AIS Explorer Prioritization for Watercraft Inspections application makes optimized research outputs accessible in multiple dynamic forms that maintain pace with the identification of new infestations and local needs. In addition, the decision support tool has supported improved and closer communication between AIS managers and researchers on this topic.


On simulation of rough Volterra stochastic volatility models. Rough Volterra volatility models are a progressive and promising field of research in derivative pricing. Although rough fractional stochastic volatility models already proved to be superior in real market data fitting, techniques used in simulation of these models are still inefficient in terms of speed and accuracy. This paper aims to present the accurate tools and techniques that could be used also in nowadays largely emerging pricing methods based on machine learning. In particular, we compare three widely used simulation methods the Cholesky method, the Hybrid scheme, and the rDonsker scheme. We also comment on implementation of variance reduction techniques. In particular, we show the obstacles of the so called turbocharging technique whose performance is sometimes contra productive. To overcome these obstacles, we suggest several modifications.