Global and local epidemiology of Group A Streptococcus indicates that naturally acquired immunity is enduring and strain specific. The bacterium Group A Streptococcus (Streptococcus pyogenes, GAS) is a human specific pathogen and a major cause of global morbidity and mortality. Despite decades of research our knowledge of GAS infection and immunity is incomplete, hampering vaccine design and other efforts to reduce disease prevalence. Epidemiological studies indicate positive associations between the prevalence of GAS related disease, the diversity of circulating strains and the degree of poverty in host populations. However, the infection and immune mechanisms underlying these associations are not clear. In this work, we use an agent based model to demonstrate that observed diversity and prevalence are best accounted for by the hypothesis that GAS infection confers enduring strain specific immunity, with reduced or absent cross protection against infection by other strains. Our results suggest that the success of GAS vaccines will depend on their ability to elicit long lasting cross protective immunity over multiple strain types.


On Agnostic PAC Learning using mathcal L 2 polynomial Regression and Fourier based Algorithms. We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint distribution D . We demonstrate that agnostic PAC learning with 0 1 loss is equivalent to an optimization in the Hilbert space domain. With our model, we revisit the PAC learning problem using methods based on least squares such as mathcal L 2 polynomial regression and Linial's low degree algorithm. We study learning with respect to several hypothesis classes such as half spaces and polynomial approximated classes (i.e., functions approximated by a fixed degree polynomial). We prove that (under some distributional assumptions) such methods obtain generalization error up to 2opt with opt being the optimal error of the class. Hence, we show the tightest bound on generalization error when opt leq 0.2 .


Human Performance Capture from Monocular Video in the Wild. Capturing the dynamically deforming 3D shape of clothed human is essential for numerous applications, including VR AR, autonomous driving, and human computer interaction. Existing methods either require a highly specialized capturing setup, such as expensive multi view imaging systems, or they lack robustness to challenging body poses. In this work, we propose a method capable of capturing the dynamic 3D human shape from a monocular video featuring challenging body poses, without any additional input. We first build a 3D template human model of the subject based on a learned regression model. We then track this template model's deformation under challenging body articulations based on 2D image observations. Our method outperforms state of the art methods on an in the wild human video dataset 3DPW. Moreover, we demonstrate its efficacy in robustness and generalizability on videos from iPER datasets.


Joint Coding and Scheduling Optimization for Distributed Learning over Wireless Edge Networks. Unlike theoretical distributed learning (DL), DL over wireless edge networks faces the inherent dynamics uncertainty of wireless connections and edge nodes, making DL less efficient or even inapplicable under the highly dynamic wireless edge networks (e.g., using mmW interfaces). This article addresses these problems by leveraging recent advances in coded computing and the deep dueling neural network architecture. By introducing coded structures redundancy, a distributed learning task can be completed without waiting for straggling nodes. Unlike conventional coded computing that only optimizes the code structure, coded distributed learning over the wireless edge also requires to optimize the selection scheduling of wireless edge nodes with heterogeneous connections, computing capability, and straggling effects. However, even neglecting the aforementioned dynamics uncertainty, the resulting joint optimization of coding and scheduling to minimize the distributed learning time turns out to be NP hard. To tackle this and to account for the dynamics and uncertainty of wireless connections and edge nodes, we reformulate the problem as a Markov Decision Process and then design a novel deep reinforcement learning algorithm that employs the deep dueling neural network architecture to find the jointly optimal coding scheme and the best set of edge nodes for different learning tasks without explicit information about the wireless environment and edge nodes' straggling parameters. Simulations show that the proposed framework reduces the average learning delay in wireless edge computing up to 66 compared with other DL approaches. The jointly optimal framework in this article is also applicable to any distributed learning scheme with heterogeneous and uncertain computing nodes.


Distinguishing Level 2 Phylogenetic Networks Using Phylogenetic Invariants. In phylogenetics, it is important for the phylogenetic network model parameters to be identifiable so that the evolutionary histories of a group of species can be consistently inferred. However, as the complexity of the phylogenetic network models grows, the identifiability of network models becomes increasingly difficult to analyze. As an attempt to analyze the identifiability of network models, we check whether two networks are distinguishable. In this paper, we specifically study the distinguishability of phylogenetic network models associated with level 2 networks. Using an algebraic approach, namely using discrete Fourier transformation, we present some results on the distinguishability of some level 2 networks, which generalize earlier work on the distinguishability of level 1 networks. In particular, we study simple and semisimple level 2 networks. Simple and semisimple level 2 networks can be thought as generalizations of level 1 sunlet and cycle networks, respectively. Moreover, we also compare the varieties associated with semisimple level 2 and cycle networks.


Squeezing function for d balanced domains. We introduce the notion of squeezing function corresponding to d balanced domains motivated by the concept of generalized squeezing function given by Rong and Yang. In this work we study some of its properties and its relation with Fridman invariant.


On deploying the Artificial Sport Trainer into practice. Computational Intelligence methods for automatic generation of sport training plans in individual sport disciplines have achieved a mature phase. In order to confirm their added value, they have been deployed into practice. As a result, several methods have been developed for generating well formulated training plans on computers automatically that, typically, depend on the collection of past sport activities. However, monitoring the realization of the performed training sessions still represents a bottleneck in automating the process of sport training as a whole. The objective of this paper is to present a new low cost and efficient embedded device for monitoring the realization of sport training sessions that is dedicated to monitor cycling training sessions. We designed and developed a new bike computer, i.e. the AST Monitor, that can be mounted easily on almost every bicycle. The aforementioned bike computer is based on the Raspberry Pi device that supports different external sensors for capturing the data during the realization of sport training sessions. An adjusted GUI tailored to the needs of athletes is developed, along with the hardware. The proof of concept study, using the AST Monitor in practice, revealed the potential of the proposed solution for monitoring of realized sport training sessions automatically. The new device also opens the door for the future utilization of Artificial Intelligence in a wide variety of sports.


Low Complexity Dynamic Resource Scheduling for Downlink MC NOMA Over Fading Channels. In this paper, we investigate dynamic resource scheduling (i.e., joint user, subchannel, and power scheduling) for downlink multi channel non orthogonal multiple access (MC NOMA) systems over time varying fading channels. Specifically, we address the weighted average sum rate maximization problem with quality of service (QoS) constraints. In particular, to facilitate fast resource scheduling, we focus on developing a very low complexity algorithm. To this end, by leveraging Lagrangian duality and the stochastic optimization theory, we first develop an opportunistic MC NOMA scheduling algorithm whereby the original problem is decomposed into a series of subproblems, one for each time slot. Accordingly, resource scheduling works in an online manner by solving one subproblem per time slot, making it more applicable to practical systems. Then, we further develop a heuristic joint subchannel assignment and power allocation (Joint SAPA) algorithm with very low computational complexity, called Joint SAPA LCC, that solves each subproblem. Finally, through simulation, we show that our Joint SAPA LCC algorithm provides good performance comparable to the existing Joint SAPA algorithms despite requiring much lower computational complexity. We also demonstrate that our opportunistic MC NOMA scheduling algorithm in which the Joint SAPA LCC algorithm is embedded works well while satisfying given QoS requirements.


Projection based model reduction of dynamical systems using space time subspace and machine learning. This paper considers the creation of parametric surrogate models for applications in science and engineering where the goal is to predict high dimensional spatiotemporal output quantities of interest, such as pressure, temperature and displacement fields. The proposed methodology develops a low dimensional parametrization of these quantities of interest using space time bases combining with machine learning methods. In particular, the space time solutions are sought in a low dimensional space time linear trial subspace that can be obtained by computing tensor decompositions of usual state snapshots data. The mapping between the input parameters and the basis expansion coefficients (or generalized coordinates) is approximated using four different machine learning techniques multivariate polynomial regression, k nearest neighbors, random forest and neural network. The relative costs and effectiveness of the four machine learning techniques are explored through three engineering problems steady heat conduction, unsteady heat conduction and unsteady advective diffusive reactive system. Numerical results demonstrate that the proposed method performs well in terms of both accuracy and computational cost, and highlight the important point that the amount of model training data available in an engineering setting is often much less than it is in other machine learning applications, making it essential to incorporate knowledge from physical models. In addition, simpler machine learning techniques are seen to perform better than more elaborate ones.


Precise Aerial Image Matching based on Deep Homography Estimation. Aerial image registration or matching is a geometric process of aligning two aerial images captured in different environments. Estimating the precise transformation parameters is hindered by various environments such as time, weather, and viewpoints. The characteristics of the aerial images are mainly composed of a straight line owing to building and road. Therefore, the straight lines are distorted when estimating homography parameters directly between two images. In this paper, we propose a deep homography alignment network to precisely match two aerial images by progressively estimating the various transformation parameters. The proposed network is possible to train the matching network with a higher degree of freedom by progressively analyzing the transformation parameters. The precision matching performances have been increased by applying homography transformation. In addition, we introduce a method that can effectively learn the difficult to learn homography estimation network. Since there is no published learning data for aerial image registration, in this paper, a pair of images to which random homography transformation is applied within a certain range is used for learning. Hence, we could confirm that the deep homography alignment network shows high precision matching performance compared with conventional works.


Zeus Efficiently Localizing Actions in Videos using Reinforcement Learning. Detection and localization of actions in videos is an important problem in practice. A traffic analyst might be interested in studying the patterns in which vehicles move at a given intersection. State of the art video analytics systems are unable to efficiently and effectively answer such action queries. The reasons are threefold. First, action detection and localization tasks require computationally expensive deep neural networks. Second, actions are often rare events. Third, actions are spread across a sequence of frames. It is important to take the entire sequence of frames into context for effectively answering the query. It is critical to quickly skim through the irrelevant parts of the video to answer the action query efficiently. In this paper, we present Zeus, a video analytics system tailored for answering action queries. We propose a novel technique for efficiently answering these queries using a deep reinforcement learning agent. Zeus trains an agent that learns to adaptively modify the input video segments to an action classification network. The agent alters the input segments along three dimensions sampling rate, segment length, and resolution. Besides efficiency, Zeus is capable of answering the query at a user specified target accuracy using a query optimizer that trains the agent based on an accuracy aware reward function. Our evaluation of Zeus on a novel action localization dataset shows that it outperforms the state of the art frame and window based techniques by up to 1.4x and 3x, respectively. Furthermore, unlike the frame based technique, it satisfies the user specified target accuracy across all the queries, at up to 2x higher accuracy, than frame based methods.


Structure Aware Hierarchical Graph Pooling using Information Bottleneck. Graph pooling is an essential ingredient of Graph Neural Networks (GNNs) in graph classification and regression tasks. For these tasks, different pooling strategies have been proposed to generate a graph level representation by downsampling and summarizing nodes' features in a graph. However, most existing pooling methods are unable to capture distinguishable structural information effectively. Besides, they are prone to adversarial attacks. In this work, we propose a novel pooling method named as HIBPool where we leverage the Information Bottleneck (IB) principle that optimally balances the expressiveness and robustness of a model to learn representations of input data. Furthermore, we introduce a novel structure aware Discriminative Pooling Readout ( DiP Readout ) function to capture the informative local subgraph structures in the graph. Finally, our experimental results show that our model significantly outperforms other state of art methods on several graph classification benchmarks and more resilient to feature perturbation attack than existing pooling methods.


An Introduction To Regret Minimization In Algorithmic Trading A Survey of Universal Portfolio Techniques. In financial investing, universal portfolios are a means of constructing portfolios which guarantee a certain level of performance relative to a baseline, while making no statistical assumptions about the future market data. They fall under the broad category of regret minimization algorithms. This document covers an introduction and survey to universal portfolio techniques, covering some of the basic concepts and proofs in the area. Topics include Constant Rebalanced Portfolios, Cover's Algorithm, Incorporating Transaction Costs, Efficient Computation of Portfolios, Including Side Information, and Follow The Leader Algorithm.


Dataset Large scale Urban IoT Activity Data for DDoS Attack Emulation. As IoT deployments grow in scale for applications such as smart cities, they face increasing cyber security threats. In particular, as evidenced by the famous Mirai incident and other ongoing threats, large scale IoT device networks are particularly susceptible to being hijacked and used as botnets to launch distributed denial of service (DDoS) attacks. Real large scale datasets are needed to train and evaluate the use of machine learning algorithms such as deep neural networks to detect and defend against such DDoS attacks. We present a dataset from an urban IoT deployment of 4060 nodes describing their spatio temporal activity under benign conditions. We also provide a synthetic DDoS attack generator that injects attack activity into the dataset based on tunable parameters such as number of nodes attacked and duration of attack. We discuss some of the features of the dataset. We also demonstrate the utility of the dataset as well as our synthetic DDoS attack generator by using them for the training and evaluation of a simple multi label feed forward neural network that aims to identify which nodes are under attack and when.


Consistency Regularization for Adversarial Robustness. Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly during AT, has been problematic, not only making practitioners consider a bag of tricks for a successful training, e.g., early stopping, but also incurring a significant generalization gap in the robustness. In this paper, we propose an effective regularization technique that prevents robust overfitting by optimizing an auxiliary consistency' regularization loss during AT. Specifically, we discover that data augmentation is a quite effective tool to mitigate the overfitting in AT, and develop a regularization that forces the predictive distributions after attacking from two different augmentations of the same instance to be similar with each other. Our experimental results demonstrate that such a simple regularization technique brings significant improvements in the test robust accuracy of a wide range of AT methods. More remarkably, we also show that our method could significantly help the model to generalize its robustness against unseen adversaries, e.g., other types or larger perturbations compared to those used during training. Code is available at https github.com alinlab consistency adversarial.


Mertens' Third Theorem for Number Fields A New Proof, Cram 'er's Inequality, Oscillations, and Bias. The first result of our article is another proof of Mertens' third theorem in the generalised setting of number fields, which generalises a method of Hardy. Diamond and Pintz showed that the error term in the classic Mertens' third theorem changes sign infinitely often, so the second result of our article generalises Diamond and Pintz's result for number fields. That is, subject to some conditions, we show that the error term in Mertens' third theorem for number fields changes sign infinitely often. To prove this result, we also needed to prove Cram 'er's inequality for number fields, which is interesting in its own right. Lamzouri built upon Diamond and Pintz's work to prove the existence of the logarithmic density of the set of x such that the error term in Mertens' third theorem is positive, so the third result of our article generalises Lamzouri's results for number fields.


Characteristic measures for language stable subshifts. We consider the problem of when a symbolic dynamical system supports a Borel probability measure that is invariant under every element of its automorphism group. It follows readily from a classical result of Parry that the full shift on finitely many symbols, and more generally any mixing subshift of finite type, supports such a measure. Frisch and Tamuz recently dubbed such measures characteristic, and further showed that every zero entropy subshift has a characteristic measure. While it remains open if every subshift over a finite alphabet has a characteristic measure, we define a new class of shifts, which we call language stable subshifts, and show that these shifts have characteristic measures. This is a large class that is generic in several senses and contains numerous positive entropy examples.


Georacle Enabling Geospatially Aware Smart Contracts. Smart contracts have enabled a paradigm shift in computing by leveraging decentralized networks of trust to achieve consensus at scale. Oracle networks further extend the power of smart contracts by solving the so called "oracle problem". Such networks enable smart contracts to make use of the vast amount pre existing data available on the web today without jeopardizing the integrity of the underlying network of trust. By leveraging oracle networks, smart contracts can make decisions based on data corresponding to the physical world. To this end, we introduce Georacle an oracle service that enables geospatially aware smart contracts in a way that respects the space constrained nature of blockchain environments. Contracts can query the location of objects in a given area, map between street addresses and coordinates, and retrieve the geometry of a desired region of space while conserving gas consumption and avoiding unnecessary data processing.


Compactness and stable regularity in multiscale homogenization. In this paper we develop some new techniques to study the multiscale elliptic equations in the form of text div big(A varepsilon nabla u varepsilon big) 0 , where A varepsilon(x) A(x, x varepsilon 1, cdots, x varepsilon n) is an n scale oscillating periodic coefficient matrix, and ( varepsilon i) 1 le i le n are scale parameters. We show that the C alpha H " o lder continuity with any alpha in (0,1) for the weak solutions is stable, namely, the constant in the estimate is uniform for arbitrary ( varepsilon 1, varepsilon 2, cdots, varepsilon n) in (0,1 n and particularly is independent of the ratios between varepsilon i 's. The proof uses an upgraded method of compactness, involving a scale reduction theorem by H convergence. The Lipschitz estimate for arbitrary ( varepsilon i) 1 le i le n still remains open. However, for special laminate structures, i.e., A varepsilon(x) A(x,x 1 varepsilon 1, cdots, x d varepsilon n) , we show that the Lipschitz estimate is stable for arbitrary ( varepsilon 1, varepsilon 2, cdots, varepsilon n) in (0,1 n . This is proved by a technique of reperiodization.


The ideal intersection property for essential groupoid C algebras. We characterise, in several complementary ways, 'etale groupoids with locally compact Hausdorff space of units whose essential groupoid C algebra has the ideal intersection property, assuming that the groupoid is either Hausdorff or sigma compact. This leads directly to a characterisation of the simplicity of this C algebra which, for Hausdorff groupoids, agrees with the reduced groupoid C algebra. Specifically, we prove that the ideal intersection property is equivalent to the absence of essentially confined amenable sections of isotropy groups. For groupoids with compact space of units we moreover show that this is equivalent to the uniqueness of equivariant pseudo expectations. A key technical idea underlying our results is a new notion of groupoid action on C algebras including the essential groupoid C algebra itself. For minimal groupoids, we further obtain a relative version of Powers averaging property. Examples arise from suitable group representations into simple groupoid C algebras. This is illustrated by the example of the quasi regular representation of Thompson's group mathrm T with respect to Thompson's group mathrm F , which satisfies the relative Powers averaging property in the Cuntz algebra mathcal O 2 .


A Framework for eVTOL Performance Evaluation in Urban Air Mobility Realm. In this paper, we developed a generalized simulation framework for the evaluation of electric vertical takeoff and landing vehicles (eVTOLs) in the context of Unmanned Aircraft Systems (UAS) Traffic Management (UTM) and under the concept of Urban Air Mobility (UAM). Unlike most existing studies, the proposed framework combines the utilization of UTM and eVTOLs to develop a realistic UAM testing platform. For this purpose, we first enhanced an existing UTM simulator to simulate the real world UAM environment. Then, instead of using a simplified eVOTL model, a realistic eVTOL design tool, namely SUAVE, is employed and an dilation sub module is introduced to bridge the gap between the UTM simulator and SUAVE eVTOL performance evaluation tool to elaborate the complete mission profile. Based on the developed simulation framework, experiments are conducted and the results are presented to analyze the performance of eVTOLs in the UAM environment.


Carnegie Mellon Team Tartan Mission level Robustness with Rapidly Deployed Autonomous Aerial Vehicles in the MBZIRC 2020. For robotics systems to be used in high risk, real world situations, they have to be quickly deployable and robust to environmental changes, under performing hardware, and mission subtask failures. Robots are often designed to consider a single sequence of mission events, with complex algorithms lowering individual subtask failure rates under some critical constraints. Our approach is to leverage common techniques in vision and control and encode robustness into mission structure through outcome monitoring and recovery strategies, aided by a system infrastructure that allows for quick mission deployments under tight time constraints and no central communication. We also detail lessons in rapid field robotics development and testing. Systems were developed and evaluated through real robot experiments at an outdoor test site in Pittsburgh, Pennsylvania, USA, as well as in the 2020 Mohamed Bin Zayed International Robotics Challenge. All competition trials were completed in fully autonomous mode without RTK GPS. Our system led to 4th place in Challenge 2 and 7th place in the Grand Challenge, and achievements like popping five balloons (Challenge 1), successfully picking and placing a block (Challenge 2), and dispensing the most water autonomously with a UAV of all teams onto an outdoor, real fire (Challenge 3).


SAC GAN Structure Aware Image to Image Composition for Self Driving. We present a compositional approach to image augmentation for self driving applications. It is an end to end neural network that is trained to seamlessly compose an object (e.g., a vehicle or pedestrian) represented as a cropped patch from an object image, into a background scene image. As our approach emphasizes more on semantic and structural coherence of the composed images, rather than their pixel level RGB accuracies, we tailor the input and output of our network with structure aware features and design our network losses accordingly. Specifically, our network takes the semantic layout features from the input scene image, features encoded from the edges and silhouette in the input object patch, as well as a latent code as inputs, and generates a 2D spatial affine transform defining the translation and scaling of the object patch. The learned parameters are further fed into a differentiable spatial transformer network to transform the object patch into the target image, where our model is trained adversarially using an affine transform discriminator and a layout discriminator. We evaluate our network, coined SAC GAN for structure aware composition, on prominent self driving datasets in terms of quality, composability, and generalizability of the composite images. Comparisons are made to state of the art alternatives, confirming superiority of our method.


When Deep Learners Change Their Mind Learning Dynamics for Active Learning. Active learning aims to select samples to be annotated that yield the largest performance improvement for the learning algorithm. Many methods approach this problem by measuring the informativeness of samples and do this based on the certainty of the network predictions for samples. However, it is well known that neural networks are overly confident about their prediction and are therefore an untrustworthy source to assess sample informativeness. In this paper, we propose a new informativeness based active learning method. Our measure is derived from the learning dynamics of a neural network. More precisely we track the label assignment of the unlabeled data pool during the training of the algorithm. We capture the learning dynamics with a metric called label dispersion, which is low when the network consistently assigns the same label to the sample during the training of the network and high when the assigned label changes frequently. We show that label dispersion is a promising predictor of the uncertainty of the network, and show on two benchmark datasets that an active learning algorithm based on label dispersion obtains excellent results.


Real Time Feedback Driven Single Particle Tracking A Survey and Perspective. Real time feedback driven single particle tracking (RT FD SPT) is a class of techniques in the field of single particle tracking that uses feedback control to keep a particle of interest in a detection volume. These methods provide high spatiotemporal resolution on particle dynamics and allow for concurrent spectroscopic measurements. This review article begins with a survey of existing techniques and of applications where RT FD SPT has played an important role. We then systematically discuss each of the core components of RT FD SPT in order to develop an understanding of the trade offs that must be made in algorithm design and to create a clear picture of the important differences, advantages, and drawbacks of existing approaches. These components are feedback tracking and control, ranging from simple proportional integral derivative control to advanced nonlinear techniques, estimation to determine particle location from the measured data, including both online and offline algorithms, and techniques for calibrating and characterizing different RT FD SPT methods. We then introduce a collection of metrics for RT FD SPT to help guide experimentalists in selecting a method for their particular application and to help reveal where there are gaps in the techniques that represent opportunities for further development. Finally, we conclude with a discussion on future perspectives in the field.


Deep Learning to Ternary Hash Codes by Continuation. Recently, it has been observed that 0,1, 1 ternary codes which are simply generated from deep features by hard thresholding, tend to outperform 1,1 binary codes in image retrieval. To obtain better ternary codes, we for the first time propose to jointly learn the features with the codes by appending a smoothed function to the networks. During training, the function could evolve into a non smoothed ternary function by a continuation method. The method circumvents the difficulty of directly training discrete functions and reduces the quantization errors of ternary codes. Experiments show that the generated codes indeed could achieve higher retrieval accuracy.


LazyFormer Self Attention with Lazy Update. Improving the efficiency of Transformer based language pre training is an important task in NLP, especially for the self attention module, which is computationally expensive. In this paper, we propose a simple but effective solution, called emph LazyFormer , which computes the self attention distribution infrequently. LazyFormer composes of multiple lazy blocks, each of which contains multiple Transformer layers. In each lazy block, the self attention distribution is only computed once in the first layer and then is reused in all upper layers. In this way, the cost of computation could be largely saved. We also provide several training tricks for LazyFormer. Extensive experiments demonstrate the effectiveness of the proposed method.


Optimizing Hospital Room Layout to Reduce the Risk of Patient Falls. Despite years of research into patient falls in hospital rooms, falls and related injuries remain a serious concern to patient safety. In this work, we formulate a gradient free constrained optimization problem to generate and reconfigure the hospital room interior layout to minimize the risk of falls. We define a cost function built on a hospital room fall model that takes into account the supportive or hazardous effect of the patient's surrounding objects, as well as simulated patient trajectories inside the room. We define a constraint set that ensures the functionality of the generated room layouts in addition to conforming to architectural guidelines. We solve this problem efficiently using a variant of simulated annealing. We present results for two real world hospital room types and demonstrate a significant improvement of 18 on average in patient fall risk when compared with a traditional hospital room layout and 41 when compared with randomly generated layouts.


Label free optical transmission tomography for biosystems Intracellular structures and dynamics. There is an increasing need for label free methods that could reveal intracellular structures and dynamics. In this context, we develop a new optical tomography method working in transmission Full field optical transmission tomography (FF OTT). The method can measure the forward scattering signals and reveal the metabolic time dependent signals in living cells. FF OTT is a common path interferometer taking advantage of the Gouy phase shift a pi phase shift that the light wave experiences around the focus. By modulating position of the focus one can alter the phase of the scattered light. Demodulation of images with different phases rejects the background and enhances the light from the depth of focus, thus producing an optical section. We test FF OTT by imaging single cell diatoms and ex vivo biological samples. In fresh samples, we show that the intracellular motions create visible intensity fluctuations in FF OTT so that the method is able to reveal a metabolic dynamic contrast. FF OTT was found to be an efficient label free technique that can be readily implemented thanks to a robust common path speckle free interferometer design using an incoherent light source.


LTB curves with Lipschitz turn are par regular. Preserving the topology during a digitization process is a requirement of first importance. To this end, it is classical in Digital Geometry to assume the shape borders to be par regular. Par regularity was proved to be equivalent to having positive reach or to belong to the class C 1,1 of curves with Lipschitz derivative. Recently, we proposed to use a larger class that encompasses polygons with obtuse angles, the locally turn bounded curves. The aim of this technical report is to define the class of par regular curves inside the class of locally turn bounded curves using only the notion of turn, that is of integral curvature. To be more precise, in a previous article, we have already proved that par regular curves are locally turn bounded. Incidentally this proof lead us to show that the turn of par regular curves is a Lipschitz function of their length. We call the class of curves verifying this latter property the curves with Lipschitz turn. In this technical report, we prove the converse assertion locally turn bounded curves with Lipschitz turn are par regular. The equivalence is stated in Theorem 3.1 and the converse assertion is proved in Lemma 3.2. In section 1, we recall the definition of par regularity and equivalently of sets with positive reach. In section 2, we present the notions of curves locally turn bounded and of curves with Lipschitz turn. Throughout this latter section, some of intermediate steps (Lemmas 2.3 and 2.11) are proved just after the introduction of their related notions. The last section (section 3) is dedicated to the proof of the equivalence of the notions.


Coloring of two step graphs open packing partitioning of graphs. The two step graphs are revisited by studying their chromatic numbers in this paper. We observe that the problem of coloring of two step graphs is equivalent to the problem of vertex partitioning of graphs into open packing sets. With this remark in mind, it can be considered as the open version of the well known 2 distance coloring problem as well as the dual version of total domatic problem. The minimum k for which the two step graph mathcal N (G) of a graph G admits a proper coloring assigning k colors to the vertices is called the open packing partition number p o (G) of G , that is, p o (G) chi big ( mathcal N (G) big ) . We give some sharp lower and upper bounds on this parameter as well as its exact value when dealing with some families of graphs like trees. Relations between p o and some well know graph parameters have been investigated in this paper. We study this vertex partitioning in the Cartesian, direct and lexicographic products of graphs. In particular, we give an exact formula in the case of lexicographic product of any two graphs. The NP hardness of the problem of computing this parameter is derived from the mentioned formula. Graphs G for which p o (G) equals the clique number of mathcal N (G) are also investigated.


The MGT Fourier model in the supercritical case. We address the energy transfer in the differential system begin cases u ttt alpha u tt beta Delta u t gamma Delta u eta Delta theta theta t kappa Delta theta eta Delta u tt alpha eta Delta u t end cases made by a Moore Gibson Thompson equation in the supercritical regime, hence antidissipative, coupled with the classical heat equation. The asymptotic properties of the related solution semigroup depend on the strength of the coupling, ruling the competition between the Fourier damping and the MGT antidamping. Exponential stability will be shown always to occur, provided that the coupling constant is sufficiently large with respect to the other structural parameters. A fact of general interest will be also discussed, namely, the impossibility of attaining the optimal exponential decay rate of a given dissipative system via energy estimates.


Iterative Empirical Game Solving via Single Policy Best Response. Policy Space Response Oracles (PSRO) is a general algorithmic framework for learning policies in multiagent systems by interleaving empirical game analysis with deep reinforcement learning (Deep RL). At each iteration, Deep RL is invoked to train a best response to a mixture of opponent policies. The repeated application of Deep RL poses an expensive computational burden as we look to apply this algorithm to more complex domains. We introduce two variations of PSRO designed to reduce the amount of simulation required during Deep RL training. Both algorithms modify how PSRO adds new policies to the empirical game, based on learned responses to a single opponent policy. The first, Mixed Oracles, transfers knowledge from previous iterations of Deep RL, requiring training only against the opponent's newest policy. The second, Mixed Opponents, constructs a pure strategy opponent by mixing existing strategy's action value estimates, instead of their policies. Learning against a single policy mitigates variance in state outcomes that is induced by an unobserved distribution of opponents. We empirically demonstrate that these algorithms substantially reduce the amount of simulation during training required by PSRO, while producing equivalent or better solutions to the game.


Generating GPU Compiler Heuristics using Reinforcement Learning. GPU compilers are complex software programs with many optimizations specific to target hardware. These optimizations are often controlled by heuristics hand designed by compiler experts using time and resource intensive processes. In this paper, we developed a GPU compiler autotuning framework that uses off policy deep reinforcement learning to generate heuristics that improve the frame rates of graphics applications. Furthermore, we demonstrate the resilience of these learned heuristics to frequent compiler updates by analyzing their stability across a year of code check ins without retraining. We show that our machine learning based compiler autotuning framework matches or surpasses the frame rates for 98 of graphics benchmarks with an average uplift of 1.6 up to 15.8 .


An Evaluation Dataset and Strategy for Building Robust Multi turn Response Selection Model. Multi turn response selection models have recently shown comparable performance to humans in several benchmark datasets. However, in the real environment, these models often have weaknesses, such as making incorrect predictions based heavily on superficial patterns without a comprehensive understanding of the context. For example, these models often give a high score to the wrong response candidate containing several keywords related to the context but using the inconsistent tense. In this study, we analyze the weaknesses of the open domain Korean Multi turn response selection models and publish an adversarial dataset to evaluate these weaknesses. We also suggest a strategy to build a robust model in this adversarial environment.


On the Computational Efficiency of Catalyst Accelerated Coordinate Descent. This article is devoted to one particular case of using universal accelerated proximal envelopes to obtain computationally efficient accelerated versions of methods used to solve various optimization problem setups. We propose a proximally accelerated coordinate descent method that achieves the efficient algorithmic complexity of iteration and allows taking advantage of the data sparseness. It was considered an example of applying the proposed approach to optimizing a SoftMax like function, for which the described method allowing weaken the dependence of the computational complexity on the dimension n in mathcal O ( sqrt n ) times and, in practice, demonstrates a faster convergence in comparison with standard methods. As an example of applying the proposed approach, it was shown a variant of obtaining on its basis some efficient methods for optimizing Markov Decision Processes (MDP) in a minimax formulation with a Nesterov smoothed target functional.


Twelve Ways To Fool The Masses When Giving Parallel In Time Results. Getting good speedup let alone high parallel efficiency for parallel in time (PinT) integration examples can be frustratingly difficult. The high complexity and large number of parameters in PinT methods can easily (and unintentionally) lead to numerical experiments that overestimate the algorithm's performance. In the tradition of Bailey's article "Twelve ways to fool the masses when giving performance results on parallel computers", we discuss and demonstrate pitfalls to avoid when evaluating performance of PinT methods. Despite being written in a light hearted tone, this paper is intended to raise awareness that there are many ways to unintentionally fool yourself and others and that by avoiding these fallacies more meaningful PinT performance results can be obtained.


Polished diamond x ray lenses. We present high quality bi concave 2D focusing diamond x ray lenses of apex radius R 100 mu m produced via laser ablation and improved via a mechanical polishing process. Both for polished and unpolished individual lenses and for stacks of 10 lenses, we show the remaining figure errors determined using x ray speckle tracking and compare these results to those of commercial R 50 mu m beryllium lenses that have similar focusing strength and physical aperture. For two stacks of 10 diamond lenses (polished and unpolished) and a stack of 11 beryllium lenses, we present measured 2D beam profiles out of focus and wire scans to obtain the beam size in the focal plane. These results are complemented with small angle x ray scattering (SAXS) measurements of a polished and an unpolished diamond lens. Again, we compare this to the SAXS of a beryllium lens. The polished x ray lenses show similar figure errors to commercially available Be lenses. While the beam size in the focal plane is comparable with that of the Be lenses, the SAXS signal of the polished diamond lenses is considerably lower.


A note on Reidemeister Torsion of G Anosov Representations. This article considers G Anosov representations of a fixed closed oriented Riemann surface Sigma of genus at least 2 . Here, G is the Lie group text PSp (2n, mathbb R ), text PSO (n,n) or text PSO (n,n 1) . It proves that Reidemeister torsion (R torsion) associated to Sigma with coefficients in the adjoint bundle representations of such representations is well defined. Moreover, by using symplectic chain complex method, it establishes a novel formula for R torsion of such representations in terms of the Atiyah Bott Goldman symplectic form corresponding to the Lie group G . Furtermore, it applies the results to Hitchin components, in particular, Teichm " u ller space.


Low Congestion Shortcuts in Constant Diameter Graphs. Low congestion shortcuts, introduced by Ghaffari and Haeupler (SODA 2016), provide a unified framework for global optimization problems in the congest model of distributed computing. Roughly speaking, for a given graph G and a collection of vertex disjoint connected subsets S 1, ldots, S ell subseteq V(G) , (c,d) low congestion shortcuts augment each subgraph G S i with a subgraph H i subseteq G such that (i) each edge appears on at most c subgraphs (congestion bound), and (ii) the diameter of each subgraph G S i cup H i is bounded by d (dilation bound). It is desirable to compute shortcuts of small congestion and dilation as these quantities capture the round complexity of many global optimization problems in the congest model. For n vertex graphs with constant diameter D O(1) , Elkin (STOC 2004) presented an (implicit) shortcuts lower bound with c d widetilde Omega (n (D 2) (2D 2) ) . A nearly matching upper bound, however, was only recently obtained for D in 3,4 by Kitamura et al. (DISC 2019). In this work, we resolve the long standing complexity gap of shortcuts in constant diameter graphs, originally posed by Lotker et al. (PODC 2001). We present new shortcut constructions which match, up to poly logarithmic terms, the lower bounds of Das Sarma et al. As a result, we provide improved and existentially optimal algorithms for several network optimization tasks in constant diameter graphs, including MST, (1 epsilon) approximate minimum cuts and more.


Learning to Elect. Voting systems have a wide range of applications including recommender systems, web search, product design and elections. Limited by the lack of general purpose analytical tools, it is difficult to hand engineer desirable voting rules for each use case. For this reason, it is appealing to automatically discover voting rules geared towards each scenario. In this paper, we show that set input neural network architectures such as Set Transformers, fully connected graph networks and DeepSets are both theoretically and empirically well suited for learning voting rules. In particular, we show that these network models can not only mimic a number of existing voting rules to compelling accuracy both position based (such as Plurality and Borda) and comparison based (such as Kemeny, Copeland and Maximin) but also discover near optimal voting rules that maximize different social welfare functions. Furthermore, the learned voting rules generalize well to different voter utility distributions and election sizes unseen during training.


Solving the Workflow Satisfiability Problem using General Purpose Solvers. The workflow satisfiability problem (WSP) is a well studied problem in access control seeking allocation of authorised users to every step of the workflow, subject to workflow specification constraints. It was noticed that the number k of steps is typically small compared to the number of users in the real world instances of WSP therefore k is considered as the parameter in WSP parametrised complexity research. While WSP in general was shown to be W 1 hard, WSP restricted to a special case of user independent (UI) constraints is fixed parameter tractable (FPT). However, restriction to the UI constraints might be impractical. To efficiently handle non UI constraints, we introduce the notion of branching factor of a constraint. As long as the branching factors of the constraints are relatively small and the number of non UI constraints is reasonable, WSP can be solved in FPT time. Extending the results from Karapetyan et al. (2019), we demonstrate that general purpose solvers are capable of achieving FPT like performance on WSP with arbitrary constraints when used with appropriate formulations. This enables one to tackle most of practical WSP instances. While important on its own, we hope that this result will also motivate researchers to look for FPT aware formulations of other FPT problems.


Word Graph Guided Summarization for Radiology Findings. Radiology reports play a critical role in communicating medical findings to physicians. In each report, the impression section summarizes essential radiology findings. In clinical practice, writing impression is highly demanded yet time consuming and prone to errors for radiologists. Therefore, automatic impression generation has emerged as an attractive research direction to facilitate such clinical practice. Existing studies mainly focused on introducing salient word information to the general text summarization framework to guide the selection of the key content in radiology findings. However, for this task, a model needs not only capture the important words in findings but also accurately describe their relations so as to generate high quality impressions. In this paper, we propose a novel method for automatic impression generation, where a word graph is constructed from the findings to record the critical words and their relations, then a Word Graph guided Summarization model (WGSum) is designed to generate impressions with the help of the word graph. Experimental results on two datasets, OpenI and MIMIC CXR, confirm the validity and effectiveness of our proposed approach, where the state of the art results are achieved on both datasets. Further experiments are also conducted to analyze the impact of different graph designs to the performance of our method.


Hemodynamic Deconvolution Demystified Sparsity Driven Regularization at Work. Deconvolution of the hemodynamic response is an important step to access short timescales of brain activity recorded by functional magnetic resonance imaging (fMRI). Albeit conventional deconvolution algorithms have been around for a long time (e.g., Wiener deconvolution), recent state of the art methods based on sparsity pursuing regularization are attracting increasing interest to investigate brain dynamics and connectivity with fMRI. This technical note revisits the main concepts underlying two main methods, Paradigm Free Mapping and Total Activation, in the most accessible way. Despite their apparent differences in the formulation, these methods are theoretically equivalent as they represent the synthesis and analysis sides of the same problem, respectively. We demonstrate this equivalence in practice with their best available implementations using both simulations, with different signal to noise ratios, and experimental fMRI data acquired during a motor task and resting state. We evaluate the parameter settings that lead to equivalent results, and showcase the potential of these algorithms compared to other common approaches. This note is useful for practitioners interested in gaining a better understanding of state of the art hemodynamic deconvolution, and aims to answer questions that practitioners often have regarding the differences between the two methods.


Relation aware Instance Refinement for Weakly Supervised Visual Grounding. Visual grounding, which aims to build a correspondence between visual objects and their language entities, plays a key role in cross modal scene understanding. One promising and scalable strategy for learning visual grounding is to utilize weak supervision from only image caption pairs. Previous methods typically rely on matching query phrases directly to a precomputed, fixed object candidate pool, which leads to inaccurate localization and ambiguous matching due to lack of semantic relation constraints. In our paper, we propose a novel context aware weakly supervised learning method that incorporates coarse to fine object refinement and entity relation modeling into a two stage deep network, capable of producing more accurate object representation and matching. To effectively train our network, we introduce a self taught regression loss for the proposal locations and a classification loss based on parsed entity relations. Extensive experiments on two public benchmarks Flickr30K Entities and ReferItGame demonstrate the efficacy of our weakly grounding framework. The results show that we outperform the previous methods by a considerable margin, achieving 59.27 top 1 accuracy in Flickr30K Entities and 37.68 in the ReferItGame dataset respectively (Code is available at https github.com youngfly11 ReIR WeaklyGrounding.pytorch.git).


Some sufficient conditions for pi nilpotence of finite groups. Let G be a group, and H a nilpotent non normal subgroup of G such that the normalizer of any non trivial normal subgroup of frac H C is equal to frac H C where C is the core of H in G . We show that if frac H C is not a 2 group, then frac G C is a Frobenius group with complement frac H C .


Self Attention Meta Learner for Continual Learning. Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non optimal ability to learn in non stationary distributions. In most settings of the current approaches, the agent starts from randomly initialized parameters and is optimized to master the current task regardless of the usefulness of the learned representation for future tasks. Moreover, each of the future tasks uses all the previously learned knowledge although parts of this knowledge might not be helpful for its learning. These cause interference among tasks, especially when the data of previous tasks is not accessible. In this paper, we propose a new method, named Self Attention Meta Learner (SAM), which learns a prior knowledge for continual learning that permits learning a sequence of tasks, while avoiding catastrophic forgetting. SAM incorporates an attention mechanism that learns to select the particular relevant representation for each future task. Each task builds a specific representation branch on top of the selected knowledge, avoiding the interference between tasks. We evaluate the proposed method on the Split CIFAR 10 100 and Split MNIST benchmarks in the task agnostic inference. We empirically show that we can achieve a better performance than several state of the art methods for continual learning by building on the top of selected representation learned by SAM. We also show the role of the meta attention mechanism in boosting informative features corresponding to the input data and identifying the correct target in the task agnostic inference. Finally, we demonstrate that popular existing continual learning methods gain a performance boost when they adopt SAM as a starting point.


A Review of Explainable Artificial Intelligence in Manufacturing. The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement learning techniques. Despite the high accuracy of these models, they are mostly considered black boxes they are unintelligible to the human. Opaqueness affects trust in the system, a factor that is critical in the context of decision making. We present an overview of Explainable Artificial Intelligence (XAI) techniques as a means of boosting the transparency of models. We analyze different metrics to evaluate these techniques and describe several application scenarios in the manufacturing domain.


Avoiding Monochromatic Solutions to 3 term Equations. Given an equation, the integers n 1, 2, dots, n as inputs, and the colors red and blue, how can we color n in order to minimize the number of monochromatic solutions to the equation, and what is the minimum? The answer is only known for a handful of equations, but much progress has been made on improving upper and lower bounds on minima for various equations. A well studied characteristic an equation, which has its roots in graph Ramsey theory, is to determine if the minimum number of monochromatic solutions can be achieved (asymptotically) by uniformly random colorings. Such equations are called common. We prove that no 3 term equations are common and provide a lower bound for a specific class of 3 term equations.


Image Inpainting with Edge guided Learnable Bidirectional Attention Maps. For image inpainting, the convolutional neural networks (CNN) in previous methods often adopt standard convolutional operator, which treats valid pixels and holes indistinguishably. As a result, they are limited in handling irregular holes and tend to produce color discrepant and blurry inpainting result. Partial convolution (PConv) copes with this issue by conducting masked convolution and feature re normalization conditioned only on valid pixels, but the mask updating is handcrafted and independent with image structural information. In this paper, we present an edge guided learnable bidirectional attention map (Edge LBAM) for improving image inpainting of irregular holes with several distinct merits. Instead of using a hard 0 1 mask, a learnable attention map module is introduced for learning feature re normalization and mask updating in an end to end manner. Learnable reverse attention maps are further proposed in the decoder for emphasizing on filling in unknown pixels instead of reconstructing all pixels. Motivated by that the filling in order is crucial to inpainting results and largely depends on image structures in exemplar based methods, we further suggest a multi scale edge completion network to predict coherent edges. Our Edge LBAM method contains dual procedures,including structure aware mask updating guided by predict edges and attention maps generated by masks for feature re normalization.Extensive experiments show that our Edge LBAM is effective in generating coherent image structures and preventing color discrepancy and blurriness, and performs favorably against the state of the art methods in terms of qualitative metrics and visual quality.


Nonlinear versions of Korovkin's abstract theorems. In this paper we prove Korovkin type theorems for sequences of sublinear, monotone and weak additive operators acting on function spaces C(X) where X is a compact or a locally compact metric space. Our results are illustrated by a series of examples


Fast and Informative Model Selection using Learning Curve Cross Validation. Common cross validation (CV) methods like k fold cross validation or Monte Carlo cross validation estimate the predictive performance of a learner by repeatedly training it on a large portion of the given data and testing on the remaining data. These techniques have two major drawbacks. First, they can be unnecessarily slow on large datasets. Second, beyond an estimation of the final performance, they give almost no insights into the learning process of the validated algorithm. In this paper, we present a new approach for validation based on learning curves (LCCV). Instead of creating train test splits with a large portion of training data, LCCV iteratively increases the number of instances used for training. In the context of model selection, it discards models that are very unlikely to become competitive. We run a large scale experiment on the 67 datasets from the AutoML benchmark and empirically show that in over 90 of the cases using LCCV leads to similar performance (at most 1.5 difference) as using 5 10 fold CV. However, it yields substantial runtime reductions of over 20 on average. Additionally, it provides important insights, which for example allow assessing the benefits of acquiring more data. These results are orthogonal to other advances in the field of AutoML.


Number of bounded distance equivalence classes in hulls of repetitive Delone sets. Two Delone sets are bounded distance equivalent to each other if there is a bijection between them such that the distance of corresponding points is uniformly bounded. Bounded distance equivalence is an equivalence relation. We show that the hull of a repetitive Delone set with finite local complexity has either one equivalence class or uncountably many. A very similar result is proven in arXiv 2011.00106 math.MG .


Deep Learning based Food Instance Segmentation using Synthetic Data. In the process of intelligently segmenting foods in images using deep neural networks for diet management, data collection and labeling for network training are very important but labor intensive tasks. In order to solve the difficulties of data collection and annotations, this paper proposes a food segmentation method applicable to real world through synthetic data. To perform food segmentation on healthcare robot systems, such as meal assistance robot arm, we generate synthetic data using the open source 3D graphics software Blender placing multiple objects on meal plate and train Mask R CNN for instance segmentation. Also, we build a data collection system and verify our segmentation model on real world food data. As a result, on our real world dataset, the model trained only synthetic data is available to segment food instances that are not trained with 52.2 mask AP all, and improve performance by 6.4 p after fine tuning comparing to the model trained from scratch. In addition, we also confirm the possibility and performance improvement on the public dataset for fair analysis. Our code and pre trained weights are avaliable online at https github.com gist ailab Food Instance Segmentation


IMENet Joint 3D Semantic Scene Completion and 2D Semantic Segmentation through Iterative Mutual Enhancement. 3D semantic scene completion and 2D semantic segmentation are two tightly correlated tasks that are both essential for indoor scene understanding, because they predict the same semantic classes, using positively correlated high level features. Current methods use 2D features extracted from early fused RGB D images for 2D segmentation to improve 3D scene completion. We argue that this sequential scheme does not ensure these two tasks fully benefit each other, and present an Iterative Mutual Enhancement Network (IMENet) to solve them jointly, which interactively refines the two tasks at the late prediction stage. Specifically, two refinement modules are developed under a unified framework for the two tasks. The first is a 2D Deformable Context Pyramid (DCP) module, which receives the projection from the current 3D predictions to refine the 2D predictions. In turn, a 3D Deformable Depth Attention (DDA) module is proposed to leverage the reprojected results from 2D predictions to update the coarse 3D predictions. This iterative fusion happens to the stable high level features of both tasks at a late stage. Extensive experiments on NYU and NYUCAD datasets verify the effectiveness of the proposed iterative late fusion scheme, and our approach outperforms the state of the art on both 3D semantic scene completion and 2D semantic segmentation.


Asymptotic completeness for a scalar quasilinear wave equation satisfying the weak null condition. In this paper, we prove the first asymptotic completeness result for a scalar quasilinear wave equation satisfying the weak null condition. The main tool we use in the study of this equation is the geometric reduced system introduced in arXiv 2002.05355. Starting from a global solution u to the quasilinear wave equation, we rigorously show that well chosen asymptotic variables solve the same reduced system with small error terms. This allows us to recover the scattering data for our system, as well as to construct a matching exact solution to the reduced system.


Sequential Reptile Inter Task Gradient Alignment for Multilingual Learning. Multilingual models jointly pretrained on multiple languages have achieved remarkable performance on various multilingual downstream tasks. Moreover, models finetuned on a single monolingual downstream task have shown to generalize to unseen languages. In this paper, we first show that it is crucial for those tasks to align gradients between them in order to maximize knowledge transfer while minimizing negative transfer. Despite its importance, the existing methods for gradient alignment either have a completely different purpose, ignore inter task alignment, or aim to solve continual learning problems in rather inefficient ways. As a result of the misaligned gradients between tasks, the model suffers from severe negative transfer in the form of catastrophic forgetting of the knowledge acquired from the pretraining. To overcome the limitations, we propose a simple yet effective method that can efficiently align gradients between tasks. Specifically, we perform each inner optimization by sequentially sampling batches from all the tasks, followed by a Reptile outer update. Thanks to the gradients aligned between tasks by our method, the model becomes less vulnerable to negative transfer and catastrophic forgetting. We extensively validate our method on various multi task learning and zero shot cross lingual transfer tasks, where our method largely outperforms all the relevant baselines we consider.


Relative de Rham Theory on Nash Manifolds. For a Nash submersion phi colon X to Y , we study the complex mathcal SDR ( phi) of Schwartz sections of the relative de Rham complex of phi . We define the notion of Schwartz sections of constructible sheaves on Nash manifolds and prove that mathcal SDR ( phi) is homotopy equivalent to the Schwartz sections of the proper push forward phi ! mathbb R X of the constant sheaf mathbb R X . Using this equivalence, we show that mathcal SDR ( phi) depends (up to homotopy equivalence) only on the homology type of the map phi . We also deduce that mathcal SDR ( phi) has Hausdorff homology spaces.


Double crystal measurements at the CERN SPS. The UA9 setup, installed in the Super Proton Synchrotron (SPS) at CERN, was exploited for a proof of principle of the double crystal scenario, proposed to measure the electric and the magnetic moments of short lived baryons in a high energy hadron collider, such as the Large Hadron Collider (LHC). Linear and angular actuators were used to position the crystals and establish the required beam configuration. Timepix detectors and high sensitivity Beam Loss Monitors were exploited to observe the deflected beams. Linear and angular scans allowed exploring the particle interactions with the two crystals and recording their efficiency. The measured values of the beam trajectories, profiles and of the channeling efficiency agree with the results of a Monte Carlo simulation.


MCDHF CI calculations for Hg and Cd with estimates for unknown clock transition frequencies. By use of the textsc grasp2018 package we perform Multiconfiguration Dirac Hartree Fock (MCDHF) calculations with configuration interaction (CI) for the 1 S 0 and 3 P 0,1 o levels in neutral cadmium and mercury. By supplying the resultant atomic state functions to the textsc ris4 program, we evaluate the mass and field shift parameters for the 1 S 0 , 3 P 0 o (clock) and 1 S 0 , 3 P 1 o (intercombination) lines. We make revised estimates of the nuclear charge parameters lambda A,A' and differences in mean square charge radii delta langle r 2 rangle A,A' for both elements and point out a discrepancy with tabulated data for Cd. In constructing a King plot with the Hg lines we examine the second order hyperfine interaction for the 3 P 0,1 o levels. Isotope shifts for the clock transition have been estimated from which we predict the unknown clock line frequencies in the bosonic Hg isotopes and all the naturally occurring isotopes of Cd.


Towards Offloadable and Migratable Microservices on Disaggregated Architectures Vision, Challenges, and Research Roadmap. Microservice and serverless computing systems open up massive versatility and opportunity to distributed and datacenter scale computing. In the meantime, the deployments of modern datacenter resources are moving to disaggregated architectures. With the flourishing growths from both sides, we believe this is high time to write this vision paper to propose a potential research agenda to achieve efficient deployments, management, and executions of next generation microservices on top of the emerging disaggregated datacenter architectures. In particular, we envision a critical systems research direction of designing and developing offloadable and migratable microservices on disaggregated architectures. With this vision, we have surveyed the recent related work to demonstrate the importance and necessity of researching it. We also outline the fundamental challenges that distributed systems and datacenter scale computing research may encounter. We further propose a research roadmap to achieve our envisioned objectives in a promising way. Within the roadmap, we identify potential techniques and methods that can be leveraged.


Hensel minimality II Mixed characteristic and a diophantine application. We extend the results about Hensel minimality to include also the mixed characteristic case. This completes our axiomatic framework for tame non archimedean geometry over Henselian valued fields of characteristic zero. We prove a Jacobian property, a strong form of Taylor approximations of definable functions, resplendency results and cell decomposition, all under 1 h minimality. We obtain a diophantine application of counting rational points of bounded height on Hensel minimal curves.


Fixed angle inverse scattering for sound speeds close to constant. We study the fixed angle inverse scattering problem of determining a sound speed from scattering measurements corresponding to a single incident wave. The main result shows that a sound speed close to constant can be stably determined by just one measurement. Our method is based on studying the linearized problem, which turns out to be related to the acoustic problem in photoacoustic imaging. We adapt the modified time reversal method from P. Stefanov and G. Uhlmann, Thermoacoustic tomography with variable sound speed, Inverse Problems 25 (2009), 075011 to solve the linearized problem in a stable way, and use this to give a local uniqueness result for the nonlinear inverse problem.


Deep learning with transfer functions new applications in system identification. This paper presents a linear dynamical operator described in terms of a rational transfer function, endowed with a well defined and efficient back propagation behavior for automatic derivatives computation. The operator enables end to end training of structured networks containing linear transfer functions and other differentiable units by exploiting standard deep learning software. Two relevant applications of the operator in system identification are presented. The first one consists in the integration of prediction error methods in deep learning. The dynamical operator is included as the last layer of a neural network in order to obtain the optimal one step ahead prediction error. The second one considers identification of general block oriented models from quantized data. These block oriented models are constructed by combining linear dynamical operators with static nonlinearities described as standard feed forward neural networks. A custom loss function corresponding to the log likelihood of quantized output observations is defined. For gradient based optimization, the derivatives of the log likelihood are computed by applying the back propagation algorithm through the whole network. Two system identification benchmarks are used to show the effectiveness of the proposed methodologies.


Aligning Hotel Embeddings using Domain Adaptation for Next Item Recommendation. In online platforms it is often the case to have multiple brands under the same group which may target different customer profiles, or have different domains. For example, in the hospitality domain, Expedia Group has multiple brands like Brand Expedia, Hotels.com and Wotif which have either different traveler profiles or are more relevant in a local context. In this context, learning embeddings for hotels that can be leveraged in recommendation tasks in multiple brands requires to have a common embedding that can be induced using alignment approaches. In the same time, one needs to ensure that this common embedding space does not degrade the performance in any of the brands. In this work we build upon the hotel2vec model and propose a simple regularization approach for aligning hotel embeddings of different brands via domain adaptation. We also explore alignment methods previously used in cross lingual embeddings to align spaces of different languages. We present results on the task of next hotel prediction using click sessions from two brands. The results show that the proposed approach can align the two embedding spaces while achieving good performance in both brands. Additionally, with respect to single brand training we show that the proposed approach can significantly reduce training time and improve the predictive performance.


F SIOL 310 A Robotic Dataset and Benchmark for Few Shot Incremental Object Learning. Deep learning has achieved remarkable success in object recognition tasks through the availability of large scale datasets like ImageNet. However, deep learning systems suffer from catastrophic forgetting when learning incrementally without replaying old data. For real world applications, robots also need to incrementally learn new objects. Further, since robots have limited human assistance available, they must learn from only a few examples. However, very few object recognition datasets and benchmarks exist to test incremental learning capability for robotic vision. Further, there is no dataset or benchmark specifically designed for incremental object learning from a few examples. To fill this gap, we present a new dataset termed F SIOL 310 (Few Shot Incremental Object Learning) which is specifically captured for testing few shot incremental object learning capability for robotic vision. We also provide benchmarks and evaluations of 8 incremental learning algorithms on F SIOL 310 for future comparisons. Our results demonstrate that the few shot incremental object learning problem for robotic vision is far from being solved.


Few Shot Domain Expansion for Face Anti Spoofing. Face anti spoofing (FAS) is an indispensable and widely used module in face recognition systems. Although high accuracy has been achieved, a FAS system will never be perfect due to the non stationary applied environments and the potential emergence of new types of presentation attacks in real world applications. In practice, given a handful of labeled samples from a new deployment scenario (target domain) and abundant labeled face images in the existing source domain, the FAS system is expected to perform well in the new scenario without sacrificing the performance on the original domain. To this end, we identify and address a more practical problem Few Shot Domain Expansion for Face Anti Spoofing (FSDE FAS). This problem is challenging since with insufficient target domain training samples, the model may suffer from both overfitting to the target domain and catastrophic forgetting of the source domain. To address the problem, this paper proposes a Style transfer based Augmentation for Semantic Alignment (SASA) framework. We propose to augment the target data by generating auxiliary samples based on photorealistic style transfer. With the assistant of the augmented data, we further propose a carefully designed mechanism to align different domains from both instance level and distribution level, and then stabilize the performance on the source domain with a less forgetting constraint. Two benchmarks are proposed to simulate the FSDE FAS scenarios, and the experimental results show that the proposed SASA method outperforms state of the art methods.


Universal Bounds for Fractional Laplacian on the Bounded Open Domain in mathbb R n . Let Omega be a bounded open domain on the Euclidean space mathbb R n and mathbb Q be the set of all positive rational numbers. In 2017, Chen and Zeng investigated the eigenvalues with higher order of the fractional Laplacian left.( Delta) s right Omega for s 0 and s in mathbb Q , and they obtained a universal inequality of Yang type( emph Universal inequality and upper bounds of eigenvalues for non integer poly Laplacian on a bounded domain, Calculus of Variations and Partial Differential Equations, (2017) textbf 56 131 ). In the spirit of Chen and Zeng's work, we study the eigenvalues of fractional Laplacian, and establish an inequality of eigenvalues with lower order under the same condition. Also, our eigenvalue inequality is universal and generalizes the eigenvalue inequality for the poly harmonic operators given by Jost et al.( emph Universal bounds for eigenvalues of polyharmonic operator. Trans. Amer. Math. Soc. bf 363 (4), 1821 1854 (2011) ).


Pseudoholomoprhic curves on the mathfrak LCS fication of contact manifolds. For each contact diffeomorphism phi (Q, xi) to (Q, xi) of (Q, xi) , we equip its mapping torus M phi with a emph locally conformal symplectic form of Banyaga's type, which we call the emph text rm lcs mapping torus of contact diffeomorphism phi . In the present paper, we consider the product Q times S 1 M id (corresponding to phi id ) and develop basic analysis of the associated J holomorphic curve equation, which has the form overline partial pi w 0, quad w lambda circ j f d theta for the map u (w,f) dot Sigma to Q times S 1 for the lambda compatible almost complex structure J and a punctured Riemann surface ( dot Sigma, j) . In particular, w is a emph contact instanton in the sense of OW2, OW3 . We develop a scheme of treating the non vanishing charge by introducing the notion of emph charge class in H 1( dot Sigma, mathbb Z) and develop the geometric framework for the study of pseudoholomorphic curves, a correct choice of energy and the definition of moduli spaces towards the construction of compactification of the moduli space on the mathfrak lcs fication of (Q, lambda) (more generally on arbitrary locally conformal symplectic manifolds).


Privacy Protecting Techniques for Behavioral Data A Survey. Our behavior (the way we talk, walk, or think) is unique and can be used as a biometric trait. It also correlates with sensitive attributes like emotions. Hence, techniques to protect individuals privacy against unwanted inferences are required. To consolidate knowledge in this area, we systematically reviewed applicable anonymization techniques. We taxonomize and compare existing solutions regarding privacy goals, conceptual operation, advantages, and limitations. Our analysis shows that some behavioral traits (e.g., voice) have received much attention, while others (e.g., eye gaze, brainwaves) are mostly neglected. We also find that the evaluation methodology of behavioral anonymization techniques can be further improved.


Taxonomy Completion via Triplet Matching Network. Automatically constructing taxonomy finds many applications in e commerce and web search. One critical challenge is as data and business scope grow in real applications, new concepts are emerging and needed to be added to the existing taxonomy. Previous approaches focus on the taxonomy expansion, i.e. finding an appropriate hypernym concept from the taxonomy for a new query concept. In this paper, we formulate a new task, "taxonomy completion", by discovering both the hypernym and hyponym concepts for a query. We propose Triplet Matching Network (TMN), to find the appropriate hypernym, hyponym pairs for a given query concept. TMN consists of one primal scorer and multiple auxiliary scorers. These auxiliary scorers capture various fine grained signals (e.g., query to hypernym or query to hyponym semantics), and the primal scorer makes a holistic prediction on query, hypernym, hyponym triplet based on the internal feature representations of all auxiliary scorers. Also, an innovative channel wise gating mechanism that retains task specific information in concept representations is introduced to further boost model performance. Experiments on four real world large scale datasets show that TMN achieves the best performance on both taxonomy completion task and the previous taxonomy expansion task, outperforming existing methods.


On the modification of the SPARUS II AUV for close range imaging survey platform. Based on the need for high resolution underwater visual surveys, this study presents the adaptation of an existing SPARUS II autonomous underwater vehicle (AUV) into an entirely hovering AUV fully capable of performing autonomous, close range imaging survey missions. This paper focuses on the enhancement of the AUVs maneuvering capability (enabling improved maneuvering control), implementation of an state of the art thruster allocation algorithm (allowing optimal thrusters allocation and thrusters redundancy), and the development of an upgraded path following controller to facilitate precise and delicate motions necessary for high resolution imaging missions. To facilitate the vehicles adaptation, a dynamic model is developed. The calibration process of the dynamic model coefficients initially obtained using well accepted formulas, by computational fluid dynamics and in real sea experiments is presented. The in house development of a pressure resistant imaging system is also presented. This system which includes a stereo camera and high power lightning strobes was developed and fitted as a dedicated AUV payload. Finally, the performance of the platform is demonstrated in an actual seabed visual survey mission.


Privacy preserving Travel Time Prediction with Uncertainty Using GPS Trace Data. The rapid growth of GPS technology and mobile devices has led to a massive accumulation of location data, bringing considerable benefits to individuals and society. One of the major usages of such data is travel time prediction, a typical service provided by GPS navigation devices and apps. Meanwhile, the constant collection and analysis of the individual location data also pose unprecedented privacy threats. We leverage the notion of geo indistinguishability, an extension of differential privacy to the location privacy setting, and propose a procedure for privacy preserving travel time prediction without collecting actual individual GPS trace data. We propose new concepts to examine the impact of geo indistinguishability based sanitization on the usefulness of GPS traces and provide analytical and experimental utility analysis for privacy preserving travel time prediction. We also propose new metrics to measure the adversary error in learning individual GPS traces from the collected sanitized data. Our experiment results suggest that the proposed procedure provides travel time prediction with satisfactory accuracy at reasonably small privacy costs.


Online Learning with Radial Basis Function Networks. We investigate the benefits of feature selection, nonlinear modelling and online learning when forecasting financial time series. We combine sequential updating with continual learning, specifically transfer learning. We perform feature representation transfer through clustering algorithms that determine the analytical structure of radial basis function networks we construct. These networks achieve lower mean square prediction errors than kernel ridge regression models, which arbitrarily use all training vectors as prototypes. We also demonstrate quantitative procedures to determine the very structure of the networks. Finally, we conduct experiments on the log returns of financial time series and show that these online transfer learning models outperform a random walk baseline. In contrast, the offline learning models struggle to do so.


Spoki Unveiling a New Wave of Scanners through a Reactive Network Telescope. Large scale Internet scans are a common method to identify victims of a specific attack. Stateless scanning like in ZMap has been established as an efficient approach to probing at Internet scale. Stateless scans, however, need a second phase to perform the attack, which remains invisible to network telescopes that only capture the first incoming packet and is not observed as a related event by honeypots. In this work, we examine Internet wide scan traffic through Spoki, a reactive network telescope operating in real time that we design and implement. Spoki responds to asynchronous TCP SYN packets and engages in TCP handshakes initiated in the second phase of two phase scans. Because it is extremely lightweight it scales to large prefixes where it has the unique opportunity to record the first data sequence submitted within the TCP handshake ACK. We analyze two phase scanners during a three months period using globally deployed Spoki reactive telescopes as well as flow data sets from IXPs and ISPs. We find that a predominant fraction of TCP SYNs on the Internet has irregular characteristics. Our findings also provide a clear signature of today's scans as (i) highly targeted, (ii) scanning activities notably vary between regional vantage points, and (iii) a significant share originates from malicious sources.


Time periodic weak solutions for an incompressible Newtonian fluid interacting with an elastic plate. Under the action of a time periodic external forces we prove the existence of at least one time periodic weak solution for the interaction between a three dimensional incompressible fluid, governed by the Navier Stokes equation and a two dimensional elastic plate. The challenge is that the Eulerian domain for the fluid changes in time and is a part of the solution. We introduce a two fixed point methodology First we construct a time periodic solutions for a given variable time periodic geometry. Then in a second step a (set valued) fixed point is performed w.r.t. the geometry of the domain. The existence relies on newly developed a priori estimates applicable for both coupled and uncoupled variable geometries. Due to the expected weak regularity of the solutions such Eulerian estimates are unavoidable. Note in particular, that only the fluid is assumed to be dissipative. But the here produced a priori estimates show that its possible to exploit the dissipative effects of the fluid also for the solid deformation. The existence of periodic solutions for a given geometry is valid for arbitrary large data. The existence of periodic coupled solutions to the fluid structure interaction is valid for all data that excludes a self intersection a priori.


MapVisual A Visualization Tool for Memory Access Patterns. Memory bandwidth is strongly correlated to the complexity of the memory access pattern of a running application. To improve memory performance of applications with irregular and or unpredictable memory patterns, we need tools to analyze these patterns during application development. In this work, we present a software tool for the analysis and visualization of memory access patterns. We perform memory tracing and profiling, we do data processing and filtering, and we use visualization algorithms to produce three dimensional graphs that describe the patterns both in space and in time. Finally, we evaluate our toolflow on a variety of applications.


Neural TMDlayer Modeling Instantaneous flow of features via SDE Generators. We study how stochastic differential equation (SDE) based ideas can inspire new modifications to existing algorithms for a set of problems in computer vision. Loosely speaking, our formulation is related to both explicit and implicit strategies for data augmentation and group equivariance, but is derived from new results in the SDE literature on estimating infinitesimal generators of a class of stochastic processes. If and when there is nominal agreement between the needs of an application task and the inherent properties and behavior of the types of processes that we can efficiently handle, we obtain a very simple and efficient plug in layer that can be incorporated within any existing network architecture, with minimal modification and only a few additional parameters. We show promising experiments on a number of vision tasks including few shot learning, point cloud transformers and deep variational segmentation obtaining efficiency or performance improvements.


Feature Detection for Hand Hygiene Stages. The process of hand washing involves complex hand movements. There are six principal sequential steps for washing hands as per the World Health Organisation (WHO) guidelines. In this work, a detailed description of an aluminium rig construction for creating a robust hand washing dataset is discussed. The preliminary results with the help of image processing and computer vision algorithms for hand pose extraction and feature detection such as Harris detector, Shi Tomasi and SIFT are demonstrated. The hand hygiene pose Rub hands palm to palm was captured as an input image for running all the experiments. The future work will focus upon processing the video recordings of hand movements captured and applying deep learning solutions for the classification of hand hygiene stages.


On values of mathfrak sl 3 weight system on chord diagrams whose intersection graph is complete bipartite. Each knot invariant can be extended to singular knots according to the skein rule. A Vassiliev invariant of order at most n is defined as a knot invariant that vanishes identically on knots with more than n double points. A chord diagram encodes the order of double points along a singular knot. A Vassiliev invariant of order n gives rise to a function on chord diagrams with n chords. Such a function should satisfy some conditions in order to come from a Vassiliev invariant. A weight system is a function on chord diagrams that satisfies so called 4 term relations. Given a Lie algebra mathfrak g equipped with a non degenerate invariant bilinear form, one can construct a weight system with values in the center of the universal enveloping algebra U( mathfrak g ) . In this paper, we calculate mathfrak sl 3 weight system for chord diagram whose intersection graph is complete bipartite graph K 2,n .


Is Object Detection Necessary for Human Object Interaction Recognition?. This paper revisits human object interaction (HOI) recognition at image level without using supervisions of object location and human pose. We name it detection free HOI recognition, in contrast to the existing detection supervised approaches which rely on object and keypoint detections to achieve state of the art. With our method, not only the detection supervision is evitable, but superior performance can be achieved by properly using image text pre training (such as CLIP) and the proposed Log Sum Exp Sign (LSE Sign) loss function. Specifically, using text embeddings of class labels to initialize the linear classifier is essential for leveraging the CLIP pre trained image encoder. In addition, LSE Sign loss facilitates learning from multiple labels on an imbalanced dataset by normalizing gradients over all classes in a softmax format. Surprisingly, our detection free solution achieves 60.5 mAP on the HICO dataset, outperforming the detection supervised state of the art by 13.4 mAP


Dynamic Reliability Management in Neuromorphic Computing. Neuromorphic computing systems uses non volatile memory (NVM) to implement high density and low energy synaptic storage. Elevated voltages and currents needed to operate NVMs cause aging of CMOS based transistors in each neuron and synapse circuit in the hardware, drifting the transistor's parameters from their nominal values. Aggressive device scaling increases power density and temperature, which accelerates the aging, challenging the reliable operation of neuromorphic systems. Existing reliability oriented techniques periodically de stress all neuron and synapse circuits in the hardware at fixed intervals, assuming worst case operating conditions, without actually tracking their aging at run time. To de stress these circuits, normal operation must be interrupted, which introduces latency in spike generation and propagation, impacting the inter spike interval and hence, performance, e.g., accuracy. We propose a new architectural technique to mitigate the aging related reliability problems in neuromorphic systems, by designing an intelligent run time manager (NCRTM), which dynamically destresses neuron and synapse circuits in response to the short term aging in their CMOS transistors during the execution of machine learning workloads, with the objective of meeting a reliability target. NCRTM de stresses these circuits only when it is absolutely necessary to do so, otherwise reducing the performance impact by scheduling de stress operations off the critical path. We evaluate NCRTM with state of the art machine learning workloads on a neuromorphic hardware. Our results demonstrate that NCRTM significantly improves the reliability of neuromorphic hardware, with marginal impact on performance.


Towards Standardizing Reinforcement Learning Approaches for Stochastic Production Scheduling. Recent years have seen a rise in interest in terms of using machine learning, particularly reinforcement learning (RL), for production scheduling problems of varying degrees of complexity. The general approach is to break down the scheduling problem into a Markov Decision Process (MDP), whereupon a simulation implementing the MDP is used to train an RL agent. Since existing studies rely on (sometimes) complex simulations for which the code is unavailable, the experiments presented are hard, or, in the case of stochastic environments, impossible to reproduce accurately. Furthermore, there is a vast array of RL designs to choose from. To make RL methods widely applicable in production scheduling and work out their strength for the industry, the standardization of model descriptions both production setup and RL design and validation scheme are a prerequisite. Our contribution is threefold First, we standardize the description of production setups used in RL studies based on established nomenclature. Secondly, we classify RL design choices from existing publications. Lastly, we propose recommendations for a validation scheme focusing on reproducibility and sufficient benchmarking.


TOD DA Towards Boosting the Robustness of Task oriented Dialogue Modeling on Spoken Conversations. Task oriented dialogue systems have been plagued by the difficulties of obtaining large scale and high quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are insufficient to reflect actual human behaviors in practical spoken dialogue systems. In this paper, we propose Task oriented Dialogue Data Augmentation (TOD DA), a novel model agnostic data augmentation paradigm to boost the robustness of task oriented dialogue modeling on spoken conversations. The TOD DA consists of two modules 1) Dialogue Enrichment to expand training data on task oriented conversations for easing data sparsity and 2) Spoken Conversation Simulator to imitate oral style expressions and speech recognition errors in diverse granularities for bridging the gap between written and spoken conversations. With such designs, our approach ranked first in both tasks of DSTC10 Track2, a benchmark for task oriented dialogue modeling on spoken conversations, demonstrating the superiority and effectiveness of our proposed TOD DA.


Evaluating Robustness over High Level Driving Instruction for Autonomous Driving. In recent years, we have witnessed increasingly high performance in the field of autonomous end to end driving. In particular, more and more research is being done on driving in urban environments, where the car has to follow high level commands to navigate. However, few evaluations are made on the ability of these agents to react in an unexpected situation. Specifically, no evaluations are conducted on the robustness of driving agents in the event of a bad high level command. We propose here an evaluation method, namely a benchmark that allows to assess the robustness of an agent, and to appreciate its understanding of the environment through its ability to keep a safe behavior, regardless of the instruction.


Dauns Hofmann Kumjian Renault Duality for Fell Bundles and Structured C Algebras. We unify the classic Dauns Hofmann representation with Kumjian and Renault's Weyl groupoid representation. More precisely, we use ultrafilters to represent C algebras with some additional structure on Fell bundles over locally compact 'etale groupoids. Our construction is even functorial and thus a fully fledged non commutative extension of the classic Gelfand duality.


Hydroelastic lumps in shallow water. Hydroelastic solitary waves propagating on the surface of a three dimensional ideal fluid through the deformation of an elastic sheet are studied. The problem is investigated based on a Benney Luke type equation derived via an explicit non local formulation of the classic water wave problem. The normal form analysis is carried out for the newly developed equation, which results in the Benney Roskes Davey Stewartson (BRDS) system governing the coupled evolution of the envelope of a carrier wave and the wave induced mean flow. Numerical results show three types of free solitary waves in the Benney Luke type equation plane solitary wave, lump (i.e., fully localized traveling waves in three dimensions), and transversally periodic solitary wave, and they are counterparts of the BRDS solutions. They are linked together by a dimension breaking bifurcation where plane solitary waves and lumps can be viewed as two limiting cases, and transversally periodic solitary waves serve as intermediate states. The stability and interaction of solitary waves are investigated via a numerical time integration of the Benney Luke type equation. For a localized load moving on the elastic sheet with a constant speed, it is found that there exists a transcritical regime of forcing speed for which there are no steady solutions. Instead, periodic shedding of lumps can be observed if the forcing moves at speed in this range.