Embracing Single Stride 3D Object Detector with Sparse Transformer. In LiDAR based 3D object detection for autonomous driving, the ratio of the object size to input scene size is significantly smaller compared to 2D detection cases. Overlooking this difference, many 3D detectors directly follow the common practice of 2D detectors, which downsample the feature maps even after quantizing the point clouds. In this paper, we start by rethinking how such multi stride stereotype affects the LiDAR based 3D object detectors. Our experiments point out that the downsampling operations bring few advantages, and lead to inevitable information loss. To remedy this issue, we propose Single stride Sparse Transformer (SST) to maintain the original resolution from the beginning to the end of the network. Armed with transformers, our method addresses the problem of insufficient receptive field in single stride architectures. It also cooperates well with the sparsity of point clouds and naturally avoids expensive computation. Eventually, our SST achieves state of the art results on the large scale Waymo Open Dataset. It is worth mentioning that our method can achieve exciting performance (83.8 LEVEL 1 AP on validation split) on small object (pedestrian) detection due to the characteristic of single stride. Codes will be released at https github.com TuSimple SST


The Privacy Paradox and Optimal Bias Variance Trade offs in Data Acquisition. While users claim to be concerned about privacy, often they do little to protect their privacy in their online actions. One prominent explanation for this "privacy paradox" is that when an individual shares her data, it is not just her privacy that is compromised the privacy of other individuals with correlated data is also compromised. This information leakage encourages oversharing of data and significantly impacts the incentives of individuals in online platforms. In this paper, we study the design of mechanisms for data acquisition in settings with information leakage and verifiable data. We design an incentive compatible mechanism that optimizes the worst case trade off between bias and variance of the estimation subject to a budget constraint, where the worst case is over the unknown correlation between costs and data. Additionally, we characterize the structure of the optimal mechanism in closed form and study monotonicity and non monotonicity properties of the marketplace.


OPEn An Open ended Physics Environment for Learning Without a Task. Humans have mental models that allow them to plan, experiment, and reason in the physical world. How should an intelligent agent go about learning such models? In this paper, we will study if models of the world learned in an open ended physics environment, without any specific tasks, can be reused for downstream physics reasoning tasks. To this end, we build a benchmark Open ended Physics ENvironment (OPEn) and also design several tasks to test learning representations in this environment explicitly. This setting reflects the conditions in which real agents (i.e. rolling robots) find themselves, where they may be placed in a new kind of environment and must adapt without any teacher to tell them how this environment works. This setting is challenging because it requires solving an exploration problem in addition to a model building and representation learning problem. We test several existing RL based exploration methods on this benchmark and find that an agent using unsupervised contrastive learning for representation learning, and impact driven learning for exploration, achieved the best results. However, all models still fall short in sample efficiency when transferring to the downstream tasks. We expect that OPEn will encourage the development of novel rolling robot agents that can build reusable mental models of the world that facilitate many tasks.


Hyperdimensional Feature Fusion for Interpretable Out Of Distribution Detection. We introduce powerful ideas from Hyperdimensional Computing into the challenging field of Out of Distribution (OOD) detection. In contrast to most existing work that performs OOD detection based on only a single layer of a neural network, we use similarity preserving semi orthogonal projection matrices to project the feature maps from multiple layers into a common vector space. By repeatedly applying the bundling operation oplus , we create expressive class specific descriptor vectors for all in distribution classes. At test time, a simple and efficient cosine similarity calculation between descriptor vectors consistently identifies OOD samples with better performance than the current state of the art. We show that the hyperdimensional fusion of multiple network layers is critical to achieve best general performance.


Multi View Multi Person 3D Pose Estimation with Plane Sweep Stereo. Existing approaches for multi view multi person 3D pose estimation explicitly establish cross view correspondences to group 2D pose detections from multiple camera views and solve for the 3D pose estimation for each person. Establishing cross view correspondences is challenging in multi person scenes, and incorrect correspondences will lead to sub optimal performance for the multi stage pipeline. In this work, we present our multi view 3D pose estimation approach based on plane sweep stereo to jointly address the cross view fusion and 3D pose reconstruction in a single shot. Specifically, we propose to perform depth regression for each joint of each 2D pose in a target camera view. Cross view consistency constraints are implicitly enforced by multiple reference camera views via the plane sweep algorithm to facilitate accurate depth regression. We adopt a coarse to fine scheme to first regress the person level depth followed by a per person joint level relative depth estimation. 3D poses are obtained from a simple back projection given the estimated depths. We evaluate our approach on benchmark datasets where it outperforms previous state of the arts while being remarkably efficient. Our code is available at https github.com jiahaoLjh PlaneSweepPose.


Muon reconstruction with a convolutional neural network in the JUNO detector. The Jiangmen Underground Neutrino Observatory (JUNO) is designed to determine the neutrino mass ordering and measure neutrino oscillation parameters. A precise muon reconstruction is crucial to reduce one of the major backgrounds induced by cosmic muons. This article proposes a novel muon reconstruction method based on convolutional neural network (CNN) models. In this method, the track information reconstructed by the top tracker is used for network training. The training dataset is augmented by applying a rotation to muon tracks to compensate for the limited angular coverage of the top tracker. The muon reconstruction with the CNN model can produce unbiased tracks with performance that spatial resolution is better than 10 cm and angular resolution is better than 0.6 degrees. By using a GPU accelerated implementation a speedup factor of 100 compared to existing CPU techniques has been demonstrated.


A Meshless Method to Compute Pressure Fields from Image Velocimetry. We propose a meshless method to compute pressure fields from image velocimetry data, regardless of whether this is available on a regular grid as in cross correlation based velocimetry or on scattered points as in tracking velocimetry. The proposed approach is based on Radial Basis Functions (RBFs) regression and relies on the solution of two constrained least square problems. The first one is the regression of the measurements to create an analytic representation of the velocity field. This regression can be constrained to impose boundary conditions (e.g. no slip velocity on a wall or inlet conditions) or differential constraints (e.g. the solenoidal condition for an incompressible flow). The second one is the meshless integration of the pressure Poisson equation, achieved by seeking a solution in the form of a RBF expansion and using constraints to impose boundary conditions. We first illustrate the derivation of the two least square problems and the numerical techniques implemented for their solution. Then, we showcase the method with three numerical test cases of growing complexity. These are a 2D Gaussian Vortex, a 2D flow past a cylinder from CFD and a 3D Stokes flow past a sphere. For each case, we consider randomly sampled vector fields simulating particle tracking measurements and analyze the sensitivity to noise and seeding density.


Backswimmer Inspired Miniature Robot with Buoyancy Auto Regulation through Controlled Nucleation and Release of Microbubbles. The backswimmer fly is an aquatic insect, capable of regulating its buoyancy underwater. Its abdomen is covered with hemoglobin cells, used to bind and release oxygen, reversibly. Upon entering water, the fly entraps an air bubble in a superhydrophobic hairy structure on its abdomen for respiration. This bubble, however, can change its volume through regulated oxygen flow from the abdominal hemoglobin cells. In this way, it can reach neutral buoyancy without further energy consumption. In this study, we develop a small, centimeter scale, backswimmer inspired robot (BackBot) with auto buoyancy regulation through controlled nucleation and release of microbubbles. The bubbles nucleate and grow directly on onboard electrodes through electrolysis, regulated by low voltage. We use 3D printing to introduce a three dimensional bubble entrapping cellular structure, in order to create a stable external gas reservoir. To reduce buoyancy forces, the bubbles are released through linear mechanical vibrations, decoupled from the robot's body. Through pressure sensing and a Proportional Integral Derivative control loop mechanism, the robot auto regulates its buoyancy to reach neutral floatation underwater within seconds. This mechanism can promote the replacement of traditional and physically larger buoyancy regulation systems, such as pistons and pressurized tanks, and to enable the miniaturization of Autonomous Underwater Vehicles.


Finitely generated submonoids. We prove several results concerning finitely generated submonoids of the free monoid. These results generalize those known for free submonoids. We prove in particular that if X Y circ Z is a composition of finite sets of words with Y complete, then d(X) d(Y)d(Z) .


SkipNode On Alleviating Over smoothing for Deep Graph Convolutional Networks. Over smoothing is a challenging problem, which degrades the performance of deep graph convolutional networks (GCNs). However, existing studies for alleviating the over smoothing problem lack either generality or effectiveness. In this paper, we analyze the underlying issues behind the over smoothing problem, i.e., feature diversity degeneration, gradient vanishing, and model weights over decaying. Inspired by this, we propose a simple yet effective plug and play module, SkipNode, to alleviate over smoothing. Specifically, for each middle layer of a GCN model, SkipNode randomly (or based on node degree) selects nodes to skip the convolutional operation by directly feeding their input features to the nonlinear function. Analytically, 1) skipping the convolutional operation prevents the features from losing diversity and 2) the "skipped" nodes enable gradients to be directly passed back, thus mitigating the gradient vanishing and model weights over decaying issues. To demonstrate the superiority of SkipNode, we conduct extensive experiments on nine popular datasets, including both homophilic and heterophilic graphs, with different graph sizes on two typical tasks node classification and link prediction. Specifically, 1) SkipNode has strong generalizability of being applied to various GCN based models on different datasets and tasks and 2) SkipNode outperforms recent state of the art anti over smoothing plug and play modules, i.e., DropEdge and DropNode, in different settings. Code will be made publicly available on GitHub.


Demonstration Informed Specification Search. This paper considers the problem of learning history dependent task specifications, e.g. automata and temporal logic, from expert demonstrations. Unfortunately, the (countably infinite) number of tasks under consideration combined with an a priori ignorance of what historical features are needed to encode the demonstrated task makes existing approaches to learning tasks from demonstrations inapplicable. To address this deficit, we propose Demonstration Informed Specification Search (DISS) a family of algorithms parameterized by black box access to (i) a maximum entropy planner and (ii) an algorithm for identifying concepts, e.g., automata, from labeled examples. DISS works by alternating between (i) conjecturing labeled examples to make the demonstrations less surprising and (ii) sampling concepts consistent with the current labeled examples. In the context of tasks described by deterministic finite automata, we provide a concrete implementation of DISS that efficiently combines partial knowledge of the task and a single expert demonstration to identify the full task specification.


Large Scale Zero Shot Image Classification from Rich and Diverse Textual Descriptions. We study the impact of using rich and diverse textual descriptions of classes for zero shot learning (ZSL) on ImageNet. We create a new dataset ImageNet Wiki that matches each ImageNet class to its corresponding Wikipedia article. We show that merely employing these Wikipedia articles as class descriptions yields much higher ZSL performance than prior works. Even a simple model using this type of auxiliary data outperforms state of the art models that rely on standard features of word embedding encodings of class names. These results highlight the usefulness and importance of textual descriptions for ZSL, as well as the relative importance of auxiliary data type compared to algorithmic progress. Our experimental results also show that standard zero shot learning approaches generalize poorly across categories of classes.


Modeling Web Browsing Behavior across Tabs and Websites with Tracking and Prediction on the Client Side. Clickstreams on individual websites have been studied for decades to gain insights into user interests and to improve website experiences. This paper proposes and examines a novel sequence modeling approach for web clickstreams, that also considers multi tab branching and backtracking actions across websites to capture the full action sequence of a user while browsing. All of this is done using machine learning on the client side to obtain a more comprehensive view and at the same time preserve privacy. We evaluate our formalism with a model trained on data collected in a user study with three different browsing tasks based on different human information seeking strategies from psychological literature. Our results show that the model can successfully distinguish between browsing behaviors and correctly predict future actions. A subsequent qualitative analysis identified five common web browsing patterns from our collected behavior data, which help to interpret the model. More generally, this illustrates the power of overparameterization in ML and offers a new way of modeling, reasoning with, and prediction of observable sequential human interaction behaviors.


Analytic operator valued generalized Feynman integral on function space. In this paper an analytic operator valued generalized Feynman integral was studied on a very general Wiener space C a,b 0,T . The general Wiener space C a,b 0,T is a function space which is induced by the generalized Brownian motion process associated with continuous functions a and b . The structure of the analytic operator valued generalized Feynman integral is suggested and the existence of the analytic operator valued generalized Feynman integral is investigated as an operator from L 1( mathbb R, nu delta,a ) to L infty ( mathbb R) where nu delta,a is a sigma finite measure on mathbb R given by d nu delta,a exp delta mathrm Var (a)u 2 du, where delta 0 and mathrm Var (a) denotes the total variation of the mean function a of the generalized Brownian motion process. It turns out in this paper that the analytic operator valued generalized Feynman integrals of functionals defined by the stochastic Fourier Stieltjes transform of complex measures on the infinite dimensional Hilbert space C a,b ' 0,T are elements of the linear space bigcap delta 0 mathcal L( L 1( mathbb R, nu delta,a ),L infty ( mathbb R)).


Effect of recirculation zones on the ventilation of a public washroom. Air borne transmission can pose a major risk of infection spread in enclosed spaces. Venting the air out using exhaust fans and ducts is a common approach to mitigate the risk. In this work, we study the air flow set up by an exhaust fan in a typical shared washroom that can be a potential hot spot for COVID 19 transmission. The primary focus is on the regions of recirculating flow that can harbor infectious aerosol for much longer than the well ventilated parts of the room. Computational fluid dynamics is used to obtain the steady state air flow field, and Lagrangian tracking of particles give the spatial and temporal distribution of infectious aerosol in the domain. It is found that the washbasin located next to the door is in a prominent recirculation zone, and particles injected in this region take much longer to be evacuated. The ventilation rate is found to be governed by the air residence time in the recirculation zone, and it is much higher than the time scale based on fully mixed reactor model of the room. Increasing the fan flow rate can reduce the ventilation time, but cannot eliminate the recirculation zones in the washroom.


Distributed Swarm Trajectory Optimization for Formation Flight in Dense Environments. For aerial swarms, navigation in a prescribed formation is widely practiced in various scenarios. However, the associated planning strategies typically lack the capability of avoiding obstacles in cluttered environments. To address this deficiency, we present an optimization based method that ensures collision free trajectory generation for formation flight. In this paper, a novel differentiable metric is proposed to quantify the overall similarity distance between formations. We then formulate this metric into an optimization framework, which achieves spatial temporal planning using polynomial trajectories. Minimization over collision penalty is also incorporated into the framework, so that formation preservation and obstacle avoidance can be handled simultaneously. To validate the efficiency of our method, we conduct benchmark comparisons with other cutting edge works. Integrated with an autonomous distributed aerial swarm system, the proposed method demonstrates its efficiency and robustness in real world experiments with obstacle rich surroundings. We will release the source code for the reference of the community.


On fine Selmer groups and the greatest common divisor of signed and chromatic p adic L functions. Let E mathbb Q be an elliptic curve and p an odd prime where E has good supersingular reduction. Let F 1 denote the characteristic power series of the Pontryagin dual of the fine Selmer group of E over the cyclotomic mathbb Z p extension of mathbb Q and let F 2 denote the greatest common divisor of Pollack's plus and minus p adic L functions or Sprung's sharp and flat p adic L functions attached to E , depending on whether a p(E) 0 or a p(E) ne0 . We study a link between the divisors of F 1 and F 2 in the Iwasawa algebra. This gives new insights into problems posed by Greenberg and Pollack Kurihara on these elements.


Sequential Aggregation and Rematerialization Distributed Full batch Training of Graph Neural Networks on Large Graphs. We present the Sequential Aggregation and Rematerialization (SAR) scheme for distributed full batch training of Graph Neural Networks (GNNs) on large graphs. Large scale training of GNNs has recently been dominated by sampling based methods and methods based on non learnable message passing. SAR on the other hand is a distributed technique that can train any GNN type directly on an entire large graph. The key innovation in SAR is the distributed sequential rematerialization scheme which sequentially re constructs then frees pieces of the prohibitively large GNN computational graph during the backward pass. This results in excellent memory scaling behavior where the memory consumption per worker goes down linearly with the number of workers, even for densely connected graphs. Using SAR, we report the largest applications of full batch GNN training to date, and demonstrate large memory savings as the number of workers increases. We also present a general technique based on kernel fusion and attention matrix rematerialization to optimize both the runtime and memory efficiency of attention based models. We show that, coupled with SAR, our optimized attention kernels lead to significant speedups and memory savings in attention based GNNs.We made the SAR GNN training library publicy available url https github.com IntelLabs SAR .


LatentHuman Shape and Pose Disentangled Latent Representation for Human Bodies. 3D representation and reconstruction of human bodies have been studied for a long time in computer vision. Traditional methods rely mostly on parametric statistical linear models, limiting the space of possible bodies to linear combinations. It is only recently that some approaches try to leverage neural implicit representations for human body modeling, and while demonstrating impressive results, they are either limited by representation capability or not physically meaningful and controllable. In this work, we propose a novel neural implicit representation for the human body, which is fully differentiable and optimizable with disentangled shape and pose latent spaces. Contrary to prior work, our representation is designed based on the kinematic model, which makes the representation controllable for tasks like pose animation, while simultaneously allowing the optimization of shape and pose for tasks like 3D fitting and pose tracking. Our model can be trained and fine tuned directly on non watertight raw data with well designed losses. Experiments demonstrate the improved 3D reconstruction performance over SoTA approaches and show the applicability of our method to shape interpolation, model fitting, pose tracking, and motion retargeting.


Socially Optimal Mechanism Design for Incentivized Online Learning. Multi arm bandit (MAB) is a classic online learning framework that studies the sequential decision making in an uncertain environment. The MAB framework, however, overlooks the scenario where the decision maker cannot take actions (e.g., pulling arms) directly. It is a practically important scenario in many applications such as spectrum sharing, crowdsensing, and edge computing. In these applications, the decision maker would incentivize other selfish agents to carry out desired actions (i.e., pulling arms on the decision maker's behalf). This paper establishes the incentivized online learning (IOL) framework for this scenario. The key challenge to design the IOL framework lies in the tight coupling of the unknown environment learning and asymmetric information revelation. To address this, we construct a special Lagrangian function based on which we propose a socially optimal mechanism for the IOL framework. Our mechanism satisfies various desirable properties such as agent fairness, incentive compatibility, and voluntary participation. It achieves the same asymptotic performance as the state of art benchmark that requires extra information. Our analysis also unveils the power of crowd in the IOL framework a larger agent crowd enables our mechanism to approach more closely the theoretical upper bound of social performance. Numerical results demonstrate the advantages of our mechanism in large scale edge computing.


RoR Read over Read for Long Document Machine Reading Comprehension. Transformer based pre trained models, such as BERT, have achieved remarkable results on machine reading comprehension. However, due to the constraint of encoding length (e.g., 512 WordPiece tokens), a long document is usually split into multiple chunks that are independently read. It results in the reading field being limited to individual chunks without information collaboration for long document machine reading comprehension. To address this problem, we propose RoR, a read over read method, which expands the reading field from chunk to document. Specifically, RoR includes a chunk reader and a document reader. The former first predicts a set of regional answers for each chunk, which are then compacted into a highly condensed version of the original document, guaranteeing to be encoded once. The latter further predicts the global answers from this condensed document. Eventually, a voting strategy is utilized to aggregate and rerank the regional and global answers for final prediction. Extensive experiments on two benchmarks QuAC and TriviaQA demonstrate the effectiveness of RoR for long document reading. Notably, RoR ranks 1st place on the QuAC leaderboard (https quac.ai ) at the time of submission (May 17th, 2021).


Sleeping Combinatorial Bandits. In this paper, we study an interesting combination of sleeping and combinatorial stochastic bandits. In the mixed model studied here, at each discrete time instant, an arbitrary emph availability set is generated from a fixed set of emph base arms. An algorithm can select a subset of arms from the emph availability set (sleeping bandits) and receive the corresponding reward along with semi bandit feedback (combinatorial bandits). We adapt the well known CUCB algorithm in the sleeping combinatorial bandits setting and refer to it as CSUCB. We prove under mild smoothness conditions that the CSUCB algorithm achieves an O( log (T)) instance dependent regret guarantee. We further prove that (i) when the range of the rewards is bounded, the regret guarantee of CSUCB algorithm is O( sqrt T log (T) ) and (ii) the instance independent regret is O( sqrt 3 T 2 log(T) ) in a general setting. Our results are quite general and hold under general environments such as non additive reward functions, volatile arm availability, a variable number of base arms to be pulled arising in practical applications. We validate the proven theoretical guarantees through experiments.


The entropic barrier is n self concordant. For any convex body K subseteq mathbb R n , S. Bubeck and R. Eldan introduced the entropic barrier on K and showed that it is a (1 o(1)) , n self concordant barrier. In this note, we observe that the optimal bound of n on the self concordance parameter holds as a consequence of the dimensional Brascamp Lieb inequality.


Reducing Redundancy in Data Organization and Arithmetic Calculation for Stencil Computations. Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization techniques, aiming at exploiting the in core data parallelism. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. In this paper, a novel transpose layout is devised to preserve the data locality for tiling in the data space and reduce the data reorganization overhead for vectorization simultaneously. We then propose an approach of temporal computation folding designed to further reduce the redundancy of arithmetic calculations by exploiting the register reuse, alleviating the increased register pressure, and deducing generalization with a linear regression model. Experimental results on the AVX 2 and AVX 512 CPUs show that our approach obtains a competitive performance.


Deep View Synthesis via Self Consistent Generative Network. View synthesis aims to produce unseen views from a set of views captured by two or more cameras at different positions. This task is non trivial since it is hard to conduct pixel level matching among different views. To address this issue, most existing methods seek to exploit the geometric information to match pixels. However, when the distinct cameras have a large baseline (i.e., far away from each other), severe geometry distortion issues would occur and the geometric information may fail to provide useful guidance, resulting in very blurry synthesized images. To address the above issues, in this paper, we propose a novel deep generative model, called Self Consistent Generative Network (SCGN), which synthesizes novel views from the given input views without explicitly exploiting the geometric information. The proposed SCGN model consists of two main components, i.e., a View Synthesis Network (VSN) and a View Decomposition Network (VDN), both employing an Encoder Decoder structure. Here, the VDN seeks to reconstruct input views from the synthesized novel view to preserve the consistency of view synthesis. Thanks to VDN, SCGN is able to synthesize novel views without using any geometric rectification before encoding, making it easier for both training and applications. Finally, adversarial loss is introduced to improve the photo realism of novel views. Both qualitative and quantitative comparisons against several state of the art methods on two benchmark tasks demonstrated the superiority of our approach.


Dispersion forces in the Lifshitz problem. We present a sequential derivation of the dispersion forces for the Lifshitz problem, based on the field mode matching technique. The results for the dispersion force on the base of the energy momentum tensor and the Lorentz force are presented as specral integrals in real domaine.


Do biological constraints impair dendritic computation?. Computations on the dendritic trees of neurons have important constraints. Voltage dependent conductances in dendrites are not similar to arbitrary direct current generation, they are the basis for dendritic nonlinearities and they do not allow converting positive currents into negative currents. While it has been speculated that the dendritic tree of a neuron can be seen as a multi layer neural network and it has been shown that such an architecture could be computationally strong, we do not know if that computational strength is preserved under these biological constraints. Here we simulate models of dendritic computation with and without these constraints. We find that dendritic model performance on interesting machine learning tasks is not hurt by these constraints but may benefit from them. Our results suggest that single real dendritic trees may be able to learn a surprisingly broad range of tasks.


Recruiting credible participants for field studies in software engineering research. Context Software practitioners are a primary provider of information for field studies in software engineering. Research typically recruits practitioners through some kind of sampling. But sampling may not in itself recruit credible participants. Objectives To propose and demonstrate a framework for recruiting professional practitioners as credible participants in field studies of software engineering. Method We review existing guidelines, checklists and other advisory sources on recruiting participants for field studies. We develop a framework, partly based on our prior research and on the research of others. We search for and select three exemplar studies (a case study, an interview study and a survey study) and use those to demonstrate the application of the framework. Results Whilst existing guidelines etc. recognise the importance of recruiting participants, there is limited guidance on how to recruit the right participants. Our demonstration of the framework with three exemplars shows that at least some members of the research community are aware of the need to carefully recruit participants. Conclusions The framework provides a new perspective for thinking about the recruitment of credible practitioners for field studies of software engineering. In particular, the framework identifies a number of characteristics not explicitly addressed by existing guidelines.


Usage of GPUs in ALICE Online and Offline processing during LHC Run 3. ALICE will significantly increase its Pb Pb data taking rate from the 1 ,kHz of triggered readout in Run 2 to 50 kHz of continuous readout for LHC Run 3. Updated tracking detectors are installed for Run 3 and a new two phase computing strategy is employed. In the first synchronous phase during the data taking, the raw data is compressed for storage to an on site disk buffer and the required data for the detector calibration is collected. In the second asynchronous phase the compressed raw data is reprocessed using the final calibration to produce the final reconstruction output. Traditional CPUs are unable to cope with the huge data rate and processing demands of the synchronous phase, therefore ALICE employs GPUs to speed up the processing. Since the online computing farm performs a part of the asynchronous processing when there is no beam in the LHC, ALICE plans to use the GPUs also for this second phase. This paper gives an overview of the GPU processing in the synchronous phase, the full system test to validate the reference GPU architecture, and the prospects for the GPU usage in the asynchronous phase.


The sharp constant for truncated Hardy Littlewood maximal inequality. This paper focuses on the operator norm of the truncated Hardy Littlewood maximal operator M b a and the strong truncated Hardy Littlewood maximal operator tilde M boldsymbol b boldsymbol a , respectively. We first present the L 1 norm of M b a , and then the L 1 norm of tilde M boldsymbol b boldsymbol a is given. Our study may have some enlightening significance for the research on sharp constant for the classical Hardy Littlewood maximal inequality.


A Tutorial on Mathematical Modeling of Millimeter Wave and Terahertz Cellular Systems. Millimeter wave (mmWave) and terahertz (THz) radio access technologies (RAT) are expected to become a critical part of the future cellular ecosystem providing an abundant amount of bandwidth in areas with high traffic demands. However, extremely directional antenna radiation patterns that need to be utilized at both transmit and receive sides of a link to overcome severe path losses, dynamic blockage of propagation paths by large static and small dynamic objects, macro and micromobility of user equipment (UE) makes provisioning of reliable service over THz mmWave RATs an extremely complex task. This challenge is further complicated by the type of applications envisioned for these systems inherently requiring guaranteed bitrates at the air interface. This tutorial aims to introduce a versatile mathematical methodology for assessing performance reliability improvement algorithms for mmWave and THz systems. Our methodology accounts for both radio interface specifics as well as service process of sessions at mmWave THz base stations (BS) and is capable of evaluating the performance of systems with multiconnectivity operation, resource reservation mechanisms, priorities between multiple traffic types having different service requirements. The framework is logically separated into two parts (i) parameterization part that abstracts the specifics of deployment and radio mechanisms, and (ii) queuing part, accounting for details of the service process at mmWave THz BSs. The modular decoupled structure of the framework allows for further extensions to advanced service mechanisms in prospective mmWave THz cellular deployments while keeping the complexity manageable and thus making it attractive for system analysts.


A Table Based Representation for Probabilistic Logic Preliminary Results. We present Probabilistic Decision Model and Notation (pDMN), a probabilistic extension of Decision Model and Notation (DMN). DMN is a modeling notation for deterministic decision logic, which intends to be user friendly and low in complexity. pDMN extends DMN with probabilistic reasoning, predicates, functions, quantification, and a new hit policy. At the same time, it aims to retain DMN's user friendliness to allow its usage by domain experts without the help of IT staff. pDMN models can be unambiguously translated into ProbLog programs to answer user queries. ProbLog is a probabilistic extension of Prolog flexibly enough to model and reason over any pDMN model.


On the Calder 'on problem for nonlocal Schr "odinger equations with homogeneous, directionally antilocal principal symbols. In this article we consider direct and inverse problems for alpha stable, elliptic nonlocal operators whose kernels are possibly only supported on cones and which satisfy the structural condition of emph directional antilocality as introduced in cite I86 . We consider the Dirichlet problem for these operators on the "domain of dependence of the operator" and in several, adapted function spaces. This formulation allows one to avoid natural "gauges" which would else have to be considered in the study of the associated inverse problems. Exploiting the directional antilocality of these operators we complement the investigation of the emph direct problem with infinite data and single measurement uniqueness results for the associated emph inverse problems . Here, due to the only directional antilocality, new geometric conditions arise on the measurement domains. We discuss both the setting of symmetric and a particular class of non symmetric nonlocal elliptic operators, and contrast the corresponding results for the direct and inverse problems. In particular for only "one sided operators" new phenomena emerge both in the direct and inverse problems For instance, it is possible to study the problem in data spaces involving local and nonlocal data, the unique continuation property may not hold in general and further restrictions on the measurement set for the inverse problem arise.


An Application of BnB NSGAII Initializing NSGAII to Solve 3 Stage Reducer Problem. The 3 stage reducer problem is a point of interest for many researchers. In this paper, this problem is reformulated to a bi objective problem with additional constraints to meet the ISO mechanical standards. Those additional constraints increase the complexity of the problem, such that, NSGAII performance is not sufficient. To overcome this, we propose to use BnB NSGAII method a hybrid multi criteria branch and bound with NSGAII to initialize NSGAII before solving the problem, seeking for a better initial population. A new feature is also proposed to enhance BnB NSGAII method, called the legacy feature. The legacy feature permits the inheritance of the elite individuals between branch and bound parent and children nodes. NSGAII and BnB NSGAII with and without the legacy feature are tested on the 3 stage reducer problem. Results demonstrate the competitive performance of BnB NSGAII with the legacy feature.


A decomposition for Levy processes inspected at Poisson moments. We consider a L 'evy process Y(t) that is not permanently observed, but rather inspected at Poisson( omega ) moments only, over an exponentially distributed time T beta with parameter beta . The focus lies on the analysis of the distribution of the running maximum at such inspection moments up to T beta , denoted by Y beta, omega . Our main result is a decomposition we derive a remarkable distributional equality that contains Y beta, omega as well as the running maximum process bar Y(t) at the exponentially distributed times T beta and T beta omega . Concretely, overline Y (T beta) can be written the sum of the two independent random variables that are distributed as Y beta, omega and overline Y (T beta omega ) . The distribution of Y beta, omega can be identified more explicitly in the two special cases of a spectrally positive and a spectrally negative L 'evy process. As an illustrative example of the potential of our results, we show how to determine the asymptotic behavior of the bankruptcy probability in the Cram 'er Lundberg insurance risk model.


References of References How Far is the Knowledge Ancestry. Scientometrics studies have extended from direct citations to high order citations, as simple citation count is found to tell only part of the story regarding scientific impact. This extension is deemed to be beneficial in scenarios like research evaluation, science history modeling, and information retrieval. In contrast to citations of citations (forward citation generations), references of references (backward citation generations) as another side of high order citations, is relatively less explored. We adopt a series of metrics for measuring the unfolding of backward citations of a focal paper, tracing back to its knowledge ancestors generation by generation. Two sub fields in Physics are subject to such analysis on a large scale citation network. Preliminary results show that (1) most papers in our dataset can be traced to their knowledge ancestry (2) the size distribution of backward citation generations presents a decreasing and then increasing shape and (3) citations more than one generation away are still relevant to the focal paper, from either a forward or backward perspective yet, backward citation generations are higher in topic relevance to the paper of interest. Furthermore, the backward citation generations shed lights for literature recommendation, science evaluation, and sociology of science studies.


An Image is Worth More Than a Thousand Words Towards Disentanglement in the Wild. Unsupervised disentanglement has been shown to be theoretically impossible without inductive biases on the models and the data. As an alternative approach, recent methods rely on limited supervision to disentangle the factors of variation and allow their identifiability. While annotating the true generative factors is only required for a limited number of observations, we argue that it is infeasible to enumerate all the factors of variation that describe a real world image distribution. To this end, we propose a method for disentangling a set of factors which are only partially labeled, as well as separating the complementary set of residual factors that are never explicitly specified. Our success in this challenging setting, demonstrated on synthetic benchmarks, gives rise to leveraging off the shelf image descriptors to partially annotate a subset of attributes in real image domains (e.g. of human faces) with minimal manual effort. Specifically, we use a recent language image embedding model (CLIP) to annotate a set of attributes of interest in a zero shot manner and demonstrate state of the art disentangled image manipulation results.


Archimedes' Revenge. We offer an instructive solution to the problem of computing the volume of the orthogonal intersection of three hyperboloids.


Long Short Temporal Modeling for Efficient Action Recognition. Efficient long short temporal modeling is key for enhancing the performance of action recognition task. In this paper, we propose a new two stream action recognition network, termed as MENet, consisting of a Motion Enhancement (ME) module and a Video level Aggregation (VLA) module to achieve long short temporal modeling. Specifically, motion representations have been proved effective in capturing short term and high frequency action. However, current motion representations are calculated from adjacent frames, which may have poor interpretation and bring useless information (noisy or blank). Thus, for short term motions, we design an efficient ME module to enhance the short term motions by mingling the motion saliency among neighboring segments. As for long term aggregations, VLA is adopted at the top of the appearance branch to integrate the long term dependencies across all segments. The two components of MENet are complementary in temporal modeling. Extensive experiments are conducted on UCF101 and HMDB51 benchmarks, which verify the effectiveness and efficiency of our proposed MENet.


Determinants preserving maps on the spaces of symmetric matrices and skew symmetric matrices. Denote Sigma n and Q n the set of all n times n symmetric and skew symmetric matrices over a field mathbb F , respectively, where char( mathbb F ) neq 2 and lvert mathbb F rvert geq n 2 1 . A characterization of phi, psi Sigma n rightarrow Sigma n , for which at least one of them is surjective, satisfying det( phi(x) psi(y)) det(x y) qquad(x,y in Sigma n) is given. Furthermore, if n is even and phi, psi Q n rightarrow Q n , for which psi is surjective and psi(0) 0 , satisfy det( phi(x) psi(y)) det(x y) qquad(x,y in Q n), then phi psi and psi must be a bijective linear map preserving the determinant.


Hydrodynamic particle interactions in linear and radial viscosity gradients. We present a versatile perturbative calculation scheme to determine the mobility matrix for two and more particles in a low Reynolds number fluid with spatially variant viscosity. Assuming an asymptotic non constant viscosity perturbation superimposed on a constant viscosity background, we exploit the Lorentz reciprocal theorem and a reflection method to obtain the leading order correction to the mobility matrix. We apply our approach firstly to an interface like linear viscosity gradient with an extension much larger than the length scale of the particle separation. We find that the viscosity gradient gives rise to additional long range flow fields, for both particle translation and rotation, which decay by one order slower than their constant viscosity counterparts. Also, we reveal that the relative positioning of two interacting particles in finite size gradients, a natural precondition to avoid pathological negative viscosity, affects the mobilities of and interaction between both particles. Secondly, we apply our result to two interacting particles with temperatures different from that of the surrounding fluid, which alters both the fluid temperature and viscosity field. We find that both, the self mobilities of the particles as well as their interactions, increase for hot particles and decrease for cold particles.


The H join of arbitrary families of graphs. The H join of a family of graphs mathcal G G 1, dots, G p , also called the generalized composition, H G 1, dots, G p , where all graphs are undirected, simple and finite, is the graph obtained by replacing each vertex i of H by G i and adding to the edges of all graphs in mathcal G the edges of the join G i vee G j , for every edge ij of H . Some well known graph operations are particular cases of the H join of a family of graphs mathcal G as it is the case of the lexicographic product (also called composition) of two graphs H and G , H G . During long time the known expressions for the determination of the entire spectrum of the H join in terms of the spectra of its components and an associated matrix were limited to families of regular graphs. In this work, we extend such a determination, as well as the determination of the characteristic polynomial, to families of arbitrary graphs. From the obtained results, the eigenvectors of the adjacency matrix of the H join can also be determined in terms of the adjacency matrices of the components and an associated matrix.


Derived Analytic Geometry for Z Valued Functions. Part I Topological Properties. We study the Banach algebras rm C (X, R) of continuous functions from a compact Hausdorff topological space X to a Banach ring R whose topology is discrete. We prove that the Berkovich spectrum of rm C (X, R) is homeomorphic to zeta(X) times mathcal M (R) , where zeta(X) is the Banaschewski compactification of X and mathcal M (R) is the Berkovich spectrum of R . We study how the topology of the spectrum of rm C (X, R) is related to the notion of homotopy Zariski open embedding used in derived geometry. We find that the topology of zeta(X) can be easily reconstructed from the homotopy Zariski topology associated to rm C (X, R) . We also prove some results about the existence of Schauder bases on rm C (X, R) and a generalisation of the Stone Weierstrass Theorem, under suitable hypotheses on X and R .


Delta Conformity Multi scale Node Assortativity in Feature rich Stream Graphs. Heterogeneity is a key aspect of complex networks, often emerging by looking at the distribution of node properties, from the milestone observations on the degree to the recent developments in mixing pattern estimation. Mixing patterns, in particular, refer to nodes' connectivity preferences with respect to an attribute label. Social networks are mostly characterized by assortative homophilic behaviour, where nodes are more likely to be connected with similar ones. Recently, assortative mixing is increasingly measured in a multi scale fashion to overcome well known limitations of classic scores. Such multi scale strategies can capture heterogeneous behaviors among node homophily, but they ignore an important, often available, addendum in real world systems the time when edges are present and the time varying paths they form accordingly. Hence, temporal homophily is still little understood in complex networks. In this work we aim to cover this gap by introducing the Delta Conformity measure, a multiscale, path aware, node homophily estimator within the new framework of feature rich stream graphs. A rich experimental section analyzes Delta Conformity trends over time, spanning the analysis from real life social interaction networks to a specific case study about the Bitcoin Transaction Network.


Human Understandable Decision Making for Visual Recognition. The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human understandable decision making, so that humans cannot fully trust the predictions made by these models. To date, little work has been done on how to align the behaviors of deep learning models with human perception in order to train a human understandable model. To fill this gap, we propose a new framework to train a deep neural network by incorporating the prior of human perception into the model learning process. Our proposed model mimics the process of perceiving conceptual parts from images and assessing their relative contributions towards the final recognition. The effectiveness of our proposed model is evaluated on two classical visual recognition tasks. The experimental results and analysis confirm our model is able to provide interpretable explanations for its predictions, but also maintain competitive recognition accuracy.


Assimilating X and S band Radar Data for a Heavy Precipitation Event in Italy. During the night between 9 and 10 September 2017, multiple flash floods associated to a heavy precipitation event affected the town of Livorno, located in Tuscany, Italy. Accumulated precipitation exceeding 200 mm in two hours, associated with a return period higher than 200 years, caused all the largest streams of the Livorno municipality to flood several areas of the town. We used the limited area Weather Research and Forecasting (WRF) model, in a convection permitting setup, to reconstruct the extreme event leading to the flash floods. We evaluated possible forecasting improvements emerging from the assimilation of local ground stations and X and S band radar data into the WRF, using the configuration operational at the meteorological center of Tuscany region (LaMMA) at the time of the event. Simulations were verified against weather station observations, through an innovative method aimed at disentangling the positioning and intensity errors of precipitation forecasts. By providing more accurate descriptions of the low level flow and a better assessment of the atmospheric water vapour, the results demonstrate that assimilating radar data improved the quantitative precipitation forecasts.


Second order correlation function supported optical sensing for particle detection. We propose a new sensing method based on the measurement of the second order autocorrelation of the output of micro and nanolasers with intensity feedback. The sensing function is implemented through the feedback induced threshold shift, whose photon statistics is controlled by the feedback level in a characteristic way for different laser sizes. The specific response offers performances which can be adapted to different kinds of sensors. We propose the implementation of two schemes capable of providing a quantitative sensing signal and covering a broad range of feedback levels one is utilizing the evolution of g (2) (0), the other one is the ratio between central and side peaks in g (2) ( tau) . Laser threshold based sensing could, thanks to its potential sensitivity, gain relevance in biomolecular diagnostics and security monitoring.


Regularized Generative Adversarial Network. We propose a framework for generating samples from a probability distribution that differs from the probability distribution of the training set. We use an adversarial process that simultaneously trains three networks, a generator and two discriminators. We refer to this new model as regularized generative adversarial network (RegGAN). We evaluate RegGAN on a synthetic dataset composed of gray scale images and we further show that it can be used to learn some pre specified notions in topology (basic topology properties). The work is motivated by practical problems encountered while using generative methods in the art world.


On the stability of harmonic self maps of cohomogeneity one manifolds. The systematic study of harmonic self maps on cohomogeneity one manifolds has recently been initiated by P "uttmann and the second named author in cite MR4000241 . In this article we investigate the corresponding Jacobi equation describing the stability of such harmonic self maps. Besides several general statements concerning their stability we explicitly solve the Jacobi equation for some harmonic self maps in the cases of spheres, special orthogonal groups and SU(3) . In particular, we show by an explicit calculation that for specific cohomogeneity one actions on the sphere the identity map is stable.


Sequence to General Tree Knowledge Guided Geometry Word Problem Solving. With the recent advancements in deep learning, neural solvers have gained promising results in solving math word problems. However, these SOTA solvers only generate binary expression trees that contain basic arithmetic operators and do not explicitly use the math formulas. As a result, the expression trees they produce are lengthy and uninterpretable because they need to use multiple operators and constants to represent one single formula. In this paper, we propose sequence to general tree (S2G) that learns to generate interpretable and executable operation trees where the nodes can be formulas with an arbitrary number of arguments. With nodes now allowed to be formulas, S2G can learn to incorporate mathematical domain knowledge into problem solving, making the results more interpretable. Experiments show that S2G can achieve a better performance against strong baselines on problems that require domain knowledge.


Non uniqueness in law of three dimensional Navier Stokes equations diffused via a fractional Laplacian with power less than one half. Non uniqueness of three dimensional Euler equations and Navier Stokes equations forced by random noise, path wise and more recently even in law, have been proven by various authors. We prove non uniqueness in law of the three dimensional Navier Stokes equations forced by random noise and diffused via a fractional Laplacian that has power between zero and one half. The solution we construct has H ddot mathrm o lder regularity with a small exponent rather than Sobolev regularity with a small exponent. For the power sufficiently small, the non uniqueness in law holds at the level of Leray Hopf regularity. In particular, in order to handle transport error, we consider phase functions convected by not only a mollified velocity field but a sum of that with a mollified Ornstein Uhlenbeck process if noise is additive and a product of that with a mollified exponential Brownian motion if noise is multiplicative.


Graphs with prescribed radius, diameter, and center. Among other things, it is shown that for every pair of positive integers r , d , satisfying 1 r d leq 2r , and every finite simple graph H, there is a connected graph G with diameter d , radius r , and center H.


Analysis of GraphSum's Attention Weights to Improve the Explainability of Multi Document Summarization. Modern multi document summarization (MDS) methods are based on transformer architectures. They generate state of the art summaries, but lack explainability. We focus on graph based transformer models for MDS as they gained recent popularity. We aim to improve the explainability of the graph based MDS by analyzing their attention weights. In a graph based MDS such as GraphSum, vertices represent the textual units, while the edges form some similarity graph over the units. We compare GraphSum's performance utilizing different textual units, i. e., sentences versus paragraphs, on two news benchmark datasets, namely WikiSum and MultiNews. Our experiments show that paragraph level representations provide the best summarization performance. Thus, we subsequently focus oAnalysisn analyzing the paragraph level attention weights of GraphSum's multi heads and decoding layers in order to improve the explainability of a transformer based MDS model. As a reference metric, we calculate the ROUGE scores between the input paragraphs and each sentence in the generated summary, which indicate source origin information via text similarity. We observe a high correlation between the attention weights and this reference metric, especially on the the later decoding layers of the transformer architecture. Finally, we investigate if the generated summaries follow a pattern of positional bias by extracting which paragraph provided the most information for each generated summary. Our results show that there is a high correlation between the position in the summary and the source origin.


An Empirical Investigation of Multi bridge Multilingual NMT models. In this paper, we present an extensive investigation of multi bridge, many to many multilingual NMT models (MB M2M) ie., models trained on non English language pairs in addition to English centric language pairs. In addition to validating previous work which shows that MB M2M models can overcome zeroshot translation problems, our analysis reveals the following results about multibridge models (1) it is possible to extract a reasonable amount of parallel corpora between non English languages for low resource languages (2) with limited non English centric data, MB M2M models are competitive with or outperform pivot models, (3) MB M2M models can outperform English Any models and perform at par with Any English models, so a single multilingual NMT system can serve all translation directions.


Towards optimal quality requirement documentation in agile software development a multiple case study. Context Agile software development (ASD) promotes minimal documentation and often prioritizes functional requirements over quality requirements (QRs). The minimal documentation emphasis may be beneficial in reducing time to market for software. However, it can also be a concern, especially with QRs, since they are challenging to specify and document and are crucial for software success. Therefore, understanding how practitioners perceive the importance of QR documentation is valuable because it can provide insight into how they approach this task. It also helps in developing models and guidelines that support the documentation of QRs in ASD, which is a research gap. Objective We aim to understand practitioners' perceptions of QR documentation and factors influencing this task to derive a model that supports optimal QR documentation in ASD. Method We conducted a multiple case study involving 12 participants from three cases that apply ASD. Please refer to the document to read the full version of the abstract.


Explicit blowing up solutions for a higher order parabolic equation with Hessian nonlinearity. In this work we consider a nonlinear parabolic higher order partial differential equation that has been proposed as a model for epitaxial growth. This equation possesses both global in time solutions and solutions that blow up in finite time, where this blow up is mediated by its Hessian nonlinearity. Herein we further analyze its blow up behaviour by building explicit solutions in the square, the disc, and the plane. Some of these solutions show complete blow up either in finite or infinite time. Finally, we refine a blow up criterium that has been proven for this evolution equation. Still, existent blow up criteria based on a priori estimates do not reflect the singular character of these explicit blowing up solutions.


On the existence and temporal asymptotics of solutions for the two and half dimensional Hall MHD. In this paper, we deal with the 2 frac 1 2 dimensional Hall MHD by taking the velocity field u and the magnetic field B of the form u(t,x,y) left( nabla perp phi(t,x,y), W(t,x,y) right) and B(t,x,y) left( nabla perp psi(t,x,y), Z(t,x,y) right) . We begin with the Hall equations (without the effect of the fluid part). We first show the long time behavior of weak solutions and weak strong uniqueness. We then proceed to prove the existence of unique strong solutions locally in time and to derive a blow up criterion. We also demonstrate that the strong solution exists globally in time and decay algebraically if some smallness conditions are imposed. We further improve the decay rates of psi using the structure of the equation of psi . As a consequence of the decay rates of ( psi,Z) , we find the asymptotic profiles of ( psi,Z) . We finally show that a small perturbation of initial data near zero can be extended to a small perturbations near harmonic functions. In the presence of the fluid filed, the results, by comparison, fall short of the previous ones in the absence of the fluid part. We prove two results the existence of unique strong solutions locally in time and a blow up criterion, and the existence of unique strong solutions globally in time with some smallness condition on initial data.


Rationales for Sequential Predictions. Sequence models are a critical component of modern NLP systems, but their predictions are difficult to explain. We consider model explanations though rationales, subsets of context that can explain individual model predictions. We find sequential rationales by solving a combinatorial optimization the best rationale is the smallest subset of input tokens that would predict the same output as the full sequence. Enumerating all subsets is intractable, so we propose an efficient greedy algorithm to approximate this objective. The algorithm, which is called greedy rationalization, applies to any model. For this approach to be effective, the model should form compatible conditional distributions when making predictions on incomplete subsets of the context. This condition can be enforced with a short fine tuning step. We study greedy rationalization on language modeling and machine translation. Compared to existing baselines, greedy rationalization is best at optimizing the combinatorial objective and provides the most faithful rationales. On a new dataset of annotated sequential rationales, greedy rationales are most similar to human rationales.


A Multi objective Evolutionary Algorithm for EEG Inverse Problem. In this paper, we proposed a multi objective approach for the EEG Inverse Problem. This formulation does not need unknown parameters that involve empirical procedures. Due to the combinatorial characteristics of the problem, this alternative included evolutionary strategies to resolve it. The result is a Multi objective Evolutionary Algorithm based on Anatomical Restrictions (MOEAAR) to estimate distributed solutions. The comparative tests were between this approach and 3 classic methods of regularization LASSO, Ridge L and ENET L. In the experimental phase, regression models were selected to obtain sparse and distributed solutions. The analysis involved simulated data with different signal to noise ratio (SNR). The indicators for quality control were Localization Error, Spatial Resolution and Visibility. The MOEAAR evidenced better stability than the classic methods in the reconstruction and localization of the maximum activation. The norm L0 was used to estimate sparse solutions with the evolutionary approach and its results were relevant.


Energy and flux budget closure theory for passive scalar in stably stratified turbulence. The energy and flux budget (EFB) closure theory for a passive scalar (non buoyant and non inertial particles or gaseous admixtures) is developed for stably stratified turbulence. The physical background of the EFB turbulence closures is based on the budget equations for the turbulent kinetic and potential energies and turbulent fluxes of momentum and buoyancy, as well as the turbulent flux of particles. The EFB turbulence closure is designed for stratified geophysical flows from neutral to very stable stratification and it implies that turbulence is maintained by the velocity shear at any stratification. In a steady state, expressions for the turbulent flux of passive scalar and the anisotropic non symmetric turbulent diffusion tensor are derived, and universal flux Richardson number dependencies of the components of this tensor are obtained. The diagonal component in the vertical direction of the turbulent diffusion tensor is suppressed by strong stratification, while the diagonal components in the horizontal directions are not suppressed, and they are dominant in comparison with the other components of turbulent diffusion tensor. This implies that any initially created strongly inhomogeneous particle cloud is evolved into a thin pancake in horizontal plane with very slow increase of its thickness in the vertical direction. The turbulent Schmidt number increases linearly with the gradient Richardson number. Considering the applications of these results to the atmospheric boundary layer turbulence, the theoretical relationships are derived which allow to determine the turbulent diffusion tensor as a function of the vertical coordinate measured in the units of the local Obukhov length scale. The obtained relations are potentially useful in modelling applications of particle dispersion in the atmospheric boundary layer turbulence and free atmosphere turbulence.


Mono2Micro A Practical and Effective Tool for Decomposing Monolithic Java Applications to Microservices. In migrating production workloads to cloud, enterprises often face the daunting task of evolving monolithic applications toward a microservice architecture. At IBM, we developed a tool called Mono2Micro to assist with this challenging task. Mono2Micro performs spatio temporal decomposition, leveraging well defined business use cases and runtime call relations to create functionally cohesive partitioning of application classes. Our preliminary evaluation of Mono2Micro showed promising results. How well does Mono2Micro perform against other decomposition techniques, and how do practitioners perceive the tool? This paper describes the technical foundations of Mono2Micro and presents results to answer these two questions. To answer the first question, we evaluated Mono2Micro against four existing techniques on a set of open source and proprietary Java applications and using different metrics to assess the quality of decomposition and tool's efficiency. Our results show that Mono2Micro significantly outperforms state of the art baselines in specific metrics well defined for the problem domain. To answer the second question, we conducted a survey of twenty one practitioners in various industry roles who have used Mono2Micro. This study highlights several benefits of the tool, interesting practitioner perceptions, and scope for further improvements. Overall, these results show that Mono2Micro can provide a valuable aid to practitioners in creating functionally cohesive and explainable microservice decompositions.


Finding a Needle in a Haystack Tiny Flying Object Detection in 4K Videos using a Joint Detection and Tracking Approach. Detecting tiny objects in a high resolution video is challenging because the visual information is little and unreliable. Specifically, the challenge includes very low resolution of the objects, MPEG artifacts due to compression and a large searching area with many hard negatives. Tracking is equally difficult because of the unreliable appearance, and the unreliable motion estimation. Luckily, we found that by combining this two challenging tasks together, there will be mutual benefits. Following the idea, in this paper, we present a neural network model called the Recurrent Correlational Network, where detection and tracking are jointly performed over a multi frame representation learned through a single, trainable, and end to end network. The framework exploits a convolutional long short term memory network for learning informative appearance changes for detection, while the learned representation is shared in tracking for enhancing its performance. In experiments with datasets containing images of scenes with small flying objects, such as birds and unmanned aerial vehicles, the proposed method yielded consistent improvements in detection performance over deep single frame detectors and existing motion based detectors. Furthermore, our network performs as well as state of the art generic object trackers when it was evaluated as a tracker on a bird image dataset.


Task Level Authoring for Remote Robot Teleoperation. Remote teleoperation of robots can broaden the reach of domain specialists across a wide range of industries such as home maintenance, health care, light manufacturing, and construction. However, current direct control methods are impractical, and existing tools for programming robot remotely have focused on users with significant robotic experience. Extending robot remote programming to end users, i.e., users who are experts in a domain but novices in robotics, requires tools that balance the rich features necessary for complex teleoperation tasks with ease of use. The primary challenge to usability is that novice users are unable to specify complete and robust task plans to allow a robot to perform duties autonomously, particularly in highly variable environments. Our solution is to allow operators to specify shorter sequences of high level commands, which we call task level authoring, to create periods of variable robot autonomy. This approach allows inexperienced users to create robot behaviors in uncertain environments by interleaving exploration, specification of behaviors, and execution as separate steps. End users are able to break down the specification of tasks and adapt to the current needs of the interaction and environments, combining the reactivity of direct control to asynchronous operation. In this paper, we describe a prototype system contextualized in light manufacturing and its empirical validation in a user study where 18 participants with some programming experience were able to perform a variety of complex telemanipulation tasks with little training. Our results show that our approach allowed users to create flexible periods of autonomy and solve rich manipulation tasks. Furthermore, participants significantly preferred our system over comparative more direct interfaces, demonstrating the potential of our approach.


When are symmetric ideals monomial?. We study conditions on polynomials such that the ideal generated by their orbits under the symmetric group action becomes a monomial ideal or has a monomial radical. If the polynomials are homogeneous, we expect that such an ideal has a monomial radical if their coefficients are sufficiently general with respect to their supports. We prove this for instance in the case where some generator contains a power of a variable. Moreover, if the polynomials have only square free terms and their coefficients do not sum to zero, then in a larger polynomial ring the ideal itself is square free monomial. This has implications also for symmetric ideals of the infinite polynomial ring.


Collage Automated Integration of Deep Learning Backends. Strong demands for efficient deployment of Deep Learning (DL) applications prompt the rapid development of a rich DL ecosystem. To keep up with its fast advancement, it is crucial for DL frameworks to efficiently integrate a variety of optimized libraries and runtimes as their backends and generate the fastest possible executable by using them properly. However, current DL frameworks require significant manual effort to integrate diverse backends and often fail to deliver high performance. In this paper, we propose Collage, an automatic framework for integrating DL backends. Collage provides a backend registration interface that allows users to precisely specify the capability of various backends. By leveraging the specifications of available backends, Collage searches for an optimized backend placement for a given workload and execution environment. Our evaluation shows that Collage automatically integrates multiple backends together without manual intervention, and outperforms existing frameworks by 1.21x, 1.39x, 1.40x on two different NVIDIA GPUs and an Intel CPU respectively.


S unit values of G n G m in function fields. In this paper we consider a simple linear recurrence sequence G n defined over a function field in one variable over the field of complex numbers. We prove an upper bound on the indices n and m such that G n G m is an S unit. This is a function field analogue of already known results in number fields.


Addressing Inherent Uncertainty Risk Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning. For highly automated driving above SAE level 3, behavior generation algorithms must reliably consider the inherent uncertainties of the traffic environment, e.g. arising from the variety of human driving styles. Such uncertainties can generate ambiguous decisions, requiring the algorithm to appropriately balance low probability hazardous events, e.g. collisions, and high probability beneficial events, e.g. quickly crossing the intersection. State of the art behavior generation algorithms lack a distributional treatment of decision outcome. This impedes a proper risk evaluation in ambiguous situations, often encouraging either unsafe or conservative behavior. Thus, we propose a two step approach for risk sensitive behavior generation combining offline distribution learning with online risk assessment. Specifically, we first learn an optimal policy in an uncertain environment with Deep Distributional Reinforcement Learning. During execution, the optimal risk sensitive action is selected by applying established risk criteria, such as the Conditional Value at Risk, to the learned state action return distributions. In intersection crossing scenarios, we evaluate different risk criteria and demonstrate that our approach increases safety, while maintaining an active driving style. Our approach shall encourage further studies about the benefits of risk sensitive approaches for self driving vehicles.


Large Scale Algebraic Riccati Equations with High Rank Nonlinear Terms and Constant Terms. For large scale discrete time algebraic Riccati equations (DAREs) with high rank nonlinear and constant terms, the stabilizing solutions are no longer numerically low rank, resulting in the obstacle in the computation and storage. However, in some proper control problems such as power systems, the potential structure of the state matrix banded plus low rank, might make the large scale computation essentially workable. In this paper, a factorized structure preserving doubling algorithm (FSDA) is developed under the frame of the banded inverse of nonlinear and constant terms. The detailed iterations format, as well as a deflation process of FSDA, are analyzed in detail. A partial truncation and compression technique is introduced to shrink the dimension of columns of low rank factors as much as possible. The computation of residual, together with the termination condition of the structured version, is also redesigned.


Geometry Entangled Visual Semantic Transformer for Image Captioning. Recent advancements of image captioning have featured Visual Semantic Fusion or Geometry Aid attention refinement. However, those fusion based models, they are still criticized for the lack of geometry information for inter and intra attention refinement. On the other side, models based on Geometry Aid attention still suffer from the modality gap between visual and semantic information. In this paper, we introduce a novel Geometry Entangled Visual Semantic Transformer (GEVST) network to realize the complementary advantages of Visual Semantic Fusion and Geometry Aid attention refinement. Concretely, a Dense Cap model proposes some dense captions with corresponding geometry information at first. Then, to empower GEVST with the ability to bridge the modality gap among visual and semantic information, we build four parallel transformer encoders VV(Pure Visual), VS(Semantic fused to Visual), SV(Visual fused to Semantic), SS(Pure Semantic) for final caption generation. Both visual and semantic geometry features are used in the Fusion module and also the Self Attention module for better attention measurement. To validate our model, we conduct extensive experiments on the MS COCO dataset, the experimental results show that our GEVST model can obtain promising performance gains.


Twitter User Representation Using Weakly Supervised Graph Embedding. Social media platforms provide convenient means for users to participate in multiple online activities on various contents and create fast widespread interactions. However, this rapidly growing access has also increased the diverse information, and characterizing user types to understand people's lifestyle decisions shared in social media is challenging. In this paper, we propose a weakly supervised graph embedding based framework for understanding user types. We evaluate the user embedding learned using weak supervision over well being related tweets from Twitter, focusing on 'Yoga', 'Keto diet'. Experiments on real world datasets demonstrate that the proposed framework outperforms the baselines for detecting user types. Finally, we illustrate data analysis on different types of users (e.g., practitioner vs. promotional) from our dataset. While we focus on lifestyle related tweets (i.e., yoga, keto), our method for constructing user representation readily generalizes to other domains.


BASS Boosting Abstractive Summarization with Unified Semantic Graph. Abstractive summarization for long document or multi document remains challenging for the Seq2Seq architecture, as Seq2Seq is not good at analyzing long distance relations in text. In this paper, we present BASS, a novel framework for Boosting Abstractive Summarization based on a unified Semantic graph, which aggregates co referent phrases distributing across a long range of context and conveys rich relations between phrases. Further, a graph based encoder decoder model is proposed to improve both the document representation and summary generation process by leveraging the graph structure. Specifically, several graph augmentation methods are designed to encode both the explicit and implicit relations in the text while the graph propagation attention mechanism is developed in the decoder to select salient content into the summary. Empirical results show that the proposed architecture brings substantial improvements for both long document and multi document summarization tasks.


Robust Place Recognition using an Imaging Lidar. We propose a methodology for robust, real time place recognition using an imaging lidar, which yields image quality high resolution 3D point clouds. Utilizing the intensity readings of an imaging lidar, we project the point cloud and obtain an intensity image. ORB feature descriptors are extracted from the image and encoded into a bag of words vector. The vector, used to identify the point cloud, is inserted into a database that is maintained by DBoW for fast place recognition queries. The returned candidate is further validated by matching visual feature descriptors. To reject matching outliers, we apply PnP, which minimizes the reprojection error of visual features' positions in Euclidean space with their correspondences in 2D image space, using RANSAC. Combining the advantages from both camera and lidar based place recognition approaches, our method is truly rotation invariant, and can tackle reverse revisiting and upside down revisiting. The proposed method is evaluated on datasets gathered from a variety of platforms over different scales and environments. Our implementation and datasets are available at https git.io image lidar


Lambek pregroups are Frobenius spiders in preorders. "Spider" is a nickname of special Frobenius algebras, a fundamental structure from mathematics, physics, and computer science. Pregroups are a fundamental structure from linguistics. Pregroups and spiders have been used together in natural language processing one for syntax, the other for semantics. It turns out that pregroups themselves can be characterized as pointed spiders in the category of preordered relations, where they naturally arise from grammars. The other way around, preordered spider algebras in general can be characterized as unions of pregroups. This extends the characterization of relational spider algebras as disjoint unions of groups. The compositional framework that emerged with the results suggests new ways to understand and apply the basis structures in machine learning and data analysis.


Linear optical properties of a linear chain of interacting gold nanoparticles. In a Drude like model for the conduction electrons of Metal Nanoparticles (MNPs) in a periodic linear chain, considering dipole dipole interactions of adjacent particles, an analytical expression is derived for each particle permittivity for two different polarizations of incident light parallel with and perpendicular to the chain line. A numerical analysis is carried out for a chain including 10 identical gold Nanoparticles (NPs) for two different sizes of NPs and two different host media of air and glass. It is shown that in the parallel case of polarization, interaction of NPs leads to a substantial increase in the extinction cross section and the red shift of the Surface Plasmon Resonance (SPR) wavelength. In comparison with the linear properties of a single NP, the second and penultimate particles have the most increase in the extinction cross section and SPR wavelength displacement while the first and last particles experience the least variations due to the mutual interactions. For the perpendicular polarization, inversely, the dipolar coupling causes the decrease in extinction cross section of all particles and the blue shift of SPR wavelength. For the parallel polarization, the absolute values of the real and imaginary parts of complex permittivity of each MNP decrease in comparison with the single particle case while they increase for the perpendicular state of polarization.


Video Similarity and Alignment Learning on Partial Video Copy Detection. Existing video copy detection methods generally measure video similarity based on spatial similarities between key frames, neglecting the latent similarity in temporal dimension, so that the video similarity is biased towards spatial information. There are methods modeling unified video similarity in an end to end way, but losing detailed partial alignment information, which causes the incapability of copy segments localization. To address the above issues, we propose the Video Similarity and Alignment Learning (VSAL) approach, which jointly models spatial similarity, temporal similarity and partial alignment. To mitigate the spatial similarity bias, we model the temporal similarity as the mask map predicted from frame level spatial similarity, where each element indicates the probability of frame pair lying right on the partial alignments. To further localize partial copies, the step map is learned from the spatial similarity where the elements indicate extending directions of the current partial alignments on the spatial temporal similarity map. Obtained from the mask map, the start points extend out into partial optimal alignments following instructions of the step map. With the similarity and alignment learning strategy, VSAL achieves the state of the art F1 score on VCDB core dataset. Furthermore, we construct a new benchmark of partial video copy detection and localization by adding new segment level annotations for FIVR 200k dataset, where VSAL also achieves the best performance, verifying its effectiveness in more challenging situations. Our project is publicly available at https pvcd vsal.github.io vsal .


Non invasive hemodynamic analysis for aortic regurgitation using computational fluid dynamics and deep learning. Changes in cardiovascular hemodynamics are closely related to the development of aortic regurgitation, a type of valvular heart disease. Metrics derived from blood flows are used to indicate aortic regurgitation onset and evaluate its severity. These metrics can be non invasively obtained using four dimensional (4D) flow magnetic resonance imaging (MRI), where accuracy is primarily dependent on spatial resolution. However, insufficient resolution often results from limitations in 4D flow MRI and complex aortic regurgitation hemodynamics. To address this, computational fluid dynamics simulations were transformed into synthetic 4D flow MRI data and used to train a variety of neural networks. These networks generated super resolution, full field phase images with an upsample factor of 4. Results showed decreased velocity error, high structural similarity scores, and improved learning capabilities from previous work. Further validation was performed on two sets of in vivo 4D flow MRI data and demonstrated success in de noising flow images. This approach presents an opportunity to comprehensively analyse aortic regurgitation hemodynamics in a non invasive manner.


Early Detection of Security Relevant Bug Reports using Machine Learning How Far Are We?. Bug reports are common artefacts in software development. They serve as the main channel for users to communicate to developers information about the issues that they encounter when using released versions of software programs. In the descriptions of issues, however, a user may, intentionally or not, expose a vulnerability. In a typical maintenance scenario, such security relevant bug reports are prioritised by the development team when preparing corrective patches. Nevertheless, when security relevance is not immediately expressed (e.g., via a tag) or rapidly identified by triaging teams, the open security relevant bug report can become a critical leak of sensitive information that attackers can leverage to perform zero day attacks. To support practitioners in triaging bug reports, the research community has proposed a number of approaches for the detection of security relevant bug reports. In recent years, approaches in this respect based on machine learning have been reported with promising performance. Our work focuses on such approaches, and revisits their building blocks to provide a comprehensive view on the current achievements. To that end, we built a large experimental dataset and performed extensive experiments with variations in feature sets and learning algorithms. Eventually, our study highlights different approach configurations that yield best performing classifiers.


Optimization Helps Scheduling Nursing Staff at the Long Term Care Homes of the City of Toronto. The City of Toronto Long Term Care Homes Services (LTCH S) division is one of the largest providers of long term care in the Canadian province of Ontario, providing care to 2,640 residents at 10 homes across Toronto. Our collaboration with LTCH S was initiated to facilitate the increasingly challenging task of scheduling nursing staff and reduce high absenteeism rate observed among the part time nurses. We developed a spreadsheet based scheduling tool to automate the generation of schedules and incorporate nurses' preferences for different shifts into the schedules. At the core of the scheduling tool is a hierarchical optimization model that generates a feasible schedule with the highest total preference score while satisfying the maximum possible demand. Feasible schedules had to abide by a set of complex seniority requirements which prioritized more senior nurses when allocating the available shifts. Our scheduling tool was implemented in a 391 bed home in Toronto. The tool allowed nursing managers to generate feasible schedules within a fraction of an hour, in contrast to the status quo manual approach which could took up to tens of hours. In addition, the schedules successfully accounted for preferences with on average above 94 of the allocated shifts ranked as most preferred.


Representation Learning via Consistent Assignment of Views to Clusters. We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self supervised contrastive learning and deep clustering. By viewing contrastive learning from a clustering perspective, CARL learns unsupervised representations by learning a set of general prototypes that serve as energy anchors to enforce different views of a given image to be assigned to the same prototype. Unlike contemporary work on contrastive learning with deep clustering, CARL proposes to learn the set of general prototypes in an online fashion, using gradient descent without the necessity of using non differentiable algorithms or K Means to solve the cluster assignment problem. CARL surpasses its competitors in many representations learning benchmarks, including linear evaluation, semi supervised learning, and transfer learning.


Earth Observation and the New African Rural Datascapes Defining an Agenda for Critical Research. The increasing availability of Earth Observation data could transform the use and governance of African rural landscapes, with major implications for the livelihoods and wellbeing of people living in those landscapes. Recent years have seen a rapid increase in the development of EO data applications targeted at stakeholders in African agricultural systems. But there is still relatively little critical scholarship questioning how EO data are accessed, presented, disseminated and used in different socio political contexts, or of whether this increases or decreases the wellbeing of poorer and marginalized peoples. We highlight three neglected areas in existing EO for development research (i) the imaginaries of 'ideal' future landscapes informing deployments of EO data (ii) how power relationships in larger EO for development networks shape the distribution of costs and benefits and (iii) how these larger scale political dynamics interact with local scale inequalities to influence the resilience of marginalised peoples. We then propose a framework for critical EO for development research drawing on recent thinking in critical data studies, ICT4D and political ecology.


Generating Dataset For Large scale 3D Facial Emotion Recognition. The tremendous development in deep learning has led facial expression recognition (FER) to receive much attention in the past few years. Although 3D FER has an inherent edge over its 2D counterpart, work on 2D images has dominated the field. The main reason for the slow development of 3D FER is the unavailability of large training and large test datasets. Recognition accuracies have already saturated on existing 3D emotion recognition datasets due to their small gallery sizes. Unlike 2D photographs, 3D facial scans are not easy to collect, causing a bottleneck in the development of deep 3D FER networks and datasets. In this work, we propose a method for generating a large dataset of 3D faces with labeled emotions. We also develop a deep convolutional neural network(CNN) for 3D FER trained on 624,000 3D facial scans. The test data comprises 208,000 3D facial scans.


A Self Guided Approach for Navigation in a Minimalistic Foraging Robotic Swarm. We present a biologically inspired design for swarm foraging based on ant's pheromone deployment, where the swarm is assumed to have very restricted capabilities. The robots do not require global or relative position measurements and the swarm is fully decentralized and needs no infrastructure in place. Additionally, the system only requires one hop communication over the robot network, we do not make any assumptions about the connectivity of the communication graph and the transmission of information and computation is scalable versus the number of agents. This is done by letting the agents in the swarm act as foragers or as guiding agents (beacons). We present experimental results computed for a swarm of Elisa 3 robots on a simulator, and show how the swarm self organizes to solve a foraging problem over an unknown environment, converging to trajectories around the shortest path. At last, we discuss the limitations of such a system and propose how the foraging efficiency can be increased.


On the mechanism of ionization oscillations in Hall thrusters. Low frequency ionization oscillations involving plasma and neutral density (breathing modes) are the most violent perturbations in Hall thrusters for electric propulsion. Because of its simplicity, the zero dimensional (0 D) predator prey model of two nonlinearly coupled ordinary differential equations for plasma and neutral density has been often used for the characterization of such oscillations and scaling estimates. We investigate the properties of its continuum analog, the one dimensional (1 D) system of two nonlinearly coupled equations in partial derivatives (PDE) for plasma and neutral density. This is a more general model, of which the standard 0 D predator prey model is a special limit case. We show that the 1 D model is stable and does not show any oscillations for the boundary conditions relevant to Hall thruster and the uniform ion velocity. We then propose a reduced 1 D model based on two coupled PDE for plasma and neutral densities that is unstable and exhibit oscillations if the ion velocity profile with the near the anode back flow (toward the anode) region is used. Comparisons of the reduced model with the predictions of the full model that takes into account the self consistent plasma response show that the main properties of the breathing mode are well captured. In particular, it is shown that the frequency of the breathing mode oscillations is weakly dependent on the final ion velocity but shows a strong correlation with the width of the ion back flow region.


A short note on the counting complexity of conjunctive queries. This note closes a minor gap in the literature on the counting complexity of conjunctive queries by showing that queries that are not free connex do not have a linear time counting algorithm under standard complexity assumptions. More generally, it is shown that the so called quantified star size is a lower bound for the exponent in the runtime of any counting algorithm for conjunctive queries.


Wireless Communication with Extremely Large Scale Intelligent Reflecting Surface. Intelligent reflecting surface (IRS) is a promising technology for wireless communications, thanks to its potential capability to engineer the radio environment. However, in practice, such an envisaged benefit is attainable only when the passive IRS is of a sufficiently large size, for which the conventional uniform plane wave (UPW) based channel model may become inaccurate. In this paper, we pursue a new channel modelling and performance analysis for wireless communications with extremely large scale IRS (XL IRS). By taking into account the variations in signal's amplitude and projected aperture across different reflecting elements, we derive both lower and upper bounds of the received signal to noise ratio (SNR) for the general uniform planar array (UPA) based XL IRS. Our results reveal that, instead of scaling quadratically with the increased number of reflecting elements M as in the conventional UPW model, the SNR under the more practically applicable non UPW model increases with M only with a diminishing return and gets saturated eventually. To gain more insights, we further study the special case of uniform linear array (ULA) based XL IRS, for which a closed form SNR expression in terms of the IRS size and transmitter receiver location is derived. This result shows that the SNR mainly depends on the two geometric angles formed by the transmitter receiver locations with the IRS, as well as the boundary points of the IRS. Numerical results validate our analysis and demonstrate the importance of proper channel modelling for wireless communications aided by XL IRS.


Local Monodromy of 1 Dimensional p Divisible Groups. Let G be a p divisible group over a complete discrete valuation ring R of characteristic p . The generic fiber of G determines a Galois representation rho . The image of rho admits a ramification filtration and a Lie filtration. We relate these filtrations in the case G is one dimensional, giving an equicharacteristic version of Sen's theorem in this setting. This result generalizes results of Gross and Chai. Additionally, we prove that the representation associated to the 'etale part of G is irreducible.