Scheduling Applications on Containers Based on Dependency of The Applications. Cloud computing technology has been one of the most critical developments in provisioning both hardware and software infrastructure in recent years. Container technology is a new cloud technology that boosts the booting of applications, increases the ability to deploy applications on containers and improves the host machine resource sharing. Thus, enhancing a cloud container system needs a robust algorithm that deploys the applications efficiently. Most of the schedulers associated with container technology are focused on load balancing for increasing container performance. The traffic over networks plays a significant role in the performance of containers. Container deployment considering only load balancing may not be the best scheduling strategy due to the dependency between the applications that might be deployed in different pods (zones) in the container's cloud. This project aims to develop an algorithm that deploys applications into containers by considering the dependencies between applications as well as load balancing. The proposed algorithm performs better in terms of improving the throughput and reducing the network traffic as compared to state of the art container scheduling algorithms.


Lipschitz retractions and complementation properties of Banach spaces. In the present paper we introduce and study the Lipschitz retractional structure of metric spaces. This topic was motivated by the analogous projectional structure of Banach spaces, a topic that has been thoroughly investigated. The more general metric setting fits well with the currently active theory of Lipschitz free spaces and spaces of Lipschitz functions. Among our applications we show that the Lipschitz free space mathcal F (X) is a Plichko space whenever X is a Plichko Banach space. Our main results include two examples of metric spaces. The first one M contains two points 0,1 such that no separable subset of M containing these points is a Lipschitz retract of M . The second example fails the analogous property for arbitrary infinite density. Finally, we introduce the metric version of the concept of locally complemented Banach subspace, and prove some metric analogues to the linear theory.


Tiny CNN for feature point description for document analysis approach and dataset. In this paper, we study the problem of feature points description in the context of document analysis and template matching. Our study shows that the specific training data is required for the task especially if we are to train a lightweight neural network that will be usable on devices with limited computational resources. In this paper, we construct and provide a dataset with a method of training patches retrieval. We prove the effectiveness of this data by training a lightweight neural network and show how it performs in both documents and general patches matching. The training was done on the provided dataset in comparison with HPatches training dataset and for the testing we use HPatches testing framework and two publicly available datasets with various documents pictured on complex backgrounds MIDV 500 and MIDV 2019.


Greedy Hierarchical Variational Autoencoders for Large Scale Video Prediction. A video prediction model that generalizes to diverse scenes would enable intelligent agents such as robots to perform a variety of tasks via planning with the model. However, while existing video prediction models have produced promising results on small datasets, they suffer from severe underfitting when trained on large and diverse datasets. To address this underfitting challenge, we first observe that the ability to train larger video prediction models is often bottlenecked by the memory constraints of GPUs or TPUs. In parallel, deep hierarchical latent variable models can produce higher quality predictions by capturing the multi level stochasticity of future observations, but end to end optimization of such models is notably difficult. Our key insight is that greedy and modular optimization of hierarchical autoencoders can simultaneously address both the memory constraints and the optimization challenges of large scale video prediction. We introduce Greedy Hierarchical Variational Autoencoders (GHVAEs), a method that learns high fidelity video predictions by greedily training each level of a hierarchical autoencoder. In comparison to state of the art models, GHVAEs provide 17 55 gains in prediction performance on four video datasets, a 35 40 higher success rate on real robot tasks, and can improve performance monotonically by simply adding more modules.


Variations on the Post Correspondence Problem for free groups. The Post Correspondence Problem is a classical decision problem about equalisers of free monoid homomorphisms. We prove connections between several variations of this classical problem, but in the setting of free groups and free group homomorphisms. Among other results, and working under certain injectivity assumptions, we prove that computing the rank of the equaliser of a pair of free group homomorphisms can be applied to computing a basis of this equaliser, and also to solve the "generalised" Post Correspondence Problem for free groups.


Equivariant message passing for the prediction of tensorial properties and molecular spectra. Message passing neural networks have become a method of choice for learning on graphs, in particular the prediction of chemical properties and the acceleration of molecular dynamics studies. While they readily scale to large training data sets, previous approaches have proven to be less data efficient than kernel methods. We identify limitations of invariant representations as a major reason and extend the message passing formulation to rotationally equivariant representations. On this basis, we propose the polarizable atom interaction neural network (PaiNN) and improve on common molecule benchmarks over previous networks, while reducing model size and inference time. We leverage the equivariant atomwise representations obtained by PaiNN for the prediction of tensorial properties. Finally, we apply this to the simulation of molecular spectra, achieving speedups of 4 5 orders of magnitude compared to the electronic structure reference.


A Multi Task Learning Framework for COVID 19 Monitoring and Prediction of PPE Demand in Community Health Centres. Currently, the world seeks to find appropriate mitigation techniques to control and prevent the spread of the new SARS CoV 2. In our paper herein, we present a peculiar Multi Task Learning framework that jointly predicts the effect of SARS CoV 2 as well as Personal Protective Equipment consumption in Community Health Centres for a given populace. Predicting the effect of the virus (SARS CoV 2), via studies and analyses, enables us to understand the nature of SARS CoV 2 with reference to factors that promote its growth and spread. Therefore, these foster widespread awareness and the populace can become more proactive and cautious so as to mitigate the spread of Corona Virus Disease 2019 (COVID 19). Furthermore, understanding and predicting the demand for Personal Protective Equipment promotes the efficiency and safety of healthcare workers in Community Health Centres. Owing to the novel nature and strains of SARS CoV 2, relatively few literature and research exist in this regard. These existing literature have attempted to solve the problem statement(s) using either Agent based Models, Machine Learning Models, or Mathematical Models. In view of this, our work herein adds to existing literature via modeling our problem statements as Multi Task Learning problems. Results from our research indicate that government actions and human factors are the most significant determinants that influence the spread of SARS CoV 2.


Towards Robust Neural Retrieval Models with Synthetic Pre Training. Recent work has shown that commonly available machine reading comprehension (MRC) datasets can be used to train high performance neural information retrieval (IR) systems. However, the evaluation of neural IR has so far been limited to standard supervised learning settings, where they have outperformed traditional term matching baselines. We conduct in domain and out of domain evaluations of neural IR, and seek to improve its robustness across different scenarios, including zero shot settings. We show that synthetic training examples generated using a sequence to sequence generator can be effective towards this goal in our experiments, pre training with synthetic examples improves retrieval performance in both in domain and out of domain evaluation on five different test sets.


A Framework for Real time Traffic Trajectory Tracking, Speed Estimation, and Driver Behavior Calibration at Urban Intersections Using Virtual Traffic Lanes. In a previous study, we presented VT Lane, a three step framework for real time vehicle detection, tracking, and turn movement classification at urban intersections. In this study, we present a case study incorporating the highly accurate trajectories and movement classification obtained via VT Lane for the purpose of speed estimation and driver behavior calibration for traffic at urban intersections. First, we use a highly instrumented vehicle to verify the estimated speeds obtained from video inference. The results of the speed validation show that our method can estimate the average travel speed of detected vehicles in real time with an error of 0.19 m sec, which is equivalent to 2 of the average observed travel speeds in the intersection of the study. Instantaneous speeds (at the resolution of 30 Hz) were found to be estimated with an average error of 0.21 m sec and 0.86 m sec respectively for free flowing and congested traffic conditions. We then use the estimated speeds to calibrate the parameters of a driver behavior model for the vehicles in the area of study. The results show that the calibrated model replicates the driving behavior with an average error of 0.45 m sec, indicating the high potential for using this framework for automated, large scale calibration of car following models from roadside traffic video data, which can lead to substantial improvements in traffic modeling via microscopic simulation.


Grant Free MIMO NOMA with Differential Modulation for Machine Type Communications. This paper considers a challenging scenario of machine type communications, where we assume internet of things (IoT) devices send short packets sporadically to an access point (AP) and the devices are not synchronized in the packet level. High transmission efficiency and low latency are concerned. Motivated by the great potential of multiple input multiple output non orthogonal multiple access (MIMO NOMA) in massive access, we design a grant free MIMO NOMA scheme, and in particular differential modulation is used so that expensive channel estimation at the receiver (AP) can be bypassed. The receiver at AP needs to carry out active device detection and multi device data detection. The active user detection is formulated as the estimation of the common support of sparse signals, and a message passing based sparse Bayesian learning (SBL) algorithm is designed to solve the problem. Due to the use of differential modulation, we investigate the problem of non coherent multi device data detection, and develop a message passing based Bayesian data detector, where the constraint of differential modulation is exploited to drastically improve the detection performance, compared to the conventional non coherent detection scheme. Simulation results demonstrate the effectiveness of the proposed active device detector and non coherent multi device data detector.


Learning Spatial and Spatio Temporal Pixel Aggregations for Image and Video Denoising. Existing denoising methods typically restore clear results by aggregating pixels from the noisy input. Instead of relying on hand crafted aggregation schemes, we propose to explicitly learn this process with deep neural networks. We present a spatial pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising. The proposed model naturally adapts to image structures and can effectively improve the denoised results. Furthermore, we develop a spatio temporal pixel aggregation network for video denoising to efficiently sample pixels across the spatio temporal space. Our method is able to solve the misalignment issues caused by large motion in dynamic scenes. In addition, we introduce a new regularization term for effectively training the proposed video denoising model. We present extensive analysis of the proposed method and demonstrate that our model performs favorably against the state of the art image and video denoising approaches on both synthetic and real world data.


Solving Challenging Control Problems Using Two Staged Deep Reinforcement Learning. We present a two staged deep reinforcement learning algorithm for solving challenging control problems. Deep reinforcement learning (deep RL) has been an effective tool for solving many high dimensional continuous control problems, but it cannot effectively solve challenging problems with certain properties, such as sparse reward functions or sensitive dynamics. In this work, we propose an approach that decomposes the given problem into two stages motion planning and motion imitation. The motion planning stage seeks to compute a feasible motion plan with approximated dynamics by directly sampling the state space rather than exploring random control signals. Once the motion plan is obtained, the motion imitation stage learns a control policy that can imitate the given motion plan with realistic sensors and actuations. We demonstrate that our approach can solve challenging control problems rocket navigation and quadrupedal locomotion which cannot be solved by the standard MDP formulation. The supplemental video can be found at https youtu.be FYLo1Ov 8 g


Personalized next best action recommendation with multi party interaction learning for automated decision making. Automated next best action recommendation for each customer in a sequential, dynamic and interactive context has been widely needed in natural, social and business decision making. Personalized next best action recommendation must involve past, current and future customer demographics and circumstances (states) and behaviors, long range sequential interactions between customers and decision makers, multi sequence interactions between states, behaviors and actions, and their reactions to their counterpart's actions. No existing modeling theories and tools, including Markovian decision processes, user and behavior modeling, deep sequential modeling, and personalized sequential recommendation, can quantify such complex decision making on a personal level. We take a data driven approach to learn the next best actions for personalized decision making by a reinforced coupled recurrent neural network (CRN). CRN represents multiple coupled dynamic sequences of a customer's historical and current states, responses to decision makers' actions, decision rewards to actions, and learns long term multi sequence interactions between parties (customer and decision maker). Next best actions are then recommended on each customer at a time point to change their state for an optimal decision making objective. Our study demonstrates the potential of personalized deep learning of multi sequence interactions and automated dynamic intervention for personalized decision making in complex systems.


Construction of frame relative to n Hilbert space. In this paper, our aim is to introduce the concept of a frame in n Hilbert space and describe some of their properties. We further discuss tight frame relative to n Hilbert space. At the end, we study the relationship between frame and bounded linear operator in n Hilbert space.


Understanding who uses Reddit Profiling individuals with a self reported bipolar disorder diagnosis. Recently, research on mental health conditions using public online data, including Reddit, has surged in NLP and health research but has not reported user characteristics, which are important to judge generalisability of findings. This paper shows how existing NLP methods can yield information on clinical, demographic, and identity characteristics of almost 20K Reddit users who self report a bipolar disorder diagnosis. This population consists of slightly more feminine than masculine gendered mainly young or middle aged US based adults who often report additional mental health diagnoses, which is compared with general Reddit statistics and epidemiological studies. Additionally, this paper carefully evaluates all methods and discusses ethical issues.


Autonomous Reinforcement Learning via Subgoal Curricula. Reinforcement learning (RL) promises to enable autonomous acquisition of complex behaviors for diverse agents. However, the success of current reinforcement learning algorithms is predicated on an often under emphasised requirement each trial needs to start from a fixed initial state distribution. Unfortunately, resetting the environment to its initial state after each trial requires substantial amount of human supervision and extensive instrumentation of the environment which defeats the goal of autonomous acquisition of complex behaviors. In this work, we propose Value accelerated Persistent Reinforcement Learning (VaPRL), which generates a curriculum of initial states such that the agent can bootstrap on the success of easier tasks to efficiently learn harder tasks. The agent also learns to reach the initial states proposed by the curriculum, minimizing the reliance on human interventions into the learning. We observe that VaPRL reduces the interventions required by three orders of magnitude compared to episodic RL while outperforming prior state of the art methods for reset free RL both in terms of sample efficiency and asymptotic performance on a variety of simulated robotics problems.


Skew cyclic codes over mathbb Z 4 v mathbb Z 4 with derivation. In this work, we study a class of skew cyclic codes over the ring R mathbb Z 4 v mathbb Z 4, where v 2 v, with an automorphism theta and a derivation Delta theta, namely codes as modules over a skew polynomial ring R x theta, Delta theta , whose multiplication is defined using an automorphism theta and a derivation Delta theta . We investigate the structures of a skew polynomial ring R x theta, Delta theta . We define Delta theta cyclic codes as a generalization of the notion of cyclic codes. The properties of Delta theta cyclic codes as well as dual Delta theta cyclic codes are derived. Some new codes over mathbb Z 4 with good parameters are obtained via a Gray map as well as residue and torsion codes of these codes.


Local regularity near boundary for the Stokes and Navier Stokes equations. We are concerned with local regularity of the solutions for the Stokes and Navier Stokes equations near boundary. Firstly, we construct a bounded solution but its normal derivatives are singular in any L p with 1 p locally near boundary. On the other hand, we present criteria of solutions of the Stokes equations near boundary to imply that the gradients of solutions are bounded (in fact, even further H " o lder continuous). Finally, we provide examples of solutions whose local regularity near boundary is optimal.


Influence of group characteristics on agent voting. A collective of identical agents in a multi agent system often works together towards the common goal. In situations where no supervisor agents are present to make decisions for the group, these agents must achieve some consensus via negotiations and other types of communications. We have previously shown that the structure of the group and the priority of communication has a high influence on the group decision if consensus theory methods are used. In this paper, we explore the influence of preferential communication channels in asynchronous group communication in situations, where majority vote and dominant value are used. We also show how this relates to consensus approach in such groups and how to use a combination of both approaches to improve performance of real life multi agent systems.


Large deviation principles for renewal reward processes. We establish a sharp large deviation principle for renewal reward processes, supposing that each renewal involves a broad sense reward taking values in a real separable Banach space. In fact, we demonstrate a weak large deviation principle without assuming any exponential moment condition on the law of waiting times and rewards by resorting to a sharp version of Cram 'er's theorem. We also exhibit sufficient conditions for exponential tightness of renewal reward processes, which leads to a full large deviation principle.


Order picking optimization with order assignment and multiple workstations in KIVA warehouses. We consider the problem of allocating orders and racks to multiple stations and sequencing their interlinked processing flows at each station in the robot assisted KIVA warehouse. The various decisions involved in the problem, which are closely associated and must be solved in real time, are often tackled separately for ease of treatment. However, exploiting the synergy between order assignment and picking station scheduling benefits picking efficiency. We develop a comprehensive mathematical model that takes the synergy into consideration to minimize the total number of rack visits. To solve this intractable problem, we develop an efficient algorithm based on simulated annealing and dynamic programming. Computational studies show that the proposed approach outperforms the rule based policies used in practice in terms of solution quality. Moreover, the results reveal that ignoring the order assignment policy leads to considerable optimality gaps for real world sized instances.


Known allosteric proteins have central roles in genetic disease. Allostery is a form of protein regulation, where ligands that bind sites located apart from the active site can modify the activity of the protein. The molecular mechanisms of allostery have been extensively studied, because allosteric sites are less conserved than active sites, and drugs targeting them are more specific than drugs binding the active sites. Here we quantify the importance of allostery in genetic disease. We show that 1) known allosteric proteins are central in disease networks, and contribute to genetic disease and comorbidities much more than non allosteric proteins, in many major disease types like hematopoietic diseases, cardiovascular diseases, cancers, diabetes, or diseases of the central nervous system. 2) variants from cancer genome wide association studies are enriched near allosteric proteins, indicating their importance to polygenic traits and 3) the importance of allosteric proteins in disease is due, at least partly, to their central positions in protein protein interaction networks, and probably not due to their dynamical properties.


ATP Synthase A Moonlighting Enzyme with Unprecedented Functions. ATP synthase's intrinsic molecular electrostatic potential (MESP) adds constructively to, and hence reinforces, the chemiosmotic voltage. This ATP synthase voltage represents a new free energy term that appears to have been overlooked. This term is at least roughly equal in order of magnitude and opposite in sign to the energy needed to be dissipated as a Maxwell's demon (Landauer principle).


A thin film equation for a viscoelastic fluid, and its application to the Landau Levich problem. Thin film flows of viscoelastic fluids are encountered in various industrial and biological settings. The understanding of thin viscous film flows in Newtonian fluids is very well developed, which for a large part is due to the so called thin film equation. This equation, a single partial differential equation describing the height of the film, is a significant simplification of the Stokes equation effected by the lubrication approximation which exploits the thinness of the film. There is no such established equation for viscoelastic fluid flows. Here we derive the thin film equation for a second order fluid, and use it to study the classical Landau Levich dip coating problem. We show how viscoelasticity of the fluid affects the thickness of the deposited film, and address the discrepancy on the topic in literature.


Cubic upper and lower bounds for subtrajectory clustering under the continuous Fr 'echet distance. Detecting commuting patterns or migration patterns in movement data is an important problem in computational movement analysis. Given a trajectory, or set of trajectories, this corresponds to clustering similar subtrajectories. We study subtrajectory clustering under the continuous and discrete Fr 'echet distances. The most relevant theoretical result is by Buchin et al. (2011). They provide, in the continuous case, an O(n 5) time algorithm and a 3SUM hardness lower bound, and in the discrete case, an O(n 3) time algorithm. We show, in the continuous case, an O(n 3 log 2 n) time algorithm and a 3OV hardness lower bound, and in the discrete case, an O(n 2 log n) time algorithm and a quadratic lower bound. Our bounds are almost tight unless SETH fails.


Prediction Analysis of Optical Tracker Parameters using Machine Learning Approaches for efficient Head Tracking. A head tracker is a crucial part of the head mounted display systems, as it tracks the head of the pilot in the plane cockpit simulator. The operational flaws of head trackers are also dependent on different environmental conditions like different lighting conditions and stray light interference. In this letter, an optical tracker has been employed to gather the 6 DoF data of head movements under different environmental conditions. Also, the effect of different environmental conditions and variation in distance between the receiver and optical transmitter on the 6 DoF data was analyzed.


Toward a Rational and Ethical Sociotechnical System of Autonomous Vehicles A Novel Application of Multi Criteria Decision Analysis. The expansion of artificial intelligence (AI) and autonomous systems has shown the potential to generate enormous social good while also raising serious ethical and safety concerns. AI technology is increasingly adopted in transportation. A survey of various in vehicle technologies found that approximately 64 of the respondents used a smartphone application to assist with their travel. The top used applications were navigation and real time traffic information systems. Among those who used smartphones during their commutes, the top used applications were navigation and entertainment. There is a pressing need to address relevant social concerns to allow for the development of systems of intelligent agents that are informed and cognizant of ethical standards. Doing so will facilitate the responsible integration of these systems in society. To this end, we have applied Multi Criteria Decision Analysis (MCDA) to develop a formal Multi Attribute Impact Assessment (MAIA) questionnaire for examining the social and ethical issues associated with the uptake of AI. We have focused on the domain of autonomous vehicles (AVs) because of their imminent expansion. However, AVs could serve as a stand in for any domain where intelligent, autonomous agents interact with humans, either on an individual level (e.g., pedestrians, passengers) or a societal level.


Isbell conjugacy and the reflexive completion. The reflexive completion of a category consists of the Set valued functors on it that are canonically isomorphic to their double conjugate. After reviewing both this construction and Isbell conjugacy itself, we give new examples and revisit Isbell's main results from 1960 in a modern categorical context. We establish the sense in which reflexive completion is functorial, and find conditions under which two categories have equivalent reflexive completions. We describe the relationship between the reflexive and Cauchy completions, determine exactly which limits and colimits exist in an arbitrary reflexive completion, and make precise the sense in which the reflexive completion of a category is the intersection of the categories of covariant and contravariant functors on it.


On F bubbles and hereditary F functorial equivalence of topological spaces. The concept of check H n bubles was defined and investigated. In this paper we generalize this conception for some other functors F . Open questions are formulated.


Enabling 3D Object Detection with a Low Resolution LiDAR. Light Detection And Ranging (LiDAR) has been widely used in autonomous vehicles for perception and localization. However, the cost of a high resolution LiDAR is still prohibitively expensive, while its low resolution counterpart is much more affordable. Therefore, using low resolution LiDAR for autonomous driving is an economically viable solution, but the point cloud sparsity makes it extremely challenging. In this paper, we propose a two stage neural network framework that enables 3D object detection using a low resolution LiDAR. Taking input from a low resolution LiDAR point cloud and a monocular camera image, a depth completion network is employed to produce dense point cloud that is subsequently processed by a voxel based network for 3D object detection. Evaluated with KITTI dataset for 3D object detection in Bird Eye View (BEV), the experimental result shows that the proposed approach performs significantly better than directly applying the 16 line LiDAR point cloud for object detection. For both easy and moderate cases, our 3D vehicle detection results are close to those using 64 line high resolution LiDARs.


Hierarchical Policies for Cluttered Scene Grasping with Latent Plans. 6D grasping in cluttered scenes is a longstanding problem in robotic manipulation. Open loop manipulation pipelines may fail due to inaccurate state estimation, while most end to end grasping methods have not yet scaled to complex scenes with obstacles. In this work, we propose a new method for end to end learning of 6D grasping in cluttered scenes. Our hierarchical framework learns collision free target driven grasping based on partial point cloud observations. We learn an embedding space to encode expert grasping plans during training and a variational autoencoder to sample diverse grasping trajectories at test time. Furthermore, we train a critic network for plan selection and an option classifier for switching to an instance grasping policy through hierarchical reinforcement learning. We evaluate our method and compare against several baselines in simulation, as well as demonstrate that our latent planning can generalize to real world cluttered scene grasping tasks. Our videos and code can be found at https sites.google.com view latent grasping .


Non convex optimization in digital pre distortion of the signal. In this paper, we give some observation of applying modern optimization methods for functionals describing digital predistortion (DPD) of signals with orthogonal frequency division multiplexing (OFDM) modulation. The considered family of model functionals is determined by the class of cascade Wiener Hammerstein models, which can be represented as a computational graph consisting of various nonlinear blocks. To assess optimization methods with the best convergence depth and rate as a properties of this models family we multilaterally consider modern techniques used in optimizing neural networks and numerous numerical methods used to optimize non convex multimodal functions. The research emphasizes the most effective of the considered techniques and describes several useful observations about the model properties and optimization methods behavior.


Generalized Polya's theorem on connected locally compact Abelian groups of dimension 1. According to the generalized Polya theorem, the Gaussian distribution on the real line is characterized by the property of equidistribution of a monomial and a linear form of independent identically distributed random variables. We give a complete description of a adic solenoids for which an analog of this theorem is true. The proof of the main theorem is reduced to solving some functional equation in the class of continuous positive definite functions on the character group of an a adic solenoid


Sparse Fourier Transform by traversing Cooley Tukey FFT computation graphs. Computing the dominant Fourier coefficients of a vector is a common task in many fields, such as signal processing, learning theory, and computational complexity. In the Sparse Fast Fourier Transform (Sparse FFT) problem, one is given oracle access to a d dimensional vector x of size N , and is asked to compute the best k term approximation of its Discrete Fourier Transform, quickly and using few samples of the input vector x . While the sample complexity of this problem is quite well understood, all previous approaches either suffer from an exponential dependence of runtime on the dimension d or can only tolerate a trivial amount of noise. This is in sharp contrast with the classical FFT algorithm of Cooley and Tukey, which is stable and completely insensitive to the dimension of the input vector its runtime is O(N log N) in any dimension d . In this work, we introduce a new high dimensional Sparse FFT toolkit and use it to obtain new algorithms, both on the exact, as well as in the case of bounded ell 2 noise. This toolkit includes i) a new strategy for exploring a pruned FFT computation tree that reduces the cost of filtering, ii) new structural properties of adaptive aliasing filters recently introduced by Kapralov, Velingker and Zandieh'SODA'19, and iii) a novel lazy estimation argument, suited to reducing the cost of estimation in FFT tree traversal approaches. Our robust algorithm can be viewed as a highly optimized sparse, stable extension of the Cooley Tukey FFT algorithm. Finally, we explain the barriers we have faced by proving a conditional quadratic lower bound on the running time of the well studied non equispaced Fourier transform problem. This resolves a natural and frequently asked question in computational Fourier transforms. Lastly, we provide a preliminary experimental evaluation comparing the runtime of our algorithm to FFTW and SFFT 2.0.


Recursive Trellis Processing of Large Polarization Kernels. A reduced complexity algorithm is presented for computing the log likelihood ratios arising in the successive cancellation decoder for polar codes with large kernels of arbitrary dimension. The proposed algorithm exploits recursive trellis representation of the codes generated by submatrices of the polarization kernel, and enables codes based on large kernels to provide better performance compared to the codes based on Arikan kernel with the same decoding complexity.


Dynamic Structural Clustering on Graphs. Structural Clustering ( DynClu ) is one of the most popular graph clustering paradigms. In this paper, we consider StrClu under two commonly adapted similarities, namely Jaccard similarity and cosine similarity on a dynamic graph, G langle V, E rangle , subject to edge insertions and deletions (updates). The goal is to maintain certain information under updates, so that the StrClu clustering result on G can be retrieved in O( V E ) time, upon request. The state of the art worst case cost is O( V ) per update we improve this update time bound significantly with the rho approximate notion. Specifically, for a specified failure probability, delta , and every sequence of M updates (no need to know M 's value in advance), our algorithm, DynELM , achieves O( log 2 V log V cdot log frac M delta ) amortized cost for each update, at all times in linear space. Moreover, DynELM provides a provable "sandwich" guarantee on the clustering quality at all times after emph each update with probability at least 1 delta . We further develop DynELM into our ultimate algorithm, DynStrClu , which also supports cluster group by queries. Given Q subseteq V , this puts the non empty intersection of Q and each StrClu cluster into a distinct group. DynStrClu not only achieves all the guarantees of DynELM , but also runs cluster group by queries in O( Q cdot log V ) time. We demonstrate the performance of our algorithms via extensive experiments, on 15 real datasets. Experimental results confirm that our algorithms are up to three orders of magnitude more efficient than state of the art competitors, and still provide quality structural clustering results. Furthermore, we study the difference between the two similarities w.r.t. the quality of approximate clustering results.


On the Correspondence Between Domination and the Spectrum of Jacobi Operators. In this paper, we first develop a notion of dominated splitting for mathbb M(2, mathbb C) sequences and show it is a stable property under cdot infty perturbation. Then we show an energy parameter belongs to the spectrum of a Jacobi operator, possibly singular, if and only if the associated Jacobi cocycle does not admit dominated splitting. This generalizes the results obtained by the second author Z in the scenario of Schr "odinger operators. Finally, we consider dynamically defined Jacobi operators whose base dynamics is only assumed to be topologically transitive. We show an energy parameter belongs to the spectrum of the operator defined by the base point with a dense orbit if and only if the dynamically defined Jacobi cocycle does not admit dominated splitting. This includes the original Johnson's theorem obtained by R. Johnson J for Sch "odinger operators and the main theorem obtained by C. Marx Ma for Jacobi operators as special cases.


A Ray Knight Theorem for Spectrally Positive Stable Processes. We generalize a classical second Ray Knight theorem to spectrally positive stable processes. It is shown that the local time processes are solutions of certain stochastic Volterra equations driven by Poisson random measure and they belong to a class of fully novel non Markov branching processes, named as textit rough continuous state branching processes . Also, we prove the weak uniqueness of solutions to the stochastic Volterra equations by providing explicit exponential representations of the characteristic functionals in terms of the unique solutions to some associated nonlinear Volterra equations.


Constrained Mean Shift for Representation Learning. We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self supervised learning (SSL), we develop a non contrastive representation learning method that can exploit additional knowledge. This additional knowledge may come from annotated labels in the supervised setting or an SSL model from another modality in the SSL setting. Our main idea is to generalize the mean shift algorithm by constraining the search space of nearest neighbors, resulting in semantically purer representations. Our method simply pulls the embedding of an instance closer to its nearest neighbors in a search space that is constrained using the additional knowledge. By leveraging this non contrastive loss, we show that the supervised ImageNet 1k pretraining with our method results in better transfer performance as compared to the baselines. Further, we demonstrate that our method is relatively robust to label noise. Finally, we show that it is possible to use the noisy constraint across modalities to train self supervised video models.


Equidistribution of rational points and the geometric sieve for toric varieties. We prove the Manin Peyre equidistribution principle for smooth projective split toric varieties over the rational numbers. That is, rational points of bounded anticanonical height outside of the boundary divisors are equidistributed with respect to the Tamagawa measure on the adelic space. Based on a refinement of the universal torsor method due to Salberger, we provide asymptotic formulas with effective error terms for counting rational points in arbitrary adelic neighbourhoods, and develop an Ekedahl type geometric sieve for such toric varieties. Several applications to counting rational points satisfying infinitely many local conditions are derived.


Boundedness and volume of generalised pairs. In this paper we investigate boundedness and volumes of generalised pairs, and give applications to usual pairs especially to a class of pairs that we call stable log minimal models. Fixing the dimension and a DCC set controlling coefficients, we will show that the set of volumes of all projective generalised lc pairs (X,B M) under the given data, satisfies the DCC. Futhermore, we will show that in the klt case, the set of such pairs with ample K X B M and fixed volume, forms a bounded family. We prove a result about descent of nef divisors to bounded families. This is the key to proving the above and various other results. We will then apply the above to study projective lc pairs (X,B) with abundant K X B of arbitrary Kodaira dimension. In particular, we show that the set of Iitaka volumes of such pairs satisfies DCC under some natural boundedness assumptions on the fibres of the Iitaka fibration. We define stable log minimal models which consist of a projective lc pair (X,B) with semi ample K X B together with a divisor A ge 0 so that K X B A is ample and A does not contain any non klt centre of (X,B) . This is a generalisation of both usual stable pairs of general type and stable log Calabi Yau pairs. Fixing appropriate invariants we show that stable log minimal models form a bounded family. Then we discuss connection with moduli spaces.


Watch It Move Unsupervised Discovery of 3D Joints for Re Posing of Articulated Objects. Rendering articulated objects while controlling their poses is critical to applications such as virtual reality or animation for movies. Manipulating the pose of an object, however, requires the understanding of its underlying structure, that is, its joints and how they interact with each other. Unfortunately, assuming the structure to be known, as existing methods do, precludes the ability to work on new object categories. We propose to learn both the appearance and the structure of previously unseen articulated objects by observing them move from multiple views, with no joints annotation supervision, or information about the structure. We observe that 3D points that are static relative to one another should belong to the same part, and that adjacent parts that move relative to each other must be connected by a joint. To leverage this insight, we model the object parts in 3D as ellipsoids, which allows us to identify joints. We combine this explicit representation with an implicit one that compensates for the approximation introduced. We show that our method works for different structures, from quadrupeds, to single arm robots, to humans.


Some sufficient conditions on impulsive and initial value fractional order functional differential equations. In this paper, we will develop a definition of mild solution for impulsive fractional differential equation of order alpha in (1,2) with the help of solution operator and study the existence results of mild solution for impulsive fractional differential equations with state dependent delay by using fixed point theorems. Finally, we present an example of partial fractional derivative to illustrate the existence and uniqueness result.


Not another computer algebra system Highlighting wxMaxima in calculus. This article introduces and explains a computer algebra system (CAS) wxMaxima for Calculus teaching and learning at the tertiary level. The didactic reasoning behind this approach is the need to implement an element of technology into classrooms to enhance students' understanding of Calculus concepts. For many mathematics educators who have been using CAS, this material is of great interest, particularly for secondary teachers and university instructors who plan to introduce an alternative CAS into their classrooms. By highlighting both the strengths and limitations of the software, we hope that it will stimulate further debate not only among mathematics educators and software users but also also among symbolic computation and software developers.


A Distributed Application Placement and Migration Management Techniques for Edge and Fog Computing Environments. Fog Edge computing model allows harnessing of resources in the proximity of the Internet of Things (IoT) devices to support various types of real time IoT applications. However, due to the mobility of users and a wide range of IoT applications with different requirements, it is a challenging issue to satisfy these applications' requirements. The execution of IoT applications exclusively on one fog edge server may not be always feasible due to limited resources, while execution of IoT applications on different servers needs further collaboration among servers. Also, considering user mobility, some modules of each IoT application may require migration to other servers for execution, leading to service interruption and extra execution costs. In this article, we propose a new weighted cost model for hierarchical fog computing environments, in terms of the response time of IoT applications and energy consumption of IoT devices, to minimize the cost of running IoT applications and potential migrations. Besides, a distributed clustering technique is proposed to enable the collaborative execution of tasks, emitted from application modules, among servers. Also, we propose an application placement technique to minimize the overall cost of executing IoT applications on multiple servers in a distributed manner. Furthermore, a distributed migration management technique is proposed for the potential migration of applications' modules to other remote servers as the users move along their path. Besides, failure recovery methods are embedded in the clustering, application placement, and migration management techniques to recover from unpredicted failures. The performance results show that our technique significantly improves its counterparts in terms of placement deployment time, average execution cost of tasks, total number of migrations, total number of interrupted tasks, and cumulative migration cost.


Large Graph Convolutional Network Training with GPU Oriented Data Communication Architecture. Graph Convolutional Networks (GCNs) are increasingly adopted in large scale graph based recommender systems. Training GCN requires the minibatch generator traversing graphs and sampling the sparsely located neighboring nodes to obtain their features. Since real world graphs often exceed the capacity of GPU memory, current GCN training systems keep the feature table in host memory and rely on the CPU to collect sparse features before sending them to the GPUs. This approach, however, puts tremendous pressure on host memory bandwidth and the CPU. This is because the CPU needs to (1) read sparse features from memory, (2) write features into memory as a dense format, and (3) transfer the features from memory to the GPUs. In this work, we propose a novel GPU oriented data communication approach for GCN training, where GPU threads directly access sparse features in host memory through zero copy accesses without much CPU help. By removing the CPU gathering stage, our method significantly reduces the consumption of the host resources and data access latency. We further present two important techniques to achieve high host memory access efficiency by the GPU (1) automatic data access address alignment to maximize PCIe packet efficiency, and (2) asynchronous zero copy access and kernel execution to fully overlap data transfer with training. We incorporate our method into PyTorch and evaluate its effectiveness using several graphs with sizes up to 111 million nodes and 1.6 billion edges. In a multi GPU training setup, our method is 65 92 faster than the conventional data transfer method, and can even match the performance of all in GPU memory training for some graphs that fit in GPU memory.


Magnetic field assisted laser ablation of silicon. Understanding and manipulation of the laser processing quality during the ablation of solids have crucial importance from fundamental and industrial perspectives. Here we have studied the effect of external magnetic field on the micro material processing of silicon by ultrashort laser pulses. It was found experimentally that such a field directed along the laser beam improves the quality and efficiency of the material removal. Additionally, we observe that the formation of laser induced periodic surface structures (LIPSS) in a multi pulse regime is affected by the external magnetic field. Our results open a route towards efficient and controllable ultrafast laser micromachining.


Hybrid and Automated Machine Learning Approaches for Oil Fields Development the Case Study of Volve Field, North Sea. The paper describes the usage of intelligent approaches for field development tasks that may assist a decision making process. We focused on the problem of wells location optimization and two tasks within it improving the quality of oil production estimation and estimation of reservoir characteristics for appropriate wells allocation and parametrization, using machine learning methods. For oil production estimation, we implemented and investigated the quality of forecasting models physics based, pure data driven, and hybrid one. The CRMIP model was chosen as a physics based approach. We compare it with the machine learning and hybrid methods in a frame of oil production forecasting task. In the investigation of reservoir characteristics for wells location choice, we automated the seismic analysis using evolutionary identification of convolutional neural network for the reservoir detection. The Volve oil field dataset was used as a case study to conduct the experiments. The implemented approaches can be used to analyze different oil fields or adapted to similar physics related problems.


Efficient Inference via Universal LSH Kernel. Large machine learning models achieve unprecedented performance on various tasks and have evolved as the go to technique. However, deploying these compute and memory hungry models on resource constraint environments poses new challenges. In this work, we propose mathematically provable Representer Sketch, a concise set of count arrays that can approximate the inference procedure with simple hashing computations and aggregations. Representer Sketch builds upon the popular Representer Theorem from kernel literature, hence the name, providing a generic fundamental alternative to the problem of efficient inference that goes beyond the popular approach such as quantization, iterative pruning and knowledge distillation. A neural network function is transformed to its weighted kernel density representation, which can be very efficiently estimated with our sketching algorithm. Empirically, we show that Representer Sketch achieves up to 114x reduction in storage requirement and 59x reduction in computation complexity without any drop in accuracy.


The Autonomous Siemens Tram. This paper presents the Autonomous Siemens Tram that was publicly demonstrated in Potsdam, Germany during the InnoTrans 2018 exhibition. The system was built on a Siemens Combino tram and used a multi modal sensor suite to localize the vehicle, and to detect and respond to traffic signals and obstacles. An overview of the hardware and the developed localization, signal handling, and obstacle handling components is presented, along with a summary of their performance.


Equilibria of charged hyperelastic solids. We investigate equilibria of charged deformable materials via the minimization of an electroelastic energy. This features the coupling of elastic response and electrostatics by means of a capacitary term, which is naturally defined in Eulerian coordinates. The ensuing electroelastic energy is then of mixed Lagrangian Eulerian type. We prove that minimizers exist by investigating the continuity properties of the capacitary terms under convergence of the deformations


Independent Spaces of q Polymatroids. This paper is devoted to the study of independent spaces of q polymatroids. With the aid of an auxiliary q matroid it is shown that the collection of independent spaces satisfies the same properties as for q matroids. However, in contrast to q matroids, the rank value of an independent space does not agree with its dimension. Nonetheless, the rank values of the independent spaces fully determine the q polymatroid, and this fact can be exploited to derive a cryptomorphism of q polymatroids. Finally, the notions of minimal spanning spaces, maximally strongly independent spaces, and bases will be elaborated on.


Levi Civita connections from toral actions. We construct tame differential calculi coming from toral actions on a class of C algebras. Relying on the existence of a unique Levi Civita connection on such a calculi, we prove a version of the Bianchi identity. A Gauss Bonnet theorem for the canonical rank 2 calculus is studied.


Eigenfunctions restriction estimates for curves with nonvanishing geodesic curvatures in compact Riemannian surfaces with nonpositive curvature. For 2 leq p 4 , we study the L p norms of restrictions of eigenfunctions of the Laplace Beltrami operator on smooth compact 2 dimensional Riemannian manifolds. Burq, G 'erard, and Tzvetkov cite BurqGerardTzvetkov2007restrictions , and Hu cite Hu2009lp found the eigenfunction estimates restricted to a curve with nonvanishing geodesic curvatures. We will explain how the proof of the known estimates helps us to consider the case where the given smooth compact Riemannian manifold has nonpositive sectional curvatures. For p 4 , we will also obtain a logarithmic analogous estimate, by using arguments in Xi and Zhang cite XiZhang2017improved , Sogge cite Sogge2017ImprovedCritical , and Bourgain cite Bourgain1991Besicovitch .


An extended MMP algorithm (I) wavefront and cut locus on a convex polyhedron. In the present paper, we propose a novel generalization of the celebrated MMP algorithm in order to find the wavefront propagation and the cut locus on a convex polyhedron with an emphasis on actual implementation for instantaneous visualization and numerical computation.


Worst Case Welfare of Item Pricing in the Tollbooth Problem. We study the worst case welfare of item pricing in the tollbooth problem. The problem was first introduced by Guruswami et al, and is a special case of the combinatorial auction in which (i) each of the m items in the auction is an edge of some underlying graph and (ii) each of the n buyers is single minded and only interested in buying all edges of a single path. We consider the competitive ratio between the hindsight optimal welfare and the optimal worst case welfare among all item pricing mechanisms, when the order of the arriving buyers is adversarial. On the one hand, we prove an Omega(m 1 8 ) lower bound of the competitive ratio for general graphs. We show that an m Omega(1) competitive ratio is unavoidable even if the graph is a grid, or if the capacity of every edge is augmented by a constant c . On the other hand, we study the competitive ratio for special families of graphs. In particular, we improve the ratio when the input graph G is a tree, from 8 (proved by Cheung and Swamy) to 3. We prove that the ratio is 2 (tight) when G is a cycle and O( log 2 m) when G is an outerplanar graph. All positive results above require that the seller can choose a proper tie breaking rule to maximize the welfare. In the paper we also consider the setting where the tie breaking power is on the buyers' side, i.e. the buyer can choose whether or not to buy her demand path when the total price of edges in the path equals her value. We show that the gap between the two settings is at least a constant even when the underlying graph is a single path (this special case is also known as the highway problem). Meanwhile, in this setting where buyers have the tie breaking power, we also prove an O(1) upper bound of competitive ratio for special families of graphs.


Comment on "Approximation algorithms for quadratic programming". The radius of the outer Dikin ellipsoid of the intersection of m ellipsoids due to Fu et al. (J. Comb. Optim., 2, 29 50, 1998) is corrected from m to sqrt m 2 m . The approximation bound for the general convex quadratic constrained nonconvex quadratic program is correspondingly corrected.


Estimates for the first eigenvalues of Bi drifted Laplacian on smooth metric measure space. In this paper, we obtain lower bounds for the first eigenvalue to some kinds of the eigenvalue problems for Bi drifted Laplacian operator on compact manifolds (also called a smooth metric measure space) with boundary and m Bakry Emery Ricci curvature or Bakry Emery Ricci curvature bounded below. We also address the eigenvalue problem with Wentzell type boundary condition for drifted Laplacian on smooth metric measure space.


An algebra isomorphism on U( mathfrak gl n) . For each positive integer n , let mathfrak s n mathfrak gl n ltimes mathbb C n . We show that U( mathfrak s n ) X n cong mathcal D n otimes U( mathfrak s n 1 ) for any n in mathbb Z geq 2 , where U( mathfrak s n ) X n is the localization of U( mathfrak s n ) with respect to the subset X n e 1 i 1 cdots e n i n mid i 1, dots,i n in mathbb Z , and mathcal D n is the Weyl algebra mathbb C x 1 pm 1 , cdots, x n pm 1 , frac partial partial x 1 , cdots, frac partial partial x n . As an application, we give a new proof of the Gelfand Kirillov conjecture for mathfrak s n and mathfrak gl n . Moreover we show that the category of Harish Chandra U( mathfrak s n ) X n modules with a fixed weight support is equivalent to the category of finite dimensional mathfrak s n 1 modules whose representation type is wild, for any n in mathbb Z geq 2 .


An ell p Variable Projection Method for Large Scale Separable Nonlinear Inverse Problems. The variable projection (VarPro) method is an efficient method to solve separable nonlinear least squares problems. In this paper, we propose a modified VarPro for large scale separable nonlinear inverse problems that promotes edge preserving and sparsity properties on the desired solution and enhances the convergence of the parameters that define the forward problem. We adopt a majorization minimization method that relies on constructing a quadratic tangent majorant to approximate a general ell p regularized problem by an ell 2 regularized problem that can be solved by the aid of generalized Krylov subspace methods at a relatively low cost compared to the original unprojected problem. In addition, we can use more potential general regularizers including total variation (TV), framelet, and wavelets operators. The regularization parameter can be defined automatically at each iteration by means of generalized cross validation. Numerical examples on large scale two dimensional imaging problems arising from blind deconvolution are used to highlight the performance of the proposed approach in both quality of the reconstructed image as well as the reconstructed forward operator.


L2C Describing Visual Differences Needs Semantic Understanding of Individuals. Recent advances in language and vision push forward the research of captioning a single image to describing visual differences between image pairs. Suppose there are two images, I 1 and I 2, and the task is to generate a description W 1,2 comparing them, existing methods directly model I 1, I 2 W 1,2 mapping without the semantic understanding of individuals. In this paper, we introduce a Learning to Compare (L2C) model, which learns to understand the semantic structures of these two images and compare them while learning to describe each one. We demonstrate that L2C benefits from a comparison between explicit semantic representations and single image captions, and generalizes better on the new testing image pairs. It outperforms the baseline on both automatic evaluation and human evaluation for the Birds to Words dataset.


A note on geometric duality in matroid theory and knot theory. We observe that for planar graphs, the geometric duality relation generates both 2 isomorphism and abstract duality. This observation has the surprising consequence that for links, the equivalence relation defined by isomorphisms of checkerboard graphs is the same as the equivalence relation defined by 2 isomorphisms of checkerboard graphs.


A Hierarchical Multi Objective Programming Approach to Planning Locations for Macro and Micro Fire Stations. Fire stations are among the most crucial emergency facilities in urban emergency control system in terms of their quick response to fires and other emergencies. Location plannings for fire stations have a significant influence on their effectiveness and capability of emergency responses trading off with the cost of constructions. To obtain efficient and practical siting plans for fire stations, various major requirements including effectiveness maximization, distance constraint and workload limitation are required to be considered in location models, especially for multi level fire facility systems with macro and micro fire stations having specific aims and construction requirements. This paper proposes a novel hierarchical optimization approach taking all the major requirements for location planning into consideration and bonds functional connections between different levels of fire stations at the same time. A single objective and a multi objective optimization model are established to solve the location siting problems for macro and micro fire stations simultaneously. Genetic algorithm with elitist reservation and Pareto based multi objective evolutionary algorithm are adopted to solve the problem with NP hard nature. The proposed hierarchical location model is further performed in a case study of Futian District in Shenzhen, and the siting result justifies the effectiveness and practicality of our novel approach.


Bifurcation of closed orbits from equilibria of Newtonian systems with Coriolis forces. We consider autonomous Newtonian systems with Coriolis forces in two and three dimensions and study the existence of branches of periodic orbits emanating from equilibria. We investigate both degenerate and nondegenerate situations. While Lyapunov's center theorem applies locally in the nondegenerate, nonresonant context, equivariant degree theory provides a global answer which is significant also in some degenerate cases. We apply our abstract results to a problem from Celestial Mechanics. More precisely, in the three dimensional version of the Restricted Triangular Four Body Problem with possibly different primaries our results show the existence of at least seven branches of periodic orbits emanating from the stationary points.


The Covering Radius of the Reed Muller Code RM(m 4,m) in RM(m 3,m) . We present methods for computing the distance from a Boolean polynomial on m variables of degree m 3 (i.e., a member of the Reed Muller code RM(m 3,m) ) to the space of lower degree polynomials ( RM(m 4,m) ). The methods give verifiable certificates for both the lower and upper bounds on this distance. By applying these methods to representative lists of polynomials, we show that the covering radius of RM(4,8) in RM(5,8) is 26 and the covering radius of RM(5,9) in RM(6,9) is between 28 and 32 inclusive, and we get improved lower bounds for higher m . We also apply our methods to various polynomials in the literature, thereby improving the known bounds on the distance from 2 resilient polynomials to RM(m 4,m) .


RheFrameDetect A Text Classification System for Automatic Detection of Rhetorical Frames in AI from Open Sources. Rhetorical Frames in AI can be thought of as expressions that describe AI development as a competition between two or more actors, such as governments or companies. Examples of such Frames include robotic arms race, AI rivalry, technological supremacy, cyberwarfare dominance and 5G race. Detection of Rhetorical Frames from open sources can help us track the attitudes of governments or companies towards AI, specifically whether attitudes are becoming more cooperative or competitive over time. Given the rapidly increasing volumes of open sources (online news media, twitter, blogs), it is difficult for subject matter experts to identify Rhetorical Frames in (near) real time. Moreover, these sources are in general unstructured (noisy) and therefore, detecting Frames from these sources will require state of the art text classification techniques. In this paper, we develop RheFrameDetect, a text classification system for (near) real time capture of Rhetorical Frames from open sources. Given an input document, RheFrameDetect employs text classification techniques at multiple levels (document level and paragraph level) to identify all occurrences of Frames used in the discussion of AI. We performed extensive evaluation of the text classification techniques used in RheFrameDetect against human annotated Frames from multiple news sources. To further demonstrate the effectiveness of RheFrameDetect, we show multiple case studies depicting the Frames identified by RheFrameDetect compared against human annotated Frames.


Infinite Loops and the p adic Littlewood Conjecture. Part I Reformulating the p adic Littlewood Conjecture in Terms of Infinite Loops. In this paper we introduce the concept of an infinite loop mod n and discuss the properties that these objects have. In particular, we show that a real number alpha is a counterexample to the p adic Littlewood Conjecture if and only if there exists some m in mathbb N such that p k alpha is an infinite loop mod p m , for all k in mathbb N . This paper is the first of a two part series, which investigate the link between infinite loops and the p adic Littlewood Conjecture.


Extraction of diverse gene groups with individual relationship from gene co expression networks. Motivation Modules in gene coexpression networks (GCN) can be regarded as gene groups with individual relationships. No studies have optimized module detection methods to extract diverse gene groups from GCN, especially for data from clinical specimens. Results Here, we optimized the flow from transcriptome data to gene modules, aiming to cover diverse gene relationships. We found the prediction accuracy of relationships in benchmark networks of non mammalian was not always suitable for evaluating gene relationships of human and employed network based metrics. We also proposed a module detection method involving a combination of graphical embedding and recursive partitioning, and confirmed its stable and high performance in biological plausibility of gene groupings. Analysis of differentially ex pressed genes of several reported cancers using the extracted modules successfully added relational information consistent with previous reports, confirming the usefulness of our framework.


On the Stability of Citation Networks. Citation networks can reveal many important information regarding the development of science and the relationship between different areas of knowledge. Thus, many studies have analyzed the topological properties of such networks. Frequently, citation networks are created using articles acquired from a set of relevant keywords or queries. Here, we study the robustness of citation networks with regards to the keywords that were used for collecting the respective articles. A perturbation approach is proposed, in which the influence of missing keywords on the topology and community structure of citation networks is quantified. In addition, the relationship between keywords and the community structure of citation networks is studied using networks generated from a simple model. We find that, owing to its highly modular structure, the community structure of citation networks tends to be preserved even when many relevant keywords are left out. Furthermore, the proposed model can reflect the impact of missing keywords on different situations.


Distribution in the unit tangent bundle of the geodesics of given type. Recall that two geodesics in a negatively curved surface S are of the same type if their free homotopy classes differ by a homeomorphism of the surface. In this note we study the distribution in the unit tangent bundle of the geodesics of fixed type, proving that they are asymptotically equidistributed with respect to a certain measure mathfrak m S on T 1S . We study a few properties of this measure, showing for example that it distinguishes between hyperbolic surfaces.


Unsupervised Joint Learning of Depth, Optical Flow, Ego motion from Video. Estimating geometric elements such as depth, camera motion, and optical flow from images is an important part of the robot's visual perception. We use a joint self supervised method to estimate the three geometric elements. Depth network, optical flow network and camera motion network are independent of each other but are jointly optimized during training phase. Compared with independent training, joint training can make full use of the geometric relationship between geometric elements and provide dynamic and static information of the scene. In this paper, we improve the joint self supervision method from three aspects network structure, dynamic object segmentation, and geometric constraints. In terms of network structure, we apply the attention mechanism to the camera motion network, which helps to take advantage of the similarity of camera movement between frames. And according to attention mechanism in Transformer, we propose a plug and play convolutional attention module. In terms of dynamic object, according to the different influences of dynamic objects in the optical flow self supervised framework and the depth pose self supervised framework, we propose a threshold algorithm to detect dynamic regions, and mask that in the loss function respectively. In terms of geometric constraints, we use traditional methods to estimate the fundamental matrix from the corresponding points to constrain the camera motion network. We demonstrate the effectiveness of our method on the KITTI dataset. Compared with other joint self supervised methods, our method achieves state of the art performance in the estimation of pose and optical flow, and the depth estimation has also achieved competitive results. Code will be available https github.com jianfenglihg Unsupervised geometry.


A uniform version of the Yau Tian Donaldson correspondence for extremal K "ahler metrics on polarized toric manifolds. The aim of this paper is to solve a uniform version of the Yau Tian Donaldson conjecture for polarized toric manifolds. Also, we show a combinatorial sufficient condition for uniform relative K polystability.


Adaptive BEM for elliptic PDE systems, part II Isogeometric analysis with hierarchical B splines for weakly singular integral equations. We formulate and analyze an adaptive algorithm for isogeometric analysis with hierarchical B splines for weakly singular boundary integral equations. We prove that the employed weighted residual error estimator is reliable and converges at optimal algebraic rate. Numerical experiments with isogeometric boundary elements for the 3D Poisson problem confirm the theoretical results, which also cover general elliptic systems like linear elasticity.


Flexible Functional Split for Processing Sharing and CoMP Enhanced Mixed eMBB URLLC Services in Beyond 5G Wireless Networks. With explosively escalating service demands, beyond fifth generation (B5G) aims to realize various requirements for multi service networks, i.e., mixed enhanced mobile broadband (eMBB) and ultra reliable low latency communication (URLLC) services. To flexibly serve diverse traffic, various functional split options (FSOs) are specified by B5G protocols enabling different network functions. In order to improve signal qualities for edge users, we consider FSO based coordinated multi point (CoMP) transmission as a prominent technique capable of supporting high traffic demands. However, due to conventional confined hardware processing capability, a processing sharing (PS) model is introduced to deal with high latency for multi service FSO based networks. Therefore, it becomes essential to assign CoMP enhanced functional split modes under PS model. A more tractable FSO based network in terms of ergodic rate and reliability is derived by stochastic geometry approach. Moreover, we have proposed CoMP enhanced functional split mode allocation (CFSMA) scheme to adaptively assign FSOs to provide enhanced mixed URLLC eMBB services. The simulation results have validated analytical derivation and demonstrated that the proposed CFSMA scheme optimizes system spectrum efficiency while guaranteeing stringent latency requirement.


Computational methods for t spread monomial ideals. Let K be a field and S K x 1, ldots,x n a standard polynomial ring over K . In this paper, some new optimized algorithms to compute the smallest t spread lexicographic set and the smallest t spread strongly stable set containing a given set of t spread monomials of S are presented. Some technical tools allowing to compute the cardinality of t spread strongly stable sets avoiding their construction are given. Then, a emph Macaulay2 package, texttt TSpreadIdeals , providing methods to easily manage t spread monomials and t spread ideals is implemented. Some functions to ease the calculation of well known results about algebraic invariants for t spread ideals are also provided.


When Can Liquid Democracy Unveil the Truth?. In this paper, we investigate the so called ODP problem that has been formulated by Caragiannis and Micha 10 . Here, we are in a setting with two election alternatives out of which one is assumed to be correct. In ODP, the goal is to organise the delegations in the social network in order to maximize the probability that the correct alternative, referred to as ground truth, is elected. While the problem is known to be computationally hard, we strengthen existing hardness results by providing a novel strong approximation hardness result For any positive constant C , we prove that, unless P NP , there is no polynomial time algorithm for ODP that achieves an approximation guarantee of alpha ge ( ln n) C , where n is the number of voters. The reduction designed for this result uses poorly connected social networks in which some voters suffer from misinformation. Interestingly, under some hypothesis on either the accuracies of voters or the connectivity of the network, we obtain a polynomial time 1 2 approximation algorithm. This observation proves formally that the connectivity of the social network is a key feature for the efficiency of the liquid democracy paradigm. Lastly, we run extensive simulations and observe that simple algorithms (working either in a centralized or decentralized way) outperform direct democracy on a large class of instances. Overall, our contributions yield new insights on the question in which situations liquid democracy can be beneficial.


From Textual to Verbal Communication Towards Applying Sentiment Analysis to a Software Project Meeting. Sentiment analysis gets increasing attention in software engineering with new tools emerging from new insights provided by researchers. Existing use cases and tools are meant to be used for textual communication such as comments on collaborative version control systems. While this can already provide useful feedback for development teams, a lot of communication takes place in meetings and is not suited for present tool designs and concepts. In this paper, we present a concept that is capable of processing live meeting audio and classifying transcribed statements into sentiment polarity classes. We combine the latest advances in open source speech recognition with previous research in sentiment analysis. We tested our approach on a student software project meeting to gain proof of concept, showing moderate agreement between the classifications of our tool and a human observer on the meeting audio. Despite the preliminary character of our study, we see promising results motivating future research in sentiment analysis on meetings. For example, the polarity classification can be extended to detect destructive behaviour that can endanger project success.


Inertial range statistics of the Entropic Lattice Boltzmann in 3D turbulence. We present a quantitative analysis of the inertial range statistics produced by Entropic Lattice Boltzmann Method (ELBM) in the context of 3d homogeneous and isotropic turbulence. ELBM is a promising mesoscopic model particularly interesting for the study of fully developed turbulent flows because of its intrinsic scalability and its unconditional stability. In the hydrodynamic limit, the ELBM is equivalent to the Navier Stokes equations with an extra eddy viscosity term 1 . From this macroscopic formulation, we have derived a new hydrodynamical model that can be implemented as a Large Eddy Simulation (LES) closure. This model is not positive definite, hence, able to reproduce backscatter events of energy transferred from the subgrid to the resolved scales. A statistical comparison of both mesoscopic and macroscopic entropic models based on the ELBM approach is presented and validated against fully resolved Direct Numerical Simulations (DNS). Besides, we provide a second comparison of the ELBM with respect to the well known Smagorinsky closure. We found that ELBM is able to extend the energy spectrum scaling range preserving at the same time the simulation stability. Concerning the statistics of higher order, inertial range observables, ELBM accuracy is shown to be comparable with other approaches such as Smagorinsky model.


Graph Based Similarity of Neural Network Representations. Understanding the black box representations in Deep Neural Networks (DNN) is an essential problem in deep learning. In this work, we propose Graph Based Similarity (GBS) to measure the similarity of layer features. Contrary to previous works that compute the similarity directly on the feature maps, GBS measures the correlation based on the graph constructed with hidden layer outputs. By treating each input sample as a node and the corresponding layer output similarity as edges, we construct the graph of DNN representations for each layer. The similarity between graphs of layers identifies the correspondences between representations of models trained in different datasets and initializations. We demonstrate and prove the invariance property of GBS, including invariance to orthogonal transformation and invariance to isotropic scaling, and compare GBS with CKA. GBS shows state of the art performance in reflecting the similarity and provides insights on explaining the adversarial sample behavior on the hidden layer space.


Adaptive Modeling Powers Fast Multi parameter Fitting of CARS Spectra. Coherent anti Stokes Raman Spectroscopy (CARS) is a laser based measurement technique widely applied across many science and engineering disciplines to perform non intrusive gas diagnostics. CARS is often used to study combustion, where the measured spectra can be used to simultaneously recover multiple flow parameters from the reacting gas such as temperature and relative species mole fractions. This is typically done by using numerical optimization to find the flow parameters for which a theoretical model of the CARS spectra best matches the actual measurements. The most commonly used theoretical model is the CARSFT spectrum calculator. Unfortunately, this CARSFT spectrum generator is computationally expensive and using it to recover multiple flow parameters can be prohibitively time consuming, especially when experiments have hundreds or thousands of measurements distributed over time or space. To overcome these issues, several methods have been developed to approximate CARSFT using a library of pre computed theoretical spectra. In this work we present a new approach that leverages ideas from the machine learning literature to build an adaptively smoothed kernel based approximator. In application on a simulated dual pump CARS experiment probing a H 2 air flame, we show that the approach can use a small number library spectra to quickly and accurately recover temperature and four gas species' mole fractions. The method's flexibility allows fine tuned navigation of the trade off between speed and accuracy, and makes the approach suitable for a wide range of problems and flow regimes.


Fast ATP dependent Subunit Rotation in Reconstituted FoF1 ATP Synthase Trapped in Solution. FoF1 ATP synthases are ubiquitous membrane bound, rotary motor enzymes that can catalyze ATP synthesis and hydrolysis. Their enzyme kinetics are controlled by internal subunit rotation, by substrate and product concentrations, by mechanical inhibitory mechanisms, but also by the electrochemical potential of protons across the membrane. Single molecule F "orster resonance energy transfer (smFRET) has been used to detect subunit rotation within FoF1 ATP synthases embedded in freely diffusing liposomes. We now report that kinetic monitoring of functional rotation can be prolonged from milliseconds to seconds by utilizing an Anti Brownian electrokinetic trap (ABEL trap). These extended observation times allowed us to observe fluctuating rates of functional rotation for individual FoF1 liposomes in solution. Broad distributions of ATP dependent catalytic rates were revealed. The buildup of an electrochemical potential of protons was confirmed to limit the maximum rate of ATP hydrolysis. In the presence of ionophores or uncouplers, the fastest subunit rotation speeds measured in single reconstituted FoF1 ATP synthases were 180 full rounds per second. This was much faster than measured by biochemical ensemble averaging, but not as fast as the maximum rotational speed reported previously for isolated single F1 complexes uncoupled from the membrane embedded Fo complex. Further application of ABEL trap measurements should help resolve the mechanistic causes of such fluctuating rates of subunit rotation.


Capillary driven fragmentation of large gas bubbles in turbulence. The bubble size distribution below a breaking wave is of paramount interest when quantifying mass exchanges between the atmosphere and oceans. Mass fluxes at the interface are driven by bubbles that are small compared to the Hinze scale d h , the critical size below which bubbles are stable, even though individually these are negligible in volume. Combining experimental and numerical approaches, we report a power law scaling 3 2 of the diameter of small bubble size distribution, for sufficiently large separation of scales between the injection size and the Hinze scale. From an analysis of individual bubble break up events, we show that break ups generating small bubbles are driven by capillary effects, and that their break up time scales with the diameter to the 3 2, which physically explains the sub Hinze scaling observed.


Occlusion Invariant Rotation Equivariant Semi Supervised Depth Based Cross View Gait Pose Estimation. Accurate estimation of three dimensional human skeletons from depth images can provide important metrics for healthcare applications, especially for biomechanical gait analysis. However, there exist inherent problems associated with depth images captured from a single view. The collected data is greatly affected by occlusions where only partial surface data can be recorded. Furthermore, depth images of human body exhibit heterogeneous characteristics with viewpoint changes, and the estimated poses under local coordinate systems are expected to go through equivariant rotations. Most existing pose estimation models are sensitive to both issues. To address this, we propose a novel approach for cross view generalization with an occlusion invariant semi supervised learning framework built upon a novel rotation equivariant backbone. Our model was trained with real world data from a single view and unlabelled synthetic data from multiple views. It can generalize well on the real world data from all the other unseen views. Our approach has shown superior performance on gait analysis on our ICL Gait dataset compared to other state of the arts and it can produce more convincing keypoints on ITOP dataset, than its provided "ground truth".


Differentiable model based adaptive optics for two photon microscopy. Aberrations limit scanning fluorescence microscopy when imaging in scattering materials such as biological tissue. Model based approaches for adaptive optics take advantage of a computational model of the optical setup. Such models can be combined with the optimization techniques of machine learning frameworks to find aberration corrections, as was demonstrated for focusing a laser beam through aberrations onto a camera arXiv 2007.13400 . Here, we extend this approach to two photon scanning microscopy. The developed sensorless technique finds corrections for aberrations in scattering samples and will be useful for a range of imaging application, for example in brain tissue.


Feature Completion for Occluded Person Re Identification. Person re identification (reID) plays an important role in computer vision. However, existing methods suffer from performance degradation in occluded scenes. In this work, we propose an occlusion robust block, Region Feature Completion (RFC), for occluded reID. Different from most previous works that discard the occluded regions, RFC block can recover the semantics of occluded regions in feature space. Firstly, a Spatial RFC (SRFC) module is developed. SRFC exploits the long range spatial contexts from non occluded regions to predict the features of occluded regions. The unit wise prediction task leads to an encoder decoder architecture, where the region encoder models the correlation between non occluded and occluded region, and the region decoder utilizes the spatial correlation to recover occluded region features. Secondly, we introduce Temporal RFC (TRFC) module which captures the long term temporal contexts to refine the prediction of SRFC. RFC block is lightweight, end to end trainable and can be easily plugged into existing CNNs to form RFCnet. Extensive experiments are conducted on occluded and commonly holistic reID benchmarks. Our method significantly outperforms existing methods on the occlusion datasets, while remains top even superior performance on holistic datasets. The source code is available at https github.com blue blue272 OccludedReID RFCnet.


Extending Lagrangian and Hamiltonian Neural Networks with Differentiable Contact Models. The incorporation of appropriate inductive bias plays a critical role in learning dynamics from data. A growing body of work has been exploring ways to enforce energy conservation in the learned dynamics by encoding Lagrangian or Hamiltonian dynamics into the neural network architecture. These existing approaches are based on differential equations, which do not allow discontinuity in the states and thereby limit the class of systems one can learn. However, in reality, most physical systems, such as legged robots and robotic manipulators, involve contacts and collisions, which introduce discontinuities in the states. In this paper, we introduce a differentiable contact model, which can capture contact mechanics frictionless frictional, as well as elastic inelastic. This model can also accommodate inequality constraints, such as limits on the joint angles. The proposed contact model extends the scope of Lagrangian and Hamiltonian neural networks by allowing simultaneous learning of contact and system properties. We demonstrate this framework on a series of challenging 2D and 3D physical systems with different coefficients of restitution and friction. The learned dynamics can be used as a differentiable physics simulator for downstream gradient based optimization tasks, such as planning and control.


Matching integral 2 connected graphs. In this note we present an infinite family of 2 connected graphs such that their matching polynomials have only integer zeros. This answers in negative a question of Akbari et al. Graphs with integer matching polynomial zeros, Discrete Appl. Math. 224 (2017), 1 8 .


Exploring a Unified Sequence To Sequence Transformer for Medical Product Safety Monitoring in Social Media. Adverse Events (AE) are harmful events resulting from the use of medical products. Although social media may be crucial for early AE detection, the sheer scale of this data makes it logistically intractable to analyze using human agents, with NLP representing the only low cost and scalable alternative. In this paper, we frame AE Detection and Extraction as a sequence to sequence problem using the T5 model architecture and achieve strong performance improvements over competitive baselines on several English benchmarks (F1 0.71, 12.7 relative improvement for AE Detection Strict F1 0.713, 12.4 relative improvement for AE Extraction). Motivated by the strong commonalities between AE related tasks, the class imbalance in AE benchmarks and the linguistic and structural variety typical of social media posts, we propose a new strategy for multi task training that accounts, at the same time, for task and dataset characteristics. Our multi task approach increases model robustness, leading to further performance gains. Finally, our framework shows some language transfer capabilities, obtaining higher performance than Multilingual BERT in zero shot learning on French data.


A Markov Decision Process Approach for Managing Medical Drone Deliveries. We consider the problem of optimizing the distribution operations at a drone hub that dispatches drones to different geographic locations generating stochastic demands for medical supplies. Drone delivery is an innovative method that introduces many benefits, such as low contact delivery, thereby reducing the spread of pandemic and vaccine preventable diseases. While we focus on medical supply delivery for this work, drone delivery is suitable for many other items, including food, postal parcels, and e commerce. In this paper, our goal is to address drone delivery challenges related to the stochastic demands of different geographic locations. We consider different classes of demand related to geographic locations that require different flight ranges, which is directly related to the amount of charge held in a drone battery. We classify the stochastic demands based on their distance from the drone hub, use a Markov decision process to model the problem, and perform computational tests using realistic data representing a prominent drone delivery company. We solve the problem using a reinforcement learning method and show its high performance compared with the exact solution found using dynamic programming. Finally, we analyze the results and provide insights for managing the drone hub operations.


Fixed time Cooperative Guidance Law for Multiple Missiles in Simultaneous Attacks. To enable multiple missiles to attack a maneuvering target simultaneously, fixed time distributed cooperative guidance laws are proposed in this paper. Here, we present a novel fixed time fast nonsingular terminal sliding mode surface (FNTSMS). In particular, the sliding mode surface not only avoids singularities but also has the characteristic of a settling time boundary regardless of the initial conditions. Based on the FNTSMS, we have developed a distributed guidance law, which has the characteristic of fixed time convergence. The guidance law achieves the consensus of range to go, relative velocity along and perpendicular to the line of sight (LOS) direction to realize the simultaneous attack. In addition, a saturation function is introduced to avoid the chattering problem caused by the commonly used sign function. Furthermore, the distributed cooperative guidance law with communication failure is considered and proved theoretically, which shows that the proposed guidance law has excellent performance. Finally, the simulation results verify the performance of the distributed guidance law and its robustness against communication topology mutations, and explain the phenomenon in detail.


Counterfactual Contextual Multi Armed Bandit a Real World Application to Diagnose Apple Diseases. Post harvest diseases of apple are one of the major issues in the economical sector of apple production, causing severe economical losses to producers. Thus, we developed DSSApple, a picture based decision support system able to help users in the diagnosis of apple diseases. Specifically, this paper addresses the problem of sequentially optimizing for the best diagnosis, leveraging past interactions with the system and their contextual information (i.e. the evidence provided by the users). The problem of learning an online model while optimizing for its outcome is commonly addressed in the literature through a stochastic active learning paradigm i.e. Contextual Multi Armed Bandit (CMAB). This methodology interactively updates the decision model considering the success of each past interaction with respect to the context provided in each round. However, this information is very often partial and inadequate to handle such complex decision making problems. On the other hand, human decisions implicitly include unobserved factors (referred in the literature as unobserved confounders) that significantly contribute to the human's final decision. In this paper, we take advantage of the information embedded in the observed human decisions to marginalize confounding factors and improve the capability of the CMAB model to identify the correct diagnosis. Specifically, we propose a Counterfactual Contextual Multi Armed Bandit, a model based on the causal concept of counterfactual. The proposed model is validated with offline experiments based on data collected through a large user study on the application. The results prove that our model is able to outperform both traditional CMAB algorithms and observed user decisions, in real world tasks of predicting the correct apple disease.


Accelerated Optimization on Riemannian Manifolds via Discrete Constrained Variational Integrators. A variational formulation for accelerated optimization on normed vector spaces was recently introduced in Wibisono et al., and later generalized to the Riemannian manifold setting in Duruisseaux and Leok. This variational framework was exploited on normed vector spaces in Duruisseaux et al. using time adaptive geometric integrators to design efficient explicit algorithms for symplectic accelerated optimization, and it was observed that geometric discretizations which respect the time rescaling invariance and symplecticity of the Lagrangian and Hamiltonian flows were substantially less prone to stability issues, and were therefore more robust, reliable, and computationally efficient. As such, it is natural to develop time adaptive Hamiltonian variational integrators for accelerated optimization on Riemannian manifolds. In this paper, we consider the case of Riemannian manifolds embedded in a Euclidean space that can be characterized as the level set of a submersion. We will explore how holonomic constraints can be incorporated in discrete variational integrators to constrain the numerical discretization of the Riemannian Hamiltonian system to the Riemannian manifold, and we will test the performance of the resulting algorithms by solving eigenvalue and Procrustes problems formulated as optimization problems on the unit sphere and Stiefel manifold.


Learning Novel Objects Continually Through Curiosity. Children learn continually by asking questions about the concepts they are most curious about. With robots becoming an integral part of our society, they must also learn unknown concepts continually by asking humans questions. The paper analyzes a recent state of the art approach for continual learning. The paper further develops a self supervised technique to find most of the uncertain objects in an environment by utilizing the cluster representation of the previously learned classes. We test our approach on a benchmark dataset for continual learning on robots. Our results show that our curiosity driven continual learning approach beats random sampling and softmax based uncertainty sampling in terms of classification accuracy and the total number of classes learned.


Estimating the Robustness of Public Transport Systems Using Machine Learning. The planning of attractive and cost efficient public transport systems is a highly complex optimization process involving many steps. Integrating robustness from a passenger's point of view makes the task even more challenging. With numerous different definitions of robustness in literature, a real world acceptable evaluation of the robustness of a public transport system is to simulate its performance under a large number of possible scenarios. Unfortunately, this is computationally very expensive. In this paper, we therefore explore a new way of such a scenario based robustness approximation by using methods from machine learning. We achieve a fast approach with a very high accuracy by gathering a subset of key features of a public transport system and its passenger demand and training an artificial neural network to learn the outcome of a given set of robustness tests. The network is then able to predict the robustness of untrained instances with high accuracy using only its key features, allowing for a robustness oracle for transport planners that approximates the robustness in constant time. Such an oracle can be used as black box to increase the robustness within a local search framework for integrated public transportation planning. In computational experiments with different benchmark instances we demonstrate an excellent quality of our predictions.


Matching Theory Based Multi User Cooperative Computing Framework. In this paper, we propose a matching theory based multi user cooperative computing (MUCC) scheme to minimize the overall energy consumption of a group of user equipments (UEs), where the UEs can be classified into the following roles resource demander (RD), resource provider (RP), and standalone UE (SU). We first determine the role of each UE by leveraging the roommate matching method. Then, we propose the college admission based algorithm to divide the UEs into multiple cooperation groups, each consisting of one RP and multiple RDs. Next, we propose the rotation swap operation to further improve the performance without deteriorating the system stability. Finally, we present an effective task offloading algorithm to minimize the energy consumption of all the cooperation groups. The simulation results verify the effectiveness of the proposed scheme.