Delving into Variance Transmission and Normalization Shift of Average Gradient Makes the Network Collapse. Normalization operations are essential for state of the art neural networks and enable us to train a network from scratch with a large learning rate (LR). We attempt to explain the real effect of Batch Normalization (BN) from the perspective of variance transmission by investigating the relationship between BN and Weights Normalization (WN). In this work, we demonstrate that the problem of the shift of the average gradient will amplify the variance of every convolutional (conv) layer. We propose Parametric Weights Standardization (PWS), a fast and robust to mini batch size module used for conv filters, to solve the shift of the average gradient. PWS can provide the speed up of BN. Besides, it has less computation and does not change the output of a conv layer. PWS enables the network to converge fast without normalizing the outputs. This result enhances the persuasiveness of the shift of the average gradient and explains why BN works from the perspective of variance transmission. The code and appendix will be made available on https github.com lyxzzz PWSConv.


Driver centric Risk Object Identification. A massive number of traffic fatalities are due to driver errors. To reduce fatalities, developing intelligent driving systems assisting drivers to identify potential risks is in urgent need. Risky situations are generally defined based on collision prediction in existing research. However, collisions are only one type of risk in traffic scenarios. We believe a more generic definition is required. In this work, we propose a novel driver centric definition of risk, i.e., risky objects influence driver behavior. Based on this definition, a new task called risk object identification is introduced. We formulate the task as a cause effect problem and present a novel two stage risk object identification framework, taking inspiration from models of situation awareness and causal inference. A driver centric Risk Object Identification (ROI) dataset is curated to evaluate the proposed system. We demonstrate state of the art risk object identification performance compared with strong baselines on the ROI dataset. In addition, we conduct extensive ablative studies to justify our design choices.


A feasibility Study of Time of Flight Computed Tomography for Breast Imaging. Cone beam computed tomography (CBCT) for breast imaging has potential to replace conventional mammograms. However, concerns over dose and image quality prevent CBBCT systems from the clinical trial phase to next stage. The time of flight (TOF) method was recently shown to reduce the x ray scattering effects by 95 and improve the image CNR by 110 for large volume objects. The advancements in x ray sources like in compact Free Electron Lasers (FEL) and advancements in detector technology show potential for the TOF method to be feasible in CBCT when imaging large objects. In this study, we investigate the efficacy of this TOF CBCT in improving the breast cancer imaging. The GATE software was used to simulate the cone beam CT imaging of an 8 cm diameter cylindrical water phantom using a modeled 20 keV quasi energetic FEL source and various detector temporal resolutions ranging from 1 to 1000 ps. An inhomogeneous breast phantom of similar size was also imaged using the same system setup. Results show that a detector temporal resolution of 10 ps improved the image contrast to noise ratio (CNR) by 57 and reduced the scatter to primary ratio (SPR) by 8.63 for a small cylindrical phantom. For the breast phantom, the image CNR was enhanced by 12 and the SPR was reduced by 1.35 at 5 ps temporal resolution.


Asymmetric Loss Functions for Learning with Noisy Labels. Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the symmetric condition is overly restrictive. In this work, we propose a new class of loss functions, namely textit asymmetric loss functions , which are robust to learning with noisy labels for various types of noise. We investigate general theoretical properties of asymmetric loss functions, including classification calibration, excess risk bound, and noise tolerance. Meanwhile, we introduce the asymmetry ratio to measure the asymmetry of a loss function. The empirical results show that a higher ratio would provide better noise tolerance. Moreover, we modify several commonly used loss functions and establish the necessary and sufficient conditions for them to be asymmetric. Experimental results on benchmark datasets demonstrate that asymmetric loss functions can outperform state of the art methods. The code is available at href https github.com hitcszx ALFs https github.com hitcszx ALFs


Isochronicity in 1 DOF. Our main result is the complete set of explicit conditions necessary and sufficient for isochronicity of a Hamiltonian system with one degree of freedom. The conditions are presented in terms of Taylor coefficients of the Hamiltonian function.


On hydrodynamic limits of the Vlasov Navier Stokes system. We introduce a framework to justify hydrodynamic limits of the Vlasov Navier Stokes system. We specifically study high friction regimes, which take into account the fact that particles of the dispersed phase are light (resp. small) compared to the fluid part, and lead to the derivation of Transport Navier Stokes (resp. Inhomogeneous Navier Stokes) systems.


Accelerated Primal Dual Gradient Method for Smooth and Convex Concave Saddle Point Problems with Bilinear Coupling. In this paper we study the convex concave saddle point problem min x max y f(x) y T mathbf A x g(y) , where f(x) and g(y) are smooth and convex functions. We propose an Accelerated Primal Dual Gradient Method (APDG) for solving this problem, achieving (i) an optimal linear convergence rate in the strongly convex strongly concave regime, matching the lower complexity bound (Zhang et al., 2021), and (ii) an accelerated linear convergence rate in the case when only one of the functions f(x) and g(y) is strongly convex or even none of them are. Finally, we obtain a linearly convergent algorithm for the general smooth and convex concave saddle point problem min x max y F(x,y) without the requirement of strong convexity or strong concavity.


Ranked masses in two parameter Fleming Viot diffusions. In previous work, we constructed Fleming Viot type measure valued diffusions (and diffusions on a space of interval partitions of the unit interval 0,1 ) that are stationary with the Poisson Dirichlet laws with parameters alpha in(0,1) and theta geq 0 . In this paper, we complete the proof that these processes resolve a conjecture by Feng and Sun (2010) by showing that the processes of ranked atom sizes (or of ranked interval lengths) of these diffusions are members of a two parameter family of diffusions introduced by Petrov (2009), extending a model by Ethier and Kurtz (1981) in the case alpha 0 . The latter diffusions are continuum limits of up down Chinese restaurant processes.


Data Engineering for Everyone. Data engineering is one of the fastest growing fields within machine learning (ML). As ML becomes more common, the appetite for data grows more ravenous. But ML requires more data than individual teams of data engineers can readily produce, which presents a severe challenge to ML deployment at scale. Much like the software engineering revolution, where mass adoption of open source software replaced the closed, in house development model for infrastructure code, there is a growing need to enable rapid development and open contribution to massive machine learning data sets. This article shows that open source data sets are the rocket fuel for research and innovation at even some of the largest AI organizations. Our analysis of nearly 2000 research publications from Facebook, Google and Microsoft over the past five years shows the widespread use and adoption of open data sets. Open data sets that are easily accessible to the public are vital to accelerating ML innovation for everyone. But such open resources are scarce in the wild. So, what if we are able to accelerate data set creation via automatic data set generation tools?


The Deligne Simpson problem for connections on mathbb G m with a maximally ramified singularity. The classical additive Deligne Simpson problem is the existence problem for Fuchsian connections with residues at the singular points in specified adjoint orbits. Crawley Boevey found the solution in 2003 by reinterpreting the problem in terms of quiver varieties. A more general version of this problem, solved by Hiroe, allows additional unramified irregular singularities. We apply the theory of fundamental and regular strata due to Bremer and Sage to formulate a version of the Deligne Simpson problem in which certain ramified singularities are allowed. These allowed singular points are called toral singularities they are singularities whose leading term with respect to a lattice chain filtration is regular semisimple. We solve this problem in the important special case of connections on mathbb G m with a maximally ramified singularity at 0 and possibly an additional regular singular point at infinity. We also give a complete characterization of all such connections which are rigid, under the additional hypothesis of unipotent monodromy at infinity.


Semi supervised dry herbage mass estimation using automatic data and synthetic images. Monitoring species specific dry herbage biomass is an important aspect of pasture based milk production systems. Being aware of the herbage biomass in the field enables farmers to manage surpluses and deficits in herbage supply, as well as using targeted nitrogen fertilization when necessary. Deep learning for computer vision is a powerful tool in this context as it can accurately estimate the dry biomass of a herbage parcel using images of the grass canopy taken using a portable device. However, the performance of deep learning comes at the cost of an extensive, and in this case destructive, data gathering process. Since accurate species specific biomass estimation is labor intensive and destructive for the herbage parcel, we propose in this paper to study low supervision approaches to dry biomass estimation using computer vision. Our contributions include a synthetic data generation algorithm to generate data for a herbage height aware semantic segmentation task, an automatic process to label data using semantic segmentation maps, and a robust regression network trained to predict dry biomass using approximate biomass labels and a small trusted dataset with gold standard labels. We design our approach on a herbage mass estimation dataset collected in Ireland and also report state of the art results on the publicly released Grass Clover biomass estimation dataset from Denmark. Our code is available at https git.io J0L2a


Representations of Degenerate Affine Hecke Algebra of Type C n Under the Etingof Freund Ma Functor. We compute the image of a polynomial GL N module under the Etingof Freund Ma functor cite EFM . We give a combinatorial description of the image in terms of standard tableaux on a collection of skew shapes and analyze weights of the image in terms of contents.


R Learning Based Admission Control for Service Federation in Multi domain 5G Networks. Service federation in 5G B5G networks enables service providers to orchestrate network services across multiple domains where admission control is a key issue. For each demand, without knowing the future ones, the admission controller either determines the domain to deploy the demand or rejects it in order to maximize the long term average profit. In this paper, at first, under the assumption of knowing the arrival and departure rates of demands, we obtain the optimal admission control policy by formulating the problem as a Markov decision process that is solved by the policy iteration method. As a practical solution, where the rates are not known, we apply the Q Learning and R Learning algorithms to approximate the optimal policy. The extensive simulation results show the learning approaches outperform the greedy policy, and while the performance of Q Learning depends on the discount factor, the optimality gap of the R Learning algorithm is at most 3 5 independent of the system configuration.


Hamiltonian loop group spaces and a theorem of Teleman and Woodward. We study a natural family of elliptic boundary problems on a compact surface Sigma parametrized by a non compact moduli space of flat G connections with framings along partial Sigma . We prove that the family has a well defined equivariant analytic index and derive various cohomological formulas (non abelian, delocalized, abelian). When Sigma has a single boundary component and one takes the invariant part of the index, our abelian localization formula reproduces the Teleman Woodward formula for the index of the Atiyah Bott classes on the moduli stack of G mathbb C bundles. We carry out the analysis more generally for suitable Fredholm families over Hamiltonian loop group spaces.


Amorphic complexity of group actions with applications to quasicrystals. In this article, we define amorphic complexity for actions of locally compact sigma compact amenable groups on compact metric spaces. Amorphic complexity, originally introduced for mathbb Z actions, is a topological invariant which measures the complexity of dynamical systems in the regime of zero entropy. We show that it is tailor made to study strictly ergodic group actions with discrete spectrum and continuous eigenfunctions. This class of actions includes, in particular, Delone dynamical systems related to regular model sets obtained via Meyer's cut and project method. We provide sharp upper bounds on amorphic complexity of such systems. In doing so, we observe an intimate relationship between amorphic complexity and fractal geometry.


Frequency comb induced radiation pressure force in dense atomic clouds. We investigate the frequency comb induced radiation pressure force acting on a cloud of cold 87 Rb atoms. Reduction and spectral broadening of the frequency comb force are observed as the cloud's optical thickness is increased. Since the radiation pressure force is uniquely determined by light scattered by an atomic cloud, we discuss different scattering mechanisms, and point to the shadow effect as the dominant mechanism affecting FC induced force in resonantly excited dense atomic clouds. Our results improve the understanding of the interaction of frequency comb light with many atom ensembles, which is essential for novel frequency comb applications in simultaneous multi species cooling, multi mode quantum memories, and multi mode atom light interfaces.


Sewer ML A Multi Label Sewer Defect Classification Dataset and Benchmark. Perhaps surprisingly sewerage infrastructure is one of the most costly infrastructures in modern society. Sewer pipes are manually inspected to determine whether the pipes are defective. However, this process is limited by the number of qualified inspectors and the time it takes to inspect a pipe. Automatization of this process is therefore of high interest. So far, the success of computer vision approaches for sewer defect classification has been limited when compared to the success in other fields mainly due to the lack of public datasets. To this end, in this work we present a large novel and publicly available multi label classification dataset for image based sewer defect classification called Sewer ML. The Sewer ML dataset consists of 1.3 million images annotated by professional sewer inspectors from three different utility companies across nine years. Together with the dataset, we also present a benchmark algorithm and a novel metric for assessing performance. The benchmark algorithm is a result of evaluating 12 state of the art algorithms, six from the sewer defect classification domain and six from the multi label classification domain, and combining the best performing algorithms. The novel metric is a class importance weighted F2 score, text F 2 text CIW , reflecting the economic impact of each class, used together with the normal pipe F1 score, text F 1 text Normal . The benchmark algorithm achieves an text F 2 text CIW score of 55.11 and text F 1 text Normal score of 90.94 , leaving ample room for improvement on the Sewer ML dataset. The code, models, and dataset are available at the project page https vap.aau.dk sewer ml


Automatic Knowledge Extraction with Human Interface. OrbWeaver, an automatic knowledge extraction system paired with a human interface, streamlines the use of unintuitive natural language processing software for modeling systems from their documentation. OrbWeaver enables the indirect transfer of knowledge about legacy systems by leveraging open source tools in document understanding and processing as well as using web based user interface constructs. By design, OrbWeaver is scalable, extensible, and usable we demonstrate its utility by evaluating its performance in processing a corpus of documents related to advanced persistent threats in the cyber domain. The results indicate better knowledge extraction by revealing hidden relationships, linking co related entities, and gathering evidence.


Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition. Current state of the art visual recognition systems usually rely on the following pipeline (a) pretraining a neural network on a large scale dataset (e.g., ImageNet) and (b) finetuning the network weights on a smaller, task specific dataset. Such a pipeline assumes the sole weight adaptation is able to transfer the network capability from one domain to another domain, based on a strong assumption that a fixed architecture is appropriate for all domains. However, each domain with a distinct recognition target may need different levels paths of feature hierarchy, where some neurons may become redundant, and some others are re activated to form new network structures. In this work, we prove that dynamically adapting network architectures tailored for each domain task along with weight finetuning benefits in both efficiency and effectiveness, compared to the existing image recognition pipeline that only tunes the weights regardless of the architecture. Our method can be easily generalized to an unsupervised paradigm by replacing supernet training with self supervised learning in the source domain tasks and performing linear evaluation in the downstream tasks. This further improves the search efficiency of our method. Moreover, we also provide principled and empirical analysis to explain why our approach works by investigating the ineffectiveness of existing neural architecture search. We find that preserving the joint distribution of the network architecture and weights is of importance. This analysis not only benefits image recognition but also provides insights for crafting neural networks. Experiments on five representative image recognition tasks such as person re identification, age estimation, gender recognition, image classification, and unsupervised domain adaptation demonstrate the effectiveness of our method.


Axis Aligned Square Contact Representations. We introduce a new class mathcal G of bipartite plane graphs and prove that each graph in mathcal G admits a proper square contact representation. A contact between two squares is emph proper if they intersect in a line segment of positive length. The class mathcal G is the family of quadrangulations obtained from the 4 cycle C 4 by successively inserting a single vertex or a 4 cycle of vertices into a face. For every graph G in mathcal G , we construct a proper square contact representation. The key parameter of the recursive construction is the aspect ratio of the rectangle bounded by the four outer squares. We show that this aspect ratio may continuously vary in an interval I G . The interval I G cannot be replaced by a fixed aspect ratio, however, as we show, the feasible interval I G may be an arbitrarily small neighborhood of any positive real.


ReAct Out of distribution Detection With Rectified Activations. Out of distribution (OOD) detection has received much attention lately due to its practical importance in enhancing the safe deployment of neural networks. One of the primary challenges is that models often produce highly confident predictions on OOD data, which undermines the driving principle in OOD detection that the model should only be confident about in distribution samples. In this work, we propose ReAct a simple and effective technique for reducing model overconfidence on OOD data. Our method is motivated by novel analysis on internal activations of neural networks, which displays highly distinctive signature patterns for OOD distributions. Our method can generalize effectively to different network architectures and different OOD detection scores. We empirically demonstrate that ReAct achieves competitive detection performance on a comprehensive suite of benchmark datasets, and give theoretical explication for our method's efficacy. On the ImageNet benchmark, ReAct reduces the false positive rate (FPR95) by 25.05 compared to the previous best method.


Self balanced Learning For Domain Generalization. Domain generalization aims to learn a prediction model on multi domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the source data is well balanced in terms of both domain and class. However, real world training data collected with different composition biases often exhibits severe distribution gaps for domain and class, leading to substantial performance degradation. In this paper, we propose a self balanced domain generalization framework that adaptively learns the weights of losses to alleviate the bias caused by different distributions of the multi domain source data. The self balanced scheme is based on an auxiliary reweighting network that iteratively updates the weight of loss conditioned on the domain and class information by leveraging balanced meta data. Experimental results demonstrate the effectiveness of our method overwhelming state of the art works for domain generalization.


Recent progress on rigity properties of higher rank diagonalizable actions and applications. The rigidity propeties of higher rank diagonalizable actions is a major theme in homogenous dynamics, with origins in work of Cassels and Swinnerton Dyer in the 1950s and Furstenberg. We survey both results and conjectures regarding such actions, with emphasize on the applications of these results towards understanding the distribution of integer points on varieties, quantum unique ergodicity, and Diophantine approximations.


Sage Using Unsupervised Learning for Scalable Performance Debugging in Microservices. Cloud applications are increasingly shifting from large monolithic services to complex graphs of loosely coupled microservices. Despite the advantages of modularity and elasticity microservices offer, they also complicate cluster management and performance debugging, as dependencies between tiers introduce backpressure and cascading QoS violations. We present Sage, a machine learning driven root cause analysis system for interactive cloud microservices. Sage leverages unsupervised ML models to circumvent the overhead of trace labeling, captures the impact of dependencies between microservices to determine the root cause of unpredictable performance online, and applies corrective actions to recover a cloud service's QoS. In experiments on both dedicated local clusters and large clusters on Google Compute Engine we show that Sage consistently achieves over 93 accuracy in correctly identifying the root cause of QoS violations, and improves performance predictability.


Positional Marked Patterns in Permutations. We define and study positional marked patterns, permutations tau where one of elements in tau is underlined. Given a permutation sigma , we say that sigma has a tau match at position i if tau occurs in sigma in such a way that sigma i plays the role of the underlined element in the occurrence. We let pmp tau( sigma) denote the number of positions i which sigma has a tau match. This defines a new class of statistics on permutations, where we study such statistics and prove a number of results. In particular, we prove that two positional marked patterns 1 underline 2 3 and 1 underline 3 2 give rise to two statistics that have the same distribution. The equidistibution phenomenon also occurs in other several collections of patterns like left 1 underline 2 3 , 1 underline 3 2 right , and left 1 underline234, 1 underline243, underline2134, underline2 1 4 3 right , as well as two positional marked patterns of any length n left 1 underline 2 tau , underline 21 tau right .


Futuristic Intelligent Transportation System. The emerging autonomous vehicles (AVs) will inevitably revolutionize the transportation systems. This is because of a key feature of AVs instead of being managed by human drivers as the conventional vehicles, AVs are of the complete capability to manage the driving by themselves. As a result, the futuristic intelligent transportation system (FITS) can be a centrally managed and optimized system with the fully coordinated driving of vehicles, which is impossible by the current transportation systems controlled by humans. In this article, we envision the operation of such FITS when AVs, advanced vehicular networks (VANETs) and artificial intelligence (AI) are adopted. Specifically, we first develop the autonomous vehicular networks (AVNs) based on the advanced development of AVs and heterogeneous vehicular communication technologies to achieve global data collection and real time data sharing. With this network architecture, we then integrate AVNs and AI based on the intelligent digital twin (IDT) to design the FITS with the target of setting up an accurate and efficient global traffic scheduling system. After that, compared with the conventional schemes, a customized path planning case is studied to evaluate the performance of the proposed FITS. Finally, we highlight the emerging issues related to the FITS for future research.


Average power scaling of THz spintronic emitters in reflection geometry. Metallic spintronic THz emitters have become well established for offering ultra broadband, gap less THz emission in a variety of excitation regimes, in combination with reliable fabrication and excellent scalability. However, so far, their potential for high average power excitation to reach strong THz fields at high repetition rates has not been thoroughly investigated. In this article, we explore the power scaling behavior of tri layer spintronic emitters using an Yb fiber excitation source, delivering an average power of 18.5 W at 400 kHz repetition rate, temporally compressed to a pulse duration of 27 fs. We confirm that the reflection geometry with back side cooling is ideally suited for these emitters in the high average power excitation regime. In order to understand limiting mechanisms, we disentangle the effects on THz power generation by average power and pulse energy, by varying the repetition rate of the laser. Our results show that the conversion efficiency remains mostly dependent on the incident fluence in this high average power, high repetition rate excitation regime if the emitters are efficiently cooled. Using these findings, we optimize the conversion efficiency to reach 5e 6 at highest excitation powers in the back cooled reflection geometry. Our findings provide guidelines for scaling the power of THz radiation emitted by spintronic emitters to the mW level by using state of the art femtosecond sources with multi hundred Watt average power to reach ultra broadband, strong field THz sources with high repetition rate.


Distribution Dependent Reflecting Stochastic Differential Equations. To characterize the Neumann problem for nonlinear Fokker Planck equations, we investigate distribution dependent reflecting SDEs (DDRSDEs) in a domain. We first prove the well posedness and establish functional inequalities for reflecting SDEs with singular drifts, then extend these results to DDRSDEs with singular or monotone coefficients, for which a general criterion deducing the well posedness of DDRSDEs from that of reflecting SDEs is established.


Frisbee automated testing of Cloud native applications in Kubernetes. As more and more companies are migrating (or planning to migrate) from on premise to Cloud, their focus is to find anomalies and deficits as early as possible in the development life cycle. We propose Frisbee, a declarative language and associated runtime components for testing cloud native applications on top of Kubernetes. Given a template describing the system under test and a workflow describing the experiment, Frisbee automatically interfaces with Kubernetes to deploy the necessary software in containers, launch needed sidecars, execute the workflow steps, and perform automated checks for deviation from expected behavior. We evaluate Frisbee through a series of tests, to demonstrate its role in designing, and evaluating cloud native applications Frisbee helps in testing uncertainties at the level of application (e.g., dynamically changing request patterns), infrastructure (e.g., crashes, network partitions), and deployment (e.g., saturation points). Our findings have strong implications for the design, deployment, and evaluation of cloud applications. The most prominent is that erroneous benchmark outputs can cause an apparent performance improvement, automated failover mechanisms may require interoperability with clients, and that a proper placement policy should also account for the clock frequency, not only the number of cores.


The VVAD LRS3 Dataset for Visual Voice Activity Detection. Robots are becoming everyday devices, increasing their interaction with humans. To make human machine interaction more natural, cognitive features like Visual Voice Activity Detection (VVAD), which can detect whether a person is speaking or not, given visual input of a camera, need to be implemented. Neural networks are state of the art for tasks in Image Processing, Time Series Prediction, Natural Language Processing and other domains. Those Networks require large quantities of labeled data. Currently there are not many datasets for the task of VVAD. In this work we created a large scale dataset called the VVAD LRS3 dataset, derived by automatic annotations from the LRS3 dataset. The VVAD LRS3 dataset contains over 44K samples, over three times the next competitive dataset (WildVVAD). We evaluate different baselines on four kinds of features facial and lip images, and facial and lip landmark features. With a Convolutional Neural Network Long Short Term Memory (CNN LSTM) on facial images an accuracy of 92 was reached on the test set. A study with humans showed that they reach an accuracy of 87.93 on the test set.


Trace estimates of Toeplitz operators on Bergman spaces and applications to composition operators. Let Omega be a subdomain of mathbb C and let mu be a positive Borel measure on Omega . In this paper, we study the asymptotic behavior of the eigenvalues of compact Toeplitz operator T mu acting on Bergman spaces on Omega . Let ( lambda n(T mu)) be the decreasing sequence of the eigenvalues of T mu and let rho be an increasing function such that rho (n) n A is decreasing for some A 0 . We give an explicit necessary and sufficient geometric condition on mu in order to have lambda n(T mu) asymp 1 rho (n) . As applications, we consider composition operators C varphi , acting on some standard analytic spaces on the unit disc mathbb D . First, we give a general criterion ensuring that the singular values of C varphi satisfy s n(C varphi ) asymp 1 rho(n) . Next, we focus our attention on composition operators with univalent symbols, where we express our general criterion in terms of the harmonic measure of varphi mathbb D ) . We finally study the case where partial varphi ( mathbb D ) meets the unit circle in one point and give several concrete examples. Our method is based on upper and lower estimates of the trace of h(T mu) , where h is suitable concave or convex functions.


A Speaker aware Parallel Hierarchical Attentive Encoder Decoder Model for Multi turn Dialogue Generation. This paper presents a novel open domain dialogue generation model emphasizing the differentiation of speakers in multi turn conversations. Differing from prior work that solely relies on the content of conversation history to generate a response, we argue that capturing relative social relations among utterances (i.e., generated by either the same speaker or different persons) benefits the machine capturing fine grained context information from a conversation history to improve context coherence in the generated response. Given that, we propose a speaker aware Parallel Hierarchical Attentive Encoder Decoder (PHAED) model that aims to model each utterance with the awareness of its speaker and contextual associations with the same speaker's previous messages. Specifically, in a conversation involving two speakers, we regard the utterances from one speaker as responses and those from the other as queries. After understanding queries via our encoder with inner query and inter query encodings, our decoder reuses the hidden states of previously generated responses, instead of reconstructing these by the encoder, to generate a new response. Our empirical results show that PHAED outperforms the state of the art in both automatic and human evaluations. Furthermore, our ablation study shows that dialogue models with speaker tokens can generally decrease the possibility of generating non coherent responses regarding the conversation context.


PSRR MaxpoolNMS Pyramid Shifted MaxpoolNMS with Relationship Recovery. Non maximum Suppression (NMS) is an essential postprocessing step in modern convolutional neural networks for object detection. Unlike convolutions which are inherently parallel, the de facto standard for NMS, namely GreedyNMS, cannot be easily parallelized and thus could be the performance bottleneck in convolutional object detection pipelines. MaxpoolNMS is introduced as a parallelizable alternative to GreedyNMS, which in turn enables faster speed than GreedyNMS at comparable accuracy. However, MaxpoolNMS is only capable of replacing the GreedyNMS at the first stage of two stage detectors like Faster RCNN. There is a significant drop in accuracy when applying MaxpoolNMS at the final detection stage, due to the fact that MaxpoolNMS fails to approximate GreedyNMS precisely in terms of bounding box selection. In this paper, we propose a general, parallelizable and configurable approach PSRR MaxpoolNMS, to completely replace GreedyNMS at all stages in all detectors. By introducing a simple Relationship Recovery module and a Pyramid Shifted MaxpoolNMS module, our PSRR MaxpoolNMS is able to approximate GreedyNMS more precisely than MaxpoolNMS. Comprehensive experiments show that our approach outperforms MaxpoolNMS by a large margin, and it is proven faster than GreedyNMS with comparable accuracy. For the first time, PSRR MaxpoolNMS provides a fully parallelizable solution for customized hardware design, which can be reused for accelerating NMS everywhere.


RANP Resource Aware Neuron Pruning at Initialization for 3D CNNs. Although 3D Convolutional Neural Networks are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by pruning therefore becomes highly desirable. However, pruning 3D CNNs is largely unexplored possibly because of the complex nature of typical pruning algorithms that embeds pruning into an iterative optimization paradigm. In this work, we introduce a Resource Aware Neuron Pruning (RANP) algorithm that prunes 3D CNNs at initialization to high sparsity levels. Specifically, the core idea is to obtain an importance score for each neuron based on their sensitivity to the loss function. This neuron importance is then reweighted according to the neuron resource consumption related to FLOPs or memory. We demonstrate the effectiveness of our pruning method on 3D semantic segmentation with widely used 3D UNets on ShapeNet and BraTS'18 datasets, video classification with MobileNetV2 and I3D on UCF101 dataset, and two view stereo matching with Pyramid Stereo Matching (PSM) network on SceneFlow dataset. In these experiments, our RANP leads to roughly 50 95 reduction in FLOPs and 35 80 reduction in memory with negligible loss in accuracy compared to the unpruned networks. This significantly reduces the computational resources required to train 3D CNNs. The pruned network obtained by our algorithm can also be easily scaled up and transferred to another dataset for training.


Flow induced flapping of an inverted flag with non uniform stiffness distribution. We perform high fidelity, two dimensional (2D), fluid structure interaction (FSI) simulations at a Reynolds number of Re 200 of uniform flow past an inverted flag (i.e., clamped at its trailing edge). The inverted flag system can exhibit large amplitude flapping motions (on the order of the flag length) that can be converted to electricity via, e.g., piezoelectric materials. We investigate the effect of structural nonuniformity in altering the FSI dynamics compared with the uniform stiffness scenario that has been thoroughly characterized. We consider linear, quadratic, and cubic stiffness distributions, and demonstrate that the FSI dynamics mirror those of a uniform stiffness flag with an appropriately defined effective stiffness. We show that this effective stiffness can be computed simply via analysis of an emph in vacuo Euler Bernoulli beam. When expressed in terms of the effective stiffness, the FSI dynamics of the nonuniform stiffness flag exhibit the same regimes with many similarities in the detailed dynamics as a uniform stiffness flag. This study opens questions about (i) what the optimal stiffness distribution is for, e.g., energy harvesting capacity, and (ii) how to use nonuniform (and possibly time varying) stiffness distributions to control the flag dynamics towards a desired state.


Neural Codes and Neural ring endomorphisms. We investigate combinatorial, topological and algebraic properties of certain classes of neural codes. We look into a conjecture that states if the minimal textit open convex embedding dimension of a neural code is two then its minimal textit convex embedding dimension is also two. We prove the conjecture for two interesting classes of examples and provide a counterexample for the converse of the conjecture. We introduce a new class of neural codes, textit Doublet maximal . We show that a Doublet maximal code is open convex if and only if it is max intersection complete. We prove that surjective neural ring homomorphisms preserve max intersection complete property. We introduce another class of neural codes, textit Circulant codes . We give the count of neural ring endomorphisms for several sub classes of this class.


Learning Based UAV Trajectory Optimization with Collision Avoidance and Connectivity Constraints. Unmanned aerial vehicles (UAVs) are expected to be an integral part of wireless networks, and determining collision free trajectories for multiple UAVs while satisfying requirements of connectivity with ground base stations (GBSs) is a challenging task. In this paper, we first reformulate the multi UAV trajectory optimization problem with collision avoidance and wireless connectivity constraints as a sequential decision making problem in the discrete time domain. We, then, propose a decentralized deep reinforcement learning approach to solve the problem. More specifically, a value network is developed to encode the expected time to destination given the agent's joint state (including the agent's information, the nearby agents' observable information, and the locations of the nearby GBSs). A signal to interference plus noise ratio (SINR) prediction neural network is also designed, using accumulated SINR measurements obtained when interacting with the cellular network, to map the GBSs' locations into the SINR levels in order to predict the UAV's SINR. Numerical results show that with the value network and SINR prediction network, real time navigation for multi UAVs can be efficiently performed in various environments with high success rate.


Discrete analysis of Schwarz Waveform Relaxation for a simplified air sea coupling problem with nonlinear transmission conditions. In this study we present a non overlapping Schwarz waveform relaxation (SWR) method applied to a one dimensional model problem representative of the coupling between the ocean and the atmosphere. This problem includes nonlinear interface conditions analogous to a quadratic friction law. We study the convergence of the corresponding SWR at a semi discrete level for a linear friction and for a linearized quadratic friction at the interface. Using numerical experiments we show that the convergence properties in the linearized quadratic friction case are very close to the ones obtained with the full nonlinear problem for the range of parameter values of interest. We investigate the possibility to improve the convergence speed by adding a relaxation parameter at the interface.


ES Net Erasing Salient Parts to Learn More in Re Identification. As an instance level recognition problem, re identification (re ID) requires models to capture diverse features. However, with continuous training, re ID models pay more and more attention to the salient areas. As a result, the model may only focus on few small regions with salient representations and ignore other important information. This phenomenon leads to inferior performance, especially when models are evaluated on small inter identity variation data. In this paper, we propose a novel network, Erasing Salient Net (ES Net), to learn comprehensive features by erasing the salient areas in an image. ES Net proposes a novel method to locate the salient areas by the confidence of objects and erases them efficiently in a training batch. Meanwhile, to mitigate the over erasing problem, this paper uses a trainable pooling layer P pooling that generalizes global max and global average pooling. Experiments are conducted on two specific re identification tasks (i.e., Person re ID, Vehicle re ID). Our ES Net outperforms state of the art methods on three Person re ID benchmarks and two Vehicle re ID benchmarks. Specifically, mAP Rank 1 rate 88.6 95.7 on Market1501, 78.8 89.2 on DuckMTMC reID, 57.3 80.9 on MSMT17, 81.9 97.0 on Veri 776, respectively. Rank 1 Rank 5 rate 83.6 96.9 on VehicleID (Small), 79.9 93.5 on VehicleID (Medium), 76.9 90.7 on VehicleID (Large), respectively. Moreover, the visualized salient areas show human interpretable visual explanations for the ranking results.


Finite amplitude RF heating rates for magnetized electrons in neutral plasma. A theoretical model is developed and evaluated using a Vlasov Poisson treatment to calculate radiofrequency (RF) electric field heating rates for magnetized electrons in neutral plasma when the magnetic and electric field directions are colinear and when the RF is of sufficiently high frequency. This calculation reduces to the theory for magnetized longitudinal AC conductivity introduced by Oberman and Shure C. Oberman and F. Shure, Phys. Fluids 6, 834 838 (1963) in the low amplitude limit when the electron oscillation velocity is much less than the thermal velocity. For electron coupling strengths Gamma 0.15 0.015 and RF fields accessible to ultracold neutral plasma experiments, the model predicts mild variations in heating rate of order unity across magnetization strengths spanning orders of magnitude. The predicted effect of including a BGK type collisional relaxation term in the Vlasov equation reduces the heating rate by 5 or less across magnetizations.


Representation of rational positive real functions of several variables by means of positive long resolvent. A rational homogeneous (of degree one) positive real matrix valued function is presented as the Schur complement of a block of the linear pencil with positive semidefinite matrix coefficients. The partial derivative numerators of a rational positive real function are the sums of squares of polynomials.


Spatial correlations in geographical spreading of COVID 19 in USA. The global spread of the COVID 19 pandemic has followed complex pathways, largely attributed to the high virus infectivity, human travel patterns, and the implementation of multiple mitigation measures. The resulting geographic patterns describe the evolution of the epidemic and can indicate areas which are at risk of an outbreak. Here, we analyze the spatial correlations of new active cases in USA at the county level and characterize the extent of these correlations at different times. We show that the epidemic did not progress uniformly and we identify various stages which are distinguished by significant differences in the correlation length. Our results indicate that the correlation length may be large even during periods when the number of cases declines. We find that correlations between urban centers were much more significant than between rural areas and this finding indicates that long range spreading was mainly facilitated by travel between cities, especially at the first months of the epidemic. We also show the existence of a percolation transition in November 2020, when the largest part of the country was connected to a spanning cluster, and a smaller scale transition in January 2021, with both times corresponding to the peak of the epidemic in the country.


Sedimentation effects on particle position and inertial deposition in 90 deg circular bends. Laminar fluid particle flows in bend geometries are present in many industrial, pharmaceutical, and biomedical applications. Particle deposition has been studied extensively however, little attention has been paid to the effect of particle sedimentation on particle position and deposition in different pipe geometry combinations. This study presented a comprehensive analysis of sedimentation effects on particle flow behaviour in 90 deg circular pipe bends of micron particles in laminar pipe flows. Pipe geometry combinations consisted of eight pipe diameters, nine bend radii, and 30 particle diameters in a range of 1 to 100 mu m. The results demonstrated the locations of particles that sedimented to the bottom half of the straight pipe section, and the particle positions upstream from the pipe bend entrance, which was no longer in a fully developed profile. These new locations represent the effects of gravity, pulling the particles down. While obtaining these positions can be found through CFD analysis, we proposed an analytical solution to predict the particle trajectory from different release locations that would help to identify the initial particle distribution at locations upstream to the bend, to obviate the need for long upstream straight pipe sections in the CFD analysis.


Anomaly Detection on Attributed Networks via Contrastive Self Supervised Learning. Anomaly detection on attributed networks attracts considerable research interests due to wide applications of attributed networks in modeling a wide range of complex systems. Recently, the deep learning based anomaly detection methods have shown promising results over shallow approaches, especially on networks with high dimensional attributes and complex structures. However, existing approaches, which employ graph autoencoder as their backbone, do not fully exploit the rich information of the network, resulting in suboptimal performance. Furthermore, these methods do not directly target anomaly detection in their learning objective and fail to scale to large networks due to the full graph training mechanism. To overcome these limitations, in this paper, we present a novel contrastive self supervised learning framework for anomaly detection on attributed networks. Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair, which can capture the relationship between each node and its neighboring substructure in an unsupervised way. Meanwhile, a well designed graph neural network based contrastive learning model is proposed to learn informative embedding from high dimensional attributes and local structure and measure the agreement of each instance pairs with its outputted scores. The multi round predicted scores by the contrastive learning model are further used to evaluate the abnormality of each node with statistical estimation. In this way, the learning model is trained by a specific anomaly detection aware target. Furthermore, since the input of the graph neural network module is batches of instance pairs instead of the full network, our framework can adapt to large networks flexibly. Experimental results show that our proposed framework outperforms the state of the art baseline methods on all seven benchmark datasets.


The complex plank problem, revisited. Ball's complex plank theorem states that if v 1, dots,v n are unit vectors in mathbb C d , and t 1, dots,t n , non negative numbers satisfying sum k 1 nt k 2 1, then there exists a unit vector v in mathbb C d for which langle v k,v rangle geq t k for every k . Here we present a streamlined version of Ball's original proof.


Learning Robot Swarm Tactics over Complex Adversarial Environments. To accomplish complex swarm robotic missions in the real world, one needs to plan and execute a combination of single robot behaviors, group primitives such as task allocation, path planning, and formation control, and mission specific objectives such as target search and group coverage. Most such missions are designed manually by teams of robotics experts. Recent work in automated approaches to learning swarm behavior has been limited to individual primitives with sparse work on learning complete missions. This paper presents a systematic approach to learn tactical mission specific policies that compose primitives in a swarm to accomplish the mission efficiently using neural networks with special input and output encoding. To learn swarm tactics in an adversarial environment, we employ a combination of 1) map to graph abstraction, 2) input output encoding via Pareto filtering of points of interest and clustering of robots, and 3) learning via neuroevolution and policy gradient approaches. We illustrate this combination as critical to providing tractable learning, especially given the computational cost of simulating swarm missions of this scale and complexity. Successful mission completion outcomes are demonstrated with up to 60 robots. In addition, a close match in the performance statistics in training and testing scenarios shows the potential generalizability of the proposed framework.


Towards Explainable Scientific Venue Recommendations. Selecting the best scientific venue (i.e., conference journal) for the submission of a research article constitutes a multifaceted challenge. Important aspects to consider are the suitability of research topics, a venue's prestige, and the probability of acceptance. The selection problem is exacerbated through the continuous emergence of additional venues. Previously proposed approaches for supporting authors in this process rely on complex recommender systems, e.g., based on Word2Vec or TextCNN. These, however, often elude an explanation for their recommendations. In this work, we propose an unsophisticated method that advances the state of the art in two aspects First, we enhance the interpretability of recommendations through non negative matrix factorization based topic models Second, we surprisingly can obtain competitive recommendation performance while using simpler learning methods.


Chordal graphs, higher independence and vertex decomposable complexes. Given a simple undirected graph G there is a simplicial complex mathrm Ind (G) , called the independence complex, whose faces correspond to the independent sets of G . This is a well studied concept because it provides a fertile ground for interactions between commutative algebra, graph theory and algebraic topology. One of the line of research pursued by many authors is to determine the graph classes for which the associated independence complex is Cohen Macaulay. For example, it is known that when G is a chordal graph the complex mathrm Ind (G) is in fact vertex decomposable, the strongest condition in the Cohen Macaulay ladder. In this article we consider a generalization of independence complex. Given r geq 1 , a subset of the vertex set is called r independent if the connected components of the induced subgraph have cardinality at most r . The collection of all r independent subsets of G form a simplicial complex called the r independence complex and is denoted by mathrm Ind r(G) . It is known that when G is a chordal graph the complex mathrm Ind r(G) has the homotopy type of a wedge of spheres. Hence it is natural to ask which of these complexes are shellable or even vertex decomposable. We prove, using Woodroofe's chordal hypergraph notion, that these complexes are always shellable when the underlying chordal graph is a tree. Further, using the notion of vertex splittable ideals we show that for caterpillar graphs the associated r independence complex is vertex decomposable for all values of r . We also construct chordal graphs on 2r 2 vertices such that their r independence complexes are not sequentially Cohen Macaulay for any r ge 2 .


Symmetry breaking in a turbulent environment. In this work we investigate symmetry breaking in the presence of a turbulent environment. The transition from a symmetric state to a symmetry breaking state is demonstrated using two examples (i) the transition of a two dimensional flow to a three dimensional flow as the fluid layer thickness is varied and (ii) the dynamo instability in a thin layer flow as the magnetic Reynolds number is varied. We show that these examples have similar critical exponents that differ from the mean field predictions. The critical behavior can be related to the multiplicative nature of the fluctuations and can be predicted in certain limits using results from the statistical properties of random interfaces. Our results indicate the possibility of existence of a new class of out of equilibrium phase transition controlled by the multiplicative noise.


Optimal Capacity Driven Design of Aperiodic Clustered Phased Arrays for Multi User MIMO Communication Systems. The optimal design of aperiodic irregular clustered phased arrays for base stations (BSs) in multi user multiple input multiple output (MU MIMO) communication systems is addressed. The paper proposes an ad hoc synthesis method aimed at maximizing the users traffic capacity within the cell served by the BS, while guaranteeing the sufficient level of signal at the terminals. Towards this end, the search of the optimal aperiodic clustering is carried out through a customized tiling technique able to consider both single and multiple tile shapes as well as to assure the complete coverage of the antenna aperture for the maximization of the directivity. Representative results, from a wide set of numerical examples concerned with realistic antenna models and benchmark 3GPP scenarios, are reported to assess the advantages of the irregular array architectures in comparison with regular periodic layouts proposed by the standard development organizations, as well.


Intelligent Icing Detection Model of Wind Turbine Blades Based on SCADA data. Diagnosis of ice accretion on wind turbine blades is all the time a hard nut to crack in condition monitoring of wind farms. Existing methods focus on mechanism analysis of icing process, deviation degree analysis of feature engineering. However, there have not been deep researches of neural networks applied in this field at present. Supervisory control and data acquisition (SCADA) makes it possible to train networks through continuously providing not only operation parameters and performance parameters of wind turbines but also environmental parameters and operation modes. This paper explores the possibility that using convolutional neural networks (CNNs), generative adversarial networks (GANs) and domain adaption learning to establish intelligent diagnosis frameworks under different training scenarios. Specifically, PGANC and PGANT are proposed for sufficient and non sufficient target wind turbine labeled data, respectively. The basic idea is that we consider a two stage training with parallel GANs, which are aimed at capturing intrinsic features for normal and icing samples, followed by classification CNN or domain adaption module in various training cases. Model validation on three wind turbine SCADA data shows that two stage training can effectively improve the model performance. Besides, if there is no sufficient labeled data for a target turbine, which is an extremely common phenomenon in real industrial practices, the addition of domain adaption learning makes the trained model show better performance. Overall, our proposed intelligent diagnosis frameworks can achieve more accurate detection on the same wind turbine and more generalized capability on a new wind turbine, compared with other machine learning models and conventional CNNs.


Finiteness theorems on elliptical billiards and a variant of the Dynamical Mordell Lang Conjecture. We offer some theorems, mainly of finiteness, for certain patterns in elliptical billiards, related to periodic trajectories. For instance, if two players hit a ball at a given position and with directions forming a fixed angle in (0, pi) , there are only finitely many cases for both trajectories being periodic. Another instance is the finiteness of the billiard shots which send a given ball into another one so that this falls eventually in a hole. These results have their origin in relative' cases of the Manin Mumford conjecture, and constitute instances of how arithmetical content may affect chaotic behaviour (in billiards). We shall also interpret the statements through a variant of the dynamical Mordell Lang conjecture. In turn, this embraces cases which, somewhat surprisingly, can be treated (only) by completely different methods compared to the former here we shall offer an explicit example related to diophantine equations in algebraic tori.


Do Pedestrians Pay Attention? Eye Contact Detection in the Wild. In urban or crowded environments, humans rely on eye contact for fast and efficient communication with nearby people. Autonomous agents also need to detect eye contact to interact with pedestrians and safely navigate around them. In this paper, we focus on eye contact detection in the wild, i.e., real world scenarios for autonomous vehicles with no control over the environment or the distance of pedestrians. We introduce a model that leverages semantic keypoints to detect eye contact and show that this high level representation (i) achieves state of the art results on the publicly available dataset JAAD, and (ii) conveys better generalization properties than leveraging raw images in an end to end network. To study domain adaptation, we create LOOK a large scale dataset for eye contact detection in the wild, which focuses on diverse and unconstrained scenarios for real world generalization. The source code and the LOOK dataset are publicly shared towards an open science mission.


Approximation algorithms for confidence bands for time series. Confidence intervals are a standard technique for analyzing data. When applied to time series, confidence intervals are computed for each time point separately. Alternatively, we can compute confidence bands, where we are required to find the smallest area enveloping k time series, where k is a user parameter. Confidence bands can be then used to detect abnormal time series, not just individual observations within the time series. We will show that despite being an NP hard problem it is possible to find optimal confidence band for some k . We do this by considering a different problem discovering regularized bands, where we minimize the envelope area minus the number of included time series weighted by a parameter alpha . Unlike normal confidence bands we can solve the problem exactly by using a minimum cut. By varying alpha we can obtain solutions for various k . If we have a constraint k for which we cannot find appropriate alpha , we demonstrate a simple algorithm that yields O( sqrt n ) approximation guarantee by connecting the problem to a minimum k union problem. This connection also implies that we cannot approximate the problem better than O(n 1 4 ) under some (mild) assumptions. Finally, we consider a variant where instead of minimizing the area we minimize the maximum width. Here, we demonstrate a simple 2 approximation algorithm and show that we cannot achieve better approximation guarantee.


Graph Neural Networks Methods, Applications, and Opportunities. In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks with state of the art performance. The data is generally represented in the Euclidean space in these domains. Various other domains conform to non Euclidean space, for which graph is an ideal representation. Graphs are suitable for representing the dependencies and interrelationships between various entities. Traditionally, handcrafted features for graphs are incapable of providing the necessary inference for various tasks from this complex data representation. Recently, there is an emergence of employing various advances in deep learning to graph data based tasks. This article provides a comprehensive survey of graph neural networks (GNNs) in each learning setting supervised, unsupervised, semi supervised, and self supervised learning. Taxonomy of each graph based learning setting is provided with logical divisions of methods falling in the given learning setting. The approaches for each learning task are analyzed from both theoretical as well as empirical standpoints. Further, we provide general architecture guidelines for building GNNs. Various applications and benchmark datasets are also provided, along with open challenges still plaguing the general applicability of GNNs.


Federated Learning for 6G Applications, Challenges, and Opportunities. Traditional machine learning is centralized in the cloud (data centers). Recently, the security concern and the availability of abundant data and computation resources in wireless networks are pushing the deployment of learning algorithms towards the network edge. This has led to the emergence of a fast growing area, called federated learning (FL), which integrates two originally decoupled areas wireless communication and machine learning. In this paper, we provide a comprehensive study on the applications of FL for sixth generation (6G) wireless networks. First, we discuss the key requirements in applying FL for wireless communications. Then, we focus on the motivating application of FL for wireless communications. We identify the main problems, challenges, and provide a comprehensive treatment of implementing FL techniques for wireless communications.


How many FIDO protocols are needed? Surveying the design, security and market perspectives. Unequivocally, a single man in possession of a strong password is not enough to solve the issue of security. Studies indicate that passwords have been subjected to various attacks, regardless of the applied protection mechanisms due to the human factor. The keystone for the adoption of more efficient authentication methods by the different markets is the trade off between security and usability. To bridge the gap between user friendly interfaces and advanced security features, the Fast Identity Online (FIDO) alliance defined several authentication protocols. Although FIDO's biometric based authentication is not a novel concept, still daunts end users and developers, which may be a contributor factor obstructing FIDO's complete dominance of the digital authentication market. This paper traces the evolution of FIDO protocols, by identifying the technical characteristics and security requirements of the FIDO protocols throughout the different versions while providing a comprehensive study on the different markets (e.g., digital banking, social networks, e government, etc.), applicability, ease of use, extensibility and future security considerations. From the analysis, we conclude that there is currently no dominant version of a FIDO protocol and more importantly, earlier FIDO protocols are still applicable to emerging vertical services.


Tree Decomposition Attention for AMR to Text Generation. Text generation from AMR requires mapping a semantic graph to a string that it annotates. Transformer based graph encoders, however, poorly capture vertex dependencies that may benefit sequence prediction. To impose order on an encoder, we locally constrain vertex self attention using a graph's tree decomposition. Instead of forming a full query key bipartite graph, we restrict attention to vertices in parent, subtree, and same depth bags of a vertex. This hierarchical context lends both sparsity and structure to vertex state updates. We apply dynamic programming to derive a forest of tree decompositions, choosing the most structurally similar tree to the AMR. Our system outperforms a self attentive baseline by 1.6 BLEU and 1.8 chrF .


Augmentations and sheaves for links. We study the relation between augmentations and sheaves in the context of framed oriented links. In this set up, we find slightly more sheaves than augmentations. After removing the sporadic sheaves, we construct a bijective correspondence between augmentations of the framed cord algebra and simple sheaves that are micro supported along the conormal bundle of the link.


Key Considerations for the Responsible Development and Fielding of Artificial Intelligence. We review key considerations, practices, and areas for future work aimed at the responsible development and fielding of AI technologies. We describe critical challenges and make recommendations on topics that should be given priority consideration, practices that should be implemented, and policies that should be defined or updated to reflect developments with capabilities and uses of AI technologies. The Key Considerations were developed with a lens for adoption by U.S. government departments and agencies critical to national security. However, they are relevant more generally for the design, construction, and use of AI systems.


An ASP based Approach to Answering Natural Language Questions for Texts. An approach based on answer set programming (ASP) is proposed in this paper for representing knowledge generated from natural language texts. Knowledge in a text is modeled using a Neo Davidsonian like formalism, which is then represented as an answer set program. Relevant commonsense knowledge is additionally imported from resources such as WordNet and represented in ASP. The resulting knowledge base can then be used to perform reasoning with the help of an ASP system. This approach can facilitate many natural language tasks such as automated question answering, text summarization, and automated question generation. ASP based representation of techniques such as default reasoning, hierarchical knowledge organization, preferences over defaults, etc., are used to model commonsense reasoning methods required to accomplish these tasks. In this paper, we describe the CASPR system that we have developed to automate the task of answering natural language questions given English text. CASPR can be regarded as a system that answers questions by "understanding" the text and has been tested on the SQuAD data set, with promising results.


TENGraD Time Efficient Natural Gradient Descent with Exact Fisher Block Inversion. This work proposes a time efficient Natural Gradient Descent method, called TENGraD, with linear convergence guarantees. Computing the inverse of the neural network's Fisher information matrix is expensive in NGD because the Fisher matrix is large. Approximate NGD methods such as KFAC attempt to improve NGD's running time and practical application by reducing the Fisher matrix inversion cost with approximation. However, the approximations do not reduce the overall time significantly and lead to less accurate parameter updates and loss of curvature information. TENGraD improves the time efficiency of NGD by computing Fisher block inverses with a computationally efficient covariance factorization and reuse method. It computes the inverse of each block exactly using the Woodbury matrix identity to preserve curvature information while admitting (linear) fast convergence rates. Our experiments on image classification tasks for state of the art deep neural architecture on CIFAR 10, CIFAR 100, and Fashion MNIST show that TENGraD significantly outperforms state of the art NGD methods and often stochastic gradient descent in wall clock time.


High Quality Diversification for Task Oriented Dialogue Systems. Many task oriented dialogue systems use deep reinforcement learning (DRL) to learn policies that respond to the user appropriately and complete the tasks successfully. Training DRL agents with diverse dialogue trajectories prepare them well for rare user requests and unseen situations. One effective diversification method is to let the agent interact with a diverse set of learned user models. However, trajectories created by these artificial user models may contain generation errors, which can quickly propagate into the agent's policy. It is thus important to control the quality of the diversification and resist the noise. In this paper, we propose a novel dialogue diversification method for task oriented dialogue systems trained in simulators. Our method, Intermittent Short Extension Ensemble (I SEE), constrains the intensity to interact with an ensemble of diverse user models and effectively controls the quality of the diversification. Evaluations on the Multiwoz dataset show that I SEE successfully boosts the performance of several state of the art DRL dialogue agents.


LRG at TREC 2020 Document Ranking with XLNet Based Models. Establishing a good information retrieval system in popular mediums of entertainment is a quickly growing area of investigation for companies and researchers alike. We delve into the domain of information retrieval for podcasts. In Spotify's Podcast Challenge, we are given a user's query with a description to find the most relevant short segment from the given dataset having all the podcasts. Previous techniques that include solely classical Information Retrieval (IR) techniques, perform poorly when descriptive queries are presented. On the other hand, models which exclusively rely on large neural networks tend to perform better. The downside to this technique is that a considerable amount of time and computing power are required to infer the result. We experiment with two hybrid models which first filter out the best podcasts based on user's query with a classical IR technique, and then perform re ranking on the shortlisted documents based on the detailed description using a transformer based model.


Nudge Stochastically Improving upon FCFS. The First Come First Served (FCFS) scheduling policy is the most popular scheduling algorithm used in practice. Furthermore, its usage is theoretically validated for light tailed job size distributions, FCFS has weakly optimal asymptotic tail of response time. But what if we don't just care about the asymptotic tail? What if we also care about the 99th percentile of response time, or the fraction of jobs that complete in under one second? Is FCFS still best? Outside of the asymptotic regime, only loose bounds on the tail of FCFS are known, and optimality is completely open. In this paper, we introduce a new policy, Nudge, which is the first policy to provably stochastically improve upon FCFS. We prove that Nudge simultaneously improves upon FCFS at every point along the tail, for light tailed job size distributions. As a result, Nudge outperforms FCFS for every moment and every percentile of response time. Moreover, Nudge provides a multiplicative improvement over FCFS in the asymptotic tail. This resolves a long standing open problem by showing that, counter to previous conjecture, FCFS is not strongly asymptotically optimal.


Encoding Explanatory Knowledge for Zero shot Science Question Answering. This paper describes N XKT (Neural encoding based on eXplanatory Knowledge Transfer), a novel method for the automatic transfer of explanatory knowledge through neural encoding mechanisms. We demonstrate that N XKT is able to improve accuracy and generalization on science Question Answering (QA). Specifically, by leveraging facts from background explanatory knowledge corpora, the N XKT model shows a clear improvement on zero shot QA. Furthermore, we show that N XKT can be fine tuned on a target QA dataset, enabling faster convergence and more accurate results. A systematic analysis is conducted to quantitatively analyze the performance of the N XKT model and the impact of different categories of knowledge on the zero shot generalization task.


Choosing points on cubic plane curves rigidity and flexibility. Every smooth cubic plane curve has 9 flex points and 27 sextatic points. We study the following question asked by Farb Is it true that the known algebraic structures give all the possible ways to continuously choose n distinct points on every smooth cubic plane curve, for each given positive integer n ? We give an affirmative answer to the question when n 9 and 18 (the smallest open cases), and a negative answer for infinitely many n 's.


SPViT Enabling Faster Vision Transformers via Soft Token Pruning. Recently, Vision Transformer (ViT) has continuously established new milestones in the computer vision field, while the high computation and memory cost makes its propagation in industrial production difficult. Pruning, a traditional model compression paradigm for hardware efficiency, has been widely applied in various DNN structures. Nevertheless, it stays ambiguous on how to perform exclusive pruning on the ViT structure. Considering three key points the structural characteristics, the internal data pattern of ViTs, and the related edge device deployment, we leverage the input token sparsity and propose a computation aware soft pruning framework, which can be set up on vanilla Transformers of both flatten and CNN type structures, such as Pooling based ViT (PiT). More concretely, we design a dynamic attention based multi head token selector, which is a lightweight module for adaptive instance wise token selection. We further introduce a soft pruning technique, which integrates the less informative tokens generated by the selector module into a package token that will participate in subsequent calculations rather than being completely discarded. Our framework is bound to the trade off between accuracy and computation constraints of specific edge devices through our proposed computation aware training strategy. Experimental results show that our framework significantly reduces the computation cost of ViTs while maintaining comparable performance on image classification. Moreover, our framework can guarantee the identified model to meet resource specifications of mobile devices and FPGA, and even achieve the real time execution of DeiT T on mobile platforms. For example, our method reduces the latency of DeiT T to 26 ms (26 sim 41 superior to existing works) on the mobile device with 0.25 sim 4 higher top 1 accuracy on ImageNet. Our code will be released soon.


MLF SC Incorporating multi layer features to sparse coding for anomaly detection. Anomalies in images occur in various scales from a small hole on a carpet to a large stain. However, anomaly detection based on sparse coding, one of the widely used anomaly detection methods, has an issue in dealing with anomalies that are out of the patch size employed to sparsely represent images. A large anomaly can be considered normal if seen in a small scale, but it is not easy to determine a single scale (patch size) that works well for all images. Then, we propose to incorporate multi scale features to sparse coding and improve the performance of anomaly detection. The proposed method, multi layer feature sparse coding (MLF SC), employs a neural network for feature extraction, and feature maps from intermediate layers of the network are given to sparse coding, whereas the standard sparse coding based anomaly detection method directly works on given images. We show that MLF SC outperforms state of the art anomaly detection methods including those employing deep learning. Our target data are the texture categories of the MVTec Anomaly Detection (MVTec AD) dataset, which is a modern benchmark dataset consisting of images from the real world. Our idea can be a simple and practical option to deal with practical data.


Simultaneous Information and Energy Transmission with Finite Constellations. In this paper, the fundamental limits on the rates at which information and energy can be simultaneously transmitted over an additive white Gaussian noise channel are studied under the following assumptions (a) the channel is memoryless (b) the number of channel input symbols (constellation size) and block length are finite and (c) the decoding error probability (DEP) and the energy outage probability (EOP) are bounded away from zero. In particular, it is shown that the limits on the maximum information and energy transmission rates and the minimum DEP and EOP, are essentially set by the type induced by the code used to perform the transmission. That is, the empirical frequency with which each channel input symbol appears in the codewords. Using this observation, guidelines for optimal constellation design for simultaneous energy and information transmission are presented.


DFL High Performance Blockchain Based Federated Learning. Many researchers are trying to replace the aggregation server in federated learning with a blockchain system to achieve better privacy, robustness and scalability. In this case, clients will upload their updated models to the blockchain ledger, and use a smart contract on the blockchain system to perform model averaging. However, running machine learning applications on the blockchain is almost impossible because a blockchain system, which usually takes over half minute to generate a block, is extremely slow and unable to support machine learning applications. This paper proposes a completely new public blockchain architecture called DFL, which is specially optimized for distributed federated machine learning. This architecture inherits most traditional blockchain merits and achieves extremely high performance with low resource consumption by waiving global consensus. To characterize the performance and robustness of our architecture, we implement the architecture as a prototype and test it on a physical four node network. To test more nodes and more complex situations, we build a simulator to simulate the network. The LeNet results indicate our system can reach over 90 accuracy for non I.I.D. datasets even while facing model poisoning attacks, with the blockchain consuming less than 5 of hardware resources.


Random cones in high dimensions II Weyl cones. We consider two models of random cones together with their duals. Let Y 1, dots,Y n be independent and identically distributed random vectors in mathbb R d whose distribution satisfies some mild condition. The random cones G n,d A and G n,d B are defined as the positive hulls text pos Y 1 Y 2, dots,Y n 1 Y n , respectively text pos Y 1 Y 2, dots,Y n 1 Y n,Y n , conditioned on the event that the respective positive hull is not equal to mathbb R d . We prove limit theorems for various expected geometric functionals of these random cones, as n and d tend to infinity in a coordinated way. This includes limit theorems for the expected number of k faces and the k th conic quermassintegrals, as n , d and sometimes also k tend to infinity simultaneously. Moreover, we uncover a phase transition in high dimensions for the expected statistical dimension for both models of random cones.


Augmented Reality for Education A Review. Augmented Reality, or simply AR, is the incorporation of information in digital format that includes live footage of a certain user's real time environment. Also now, various universities are using Augmented Reality. Applying the technology in the education sector can result in having a smart campus. In line with that, this paper will discuss how Augmented Reality is being used now in different learning areas.


Automating John P. D'Angelo's method to study Complete Polynomial Sequences. In this article, dedicated to the memory of Ron Graham, we fully automate John P. D'Angelo's method for studying complete polynomial sequences, for which Ron Graham, back in 1964, gave a beautiful necessary and sufficient conditions. D'Angelo found surprising connection of these elementary (but deep) number theoretic questions to determining certain critical dimensions in complex geometry.


An Image is Worth 16x16 Words, What is a Video Worth?. Leading methods in the domain of action recognition try to distill information from both the spatial and temporal dimensions of an input video. Methods that reach State of the Art (SotA) accuracy, usually make use of 3D convolution layers as a way to abstract the temporal information from video frames. The use of such convolutions requires sampling short clips from the input video, where each clip is a collection of closely sampled frames. Since each short clip covers a small fraction of an input video, multiple clips are sampled at inference in order to cover the whole temporal length of the video. This leads to increased computational load and is impractical for real world applications. We address the computational bottleneck by significantly reducing the number of frames required for inference. Our approach relies on a temporal transformer that applies global attention over video frames, and thus better exploits the salient information in each frame. Therefore our approach is very input efficient, and can achieve SotA results (on Kinetics dataset) with a fraction of the data (frames per video), computation and latency. Specifically on Kinetics 400, we reach 80.5 top 1 accuracy with times 30 less frames per video, and times 40 faster inference than the current leading method. Code is available at https github.com Alibaba MIIL STAM


Adversarial machine learning for protecting against online manipulation. Adversarial examples are inputs to a machine learning system that result in an incorrect output from that system. Attacks launched through this type of input can cause severe consequences for example, in the field of image recognition, a stop signal can be misclassified as a speed limit indication.However, adversarial examples also represent the fuel for a flurry of research directions in different domains and applications. Here, we give an overview of how they can be profitably exploited as powerful tools to build stronger learning models, capable of better withstanding attacks, for two crucial tasks fake news and social bot detection.


Optimal Codes Correcting Localized Deletions. We consider the problem of constructing codes that can correct deletions that are localized within a certain part of the codeword that is unknown a priori. Namely, the model that we study is when at most k deletions occur in a window of size k , where the positions of the deletions within this window are not necessarily consecutive. Localized deletions are thus a generalization of burst deletions that occur in consecutive positions. We present novel explicit codes that are efficiently encodable and decodable and can correct up to k localized deletions. Furthermore, these codes have log n mathcal O (k log 2 (k log n)) redundancy, where n is the length of the information message, which is asymptotically optimal in n for k o( log n ( log log n) 2) .


Automatic API Usage Scenario Documentation from Technical Q A Sites. The online technical Q A site Stack Overflow (SO) is popular among developers to support their coding and diverse development needs. To address shortcomings in API official documentation resources, several research has thus focused on augmenting official API documentation with insights (e.g., code examples) from SO. The techniques propose to add code examples insights about APIs into its official documentation. Reviews are opinionated sentences with positive negative sentiments. However, we are aware of no previous research that attempts to automatically produce API documentation from SO by considering both API code examples and reviews. In this paper, we present two novel algorithms that can be used to automatically produce API documentation from SO by combining code examples and reviews towards those examples. The first algorithm is called statistical documentation, which shows the distribution of positivity and negativity around the code examples of an API using different metrics (e.g., star ratings). The second algorithm is called concept based documentation, which clusters similar and conceptually relevant usage scenarios. An API usage scenario contains a code example, a textual description of the underlying task addressed by the code example, and the reviews (i.e., opinions with positive and negative sentiments) from other developers towards the code example. We deployed the algorithms in Opiner, a web based platform to aggregate information about APIs from online forums. We evaluated the algorithms by mining all Java JSON based posts in SO and by conducting three user studies based on produced documentation from the posts.


The Vlasov Poisson Boltzmann Landau system with polynomial perturbation near Maxwellian. In this work, we consider the Vlasov Poisson Boltzmann system without angular cutoff and the Vlasov Poisson Landau system with Coulomb potential near a global Maxwellian mu . We establish the global existence, uniqueness and large time behavior for solutions in a polynomial weighted Sobolev space H 2 x, v ( langle v rangle k) for some constant k 0 . The proof is based on extra dissipation generated from semigroup method and energy estimates on electrostatic field.


TransMVSNet Global Context aware Multi view Stereo Network with Transformers. In this paper, we present TransMVSNet, based on our exploration of feature matching in multi view stereo (MVS). We analogize MVS back to its nature of a feature matching task and therefore propose a powerful Feature Matching Transformer (FMT) to leverage intra (self ) and inter (cross ) attention to aggregate long range context information within and across images. To facilitate a better adaptation of the FMT, we leverage an Adaptive Receptive Field (ARF) module to ensure a smooth transit in scopes of features and bridge different stages with a feature pathway to pass transformed features and gradients across different scales. In addition, we apply pair wise feature correlation to measure similarity between features, and adopt ambiguity reducing focal loss to strengthen the supervision. To the best of our knowledge, TransMVSNet is the first attempt to leverage Transformer into the task of MVS. As a result, our method achieves state of the art performance on DTU dataset, Tanks and Temples benchmark, and BlendedMVS dataset. The code of our method will be made available at https github.com MegviiRobot TransMVSNet .


Challenges of Adopting SAFe in the Banking Industry A Study Two Years after its Introduction. The Scaled Agile Framework (SAFe) is a framework for scaling agile methods in large organizations. We have found several experience reports and white papers describing SAFe adoptions in different banks, which indicates that SAFe is being used in the banking industry. However, there is a lack of academic publications on the topic, the banking industry is missing in the scientific reports analyzing SAFe transformations. To fill this gap, we present a study on the main challenges with a SAFe transformation at a large full service bank. We identify the challenges in the bank under study and compare the findings with experience reports from other banks, as well as with research on SAFe transformations in other domains. Many of the challenges reported in this paper overlap with the generic SAFe challenges, including management and organization, education and training, culture and mindset, requirements engineering, quality assurance, and systems architecture. However, we also report some novel challenges specific to the banking domain, e.g., the risk of jeopardizing customer relations, stability, and trust of external stakeholders. This study validates several SAFe related challenges reported in previous work in the banking context. It also brings up some novel challenges specific to the banking industry. Therefore, we believe our results are particularly useful to practitioners responsible for SAFe transformations at other banks.


Circle graphs (chord interlacement graphs) of Gauss diagrams Descriptions of realizable Gauss diagrams, algorithms, enumeration. Chord diagrams, under the name of Gauss diagrams, are used in low dimensional topology as an important tool for studying curves or knots. Those Gauss diagrams that correspond to curves or knots are called realizable. The theme of our paper is the fact that realizability of a Gauss diagram can be expressed via its circle graph. Accordingly, one can define and study realizable circle graphs (with realizability of a circle graph understood as realizability of any one of chord diagrams corresponding to the graph). Several studies contain theorems purporting to prove the fact. We check several of these descriptions experimentally and find counterexamples to the descriptions of realizable Gauss diagrams in some of these publications. We formulate new descriptions of realizable circle graphs and present an elegant algorithm for checking if a circle graph is realizable. We enumerate realizable circle graphs for small sizes and comment on these numbers. Then we concentrate on one type of curves, called meanders, and study the circle graphs of their Gauss diagrams.


Investigating Bi Level Optimization for Learning and Vision from a Unified Perspective A Survey and Beyond. Bi Level Optimization (BLO) is originated from the area of economic game theory and then introduced into the optimization community. BLO is able to handle problems with a hierarchical structure, involving two levels of optimization tasks, where one task is nested inside the other. In machine learning and computer vision fields, despite the different motivations and mechanisms, a lot of complex problems, such as hyper parameter optimization, multi task and meta learning, neural architecture search, adversarial learning and deep reinforcement learning, actually all contain a series of closely related subproblms. In this paper, we first uniformly express these complex learning and vision problems from the perspective of BLO. Then we construct a best response based single level reformulation and establish a unified algorithmic framework to understand and formulate mainstream gradient based BLO methodologies, covering aspects ranging from fundamental automatic differentiation schemes to various accelerations, simplifications, extensions and their convergence and complexity properties. Last but not least, we discuss the potentials of our unified BLO framework for designing new algorithms and point out some promising directions for future research.


Reaction Diffusion Advection Systems with Discontinuous Diffusion and Mass Control. In this paper, we study unique, globally defined uniformly bounded weak solutions for a class of semilinear reaction diffusion advection systems. The coefficients of the differential operators and the initial data are only required to be measurable and uniformly bounded. The nonlinearities are quasi positive and satisfy a commonly called mass control or dissipation of mass property. Moreover, we assume the intermediate sum condition of a certain order. The key feature of this work is the surprising discovery that quasi positive systems that satisfy an intermediate sum condition automatically give rise to a new class of L p energy type functionals that allow us to obtain requisite uniform a priori bounds. Our methods are sufficiently robust to extend to different boundary conditions, or to certain quasi linear systems. We also show that in case of mass dissipation, the solution is bounded in sup norm uniformly in time. We illustrate the applicability of results by showing global existence and large time behavior of models arising from a spatio temporal spread of infectious disease.


Derivation of the Hall MHD equations from the Navier Stokes Maxwell equations. By using a set of scaling limits, the authors in cite ADFL,SS proposed a framework of deriving the Hall MHD equations from the two fluids Euler Maxwell equations for electrons and ions. In this paper, we derive the Hall MHD equations from the Navier Stokes Maxwell equations with generalized Ohm's law in a mathematically rigorous way via the spectral analysis and energy methods.


Open Source Verification with Chisel and Scala. Performance increase with general purpose processors has come to a halt. We can no longer depend on Moore's Law to increase computing performance. The only way to achieve higher performance or lower energy consumption is by building domain specific hardware accelerators. To efficiently design and verify those domain specific accelerators, we need agile hardware development. One of the main obstacles when proposing such a modern method is the lack of modern tools to attack it. To be able to verify a design in such a time constrained development method, one needs to have efficient tools both for design and verification. This paper thus proposes ChiselVerify, an open source tool for verifying circuits described in any Hardware Description Language. It builds on top of the Chisel hardware construction language and uses Scala to drive the verification using a testing strategy inspired by the Universal Verification Methodology (UVM) and adapted for designs described in Chisel. ChiselVerify is created based on three key ideas. First, our solution highly increases the productivity of the verification engineer, by allowing hardware testing to be done in a modern high level programming environment. Second, the framework functions with any hardware description language thanks to the flexibility of Chisel blackboxes. Finally, the solution is well integrated into the existing Chisel universe, making it an extension of currently existing testing libraries. We implement ChiselVerify in a way inspired by the functionalities found in SystemVerilog. This allows one to use functional coverage, constrained random verification, bus functional models, transaction level modeling and much more during the verification process of a design in a contemporary high level programming ecosystem.


Bridged Hamiltonian Cycles in Sub critical Random Geometric Graphs. In this paper, we consider a random geometric graph (RGG) (G ) on (n ) nodes with adjacency distance (r n ) just below the Hamiltonicity threshold and construct Hamiltonian cycles using additional edges called bridges. The bridges by definition do not belong to (G ) and we are interested in estimating the number of bridges and the maximum bridge length, needed for constructing a Hamiltonian cycle. In our main result, we show that with high probability, i.e. with probability converging to one as (n rightarrow infty, ) we can obtain a Hamiltonian cycle with maximum bridge length a constant multiple of (r n ) and containing an arbitrarily small fraction of edges as bridges. We use a combination of backbone construction and iterative cycle merging to obtain the desired Hamiltonian cycle.


Classification of Consumer Belief Statements From Social Media. Social media offer plenty of information to perform market research in order to meet the requirements of customers. One way how this research is conducted is that a domain expert gathers and categorizes user generated content into a complex and fine grained class structure. In many of such cases, little data meets complex annotations. It is not yet fully understood how this can be leveraged successfully for classification. We examine the classification accuracy of expert labels when used with a) many fine grained classes and b) few abstract classes. For scenario b) we compare abstract class labels given by the domain expert as baseline and by automatic hierarchical clustering. We compare this to another baseline where the entire class structure is given by a completely unsupervised clustering approach. By doing so, this work can serve as an example of how complex expert annotations are potentially beneficial and can be utilized in the most optimal way for opinion mining in highly specific domains. By exploring across a range of techniques and experiments, we find that automated class abstraction approaches in particular the unsupervised approach performs remarkably well against domain expert baseline on text classification tasks. This has the potential to inspire opinion mining applications in order to support market researchers in practice and to inspire fine grained automated content analysis on a large scale.


The finite dual of commutative by finite Hopf algebras. The finite dual H circ of an affine commutative by finite Hopf algebra H is studied. Such a Hopf algebra H is an extension of an affine commutative Hopf algebra A by a finite dimensional Hopf algebra F . The main theorem gives natural conditions under which H circ decomposes as a crossed or smash product of F ast by the finite dual of A . This decomposition is then further analysed using the Cartier Gabriel Kostant theorem to obtain component Hopf subalgebras of H circ mapping onto the classical components of A circ . The detailed consequences for a number of families of examples are then studied.


The Multiplicative Version of Azuma's Inequality, with an Application to Contention Analysis. Azuma's inequality is a tool for proving concentration bounds on random variables. The inequality can be thought of as a natural generalization of additive Chernoff bounds. On the other hand, the analogous generalization of multiplicative Chernoff bounds has, to our knowledge, never been explicitly formulated. We formulate a multiplicative error version of Azuma's inequality. We then show how to apply this new inequality in order to greatly simplify (and correct) the analysis of contention delays in multithreaded systems managed by randomized work stealing.