Improving the performance of bagging ensembles for data streams through mini batching. Often, machine learning applications have to cope with dynamic environments where data are collected in the form of continuous data streams with potentially infinite length and transient behavior. Compared to traditional (batch) data mining, stream processing algorithms have additional requirements regarding computational resources and adaptability to data evolution. They must process instances incrementally because the data's continuous flow prohibits storing data for multiple passes. Ensemble learning achieved remarkable predictive performance in this scenario. Implemented as a set of (several) individual classifiers, ensembles are naturally amendable for task parallelism. However, the incremental learning and dynamic data structures used to capture the concept drift increase the cache misses and hinder the benefit of parallelism. This paper proposes a mini batching strategy that can improve memory access locality and performance of several ensemble algorithms for stream mining in multi core environments. With the aid of a formal framework, we demonstrate that mini batching can significantly decrease the reuse distance (and the number of cache misses). Experiments on six different state of the art ensemble algorithms applying four benchmark datasets with varied characteristics show speedups of up to 5X on 8 core processors. These benefits come at the expense of a small reduction in predictive performance.


Investigating the Impact of Multi LiDAR Placement on Object Detection for Autonomous Driving. The past few years have witnessed an increasing interest in improving the perception performance of LiDARs on autonomous vehicles. While most of the existing works focus on developing new deep learning algorithms or model architectures, we study the problem from the physical design perspective, i.e., how different placements of multiple LiDARs influence the learning based perception. To this end, we introduce an easy to compute information theoretic surrogate metric to quantitatively and fast evaluate LiDAR placement for 3D detection of different types of objects. We also present a new data collection, detection model training and evaluation framework in the realistic CARLA simulator to evaluate disparate multi LiDAR configurations. Using several prevalent placements inspired by the designs of self driving companies, we show the correlation between our surrogate metric and object detection performance of different representative algorithms on KITTI through extensive experiments, validating the effectiveness of our LiDAR placement evaluation approach. Our results show that sensor placement is non negligible in 3D point cloud based object detection, which will contribute up to 10 performance discrepancy in terms of average precision in challenging 3D object detection settings. We believe that this is one of the first studies to quantitatively investigate the influence of LiDAR placement on perception performance. The code is available on https github.com HanjiangHu Multi LiDAR Placement for 3D Detection.


Generative Convolution Layer for Image Generation. This paper introduces a novel convolution method, called generative convolution (GConv), which is simple yet effective for improving the generative adversarial network (GAN) performance. Unlike the standard convolution, GConv first selects useful kernels compatible with the given latent vector, and then linearly combines the selected kernels to make latent specific kernels. Using the latent specific kernels, the proposed method produces the latent specific features which encourage the generator to produce high quality images. This approach is simple but surprisingly effective. First, the GAN performance is significantly improved with a little additional hardware cost. Second, GConv can be employed to the existing state of the art generators without modifying the network architecture. To reveal the superiority of GConv, this paper provides extensive experiments using various standard datasets including CIFAR 10, CIFAR 100, LSUN Church, CelebA, and tiny ImageNet. Quantitative evaluations prove that GConv significantly boosts the performances of the unconditional and conditional GANs in terms of Inception score (IS) and Frechet inception distance (FID). For example, the proposed method improves both FID and IS scores on the tiny ImageNet dataset from 35.13 to 29.76 and 20.23 to 22.64, respectively.


Moduli spaces of sheaves via affine Grassmannians. We develop a new method for analyzing moduli problems related to the stack of pure coherent sheaves on a polarized family of projective schemes. It is an infinite dimensional analogue of geometric invariant theory. We apply this to two familiar moduli problems the stack of Lambda modules and the stack of pairs. In both examples, we construct a Theta stratification of the stack, defined in terms of a polynomial numerical invariant, and we construct good moduli spaces for the open substacks of semistable points. One of the essential ingredients is the construction of higher dimensional analogues of the affine Grassmannian for the moduli problems considered.


Automated Mechanism Design for Classification with Partial Verification. We study the problem of automated mechanism design with partial verification, where each type can (mis)report only a restricted set of types (rather than any other type), induced by the principal's limited verification power. We prove hardness results when the revelation principle does not necessarily hold, as well as when types have even minimally different preferences. In light of these hardness results, we focus on truthful mechanisms in the setting where all types share the same preference over outcomes, which is motivated by applications in, e.g., strategic classification. We present a number of algorithmic and structural results, including an efficient algorithm for finding optimal deterministic truthful mechanisms, which also implies a faster algorithm for finding optimal randomized truthful mechanisms via a characterization based on convexity. We then consider a more general setting, where the principal's cost is a function of the combination of outcomes assigned to each type. In particular, we focus on the case where the cost function is submodular, and give generalizations of essentially all our results in the classical setting where the cost function is additive. Our results provide a relatively complete picture for automated mechanism design with partial verification.


Access Management in Joint Sensing and Communication Systems Efficiency versus Fairness. In this paper, we consider a distributed joint sensing and communication (DJSC) system in which multiple radar sensors are deployed. Each sensor is equipped with a sensing function and a communication function, and thus it is a JSC node. The JSC nodes are able to perform sensing their surrounding environments, e.g., weather conditions or available spectrum. Furthermore, they can cooperatively detect and track a common target. The information, i.e., of the environment and target, collected by the JSC nodes is transmitted to a base station (BS) for further processing. As such, different aspects of the target to be viewed simultaneously, which significantly improves the performance of the target detection and tracking. However, both the sensing function and communication function require a certain amount of bandwidth for their operations, and deploying multiple JSC nodes may consume a large amount of bandwidth. Therefore, we investigate the bandwidth allocation problem for the DJSC system. In particular, we aim to optimize the bandwidth allocation to the sensing function and the communication function of the JSC nodes. To improve the allocation efficiency while benefiting the spatial diversity advantage of the DJSC systems, the objective is to maximize the sum of sensing performances, i.e., estimation rates, communication performances, i.e., communication data rates, and fairnesses of all the users. The optimization problem is non convex and difficult to be solved. For this, we propose a fully polynomial time approximation algorithm, and we prove that the approximation algorithm can guarantee a near optimal solution with an accuracy bound of epsilon . Furthermore, we propose to use a heuristic algorithm with lower complexity. The simulation results show that both the proposed algorithms are able to achieve the solutions close to the optimum in a computationally efficient fashion.


Boundary induced and scene aggregated network for monocular depth prediction. Monocular depth prediction is an important task in scene understanding. It aims to predict the dense depth of a single RGB image. With the development of deep learning, the performance of this task has made great improvements. However, two issues remain unresolved (1) The deep feature encodes the wrong farthest region in a scene, which leads to a distorted 3D structure of the predicted depth (2) The low level features are insufficient utilized, which makes it even harder to estimate the depth near the edge with sudden depth change. To tackle these two issues, we propose the Boundary induced and Scene aggregated network (BS Net). In this network, the Depth Correlation Encoder (DCE) is first designed to obtain the contextual correlations between the regions in an image, and perceive the farthest region by considering the correlations. Meanwhile, the Bottom Up Boundary Fusion (BUBF) module is designed to extract accurate boundary that indicates depth change. Finally, the Stripe Refinement module (SRM) is designed to refine the dense depth induced by the boundary cue, which improves the boundary accuracy of the predicted depth. Several experimental results on the NYUD v2 dataset and xff the iBims 1 dataset illustrate the state of the art performance of the proposed approach. And the SUN RGBD dataset is employed to evaluate the generalization of our method. Code is available at https github.com XuefengBUPT BS Net.


Variance asymptotics and central limit theory for geometric functionals of Poisson cylinder processes. This paper deals with the union set of a stationary Poisson process of cylinders in mathbb R n having an (n m) dimensional base and an m dimensional direction space, where m in 0,1, ldots,n 1 and n geq 2 . The concept simultaneously generalises those of a Boolean model and a Poisson hyperplane or m flat process. Under very general conditions on the typical cylinder base a Berry Esseen bound for the volume of the union set within a sequence of growing test sets is derived. Assuming convexity of the cylinder bases and of the window a similar result is shown for a broad class of geometric functionals, including the intrinsic volumes. In this context the asymptotic variance constant is analysed in detail, which in contrast to the Boolean model leads to a new degeneracy phenomenon. A quantitative central limit theory is developed in a multivariate set up as well.


Harnessing the Benefits of Open Electronics in Science. Freely and openly shared low cost electronic applications, known as open electronics, have sparked a new open source movement, with much un tapped potential to advance scientific research. Initially designed to appeal to electronic hobbyists, open electronics have formed a global community of "makers" and inventors and are increasingly used in science and industry. Here, we review the current benefits of open electronics for scientific research and guide academics to enter this emerging field. We discuss how electronic applications, from the experimental to the theoretical sciences, can help (I) individual researchers by increasing the customization, efficiency, and scalability of experiments, while improving data quantity and quality (II) scientific institutions by improving access and maintenance of high end technologies, visibility and interdisciplinary collaboration potential and (III) the scientific community by improving transparency and reproducibility, helping decouple research capacity from funding, increasing innovation, and improving collaboration potential among researchers and the public. Open electronics are powerful tools to increase creativity, democratization, and reproducibility of research and thus offer practical solutions to overcome significant barriers in science.


Market Complete Option Valuation using a Jarrow Rudd Pricing Tree with Skewness and Kurtosis. Applying the Cherny Shiryaev Yor invariance principle, we introduce a generalized Jarrow Rudd (GJR) option pricing model with uncertainty driven by a skew random walk. The GJR pricing tree exhibits skewness and kurtosis in both the natural and risk neutral world. We construct implied surfaces for the parameters determining the GJR tree. Motivated by Merton's pricing tree incorporating transaction costs, we extend the GJR pricing model to include a hedging cost. We demonstrate ways to fit the GJR pricing model to a market driver that influences the price dynamics of the underlying asset. We supplement our findings with numerical examples.


Classification of head impacts based on the spectral density of measurable kinematics. Traumatic brain injury can be caused by head impacts, but many brain injury risk estimation models are less accurate across the variety of impacts that patients may undergo. We investigated the spectral characteristics of different head impact types with kinematics classification. Data was analyzed from 3,262 head impacts from lab reconstruction, American football, mixed martial arts, and publicly available car crash data. A random forest classifier with spectral densities of linear acceleration and angular velocity was built to classify head impact types (e.g., football), reaching a median accuracy of 96 over 1,000 random partitions of training and test sets. To test the classifier on data from different measurement devices, another 271 lab reconstructed impacts were obtained from 5 other instrumented mouthguards with the classifier reaching over 96 accuracy. The most important features in the classification included both low frequency and high frequency features, both linear acceleration features and angular velocity features. Different head impact types had different distributions of spectral densities in low frequency and high frequency ranges (e.g., the spectral densities of MMA impacts were higher in high frequency range than in the low frequency range). Finally, with the classifier, type specific, nearest neighbor regression models were built for 95th percentile maximum principal strain, 95th percentile maximum principal strain in corpus callosum, and cumulative strain damage (15th percentile). This showed a generally higher R2 value than baseline models. The classifier enables a better understanding of the impact kinematics in different sports, and it can be applied to evaluate the quality of impact simulation systems and on field data augmentation. Key words traumatic brain injury, head impacts, classification, impact kinematics


Pixel integrated thin film filter simulation and scaling trade offs. Thin film optical filters can nowadays be integrated onto pixels of commercial image sensors used for spectral imaging. A drawback of having more filters on an image sensor is a loss in spatial resolution which could be regained by using smaller pixels. However, this work shows that miniaturization causes a reduction in transmittance and requires a trade off between pixel size and filter bandwidth. This is caused by diffraction and the reduced number of reflections in the filter. Analytical wave and ray optics models are developed and used for fast transmittance prediction and this is validated using a commercial spectral sensor and numerical simulations. The identified trade off is an intrinsic limitation of pixel integrated thin film filter technology and the developed models will be useful tools for exploring new hardware and computational solutions.


Design considerations for a new generation of SiPMs with unprecedented timing resolution. The potential of photon detectors to achieve precise timing information is of increasing importance in many domains, PET and CT scanners in medical imaging and particle physics detectors, amongst others. The goal to increase by an order of magnitude the sensitivity of PET scanners and to deliver, via time of flight (TOF), true space points for each event, as well as the constraints set by future particle accelerators require a further leap in time resolution of scintillator based ionizing radiation detectors, reaching eventually a few picoseconds resolution for sub MeV energy deposits. In spite of the impressive progress made in the last decade by several manufacturers, the Single Photon Time Resolution (SPTR) of SiPMs is still in the range of 70 120ps FWHM, whereas a value of 10ps or even less would be desirable. Such a step requires a break with traditional methods and the development of novel technologies. The possibility of combining the extraordinary potential of nanophotonics with new approaches offered by modern microelectronics and 3D electronic integration opens novel perspectives for the development of a new generation of metamaterial based SiPMs with unprecedented photodetection efficiency and timing resolution.


Differentially private training of neural networks with Langevin dynamics for calibrated predictive uncertainty. We show that differentially private stochastic gradient descent (DP SGD) can yield poorly calibrated, overconfident deep learning models. This represents a serious issue for safety critical applications, e.g. in medical diagnosis. We highlight and exploit parallels between stochastic gradient Langevin dynamics, a scalable Bayesian inference technique for training deep neural networks, and DP SGD, in order to train differentially private, Bayesian neural networks with minor adjustments to the original (DP SGD) algorithm. Our approach provides considerably more reliable uncertainty estimates than DP SGD, as demonstrated empirically by a reduction in expected calibration error (MNIST sim 5 fold, Pediatric Pneumonia Dataset sim 2 fold).


Projective Determinacy from long Chang's Conjecture. Consider the property ( aleph omega 1 , aleph omega 2 , ldots) twoheadrightarrow ( aleph 1, aleph 2, ldots) . Here we will show that this property with the addition of the General Continuum Hypothesis implies projective determinacy. Of particular interest here is the use of a variant covering argument to prove limited instances of mouse reflection. We believe that this approach could find use for other forms of Chang's Conjecture as well.


HOMRS High Order Metamorphic Relations Selector for Deep Neural Networks. Deep Neural Networks (DNN) applications are increasingly becoming a part of our everyday life, from medical applications to autonomous cars. Traditional validation of DNN relies on accuracy measures, however, the existence of adversarial examples has highlighted the limitations of these accuracy measures, raising concerns especially when DNN are integrated into safety critical systems. In this paper, we present HOMRS, an approach to boost metamorphic testing by automatically building a small optimized set of high order metamorphic relations from an initial set of elementary metamorphic relations. HOMRS' backbone is a multi objective search it exploits ideas drawn from traditional systems testing such as code coverage, test case, path diversity as well as input validation. We applied HOMRS to MNIST LeNet and SVHN VGG and we report evidence that it builds a small but effective set of high order transformations that generalize well to the input data distribution. Moreover, comparing to similar generation technique such as DeepXplore, we show that our distribution based approach is more effective, generating valid transformations from an uncertainty quantification point of view, while requiring less computation time by leveraging the generalization ability of the approach.


On Limit sets of Monotone maps on Regular curves. We investigate the structure of omega limit (resp. alpha limit) sets for a monotone map f on a regular curve X . Let X be a regular curve and let f X longrightarrowX be a monotone map. We show that for any x in X (resp. for any negative orbit (x n ) n geq 0 of x ), the omega limit set omega f (x) (resp. alpha limit set alpha f ((x n ) n geq 0 ) ) is a minimal set. This also hold for alpha limit set alpha f (x) whenever x is not a periodic point. These results extend those of Naghmouchi cite n J. Difference Equ. Appl., 23 (2017), 1485 1490 established whenever f is a homeomorphism on a regular curve and those of Abdelli cite a Chaos, Solitons Fractals, 71 (2015), 66 72 , whenever f is a monotone map on a local dendrite. Further results related to the basin of attraction of an infinite minimal set are also obtained.


Fast adjoint differentiation of chaos via computing unstable perturbations of transfer operators. We devise the fast adjoint response algorithm for the gradient of physical measures (long time average statistics) of hyperbolic chaotic systems with respect to system parameters. It runs on one sample orbit its cost is linear to the unstable dimension but is almost independent of the number of parameters. The algorithm is based on the adjoint shadowing lemma and the equivariant divergence formula for the unstable perturbation of transfer operators. We demonstrate the algorithm on a 21 dimensional system with 20 unstable dimensions. We also test on a system with stochastic noise. Finally, we test the algorithm on a Lorenz map, where the conditional measure is discontinuous. Also, the appendix gives another proof of the equivariant divergence formula.


Invertibility of Positive Toeplitz Operators and Associated Uncertainty Principle. We study invertibility and compactness of positive Toeplitz operators associated to a continuous Parseval frame on a Hilbert space. As applications, we characterize compactness of affine and Weyl Heisenberg localization operators as well as give uncertainty principles for the associated transforms.


Optical Vortex Braiding with Bessel Beams. We propose the braiding of optical vortices in a laser beam with more than 2 pi rotation by superposing Bessel modes with a plane wave. We experimentally demonstrate this by using a Bessel Gaussian beam and a coaxial Gaussian, and we present measurement of three complete braids. The amount of braiding is fundamentally limited only by the numerical aperture of the system and we discuss how braiding can be controlled experimentally for any number of vortices.


A Buchsbaum theory for tight closure. A Noetherian local ring (R, mathfrak m ) is called Buchsbaum if the difference e( mathfrak q , R) ell(R mathfrak q ) , where mathfrak q is an ideal generated by a system of parameters, is a constant independent of mathfrak q . In this article, we study the tight closure analog of this condition. We prove that in an unmixed excellent local ring (R, mathfrak m ) of prime characteristic p 0 and dimension at least one, the difference e( mathfrak q , R) ell(R mathfrak q ) is independent of mathfrak q if and only if the parameter test ideal tau text par (R) contains mathfrak m . We also provide a characterization of this condition via derived category which is analogous to Schenzel's criterion for Buchsbaum rings.


Horizontal to Vertical Video Conversion. Alongside the prevalence of mobile videos, the general public leans towards consuming vertical videos on hand held devices. To revitalize the exposure of horizontal contents, we hereby set forth the exploration of automated horizontal to vertical (abbreviated as H2V) video conversion with our proposed H2V framework, accompanied by an accurately annotated H2V 142K dataset. Concretely, H2V framework integrates video shot boundary detection, subject selection and multi object tracking to facilitate the subject preserving conversion, wherein the key is subject selection. To achieve so, we propose a Rank SS module that detects human objects, then selects the subject to preserve via exploiting location, appearance, and salient cues. Afterward, the framework automatically crops the video around the subject to produce vertical contents from horizontal sources. To build and evaluate our H2V framework, H2V 142K dataset is densely annotated with subject bounding boxes for 125 videos with 132K frames and 9,500 video covers, upon which we demonstrate superior subject selection performance comparing to traditional salient approaches, and exhibit promising horizontal to vertical conversion performance overall. By publicizing this dataset as well as our approach, we wish to pave the way for more valuable endeavors on the horizontal to vertical video conversion task.


Safe Distillation Box. Knowledge distillation (KD) has recently emerged as a powerful strategy to transfer knowledge from a pre trained teacher model to a lightweight student, and has demonstrated its unprecedented success over a wide spectrum of applications. In spite of the encouraging results, the KD process per se poses a potential threat to network ownership protection, since the knowledge contained in network can be effortlessly distilled and hence exposed to a malicious user. In this paper, we propose a novel framework, termed as Safe Distillation Box (SDB), that allows us to wrap a pre trained model in a virtual box for intellectual property protection. Specifically, SDB preserves the inference capability of the wrapped model to all users, but precludes KD from unauthorized users. For authorized users, on the other hand, SDB carries out a knowledge augmentation scheme to strengthen the KD performances and the results of the student model. In other words, all users may employ a model in SDB for inference, but only authorized users get access to KD from the model. The proposed SDB imposes no constraints over the model architecture, and may readily serve as a plug and play solution to protect the ownership of a pre trained network. Experiments across various datasets and architectures demonstrate that, with SDB, the performance of an unauthorized KD drops significantly while that of an authorized gets enhanced, demonstrating the effectiveness of SDB.


The Query Complexity of Local Search and Brouwer in Rounds. We consider the query complexity of finding a local minimum of a function defined on a graph, where at most k rounds of interaction with the oracle are allowed. Rounds model parallel settings, where each query takes resources to complete and is executed on a separate processor. Thus the query complexity in k rounds informs how many processors are needed to achieve a parallel time of k . We focus on the d dimensional grid n d , where the dimension d is a constant, and consider two regimes for the number of rounds constant and polynomial in n. We give algorithms and lower bounds that characterize the trade off between the number of rounds of adaptivity and the query complexity of local search. When the number of rounds k is constant, we show that the query complexity of local search in k rounds is Theta bigl(n frac d k 1 d k d k 1 bigl) , for both deterministic and randomized algorithms. When the number of rounds is polynomial, i.e. k n alpha for 0 alpha d 2 , the randomized query complexity is Theta left(n d 1 frac d 2 d alpha right) for all d geq 5 . For d 3 and d 4 , we show the same upper bound expression holds and give almost matching lower bounds. The local search analysis also enables us to characterize the query complexity of computing a Brouwer fixed point in rounds. Our proof technique for lower bounding the query complexity in rounds may be of independent interest as an alternative to the classical relational adversary method of Aaronson from the fully adaptive setting.


A generalized model interpolating between the random energy model and the branching random walk. We study a generalization of the model introduced by Kistler and Schmidt in 2015 , that interpolates between the random energy model (REM) and the branching random walk (BRW). More precisely, we are interested in the asymptotic behaviour of the extremal process associated to this model. Kistler and Schmidt show that the extremal process of the GREM(N alpha ) , alpha in 0,1) converges weakly to a simple Poisson point process. This contrasts with the extremal process of the branching random walk ( alpha 1) which was shown to converge toward a decorate Poisson point process by Madaule. In this paper we propose a generalized model of the GREM(N alpha ) , that has the structure of a tree with k n levels, where (k n leq n) is a non decreasing sequence of positive integers. We study a generalized case, where the position of the particles are not necessarily Gaussian variables and the reproduction law is not necessarily binary. We show that as long as b n lfloor frac n k n rfloor to n to infty infty in the Gaussian case (with the assumption frac b n log(n) 2 to infty as n to infty in the non Gaussian case) the decoration disappears and we have convergence to a simple Poisson point process.


GrowSpace Learning How to Shape Plants. Plants are dynamic systems that are integral to our existence and survival. Plants face environment changes and adapt over time to their surrounding conditions. We argue that plant responses to an environmental stimulus are a good example of a real world problem that can be approached within a reinforcement learning (RL)framework. With the objective of controlling a plant by moving the light source, we propose GrowSpace, as a new RL benchmark. The back end of the simulator is implemented using the Space Colonisation Algorithm, a plant growing model based on competition for space. Compared to video game RL environments, this simulator addresses a real world problem and serves as a test bed to visualize plant growth and movement in a faster way than physical experiments. GrowSpace is composed of a suite of challenges that tackle several problems such as control, multi stage learning,fairness and multi objective learning. We provide agent baselines alongside case studies to demonstrate the difficulty of the proposed benchmark.


NRC GAMMA Introducing a Novel Large Gas Meter Image Dataset. Automatic meter reading technology is not yet widespread. Gas, electricity, or water accumulation meters reading is mostly done manually on site either by an operator or by the homeowner. In some countries, the operator takes a picture as reading proof to confirm the reading by checking offline with another operator and or using it as evidence in case of conflicts or complaints. The whole process is time consuming, expensive, and prone to errors. Automation can optimize and facilitate such labor intensive and human error prone processes. With the recent advances in the fields of artificial intelligence and computer vision, automatic meter reading systems are becoming more viable than ever. Motivated by the recent advances in the field of artificial intelligence and inspired by open source open access initiatives in the research community, we introduce a novel large benchmark dataset of real life gas meter images, named the NRC GAMMA dataset. The data were collected from an Itron 400A diaphragm gas meter on January 20, 2020, between 00 05 am and 11 59 pm. We employed a systematic approach to label the images, validate the labellings, and assure the quality of the annotations. The dataset contains 28,883 images of the entire gas meter along with 57,766 cropped images of the left and the right dial displays. We hope the NRC GAMMA dataset helps the research community to design and implement accurate, innovative, intelligent, and reproducible automatic gas meter reading solutions.


Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection. Fake news detection is an important task for increasing the credibility of information on the media since fake news is constantly spreading on social media every day and it is a very serious concern in our society. Fake news is usually created by manipulating images, texts, and videos. In this paper, we present a novel method for detecting fake news by fusing multimodal features derived from textual and visual data. Specifically, we used a pre trained BERT model to learn text features and a VGG 19 model pre trained on the ImageNet dataset to extract image features. We proposed a scale dot product attention mechanism to capture the relationship between text features and visual features. Experimental results showed that our approach performs better than the current state of the art method on a public Twitter dataset by 3.1 accuracy.


Performance optimized components for quantum technologies via additive manufacturing. Novel quantum technologies and devices place unprecedented demands on the performance of experimental components, while their widespread deployment beyond the laboratory necessitates increased robustness and fast, affordable production. We show how the use of additive manufacturing, together with mathematical optimization techniques and innovative designs, allows the production of compact, lightweight components with greatly enhanced performance. We use such components to produce a magneto optical trap that captures sim 2 times 10 8 rubidium atoms, employing for this purpose a compact and highly stable device for spectroscopy and optical power distribution, optimized neodymium magnet arrays for magnetic field generation, and a lightweight, additively manufactured ultra high vacuum chamber. We show how the use of additive manufacturing enables substantial weight reduction and stability enhancement, while also illustrating the transferability of our approach to experiments and devices across the quantum technology sector and beyond.


Learning a Weight Map for Weakly Supervised Localization. In the weakly supervised localization setting, supervision is given as an image level label. We propose to employ an image classifier f and to train a generative network g that outputs, given the input image, a per pixel weight map that indicates the location of the object within the image. Network g is trained by minimizing the discrepancy between the output of the classifier f on the original image and its output given the same image weighted by the output of g . The scheme requires a regularization term that ensures that g does not provide a uniform weight, and an early stopping criterion in order to prevent g from over segmenting the image. Our results indicate that the method outperforms existing localization methods by a sizable margin on the challenging fine grained classification datasets, as well as a generic image recognition dataset. Additionally, the obtained weight map is also state of the art in weakly supervised segmentation in fine grained categorization datasets.


Causal Intervention for Leveraging Popularity Bias in Recommendation. Recommender system usually faces popularity bias issues from the data perspective, items exhibit uneven (long tail) distribution on the interaction frequency from the method perspective, collaborative filtering methods are prone to amplify the bias by over recommending popular items. It is undoubtedly critical to consider popularity bias in recommender systems, and existing work mainly eliminates the bias effect. However, we argue that not all biases in the data are bad some items demonstrate higher popularity because of their better intrinsic quality. Blindly pursuing unbiased learning may remove the beneficial patterns in the data, degrading the recommendation accuracy and user satisfaction. This work studies an unexplored problem in recommendation how to leverage popularity bias to improve the recommendation accuracy. The key lies in two aspects how to remove the bad impact of popularity bias during training, and how to inject the desired popularity bias in the inference stage that generates top K recommendations. This questions the causal mechanism of the recommendation generation process. Along this line, we find that item popularity plays the role of confounder between the exposed items and the observed interactions, causing the bad effect of bias amplification. To achieve our goal, we propose a new training and inference paradigm for recommendation named Popularity bias Deconfounding and Adjusting (PDA). It removes the confounding popularity bias in model training and adjusts the recommendation score with desired popularity bias via causal intervention. We demonstrate the new paradigm on latent factor model and perform extensive experiments on three real world datasets. Empirical studies validate that the deconfounded training is helpful to discover user real interests and the inference adjustment with popularity bias could further improve the recommendation accuracy.


Temporal Action Proposal Generation with Transformers. Transformer networks are effective at modeling long range contextual information and have recently demonstrated exemplary performance in the natural language processing domain. Conventionally, the temporal action proposal generation (TAPG) task is divided into two main sub tasks boundary prediction and proposal confidence prediction, which rely on the frame level dependencies and proposal level relationships separately. To capture the dependencies at different levels of granularity, this paper intuitively presents a unified temporal action proposal generation framework with original Transformers, called TAPG Transformer, which consists of a Boundary Transformer and a Proposal Transformer. Specifically, the Boundary Transformer captures long term temporal dependencies to predict precise boundary information and the Proposal Transformer learns the rich inter proposal relationships for reliable confidence evaluation. Extensive experiments are conducted on two popular benchmarks ActivityNet 1.3 and THUMOS14, and the results demonstrate that TAPG Transformer outperforms state of the art methods. Equipped with the existing action classifier, our method achieves remarkable performance on the temporal action localization task. Codes and models will be available.


Functional norms, condition numbers and numerical algorithms in algebraic geometry. In numerical linear algebra, a well established practice is to choose a norm that exploits the structure of the problem at hand in order to optimize accuracy or computational complexity. In numerical polynomial algebra, a single norm (attributed to Weyl) dominates the literature. This article initiates the use of L p norms for numerical algebraic geometry, with an emphasis on L infty . This classical idea yields strong improvements in the analysis of the number of steps performed by numerous iterative algorithms. In particular, we exhibit three algorithms where, despite the complexity of computing L infty norm, the use of L p norms substantially reduces computational complexity a subdivision based algorithm in real algebraic geometry for computing the homology of semialgebraic sets, a well known meshing algorithm in computational geometry, and the computation of zeros of systems of complex quadratic polynomials (a particular case of Smale's 17th problem).


Characterization and Mitigation of Electromigration Effects in TSV Based Power Delivery Network Enabled 3D Stacked DRAMs. With 3D stacked DRAM architectures becoming more prevalent, it has become important to find ways to characterize and mitigate the adverse effects that can hinder their inherent access parallelism and throughput. One example of such adversities is the electromigration (EM) effects in the through silicon vias (TSVs) of the power delivery network (PDN) of 3D stacked DRAM architectures. Several prior works have addressed the effects of EM in TSVs of 3D integrated circuits. However, no prior work has addressed the effects of EM in the PDN TSVs on the performance and lifetime of 3D stacked DRAMs. In this paper, we characterize the effects of EM in PDN TSVs on a Hybrid Memory Cube (HMC) architecture employing the conventional PDN design with clustered layout of power and ground TSVs. We then present a new PDN design with a distributed layout of power and ground TSVs and show that it can mitigate the adverse effects of EM on the HMC architecture performance without requiring additional power and ground pins. Our benchmark driven simulation based analysis shows that compared to the clustered PDN layout, our proposed distributed PDN layout improves the EM affected lifetime of the HMC architecture by up to 10 years. During this useful lifetime, the HMC architecture yields up to 1.51 times less energy delay product (EDP).


A Spiking Neuron Synaptic Plasticity Model Optimized for Unsupervised Learning. Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasticity the rules which determine dynamics of synaptic weights depending usually on activity of the pre and post synaptic neurons. Diversity of various learning regimes assumes that different forms of synaptic plasticity may be most efficient for, for example, unsupervised and supervised learning, as it is observed in living neurons demonstrating many kinds of deviations from the basic spike timing dependent plasticity (STDP) model. In the present paper, we formulate specific requirements to plasticity rules imposed by unsupervised learning problems and construct a novel plasticity model generalizing STDP and satisfying these requirements. This plasticity model serves as main logical component of the novel supervised learning algorithm called SCoBUL (Spike Correlation Based Unsupervised Learning) proposed in this work. We also present the results of computer simulation experiments confirming efficiency of these synaptic plasticity rules and the algorithm SCoBUL.


Minimization and Synthesis of the Tail in Sequential Compositions of Mealy Machines. We consider a system consisting of a sequential composition of Mealy machines, called head and tail. We study two problems related to these systems. In the first problem, models of both head and tail components are available, and the aim is to obtain a replacement for the tail with the minimum number of states. We introduce a minimization method for this context which yields an exponential improvement over the state of the art. In the second problem, only the head is known, and a desired model for the whole system is given. The objective is to construct a tail that causes the system to behave according to the given model. We show that, while it is possible to decide in polynomial time whether such a tail exists, there are instances where its size is exponential in the sizes of the head and the desired system. This shows that the complexity of the synthesis procedure is at least exponential, matching the upper bound in complexity provided by the existing methods for solving unknown component equations.


Deep SIMBAD Active Landmark based Self localization Using Ranking based Scene Descriptor. Landmark based robot self localization has recently garnered interest as a highly compressive domain invariant approach for performing visual place recognition (VPR) across domains (e.g., time of day, weather, and season). However, landmark based self localization can be an ill posed problem for a passive observer (e.g., manual robot control), as many viewpoints may not provide an effective landmark view. In this study, we consider an active self localization task by an active observer and present a novel reinforcement learning (RL) based next best view (NBV) planner. Our contributions are as follows. (1) SIMBAD based VPR We formulate the problem of landmark based compact scene description as SIMBAD (similarity based pattern recognition) and further present its deep learning extension. (2) VPR to NBV knowledge transfer We address the challenge of RL under uncertainty (i.e., active self localization) by transferring the state recognition ability of VPR to the NBV. (3) NNQL based NBV We regard the available VPR as the experience database by adapting nearest neighbor approximation of Q learning (NNQL). The result shows an extremely compact data structure that compresses both the VPR and NBV into a single incremental inverted index. Experiments using the public NCLT dataset validated the effectiveness of the proposed approach.


Dynamic Mirror Descent based Model Predictive Control for Accelerating Robot Learning. Recent works in Reinforcement Learning (RL) combine model free (Mf) RL algorithms with model based (Mb) RL approaches to get the best from both asymptotic performance of Mf RL and high sample efficiency of Mb RL. Inspired by these works, we propose a hierarchical framework that integrates online learning for the Mb trajectory optimization with off policy methods for the Mf RL. In particular, two loops are proposed, where the Dynamic Mirror Descent based Model Predictive Control (DMD MPC) is used as the inner loop Mb RL to obtain an optimal sequence of actions. These actions are in turn used to significantly accelerate the outer loop Mf RL. We show that our formulation is generic for a broad class of MPC based policies and objectives, and includes some of the well known Mb Mf approaches. We finally introduce a new algorithm Mirror Descent Model Predictive RL (M DeMoRL), which uses Cross Entropy Method (CEM) with elite fractions for the inner loop. Our experiments show faster convergence of the proposed hierarchical approach on benchmark MuJoCo tasks. We also demonstrate hardware training for trajectory tracking in a 2R leg and hardware transfer for robust walking in a quadruped. We show that the inner loop Mb RL significantly decreases the number of training iterations required in the real system, thereby validating the proposed approach.


ExSinGAN Learning an Explainable Generative Model from a Single Image. Generating images from a single sample, as a newly developing branch of image synthesis, has attracted extensive attention. In this paper, we formulate this problem as sampling from the conditional distribution of a single image, and propose a hierarchical framework that simplifies the learning of the intricate conditional distributions through the successive learning of the distributions about structure, semantics and texture, making the process of learning and generation comprehensible. On this basis, we design ExSinGAN composed of three cascaded GANs for learning an explainable generative model from a given image, where the cascaded GANs model the distributions about structure, semantics and texture successively. ExSinGAN is learned not only from the internal patches of the given image as the previous works did, but also from the external prior obtained by the GAN inversion technique. Benefiting from the appropriate combination of internal and external information, ExSinGAN has a more powerful capability of generation and competitive generalization ability for the image manipulation tasks compared with prior works.


The variational approach to s fractional heat flows and the limit cases s to 0 and s to 1 . This paper deals with the limit cases for s fractional heat flows in a cylindrical domain, with homogeneous Dirichlet boundary conditions, as s to 0 and s to 1 ,. To this purpose, we describe the fractional heat flows as minimizing movements of the corresponding Gagliardo seminorms, with respect to the L 2 metric. First, we provide an abstract stability result for minimizing movements in Hilbert spaces, with respect to a sequence of Gamma converging uniformly lambda convex energy functionals. Then, we provide the Gamma convergence analysis of the s Gagliardo seminorms as s to 0 and s to 1 ,, and apply the general stability result to such specific cases. As a consequence, we prove that s fractional heat flows (suitably scaled in time) converge to the standard heat flow as s to 1 , and to a degenerate ODE type flow as s to 0 ,. Moreover, looking at the next order term in the asymptotic expansion of the s fractional Gagliardo seminorm, we show that suitably forced s fractional heat flows converge, as s to 0 ,, to the parabolic flow of an energy functional that can be seen as a sort of renormalized 0 Gagliardo seminorm the resulting parabolic equation involves the first variation of such an energy, that can be understood as a zero (or logarithmic) Laplacian.


Skin friction and heat transfer in hypersonic transitional and turbulent boundary layers. The decompositions of the skin friction and heat transfer coefficients based on the two fold repeated integration in hypersonic transitional and turbulent boundary layers are analyzed to explain the generations of the wall skin friction and heat transfer. The Reynolds analogy factor slightly increases as the wall temperature decreases, especially for the extremely cooled wall. The integral analysis is applied to explain the overshoot behaviours of the skin friction and heat transfer coefficients in hypersonic transitional boundary layers. The overshoot of the skin friction coefficient is mainly caused by the drastic change of the mean velocity profiles, and the overshoot of the heat transfer coefficient is primarily due to the viscous dissipation. In the hypersonic turbulent boundary layers, the skin friction and heat transfer coefficients increase significantly as the wall temperature decreases. The effects of the mean velocity gradients and the Reynolds shear stress contribute dominantly to the wall skin friction, and have weak correlations with the wall temperature, except for the strongly cooled wall condition. The strongly cooled wall condition and high Mach number can enhance the effect of the Reynolds shear stress, and weaken the impact of the mean velocity gradients. Furthermore, the magnitudes of the dominant relative contributions of the mean temperature gradients, pressure dilatation, viscous dissipation and the Reynolds heat flux to the heat transfer coefficient increase as the wall temperature increases in the hypersonic turbulent boundary layers.


Three characterizations of strict coherence on infinite valued events. This paper builds on a recent article co authored by the present author, H. Hosni and F. Montagna. It is meant to contribute to the logical foundations of probability theory on many valued events and, specifically, to a deeper understanding of the notion of strict coherence. In particular, we will make use of geometrical, measure theoretical and logical methods to provide three characterizations of strict coherence on formulas of infinite valued L ukasewicz logic


Smooth convergence to the enveloping cylinder for mean curvature flow of complete graphical hypersurfaces. For a mean curvature flow of complete graphical hypersurfaces M t operatorname graph u( cdot,t) defined over domains Omega t , the enveloping cylinder is partial Omega t times mathbb R . We prove the smooth convergence of M t h ,e n 1 to the enveloping cylinder under certain circumstances. Moreover, we give examples demonstrating that there is no uniform curvature bound in terms of the inital curvature and the geometry of Omega t . Furthermore, we provide an example where the hypersurface increasingly oscillates towards infinity in both space and time. It has unbounded curvature at all times and is not smoothly asymptotic to the enveloping cylinder. We also prove a relation between the initial spatial asymptotics at the boundary and the temporal asymptotics of how the surface vanishes to infinity for certain rates in the case Omega t are balls.


Tackling Variabilities in Autonomous Driving. The state of the art driving automation system demands extreme computational resources to meet rigorous accuracy and latency requirements. Though emerging driving automation computing platforms are based on ASIC to provide better performance and power guarantee, building such an accelerator based computing platform for driving automation still present challenges. First, the workloads mix and performance requirements exposed to driving automation system present significant variability. Second, with more cameras sensors integrated in a future fully autonomous driving vehicle, a heterogeneous multi accelerator architecture substrate is needed that requires a design space exploration for a new form of parallelism. In this work, we aim to extensively explore the above system design challenges and these challenges motivate us to propose a comprehensive framework that synergistically handles the heterogeneous hardware accelerator design principles, system design criteria, and task scheduling mechanism. Specifically, we propose a novel heterogeneous multi core AI accelerator (HMAI) to provide the hardware substrate for the driving automation tasks with variability. We also define system design criteria to better utilize hardware resources and achieve increased throughput while satisfying the performance and energy restrictions. Finally, we propose a deep reinforcement learning (RL) based task scheduling mechanism FlexAI, to resolve task mapping issue. Experimental results show that with FlexAI scheduling, basically 100 tasks in each driving route can be processed by HMAI within their required period to ensure safety, and FlexAI can also maximally reduce the breaking distance up to 96 as compared to typical heuristics and guided random search based algorithms.


Exploring Transformers in Natural Language Generation GPT, BERT, and XLNet. Recent years have seen a proliferation of attention mechanisms and the rise of Transformers in Natural Language Generation (NLG). Previously, state of the art NLG architectures such as RNN and LSTM ran into vanishing gradient problems as sentences grew larger, distance between positions remained linear, and sequential computation hindered parallelization since sentences were processed word by word. Transformers usher in a new era. In this paper, we explore three major Transformer based models, namely GPT, BERT, and XLNet, that carry significant implications for the field. NLG is a burgeoning area that is now bolstered with rapid developments in attention mechanisms. From poetry generation to summarization, text generation derives benefit as Transformer based language models achieve groundbreaking results.


FisheyeSuperPoint Keypoint Detection and Description Network for Fisheye Images. Keypoint detection and description is a commonly used building block in computer vision systems particularly for robotics and autonomous driving. However, the majority of techniques to date have focused on standard cameras with little consideration given to fisheye cameras which are commonly used in urban driving and automated parking. In this paper, we propose a novel training and evaluation pipeline for fisheye images. We make use of SuperPoint as our baseline which is a self supervised keypoint detector and descriptor that has achieved state of the art results on homography estimation. We introduce a fisheye adaptation pipeline to enable training on undistorted fisheye images. We evaluate the performance on the HPatches benchmark, and, by introducing a fisheye based evaluation method for detection repeatability and descriptor matching correctness, on the Oxford RobotCar dataset.


JPS daprinfo A Dataset for Japanese Dialog Act Analysis and People related Information Detection. We conducted a labeling work on a spoken Japanese dataset (I JAS) for the text classification, which contains 50 interview dialogues of two way Japanese conversation that discuss the participants' past present and future. Each dialogue is 30 minutes long. From this dataset, we selected the interview dialogues of native Japanese speakers as the samples. Given the dataset, we annotated sentences with 13 labels. The labeling work was conducted by native Japanese speakers who have experiences with data annotation. The total amount of the annotated samples is 20130.


"It's a Trap!" How Speculation Invariance Can Be Abused with Forward Speculative Interference. Speculative side channel attacks access sensitive data and use transmitters to leak the data during wrong path execution. Various defenses have been proposed to prevent such information leakage. However, not all speculatively executed instructions are unsafe Recent work demonstrates that speculation invariant instructions are independent of speculative control flow paths and are guaranteed to eventually commit, regardless of the speculation outcome. Compile time information coupled with run time mechanisms can then selectively lift defenses for speculation invariant instructions, reclaiming some of the lost performance. Unfortunately, speculation invariant instructions can easily be manipulated by a form of speculative interference to leak information via a new side channel that we introduce in this paper. We show that forward speculative interference whereolder speculative instructions interfere with younger speculation invariant instructions effectively turns them into transmitters for secret data accessed during speculation. We demonstrate forward speculative interference on actual hardware, by selectively filling the reorder buffer (ROB) with instructions, pushing speculative invariant instructions in or out of the ROB on demand, based on a speculatively accessed secret. This reveals the speculatively accessed secret, as the occupancy of the ROB itself becomes a new speculative side channel.


Machine learning for rapid discovery of laminar flow channel wall modifications that enhance heat transfer. The calculation of heat transfer in fluid flow in simple flat channels is a relatively easy task for various simulations methods. However, once the channel geometry becomes more complex, numerical simulations become a bottleneck in optimizing wall geometries. We present a combination of accurate numerical simulations of arbitrary, non flat channels and machine learning models predicting drag coefficient and Stanton number. We show that convolutional neural networks can accurately predict the target properties at a fraction of the time of numerical simulations. We use the CNN models in a virtual high throughput screening approach to explore a large number of possible, randomly generated wall architectures. We find that S shaped channel geometries are Pareto optimal, a result which seems intuitive, but was not obvious before analysing the data. The general approach is not only applicable to simple flow setups as presented here, but can be extended to more complex tasks, such as multiphase or even reactive unit operations in chemical engineering.


Turning Your Strength against You Detecting and Mitigating Robust and Universal Adversarial Patch Attacks. Adversarial patch attacks against image classification deep neural networks (DNNs), which inject arbitrary distortions within a bounded region of an image, can generate adversarial perturbations that are robust (i.e., remain adversarial in physical world) and universal (i.e., remain adversarial on any input). Such attacks can lead to severe consequences in real world DNN based systems. This work proposes Jujutsu, a technique to detect and mitigate robust and universal adversarial patch attacks. For detection, Jujutsu exploits the attacks' universal property Jujutsu first locates the region of the potential adversarial patch, and then strategically transfers it to a dedicated region in a new image to determine whether it is truly malicious. For attack mitigation, Jujutsu leverages the attacks' localized nature via image inpainting to synthesize the semantic contents in the pixels that are corrupted by the attacks, and reconstruct the clean'' image. We evaluate Jujutsu on four diverse datasets (ImageNet, ImageNette, CelebA and Place365), and show that Jujutsu achieves superior performance and significantly outperforms existing techniques. We find that Jujutsu can further defend against different variants of the basic attack, including 1) physical world attack 2) attacks that target diverse classes 3) attacks that construct patches in different shapes and 4) adaptive attacks.


Optimal Income Crossover for Two Class Model Using Particle Swarm Optimization. Personal income distribution may exhibit a two class structure, such that the lower income class of the population (85 98 ) is described by exponential Boltzmann Gibbs distribution, whereas the upper income class (15 2 ) has a Pareto power law distribution. We propose a method, based on a theoretical and numerical optimization scheme, which allows us to determine the crossover income between the distributions, the temperature of the Boltzmann Gibbs distribution and the Pareto index. Using this method, the Brazilian income distribution data provided by the National Household Sample Survey was studied. The data was stratified into two dichotomies (sex gender and color race), so the model was tested using different subsets along with accessing the economic differences between these groups. Lastly, we analyse the temporal evolution of the parameters of our model and the Gini coefficient discussing the implication on the Brazilian income inequality. To our knowledge, for the first time an optimization method is proposed in order to find a continuous two class income distribution, which is able to delimit the boundaries of the two distributions. It also gives a measure of inequality which is a function that depends only on the Pareto index and the percentage of people in the high income region. It was found a temporal dynamics relation, that may be general, between the Pareto and the percentage of people described by the Pareto tail.


The mean field limit of stochastic differential equation systems modelling grid cells. Several differential equation models have been proposed to explain the formation of stationary activity patterns characteristic of the grid cell network. Understanding the robustness of these patterns with respect to noise is one of the key open questions in computational neuroscience. In the present work, we analyze a family of stochastic differential systems modelling grid cell networks. Furthermore, the well posedness of the associated McKean Vlasov and Fokker Planck equations, describing the average behavior of the networks, is established. Finally, we rigorously prove the mean field limit of these systems and provide a sharp rate of convergence for their empirical measures.


Lattices of logmodular algebras. A subalgebra mathcal A of a C algebra mathcal M is logmodular (resp. has factorization) if the set a a a text is invertible with a,a 1 in mathcal A is dense in (resp. equal to) the set of all positive and invertible elements of mathcal M . There are large classes of well studied algebras, both in commutative and non commutative settings, which are known to be logmodular. In this paper, we show that the lattice of projections in a von Neumann algebra mathcal M whose ranges are invariant under a logmodular algebra in mathcal M , is a commutative subspace lattice. Further, if mathcal M is a factor then this lattice is a nest. As a special case, it follows that all reflexive (in particular, completely distributive CSL) logmodular subalgebras of type I factors are nest algebras, thus answering a question of Paulsen and Raghupathi Trans. Amer. Math. Soc., 363 (2011) 2627 2640 . We also discuss some sufficient criteria under which an algebra having factorization is automatically reflexive and is a nest algebra.


The anatomy of social dynamics in escape rooms. From sport and science production to everyday life, higher level pursuits demand collaboration. Despite an increase in the number of data driven studies on human behavior, the social dynamics of collaborative problem solving are still largely unexplored with network science and other computational and quantitative tools. Here we introduce escape rooms as a non interventional and minimally biased social laboratory, which allows us to capture at a high resolution real time communications in small project teams. Our analysis portrays a nuanced picture of different dimensions of social dynamics. We reveal how socio demographic characteristics impact problem solving and the importance of prior relationships for enhanced interactions. We extract key conversation rules from motif analysis, and discuss turn usurping gendered behavior, a phenomenon particularly strong in male dominated teams. We investigate the temporal evolution of signed and group interactions, finding that a minimum level of tense communication might be beneficial for collective problem solving, and revealing differences in the behavior of successful and failed teams. Our work unveils the innovative potential of escape rooms to study teams in their complexity, contributing to a deeper understanding of the micro dynamics of collaborative team processes.


Online Euclidean Spanners. In this paper, we study the online Euclidean spanners problem for points in mathbb R d . Suppose we are given a sequence of n points (s 1,s 2, ldots, s n) in mathbb R d , where point s i is presented in step i for i 1, ldots, n . The objective of an online algorithm is to maintain a geometric t spanner on S i s 1, ldots, s i for each step i . First, we establish a lower bound of Omega( varepsilon 1 log n log varepsilon 1 ) for the competitive ratio of any online (1 varepsilon) spanner algorithm, for a sequence of n points in 1 dimension. We show that this bound is tight, and there is an online algorithm that can maintain a (1 varepsilon) spanner with competitive ratio O( varepsilon 1 log n log varepsilon 1 ) . Next, we design online algorithms for sequences of points in mathbb R d , for any constant d ge 2 , under the L 2 norm. We show that previously known incremental algorithms achieve a competitive ratio O( varepsilon (d 1) log n) . However, if the algorithm is allowed to use additional points (Steiner points), then it is possible to substantially improve the competitive ratio in terms of varepsilon . We describe an online Steiner (1 varepsilon) spanner algorithm with competitive ratio O( varepsilon (1 d) 2 log n) . As a counterpart, we show that the dependence on n cannot be eliminated in dimensions d ge 2 . In particular, we prove that any online spanner algorithm for a sequence of n points in mathbb R d under the L 2 norm has competitive ratio Omega(f(n)) , where lim n rightarrow infty f(n) infty . Finally, we provide improved lower bounds under the L 1 norm Omega( varepsilon 2 log varepsilon 1 ) in the plane and Omega( varepsilon d ) in mathbb R d for d geq 3 .


Behavior Change in Response to Subreddit Bans and External Events. As more people flock to social media to connect with others and form virtual communities, it is important to research how members of these groups interact to understand human behavior on the Web. In response to an increase in hate speech, harassment and other antisocial behaviors, many social media companies have implemented different content and user moderation policies. On Reddit, for example, communities, i.e, subreddits, are occasionally banned for violating these policies. We study the effect of these regulatory actions as well as when a community experiences a significant external event like a political election or a market crash. Overall, we find that most subreddit bans prompt a small, but statistically significant, number of active users to leave the platform the effect of external events varies with the type of event. We conclude with a discussion on the effectiveness of the bans and wider implications for the online content moderation.


Global existence of weak solutions to the compressible Navier Stokes equations with temperature depending viscosity coefficients. This paper is devoted to the global existence of weak solutions to the three dimensional compressible Navier Stokes equations with heat conducting effects in a bounded domain. The viscosity and the heat conductivity coefficients are assumed to be functions of the temperature, and the shear viscosity coefficient may vanish as the temperature goes to zero. The proof is to apply Galerkin method to a suitable approximate system with several parameters and obtain uniform estimates for the approximate solutions. The key ingredient in obtaining the required estimates is to apply De Giorgi's iteration to the modified temperature equation, from which we can get a lower bound for the temperature not depending on the artificial viscosity coefficient introduced in the modified momentum equation, which makes the compactness argument available as the artificial viscous term vanishes.


The Best Thresholds for Rapid Identification of Episodic and Chronic Homeless Shelter Use. This paper explores how to best identify clients for housing services based on their homeless shelter access patterns. We focus on counting the number of shelter stays and episodes of shelter use for a client within a time window. Thresholds are then applied to these values to determine if that individual is a good candidate for housing support. Using new housing referral impact metrics, we explore a range of threshold and time window values to determine which combination both maximizes impact and identifies good candidates for housing as soon as possible. New insights are also provided regarding the characteristics of the "under the radar" client group who are typically not identified for housing support.


A Distance based Separability Measure for Internal Cluster Validation. To evaluate clustering results is a significant part of cluster analysis. Since there are no true class labels for clustering in typical unsupervised learning, many internal cluster validity indices (CVIs), which use predicted labels and data, have been created. Without true labels, to design an effective CVI is as difficult as to create a clustering method. And it is crucial to have more CVIs because there are no universal CVIs that can be used to measure all datasets and no specific methods of selecting a proper CVI for clusters without true labels. Therefore, to apply a variety of CVIs to evaluate clustering results is necessary. In this paper, we propose a novel internal CVI the Distance based Separability Index (DSI), based on a data separability measure. We compared the DSI with eight internal CVIs including studies from early Dunn (1974) to most recent CVDD (2019) and an external CVI as ground truth, by using clustering results of five clustering algorithms on 12 real and 97 synthetic datasets. Results show DSI is an effective, unique, and competitive CVI to other compared CVIs. We also summarized the general process to evaluate CVIs and created the rank difference metric for comparison of CVIs' results.


Privacy Preserving Decentralized Multi Agent Cooperative Optimization Paradigm Design and Privacy Analysis. Large scale multi agent cooperative control problems have materially enjoyed the scalability, adaptivity, and flexibility of decentralized optimization. However, due to the mandatory iterative communications between the agents and the system operator, the decentralized architecture is vulnerable to malicious attacks and privacy breach. Current research on addressing privacy preservation of both agents and the system operator in cooperative decentralized optimization with strongly coupled objective functions and constraints is still primitive. To fill in the gaps, this paper proposes a novel privacy preserving decentralized optimization paradigm based on Paillier cryptosystem. The proposed paradigm achieves ideal correctness and security, as well as resists attacks from a range of adversaries. The efficacy and efficiency of the proposed approach are verified via numerical simulations and a real world physical platform.


Clifford Groups of Arbitrary Quadratic Modules over Commutative Rings. We consider the Clifford algebra and the Clifford group associated with any quadratic module, degenerate or not, over an arbitrary commutative ring with 1. We determine some of the important subalgebras of the Clifford algebra under some conditions, and generalize some of the classical relations between the Clifford group and the orthogonal group of the quadratic module.


Doing Natural Language Processing in A Natural Way An NLP toolkit based on object oriented knowledge base and multi level grammar base. We introduce an NLP toolkit based on object oriented knowledge base and multi level grammar base. This toolkit focuses on semantic parsing, it also has abilities to discover new knowledge and grammar automatically, new discovered knowledge and grammar will be identified by human, and will be used to update the knowledge base and grammar base. This process can be iterated many times to improve the toolkit continuously.


MegBA A High Performance and Distributed Library for Large Scale Bundle Adjustment. Large scale Bundle Adjustment (BA) is the key for many 3D vision applications (e.g., Structure from Motion and SLAM). Though important, large scale BA is still poorly supported by existing BA libraries (e.g., Ceres and g2o). These libraries under utilise accelerators (i.e., GPUs), and they lack algorithms to distribute BA computation constrained by the memory on a single device. In this paper, we propose MegBA, a high performance and distributed library for large scale BA. MegBA has a novel end to end vectorised BA algorithm that can fully exploit the massive parallel cores on GPUs, thus speeding up the entire BA computation. It also has a novel distributed BA algorithm that can automatically partition BA problems, and solve BA sub problems using distributed GPUs. The GPUs synchronise intermediate solving state using network efficient collective communication, and the synchronisation is designed to minimise communication cost. MegBA has a memory efficient GPU runtime and exposes g2o compatible APIs. Experiments show that MegBA can out perform state of the art BA libraries (i.e., Ceres and DeepLM) by up to 47.6x and 6.4x respectively, in public large scale BA benchmarks. The code of MegBA is available at https github.com MegviiRobot MegBA.


AdEle An Adaptive Congestion and Energy Aware Elevator Selection for Partially Connected 3D NoCs. By lowering the number of vertical connections in fully connected 3D networks on chip (NoCs), partially connected 3D NoCs (PC 3DNoCs) help alleviate reliability and fabrication issues. This paper proposes a novel, adaptive congestion and energy aware elevator selection scheme called AdEle to improve the traffic distribution in PC 3DNoCs. AdEle employs an offline multi objective simulated annealing based algorithm to find good elevator subsets and an online elevator selection policy to enhance elevator selection during routing. Compared to the state of the art techniques under different real application traffics and configuration scenarios, AdEle improves the network latency by 10.9 on average (up to 14.6 ) with less than 6.9 energy consumption overhead.


Conditionally positive definite unilateral weighted shifts. In a recent paper 15 , Hilbert space operators T with the property that each sequence of the form T n h 2 n 0 infty is conditionally positive definite in a semigroup sense were introduced. In the present paper, this line of research is continued in depth in the case of unilateral weighted shifts. The conditional positive definiteness of weighted shifts is characterized in terms of formal moment sequences. The description of the representing triplet, the main object canonically associated with such operators, is provided. The backward extension problem for conditionally positive definite weighted shifts is solved, revealing a new feature that does not appear in the case of other operator classes. Finally, the flatness problem in this context is discussed, with an emphases on unexpected differences from the corresponding problem for subnormal weighted shifts.


Essential normality of Bergman modules over intersections of complex ellipsoids. This paper studies the essential normality of Bergman modules over the intersection of complex ellipsoids, as well as their quotients by monomial ideals.


A Systematic Literature Review on Wearable Health Data Publishing under Differential Privacy. Wearable devices generate different types of physiological data about the individuals. These data can provide valuable insights for medical researchers and clinicians that cannot be availed through traditional measures. Researchers have historically relied on survey responses or observed behavior. Interestingly, physiological data can provide a richer amount of user cognition than that obtained from any other sources, including the user himself. Therefore, the inexpensive consumer grade wearable devices have become a point of interest for the health researchers. In addition, they are also used in continuous remote health monitoring and sometimes by the insurance companies. However, the biggest concern for such kind of use cases is the privacy of the individuals. There are a few privacy mechanisms, such as abstraction and k anonymity, are widely used in information systems. Recently, Differential Privacy (DP) has emerged as a proficient technique to publish privacy sensitive data, including data from wearable devices. In this paper, we have conducted a Systematic Literature Review (SLR) to identify, select and critically appraise researches in DP as well as to understand different techniques and exiting use of DP in wearable data publishing. Based on our study we have identified the limitations of proposed solutions and provided future directions.


Mini Cheetah, the Falling Cat A Case Study in Machine Learning and Trajectory Optimization for Robot Acrobatics. Seemingly in defiance of basic physics, cats consistently land on their feet after falling. In this paper, we design a controller that lands the Mini Cheetah quadruped robot on its feet as well. Specifically, we explore how trajectory optimization and machine learning can work together to enable highly dynamic bioinspired behaviors. We find that a reflex approach, in which a neural network learns entire state trajectories, outperforms a policy approach, in which a neural network learns a mapping from states to control inputs. We validate our proposed controller in both simulation and hardware experiments, and are able to land the robot on its feet from falls with initial pitch angles between 90 and 90 degrees.


A Generative Variational Model for Inverse Problems in Imaging. This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative convolutional neural networks it aims to generate the unknown from variables in a latent space via multi layer convolutions and non linear penalties, and penalizes an associated cost. In contrast to conventional neural network based approaches, however, the convolution kernels are learned directly from the measured data such that no training is required. The present work provides a mathematical analysis of the proposed model in a function space setting, including proofs for regularity and existence stability of solutions, and convergence for vanishing noise. Moreover, in a discretized setting, a numerical algorithm for solving various types of inverse problems with the proposed model is derived. Numerical results are provided for applications in inpainting, denoising, deblurring under noise, super resolution and JPEG decompression with multiple test images.


Stashing And Parallelization Pentagons. Parallelization is an algebraic operation that lifts problems to sequences in a natural way. Given a sequence as an instance of the parallelized problem, another sequence is a solution of this problem if every component is instance wise a solution of the original problem. In the Weihrauch lattice parallelization is a closure operator. Here we introduce a dual operation that we call stashing and that also lifts problems to sequences, but such that only some component has to be an instance wise solution. In this case the solution is stashed away in the sequence. This operation, if properly defined, induces an interior operator in the Weihrauch lattice. We also study the action of the monoid induced by stashing and parallelization on the Weihrauch lattice, and we prove that it leads to at most five distinct degrees, which (in the maximal case) are always organized in pentagons. We also introduce another closely related interior operator in the Weihrauch lattice that replaces solutions of problems by upper Turing cones that are strong enough to compute solutions. It turns out that on parallelizable degrees this interior operator corresponds to stashing. This implies that, somewhat surprisingly, all problems which are simultaneously parallelizable and stashable have computability theoretic characterizations. Finally, we apply all these results in order to study the recently introduced discontinuity problem, which appears as the bottom of a number of natural stashing parallelization pentagons. The discontinuity problem is not only the stashing of several variants of the lesser limited principle of omniscience, but it also parallelizes to the non computability problem. This supports the slogan that "non computability is the parallelization of discontinuity".


Multivariate Dynamical Sampling in l 2( mathbb Z 2) and Shift Invariant Spaces Associated with Linear Canonical Transform. In this paper, we investigate the multivariate dynamical sampling problem in l 2( mathbb Z 2) associated with the two dimensional discrete time non separable linear canonical transform (2D DT NS LCT) and shift invariant spaces associated with the two dimensional non separable linear canonical transform (2D NS LCT), respectively. Specifically, we derive a sufficient and necessary condition under which a sequence in l 2( mathbb Z 2) (or a function in a shift invariant space) can be stably recovered from its dynamical sampling measurements associated with the 2D DT NS LCT (or the 2D NS LCT). We also present a simple example to elucidate our main results.


Masking Modalities for Cross modal Video Retrieval. Pre training on large scale unlabelled datasets has shown impressive performance improvements in the fields of computer vision and natural language processing. Given the advent of large scale instructional video datasets, a common strategy for pre training video encoders is to use the accompanying speech as weak supervision. However, as speech is used to supervise the pre training, it is never seen by the video encoder, which does not learn to process that modality. We address this drawback of current pre training methods, which fail to exploit the rich cues in spoken language. Our proposal is to pre train a video encoder using all the available video modalities as supervision, namely, appearance, sound, and transcribed speech. We mask an entire modality in the input and predict it using the other two modalities. This encourages each modality to collaborate with the others, and our video encoder learns to process appearance and audio as well as speech. We show the superior performance of our "modality masking" pre training approach for video retrieval on the How2R, YouCook2 and Condensed Movies datasets.


Moving Object Segmentation in 3D LiDAR Data A Learning based Approach Exploiting Sequential Data. The ability to detect and segment moving objects in a scene is essential for building consistent maps, making future state predictions, avoiding collisions, and planning. In this paper, we address the problem of moving object segmentation from 3D LiDAR scans. We propose a novel approach that pushes the current state of the art in LiDAR only moving object segmentation forward to provide relevant information for autonomous robots and other vehicles. Instead of segmenting the point cloud semantically, i.e., predicting the semantic classes such as vehicles, pedestrians, roads, etc., our approach accurately segments the scene into moving and static objects, i.e., also distinguishing between moving cars vs. parked cars. Our proposed approach exploits sequential range images from a rotating 3D LiDAR sensor as an intermediate representation combined with a convolutional neural network and runs faster than the frame rate of the sensor. We compare our approach to several other state of the art methods showing superior segmentation quality in urban environments. Additionally, we created a new benchmark for LiDAR based moving object segmentation based on SemanticKITTI. We published it to allow other researchers to compare their approaches transparently and we furthermore published our code.


Effective Sequence to Sequence Dialogue State Tracking. Sequence to sequence models have been applied to a wide variety of NLP tasks, but how to properly use them for dialogue state tracking has not been systematically investigated. In this paper, we study this problem from the perspectives of pre training objectives as well as the formats of context representations. We demonstrate that the choice of pre training objective makes a significant difference to the state tracking quality. In particular, we find that masked span prediction is more effective than auto regressive language modeling. We also explore using Pegasus, a span prediction based pre training objective for text summarization, for the state tracking model. We found that pre training for the seemingly distant summarization task works surprisingly well for dialogue state tracking. In addition, we found that while recurrent state context representation works also reasonably well, the model may have a hard time recovering from earlier mistakes. We conducted experiments on the MultiWOZ 2.1 2.4, WOZ 2.0, and DSTC2 datasets with consistent observations.


An efficient phase field method for turbulent multiphase flows. With the aim of efficiently simulating three dimensional multiphase turbulent flows with a phase field method, we propose a new discretization scheme for the biharmonic term (the 4th order derivative term) of the Cahn Hilliard equation. This novel scheme can significantly reduce the computational cost while retaining the same accuracy as the original procedure. Our phase field method is built on top of a direct numerical simulation solver, named AFiD (www.afid.eu) and open sourced by our research group. It relies on a pencil distributed parallel strategy and a FFT based Poisson solver. To deal with large density ratios between the two phases, a pressure split method 1 has been applied to the Poisson solver. To further reduce computational costs, we implement a multiple resolution algorithm which decouples the discretizations for the Navier Stokes equations and the scalar equation while a stretched wall resolving grid is used for the Navier Stokes equations, for the Cahn Hilliard equation we use a fine uniform mesh. The present method shows excellent computational performance for large scale computation on meshes up to 8 billion nodes and 3072 CPU cores, a multiphase flow needs only slightly less than 1.5 times the CPU time of the single phase flow solver on the same grid. The present method is validated by comparing the results to previous studies for the cases of drop deformation in shear flow, including the convergence test with mesh refinement, and breakup of a rising buoyant bubble with density ratio up to 1000. Finally, we simulate the breakup of a big drop and the coalescence of O(10 3) drops in turbulent Rayleigh B 'enard convection at a Rayleigh number of 10 8 , observing good agreement with theoretical results.


An Improved and Optimized Practical Non Blocking PageRank Algorithm for Massive Graphs. PageRank is a well known algorithm whose robustness helps set a standard benchmark when processing graphs and analytical problems. The PageRank algorithm serves as a standard for many graph analytics and a foundation for extracting graph features and predicting user ratings in recommendation systems. The PageRank algorithm iterates continuously, updating the ranks of the pages till convergence is achieved. Nevertheless, the implementation of the PageRank algorithm on large scale graphs that on shared memory architecture utilizing fine grained parallelism is a difficult task at hand. The experimental study and analysis of the Parallel PageRank kernel on large graphs and shared memory architectures using different programming models have been studied extensively. This paper presents the asynchronous execution of the PageRank algorithm to leverage the computations on massive graphs, especially on shared memory architectures. We evaluate the performance of our proposed non blocking algorithms for PageRank computation on real world and synthetic datasets using Posix Multithreaded Library on a 56 core Intel(R) Xeon processor. We observed that our asynchronous implementations achieve 10x to 30x speedup with respect to sequential runs and 5x to 10x improvements over synchronous variants.


Tailor Generating and Perturbing Text with Semantic Controls. Controlled text perturbation is useful for evaluating and improving model generalizability. However, current techniques rely on training a model for every target perturbation, which is expensive and hard to generalize. We present Tailor, a semantically controlled text generation system. Tailor builds on a pretrained seq2seq model and produces textual outputs conditioned on control codes derived from semantic representations. We craft a set of operations to modify the control codes, which in turn steer generation towards targeted attributes. These operations can be further composed into higher level ones, allowing for flexible perturbation strategies. We demonstrate the effectiveness of these perturbations in multiple applications. First, we use Tailor to automatically create high quality contrast sets for four distinct natural language processing (NLP) tasks. These contrast sets contain fewer spurious artifacts and are complementary to manually annotated ones in their lexical diversity. Second, we show that Tailor perturbations can improve model generalization through data augmentation. Perturbing just 2 of training data leads to a 5.8 point gain on an NLI challenge set measuring reliance on syntactic heuristics.


Ants and bracket generating distributions in dimension 5 and 6. We consider a mechanical system of three ants on the floor, which move according to two independt rules Rule A forces the velocity of any given ant to always point at a neighboring ant, and Rule B forces the velocity of every ant to be parallel to the line defined by the two other ants. We observe that Rule A equips the 6 dimensional configuration space of the ants with a structure of a homogeneous (3,6) distribution, and that Rule B foliates this 6 dimensional configuration space onto 5 dimensional leaves, each of which is equiped with a homogeneous (2,3,5) distribution. The symmetry properties and Bryant Cartan local invariants of these distributions are determined. In the case of Rule B we study and determine the singular trajectories (abnormal extremals) of the corresponding distributions. We show that these satisfy an interesting system of two ODEs of Fuchsian type.


Estimating Regions of Attraction for Transitional Flows using Quadratic Constraints. This letter describes a method for estimating regions of attraction and bounds on permissible perturbation amplitudes in nonlinear fluids systems. The proposed approach exploits quadratic constraints between the inputs and outputs of the nonlinearity on elliptical sets. This approach reduces conservatism and improves estimates for regions of attraction and bounds on permissible perturbation amplitudes over related methods that employ quadratic constraints on spherical sets. We present and investigate two algorithms for performing the analysis an iterative method that refines the analysis by solving a sequence of semi definite programs, and another based on solving a generalized eigenvalue problem with lower computational complexity, but at the cost of some precision in the final solution. The proposed algorithms are demonstrated on low order mechanistic models of transitional flows. We further compare accuracy and computational complexity with analysis based on sum of squares optimization and direct adjoint looping methods.


SYNERGY Building Task Bots at Scale Using Symbolic Knowledge and Machine Teaching. In this paper we explore the use of symbolic knowledge and machine teaching to reduce human data labeling efforts in building neural task bots. We propose SYNERGY, a hybrid learning framework where a task bot is developed in two steps (i) Symbolic knowledge to neural networks Large amounts of simulated dialog sessions are generated based on task specific symbolic knowledge which is represented as a task schema consisting of dialog flows and task oriented databases. Then a pre trained neural dialog model, SOLOIST, is fine tuned on the simulated dialogs to build a bot for the task. (ii) Neural learning The fine tuned neural dialog model is continually refined with a handful of real task specific dialogs via machine teaching, where training samples are generated by human teachers interacting with the task bot. We validate SYNERGY on four dialog tasks. Experimental results show that SYNERGY maps task specific knowledge into neural dialog models achieving greater diversity and coverage of dialog flows, and continually improves model performance with machine teaching, thus demonstrating strong synergistic effects of symbolic knowledge and machine teaching.


Some q supercongruences from Rahman's summation formula. Inspired by the recent work on q congruences and the quadratic summation formula of Rahman, we provide some new q supercongruences. By taking q to 1 in one of our results, we obtain a new Ramanujan type supercongruence, which has the same right hand side as Van Hamme's (G.2) supercongruence for p equiv 1 pmod 4 . We also formulate some related challenging conjectures on supercongruences and q supercongruences.


Rotorcraft RPM on Mars. The Ingenuity helicopter test flights on Mars in April 2021 marked the first time a powered aircraft has flown on another world. Students who have access to model helicopters and drones may wonder, how well could those hover on the Red Planet? The answer can be found in this journal The Physics Teacher , using appropriate scaling of the surface gravity and atmospheric density to Martian values.


Operation of Natural Gas Pipeline Networks With Storage Under Transient Flow Conditions. We formulate a nonlinear optimal control problem for intra day operation of a natural gas pipeline network that includes storage reservoirs. The dynamics of compressible gas flow through pipes, compressors, reservoirs, and wells are considered. In particular, a reservoir is modeled as a rigid, hollow container that stores gas under isothermal conditions and uniform density, and a well is modeled as a vertical pipe. For each pipe, flow dynamics are described by a coupled partial differential equation (PDE) system in density and mass flux variables, with momentum dissipation modeled using the Darcy Wiesbach friction approximation. Compressors are modeled as scaling up the pressure of gas between inlet and outlet. The governing equations for all network components are spatially discretized and assembled into a nonlinear differential algebraic equation (DAE) system, which synthesizes above ground pipeline and subsurface reservoir dynamics into a single reduced order model. We seek to maximize an objective function that quantifies economic profit and network efficiency subject to the flow equations and inequalities that represent operating limitations. The problem is solved using a primal dual interior point solver and the solutions are validated in computational experiments and simulations on several pipeline test networks to demonstrate the effectiveness of the proposed methodology.


Contingency Aware Influence Maximization A Reinforcement Learning Approach. The influence maximization (IM) problem aims at finding a subset of seed nodes in a social network that maximize the spread of influence. In this study, we focus on a sub class of IM problems, where whether the nodes are willing to be the seeds when being invited is uncertain, called contingency aware IM. Such contingency aware IM is critical for applications for non profit organizations in low resource communities (e.g., spreading awareness of disease prevention). Despite the initial success, a major practical obstacle in promoting the solutions to more communities is the tremendous runtime of the greedy algorithms and the lack of high performance computing (HPC) for the non profits in the field whenever there is a new social network, the non profits usually do not have the HPCs to recalculate the solutions. Motivated by this and inspired by the line of works that use reinforcement learning (RL) to address combinatorial optimization on graphs, we formalize the problem as a Markov Decision Process (MDP), and use RL to learn an IM policy over historically seen networks, and generalize to unseen networks with negligible runtime at test phase. To fully exploit the properties of our targeted problem, we propose two technical innovations that improve the existing methods, including state abstraction and theoretically grounded reward shaping. Empirical results show that our method achieves influence as high as the state of the art methods for contingency aware IM, while having negligible runtime at test phase.


A note on approximate accelerated forward backward methods with absolute and relative errors, and possibly strongly convex objectives. In this short note, we provide a simple version of an accelerated forward backward method (a.k.a. Nesterov's accelerated proximal gradient method) possibly relying on approximate proximal operators and allowing to exploit strong convexity of the objective function. The method supports both relative and absolute errors, and its behavior is illustrated on a set of standard numerical experiments. Using the same developments, we further provide a version of the accelerated proximal hybrid extragradient method of Monteiro and Svaiter (2013) possibly exploiting strong convexity of the objective function.


CODER An efficient framework for improving retrieval through COntextual Document Embedding Reranking. We present CODER, a lightweight performance enhancement framework for a wide range of dense retrieval models. It employs a list wise loss and jointly scores a large set of retrieved candidate documents, rather than randomly sampled documents, for each query. When scoring a document representation based on its similarity to a query, the model is thus aware of the representation of its "peer" documents within the same retrieval context. We investigate the effect of training through contextual reranking of document embeddings and show that our approach leads to substantial improvement in retrieval performance over pair wise scoring of candidate documents in isolation from one another. Crucially, CODER incurs only a negligible computational overhead ( 5.5 ms delay per query) on top of any first stage method at run time, allowing it to be easily combined with any state of the art dense retrieval method.