COMTEST Project A Complete Modular Test Stand for Human and Humanoid Posture Control and Balance. This work presents a system to benchmark humanoid posture control and balance performances under perturbed conditions. The specific benchmarking scenario consists, for example, of balancing upright stance while performing voluntary movements on moving surfaces. The system includes a motion platform used to provide the perturbation, an innovative body tracking system suitable for robots, humans and exoskeletons, control software and a set of predefined perturbations, a humanoid robot used to test algorithms, and analysis software providing state of the art data analysis used to provide quantitative measures of performance. In order to provide versatility, the design of the system is oriented to modularity all its components can be replaced or extended according to experimental needs, adding additional perturbation profiles, new evaluation principles, and alternative tracking systems. It will be possible to use the system with different kinds of robots and exoskeletons as well as for human experiments aimed at gaining insights into human balance capabilities.


Expert Human Level Driving in Gran Turismo Sport Using Deep Reinforcement Learning with Image based Representation. When humans play virtual racing games, they use visual environmental information on the game screen to understand the rules within the environments. In contrast, a state of the art realistic racing game AI agent that outperforms human players does not use image based environmental information but the compact and precise measurements provided by the environment. In this paper, a vision based control algorithm is proposed and compared with human player performances under the same conditions in realistic racing scenarios using Gran Turismo Sport (GTS), which is known as a high fidelity realistic racing simulator. In the proposed method, the environmental information that constitutes part of the observations in conventional state of the art methods is replaced with feature representations extracted from game screen images. We demonstrate that the proposed method performs expert human level vehicle control under high speed driving scenarios even with game screen images as high dimensional inputs. Additionally, it outperforms the built in AI in GTS in a time trial task, and its score places it among the top 10 approximately 28,000 human players.


AdaL Adaptive Gradient Transformation Contributes to Convergences and Generalizations. Adaptive optimization methods have been widely used in deep learning. They scale the learning rates adaptively according to the past gradient, which has been shown to be effective to accelerate the convergence. However, they suffer from poor generalization performance compared with SGD. Recent studies point that smoothing exponential gradient noise leads to generalization degeneration phenomenon. Inspired by this, we propose AdaL, with a transformation on the original gradient. AdaL accelerates the convergence by amplifying the gradient in the early stage, as well as dampens the oscillation and stabilizes the optimization by shrinking the gradient later. Such modification alleviates the smoothness of gradient noise, which produces better generalization performance. We have theoretically proved the convergence of AdaL and demonstrated its effectiveness on several benchmarks.


High Resolution Generation Expansion Planning Considering Flexibility Needs The Case of Switzerland in 2030. This paper presents a static generation expansion planning formulation in which operational and investment decisions for a wide range of technologies are co optimized from a centralized perspective. The location, type and quantity of new generation and storage capacities are provided such that system demand and flexibility requirements are satisfied. Depending on investments in new intermittent renewables (wind, PV), the flexibility requirements are adapted in order to fully capture RES integration costs and ensure normal system operating conditions. To position candidate units, we incorporate DC constraints, nodal demand and production of existing generators as well as imports and exports from other interconnected zones. To show the capabilities of the formulation, high temporal resolution simulations are conducted on a 162 bus system consisting of the full Swiss transmission grid and aggregated neighboring countries.


GradSign Model Performance Inference with Theoretical Insights. A key challenge in neural architecture search (NAS) is quickly inferring the predictive performance of a broad spectrum of networks to discover statistically accurate and computationally efficient ones. We refer to this task as model performance inference (MPI). The current practice for efficient MPI is gradient based methods that leverage the gradients of a network at initialization to infer its performance. However, existing gradient based methods rely only on heuristic metrics and lack the necessary theoretical foundations to consolidate their designs. We propose GradSign, an accurate, simple, and flexible metric for model performance inference with theoretical insights. The key idea behind GradSign is a quantity Psi to analyze the optimization landscape of different networks at the granularity of individual training samples. Theoretically, we show that both the network's training and true population losses are proportionally upper bounded by Psi under reasonable assumptions. In addition, we design GradSign, an accurate and simple approximation of Psi using the gradients of a network evaluated at a random initialization state. Evaluation on seven NAS benchmarks across three training datasets shows that GradSign generalizes well to real world networks and consistently outperforms state of the art gradient based methods for MPI evaluated by Spearman's rho and Kendall's Tau. Additionally, we integrate GradSign into four existing NAS algorithms and show that the GradSign assisted NAS algorithms outperform their vanilla counterparts by improving the accuracies of best discovered networks by up to 0.3 , 1.1 , and 1.0 on three real world tasks.


Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flows. 3D human pose estimation from monocular images is a highly ill posed problem due to depth ambiguities and occlusions. Nonetheless, most existing works ignore these ambiguities and only estimate a single solution. In contrast, we generate a diverse set of hypotheses that represents the full posterior distribution of feasible 3D poses. To this end, we propose a normalizing flow based method that exploits the deterministic 3D to 2D mapping to solve the ambiguous inverse 2D to 3D problem. Additionally, uncertain detections and occlusions are effectively modeled by incorporating uncertainty information of the 2D detector as condition. Further keys to success are a learned 3D pose prior and a generalization of the best of M loss. We evaluate our approach on the two benchmark datasets Human3.6M and MPI INF 3DHP, outperforming all comparable methods in most metrics. The implementation is available on GitHub.


Discrepancy Based Active Learning for Domain Adaptation. The goal of the paper is to design active learning strategies which lead to domain adaptation under an assumption of covariate shift in the case of Lipschitz labeling function. Building on previous work by Mansour et al. (2009) we adapt the concept of discrepancy distance between source and target distributions to restrict the maximization over the hypothesis class to a localized class of functions which are performing accurate labeling on the source domain. We derive generalization error bounds for such active learning strategies in terms of Rademacher average and localized discrepancy for general loss functions which satisfy a regularity condition. A practical K medoids algorithm that can address the case of large data set is inferred from the theoretical bounds. Our numerical experiments show that the proposed algorithm is competitive against other state of the art active learning techniques in the context of domain adaptation, in particular on large data sets of around one hundred thousand images.


Bias and variance of the Bayesian mean decoder. Perception, in theoretical neuroscience, has been modeled as the encoding of external stimuli into internal signals, which are then decoded. The Bayesian mean is an important decoder, as it is optimal for purposes of both estimation and discrimination. We present widely applicable approximations to the bias and to the variance of the Bayesian mean, obtained under the minimal and biologically relevant assumption that the encoding results from a series of independent, though not necessarily identically distributed, signals. Simulations substantiate the accuracy of our approximations in the small noise regime. The bias of the Bayesian mean comprises two components one driven by the prior, and one driven by the precision of the encoding. If the encoding is 'efficient', the two components have opposite effects their relative strengths are determined by the objective that the encoding optimizes. The experimental literature on perception reports both 'Bayesian' biases directed towards prior expectations, and opposite, 'anti Bayesian' biases. We show that different tasks are indeed predicted to yield such contradictory biases, under a consistently optimal encoding decoding model. Moreover, we recover Wei and Stocker's "law of human perception", a relation between the bias of the Bayesian mean and the derivative of its variance, and show how the coefficient of proportionality in this law depends on the task at hand. Our results provide a parsimonious theory of optimal perception under constraints, in which encoding and decoding are adapted both to the prior and to the task faced by the observer.


Quantifying the relative contribution of free virus and cell to cell transmission routes to the propagation of hepatitis C virus infections in vitro using an agent based model. Experiments have shown that hepatitis C virus (HCV) infections in vitro disseminate both distally via the release and diffusion of cell free virus through the medium, and locally via direct, cell to cell transmission. To determine the relative contribution of each mode of infection to HCV dissemination, we developed an agent based model (ABM) that explicitly incorporates both distal and local modes of infection. The ABM tracks the concentration of extracellular infectious virus in the supernatant and the number of intracellular HCV RNA segments within each infected cell over the course of simulated in vitro HCV infections. Experimental data for in vitro HCV infections conducted in the presence and absence of free virus neutralizing antibodies was used to validate the ABM and constrain the value of its parameters. We found that direct, cell to cell infection accounts for 99 (84 100 , 95 credible interval) of infection events, making it the dominant mode of HCV dissemination in vitro. Yet, when infection via the free virus route is blocked, a 57 reduction in the number of infection events at 72 hpi is observed experimentally a result consistent with that found by our ABM. Taken together, these findings suggest that while HCV spread via cell free virus contributes little to the total number of infection events in vitro, it plays a critical role in enhancing cell to cell HCV dissemination by providing access to distant, uninfected areas, away from the already established large infection foci.


Adversarial Attacks on Deep Models for Financial Transaction Records. Machine learning models using transaction records as inputs are popular among financial institutions. The most efficient models use deep learning architectures similar to those in the NLP community, posing a challenge due to their tremendous number of parameters and limited robustness. In particular, deep learning models are vulnerable to adversarial attacks a little change in the input harms the model's output. In this work, we examine adversarial attacks on transaction records data and defences from these attacks. The transaction records data have a different structure than the canonical NLP or time series data, as neighbouring records are less connected than words in sentences, and each record consists of both discrete merchant code and continuous transaction amount. We consider a black box attack scenario, where the attack doesn't know the true decision model, and pay special attention to adding transaction tokens to the end of a sequence. These limitations provide more realistic scenario, previously unexplored in NLP world. The proposed adversarial attacks and the respective defences demonstrate remarkable performance using relevant datasets from the financial industry. Our results show that a couple of generated transactions are sufficient to fool a deep learning model. Further, we improve model robustness via adversarial training or separate adversarial examples detection. This work shows that embedding protection from adversarial attacks improves model robustness, allowing a wider adoption of deep models for transaction records in banking and finance.


Adaptive Self Interference Cancellation for Full Duplex Wireless Communication Systems. In this letter, we consider single cell, single user systems wherein uplink and downlink user equipment communicate with a full duplex relay. Due to the near far problem, the self interference (SI) can be 100 1000x the received signal power. In this context, we consider the adaptive Least Mean Squares (LMS) algorithm to estimate the SI channel and then subtract the SI from the desired received signal before the analog to digital converter (ADC). We measure the robustness of this technique in terms of bit error rate (BER) and spectral efficiency.


Herding of proteins by the ends of shrinking polymers. The control of biopolymer length is mediated by proteins that localize to polymer ends and regulate polymerization dynamics. Several mechanisms have been proposed to achieve end localization. Here, we propose a novel mechanism by which a protein that binds to a shrinking polymer and slows its shrinkage will be spontaneously enriched at the shrinking end through a "herding" effect. We formalize this process using both a lattice gas model and a continuum description, and we present experimental evidence that the microtubule regulator spastin employs this mechanism. Our findings extend to more general problems involving diffusion within shrinking domains.


On torque computation in electric machine simulation by harmonic mortar methods. The use of trigonometric polynomials as Lagrange multipliers in the harmonic mortar method enables an efficient and elegant treatment of relative motion in the stator rotor coupling of electric machine simulation. Explicit formulas for the torque computation are derived by energetic considerations, and their realization by harmonic mortar finite element and isogemetric analysis discretizations is discussed. Numerical tests are presented to illustrate the theoretical results and demonstrate the potential of harmonic mortar methods for the evaluation of torque ripples.


Complete weighted Bergman spaces have bounded point evaluations. Let Omega subset mathbb C be an arbitrary domain in the one dimensional complex plane equipped with a positive Radon measure mu . For any 1 le p infty , it is shown that the weighted Bergman space A p( Omega, mu) of holomorphic functions is a Banach space if and only if A p( Omega, mu) has locally uniformly bounded point evaluations. In particular, in the case p 2 , any complete Bergman space A 2( Omega, mu) is automatically a reproducing kernel Hilbert space.


Strong boundedness of rm SL 2(R) for rings of S algebraic integers with infinitely many units. A group is called strongly bounded, if the speed with which it is generated by finitely many conjugacy classes has a positive, lower bound only dependent on the number of the conjugacy classes in question rather than the actual conjugacy classes. Earlier papers by Kedra, Libman and Martin and myself have shown that this is a property common to split Chevalley groups defined using an irreducible root system of rank at least 2 and the ring of all S algebraic integers and that the situation is dependent on the number theory of R for rm Sp 4 and G 2. In this paper, we will show that rm SL 2(R) is also strongly bounded for R the ring of all S algebraic integers in a number field K with R having infinitely many units and will give a complete account of the existence of small conjugacy classes generating rm SL 2(R) in terms of the prime factorization of the rational primes 2 and 3 in R.


Iterated integrals and unipotent periods on families of marked elliptic curves. We describe iterated integrals as unipotent periods on families of marked elliptic curves in terms of multiple zeta values and elliptic multiple zeta values.


Partition Rank and Analytic Rank are Uniformly Equivalent. We prove that the partition rank and the analytic rank of tensors are equal up to a constant, over finite fields of any characteristic and any large enough cardinality, independently of the number of variables. Moreover, a quantitative improvement of our field cardinality requirement would imply that the ranks are equal up to 1 o(1) in the exponent over every finite field. At the core of the proof is a technique for lifting decompositions of multilinear polynomials in an open subset of an algebraic variety, and a technique for finding a large subvariety that retains all rational points such that at least one of these points satisfies a finite field analogue of genericity with respect to it. Proving the equivalence between these two ranks is a central question in additive combinatorics, and was reiterated by multiple authors. As a corollary we prove, over any mildly large field, the Polynomial Gowers Inverse Conjecture in the d vs. d 1 case.


The critical curvature degree of an algebraic variety. In this article, we study the complexity involved in the computation of the reach in arbitrary dimension and in particular the computation of the critical spherical curvature points of an arbitrary algebraic variety. We present properties of the critical spherical curvature points as well as an algorithm for computing it.


Torelli theorem for the moduli space of symplectic parabolic Higgs bundles. Let (X,D) and (X',D') be two compact Riemann surfaces of genus g geq 4 with the set of marked points D subset X and D' subset X' . Fix a parabolic line bundle L with trivial parabolic structure. Let mathcal N textnormal Sp (2m, alpha,L) and mathcal N ' textnormal Sp (2m, alpha,L) be the moduli spaces of stable symplectic parabolic Higgs bundles over X and X' respectively, with rank 2m and fixed parabolic structure alpha , with the symplectic form taking values in L . We prove that if mathcal N textnormal Sp (2m, alpha,L) is isomorphic to mathcal N ' textnormal Sp (2m, alpha,L) , then there exist an isomorphism between X and X' sending D to D' .


Strengthening the Training of Convolutional Neural Networks By Using Walsh Matrix. DNN structures are continuously developing and achieving high performances in classification problems. Also, it is observed that success rates obtained with DNNs are higher than those obtained with traditional neural networks. In addition, one of the advantages of DNNs is that there is no need to spend an extra effort to determine the features the CNN automatically extracts the features from the dataset during the training. Besides their benefits, the DNNs have the following three major drawbacks among the others (i) Researchers have struggled with over fitting and under fitting issues in the training of DNNs, (ii) determination of even a coarse structure for the DNN may take days, and (iii) most of the time, the proposed network structure is too large to be too bulky to be used in real time applications. We have modified the training and structure of DNN to increase the classification performance, to decrease the number of nodes in the structure, and to be used with less number of hyper parameters. A minimum distance network (MDN) following the last layer of the convolutional neural network (CNN) is used as the classifier instead of a fully connected neural network (FCNN). In order to strengthen the training of the CNN, we suggest employing Walsh function. We tested the performances of the proposed DNN (named as DivFE) on the classification of ECG, EEG, heart sound, detection pneumonia in X ray chest images, detection of BGA solder defects, and patterns of benchmark datasets (MNIST, IRIS, CIFAR10 and CIFAR20). In different areas, it has been observed that a higher classification performance was obtained by using the DivFE with less number of nodes.


Representation and Processing of Instantaneous and Durative Temporal Phenomena. Event definitions in Complex Event Processing systems are constrained by the expressiveness of each system's language. Some systems allow the definition of instantaneous complex events, while others allow the definition of durative complex events. While there are exceptions that offer both options, they often lack of intervals relations such as those specified by the Allen's interval algebra. In this paper, we propose a new logic based temporal phenomena definition language, specifically tailored for Complex Event Processing, that allows the representation of both instantaneous and durative phenomena and the temporal relations between them. Moreover, we demonstrate the expressiveness of our proposed language by employing a maritime use case where we define maritime events of interest. Finally, we analyse the execution semantics of our proposed language for stream processing and introduce the Phenesthe' implementation prototype.


Flexural wave modulation and mitigation in airfoils using acoustic black holes. This study introduces a framework for the design and implementation of acoustic black holes (ABHs) in airfoils. A generalized multi parameter damped ABH generation function is mapped onto NACA series airfoils. Representative geometries and a uniformly distributed baseline, all with the same mass of structure and damping are fabricated using multi material PolyJet 3D printing. Laser Doppler vibrometer measurements along the airfoil chord in response to a broadband 0.1 12 kHz excitation show a decrease in trailing edge vibrations by as much as 10 dB, a broadband 5 dB reduction across the entire chord as well as substantial spatial and temporal modulation of flexural waves by ABH embedded foils. Finite element analysis (FEA) models are developed and validated based on the measured data. Furthermore, a parametric FEA study is performed on a set of comparable designs to elucidate the scope of modulation achievable. These findings are applicable to trailing edge noise reduction, flow control, structural enhancement and energy harvesting for airfoils.


LOS Local Optimistic Scheduling of Periodic Model Training For Anomaly Detection on Sensor Data Streams in Meshed Edge Networks. Anomaly detection is increasingly important to handle the amount of sensor data in Edge and Fog environments, Smart Cities, as well as in Industry 4.0. To ensure good results, the utilized ML models need to be updated periodically to adapt to seasonal changes and concept drifts in the sensor data. Although the increasing resource availability at the edge can allow for in situ execution of model training directly on the devices, it is still often offloaded to fog devices or the cloud. In this paper, we propose Local Optimistic Scheduling (LOS), a method for executing periodic ML model training jobs in close proximity to the data sources, without overloading lightweight edge devices. Training jobs are offloaded to nearby neighbor nodes as necessary and the resource consumption is optimized to meet the training period while still ensuring enough resources for further training executions. This scheduling is accomplished in a decentralized, collaborative and opportunistic manner, without full knowledge of the infrastructure and workload. We evaluated our method in an edge computing testbed on real world datasets. The experimental results show that LOS places the training executions close to the input sensor streams, decreases the deviation between training time and training period by up to 40 and increases the amount of successfully scheduled training jobs compared to an in situ execution.


Magnetic confinement for the 2D axisymmetric relativistic Vlasov Maxwell system in an annulus. Although the nuclear fusion process has received a great deal of attention in recent years, the amount of mathematical analysis that supports the stability of the system seems to be relatively insufficient. This paper deals with the mathematical analysis of the magnetic confinement of the plasma via kinetic equations. We prove the global wellposedness of the Vlasov Maxwell system in a two dimensional annulus when a huge (but finite in time) external magnetic potential is imposed near the boundary. We assume that the solution is axisymmetric. The authors hope that this work is a step towards a more generalized work on the three dimensional Tokamak structure. The highlight of this work is the physical assumptions on the external magnetic potential well which remains finite within a finite time interval and from that, we prove that the plasma never touches the boundary. In addition, we provide a sufficient condition on the magnitude of the external magnetic potential to guarantee that the plasma is confined in an annulus of the desired thickness which is slightly larger than the initial support. Our method uses the cylindrical coordinate forms of the Vlasov Maxwell system.


VeriFly On the fly Assertion Checking via Incrementality. Assertion checking is an invaluable programmer's tool for finding many classes of errors or verifying their absence in dynamic languages such as Prolog. For Prolog programmers this means being able to have relevant properties such as modes, types, determinacy, non failure, sharing, constraints, cost, etc., checked and errors flagged without having to actually run the program. Such global static analysis tools are arguably most useful the earlier they are used in the software development cycle, and fast response times are essential for interactive use. Triggering a full and precise semantic analysis of a software project every time a change is made can be prohibitively expensive. In our static analysis and verification framework this challenge is addressed through a combination of modular and incremental (context and path sensitive) analysis that is responsive to program edits, at different levels of granularity. We describe how the combination of this framework within an integrated development environment (IDE) takes advantage of such incrementality to achieve a high level of reactivity when reflecting analysis and verification results back as colorings and tooltips directly on the program text the tool's VeriFly mode. The concrete implementation that we describe is Emacs based and reuses in part off the shelf "on the fly" syntax checking facilities (flycheck). We believe that similar extensions are also reproducible with low effort in other mature development environments. Our initial experience with the tool shows quite promising results, with low latency times that provide early, continuous, and precise assertion checking and other semantic feedback to programmers during the development process. The tool supports Prolog natively, as well as other languages by semantic transformation into Horn clauses. This paper is under consideration for acceptance in TPLP.


Tradeoffs inherent in solar geoengineering peak shaving strategies. Some have suggested solar geoengineering, cooling the planet by reflecting sunlight, could be deployed temporarily to shave the peak of global temperatures. This would use limited deployment to keep global mean temperatures below a given threshold, buying time for emissions reductions and negative emissions to reduce greenhouse gas concentrations. However, we suggest the trade offs inherent in such scenarios are not widely appreciated. In this study, we explore general features of such scenarios, using a combination of simple analytical relationships between emissions and temperatures and modelling to illustrate the strong trade off between the duration of geoengineering deployment and the temperature overshoot that is suppressed by geoengineering, as well as the scale of negative emissions that are required. Our results indicate that, unless climate sensitivity is at the high end of estimates, shaving a substantial peak, say, of 2K to 1.5K, would require at least a century of deployment of solar geoengineering and large scale negative emissions, under a broad range of emissions trajectories. If negative emissions are not available at the scale of tens of gigatonnes of C02 per year, substantial peak shaving will require deployment of geoengineering for multiple centuries. Our analysis emphasise the importance of factoring in the scale, feasibility, and cost of the negative emissions required to avoid indefinite commitment to solar geoengineering.


Applications of Random Algebraic Constructions to Hardness of Approximation. In this paper, we show how one may (efficiently) construct two types of extremal combinatorial objects whose existence was previously conjectural. ( ) Panchromatic Graphs For fixed integer k, a k panchromatic graph is, roughly speaking, a balanced bipartite graph with one partition class equipartitioned into k colour classes in which the common neighbourhoods of panchromatic k sets of vertices are much larger than those of k sets that repeat a colour. The question of their existence was raised by Karthik and Manurangsi Combinatorica 2020 . ( ) Threshold Graphs For fixed integer k, a k threshold graph is, roughly speaking, a balanced bipartite graph in which the common neighbourhoods of k sets of vertices on one side are much larger than those of (k 1) sets. The question of their existence was raised by Lin JACM 2018 . As applications of our constructions, we show the following conditional time lower bounds on the parameterized set intersection problem where, given a collection of n sets over universe n and a parameter k, the goal is to find k sets with the largest intersection. ( ) Assuming ETH, for any computable function F, no n o(k) time algorithm can approximate the parameterized set intersection problem up to factor F(k). This improves considerably on the previously best known result under ETH due to Lin JACM 2018 , who ruled out any n o( sqrt k ) time approximation algorithm for this problem. ( ) Assuming SETH, for every varepsilon 0 and any computable function F, no n k varepsilon time algorithm can approximate the parameterized set intersection problem up to factor F(k). No result of comparable strength was previously known under SETH, even for solving this problem exactly.


Two photon emission from superluminal and accelerating index perturbations. Sources of photons with controllable quantum properties such as entanglement and squeezing are desired for applications in quantum information, metrology, and sensing. However, fine grained control over these properties is hard to achieve, especially for two photon sources. Here, we propose a new mechanism for generating entangled and squeezed photon pairs using superluminal and or accelerating modulations of the refractive index in a medium. By leveraging time changing dielectric media, where quantum vacuum fluctuations of the electromagnetic field can be converted into photon pairs, we show that energy and momentum conservation in multi mode systems give rise to frequency and angle correlations of photon pairs which are controlled by the trajectory of the index modulation. These radiation effects are two photon analogues of Cherenkov and synchrotron radiation by moving charged particles such as free electrons. We find the particularly intriguing result that synchrotron like radiation into photon pairs exhibits frequency correlations which can enable the realization of a heralded single photon frequency comb. We conclude with a general discussion of experimental viability, showing how solitons, ultrashort pulses, and nonlinear waveguides may enable pathways to realize this two photon emission mechanism. For completeness, we discuss in the Supplementary Information how these effects, sensitive to the local density of photonic states, can be strongly enhanced using photonic nanostructures. As an example, we show that index modulations propagating near the surface of graphene produce entangled pairs of graphene plasmons with high efficiency, leading to additional experimental opportunities.


A positive proportion of quartic fields are not monogenic yet have no local obstruction to being so. We show that a positive proportion of quartic fields are not monogenic, despite having no local obstruction to being monogenic. Our proof builds on the corresponding result for cubic fields that we obtained in a previous work. Along the way, we also prove that a positive proportion of quartic rings of integers do not arise as the invariant order of an integral binary quartic form despite having no local obstruction.


Exact controllability to eigensolutions for evolution equations of parabolic type via bilinear control. In a separable Hilbert space X , we study the controlled evolution equation begin equation u'(t) Au(t) p(t)Bu(t) 0, end equation where A geq sigma I ( sigma geq0 ) is a self adjoint linear operator, B is a bounded linear operator on X , and p in L 2 loc (0, infty) is a bilinear control. We give sufficient conditions in order for the above nonlinear control system to be locally controllable to the j th eigensolution for any j geq1 . We also derive semi global controllability results in large time and discuss applications to parabolic equations in low space dimension. Our method is constructive and all the constants involved in the main results can be explicitly computed.


Eigenvalues of the Laplacian with moving mixed boundary conditions the case of disappearing Neumann region. We deal with eigenvalue problems for the Laplacian with varying mixed boundary conditions, consisting in homogeneous Neumann conditions on a vanishing portion of the boundary and Dirichlet conditions on the complement. By the study of an Almgren type frequency function, we derive upper and lower bounds of the eigenvalue variation and sharp estimates in the case of a strictly star shaped Neumann region.


QUEACO Borrowing Treasures from Weakly labeled Behavior Data for Query Attribute Value Extraction. We study the problem of query attribute value extraction, which aims to identify named entities from user queries as diverse surface form attribute values and afterward transform them into formally canonical forms. Such a problem consists of two phases named entity recognition (NER) and attribute value normalization (AVN) . However, existing works only focus on the NER phase but neglect equally important AVN. To bridge this gap, this paper proposes a unified query attribute value extraction system in e commerce search named QUEACO, which involves both two phases. Moreover, by leveraging large scale weakly labeled behavior data, we further improve the extraction performance with less supervision cost. Specifically, for the NER phase, QUEACO adopts a novel teacher student network, where a teacher network that is trained on the strongly labeled data generates pseudo labels to refine the weakly labeled data for training a student network. Meanwhile, the teacher network can be dynamically adapted by the feedback of the student's performance on strongly labeled data to maximally denoise the noisy supervisions from the weak labels. For the AVN phase, we also leverage the weakly labeled query to attribute behavior data to normalize surface form attribute values from queries into canonical forms from products. Extensive experiments on a real world large scale E commerce dataset demonstrate the effectiveness of QUEACO.


Graph Embedding via Diffusion Wavelets Based Node Feature Distribution Characterization. Recent years have seen a rise in the development of representational learning methods for graph data. Most of these methods, however, focus on node level representation learning at various scales (e.g., microscopic, mesoscopic, and macroscopic node embedding). In comparison, methods for representation learning on whole graphs are currently relatively sparse. In this paper, we propose a novel unsupervised whole graph embedding method. Our method uses spectral graph wavelets to capture topological similarities on each k hop sub graph between nodes and uses them to learn embeddings for the whole graph. We evaluate our method against 12 well known baselines on 4 real world datasets and show that our method achieves the best performance across all experiments, outperforming the current state of the art by a considerable margin.


ECCR Edge Cloud Collaborative Recovery for Low Power Wide Area Networks interference mitigation. Recent advances in Low Power Wide Area Networks have mitigated interference by using cloud assistance. Those methods transmit the RSSI samples and corrupted packets to the cloud to restore the correct message. However, the effectiveness of those methods is challenged by the high transmission data amount. This paper presents a novel method for interference mitigation in a Edge Cloud collaborative manner, namely ECCR. It does not require transmitting RSSI sample any more, whose length is eight times of the packet's. We demonstrate the disjointness of the bit errors of packets at the base stations via real word experiments. ECCR leverages this to collaborate with multiple base stations for error recovery. Each base station detects and reports bit error locations to the cloud, then both error checking code and interfered packets from other receivers are utilized to restore correct packets. ECCR takes the advantages of both the global management ability of the cloud and the signal to perceive the benefit of each base station, and it is applicable to deployed LP WAN systems (e.g. sx1280) without any extra hardware requirement. Experimental results show that ECCR is able to accurately decode packets when packets have nearly 51.76 corruption.


ExpMRC Explainability Evaluation for Machine Reading Comprehension. Achieving human level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre trained Language Models (PLMs). However, it is necessary to provide both answer prediction and its explanation to further improve the MRC system's reliability, especially for real life applications. In this paper, we propose a new benchmark called ExpMRC for evaluating the explainability of the MRC systems. ExpMRC contains four subsets, including SQuAD, CMRC 2018, RACE , and C 3 with additional annotations of the answer's evidence. The MRC systems are required to give not only the correct answer but also its explanation. We use state of the art pre trained language models to build baseline systems and adopt various unsupervised approaches to extract evidence without a human annotated training set. The experimental results show that these models are still far from human performance, suggesting that the ExpMRC is challenging. Resources will be available through https github.com ymcui expmrc


MultiWalk A Framework to Generate Node Embeddings Based on an Ensemble of Walk Methods. Graph embeddings are low dimensional representations of nodes, edges or whole graphs. Such representations allow for data in a network format to be used along with machine learning models for a variety of tasks (e.g., node classification), where using a similarity matrix would be impractical. In recent years, many methods for graph embedding generation have been created based on the idea of random walks. We propose MultiWalk, a framework that uses an ensemble of these methods to generate the embeddings. Our experiments show that the proposed framework, using an ensemble composed of two state of the art methods, can generate embeddings that perform better in classification tasks than each method in isolation.


Voluntary control of semantic neural representations by imagery with conflicting visual stimulation. Neural representations of visual perception are affected by mental imagery and attention. Although attention is known to modulate neural representations, it is unknown how imagery changes neural representations when imagined and perceived images semantically conflict. We hypothesized that imagining an image would activate a neural representation during its perception even while watching a conflicting image. To test this hypothesis, we developed a closed loop system to show images inferred from electrocorticograms using a visual semantic space. The successful control of the feedback images demonstrated that the semantic vector inferred from electrocorticograms became closer to the vector of the imagined category, even while watching images from different categories. Moreover, modulation of the inferred vectors by mental imagery depended on both the image category and time from the initiation of imagery. The closed loop control of the semantic vectors revealed an asymmetrical interaction between visual perception and imagery.


Influence of the Binomial Crossover on Performance of Evolutionary Algorithms. In differential Evolution (DE) algorithms, a crossover operation filtering variables to be mutated is employed to search the feasible region flexibly, which leads to its successful applications in a variety of complicated optimization problems. To investigate whether the crossover operator of DE is helpful to performance improvement of evolutionary algorithms (EAs), this paper implements a theoretical analysis for the (1 1)EA C and the (1 1)EA CM , two variants of the (1 1)EA that incorporate the binomial crossover operator. Generally, the binomial crossover results in the enhancement of exploration and the dominance of transition matrices under some conditions. As a result, both the (1 1)EA C and the (1 1)EA CM outperform the (1 1)EA on the unimodal OneMax problem, but do not always dominate it on the Deceptive problem. Finally, we perform an exploration analysis by investigating probabilities to transfer from non optimal statuses to the optimal status of the Deceptive problem, and propose adaptive parameter settings to strengthen the promising function of binomial crossover. It suggests that incorporation of the binomial crossover could be a feasible strategy to improve the performances of EAs.


K " a hler cone manifolds arising from a projective arrangement. Given a hyperplane arrangement of some type in a projective space, the Dunkl system, developed by Couwenberg, Heckman and Looijenga, is used to study the geometric structures on its complement, and as a consequence it leads to the discovery of new ball quotients when the Schwarz conditions are imposed. In this paper, we study how the space, investigated in this system, looks like when there is no Schwarz conditions imposed. As a result, we show that the space in question is still of a particular type of structure, namely, the structure of a cone manifold. With this point of view, Thurston's work on moduli of cone metrics on the sphere appears as a special case in this set up.


Fine Grained Human Evaluation for English to Chinese Machine Translation A Case Study on Scientific Text. Recent research suggests that neural machine translation (MT) in the news domain has reached human level performance, but for other professional domains, it is far below the level. In this paper, we conduct a fine grained systematic human evaluation for four widely used Chinese English NMT systems on scientific abstracts which are collected from published journals and books. Our human evaluation results show that all the systems return with more than 10 error rates on average, which requires much post editing effort for real academic use. Furthermore, we categorize six main error types and and provide some real examples. Our findings emphasise the needs that research attention in the MT community should be shifted from short text generic translation to professional machine translation and build large scale bilingual corpus for these specific domains.


Electronics integration for the GE2 1 and ME0 GEM detector systems for the CMS Phase 2 Muon System Upgrade. The Large Hadron Collider is currently undergoing its High Luminosity upgrade, which is set to increase the instantaneous luminosity by about a factor of five. Consequently, the Compact Muon Solenoid experiment is upgrading its muon spectrometer to cope with the increased muon flux in the forward region. The GE2 1 triple Gas Electron Multiplier detector, which has recently entered the mass production phase, and the ME0 triple GEM detector system, which is in the late prototyping phase, are undergoing electronics integration. These proceedings briefly discuss the frontend electronics for the GE2 1 and ME0 detector systems, the electronics integration testing process, and the future plans for the frontend electronics of these two detector systems by the CMS GEM Collaboration.


When heart beats differently in depression a review of HRV measures. Background and Objective The connection between depression and autonomous nervous system (ANS) is well documented in scientific literature. Heart rate variability (HRV) is a rich source of information for studying the dynamics of this relation. Disturbed heart dynamics in depression seriously increases mortality risk. Technical sciences help improve early detection and monitoring and offer more accurate management of treatment. Based on advances in computational power, information theory, complex systems dynamics, and nonlinear analysis applied to physiological complexity, we can now turn to novel biomarkers extracted from electrophysiological signals. This work is a cross sectional analysis with methodological commentary of application of nonlinear measures of HRV related to depression. Methods We systematically searched online for papers exploring the connection of depression and HRV, using both conventional and nonlinear analysis. We scrutinized chosen publications and methodologically analyzed and compared them. Results Sixty seven publications on the connection of HRV measures and depression meeting our inclusion criteria are selected. The effectiveness of the applied methods of electrocardiogram (ECG) analysis are compared and discussed in the light of detection and prevention of depression related cardiac diseases. Conclusions It is clear that aberrated ANS dynamics can be detected via ECG analysis, where nonlinear measures show to be more sensitive and accurate than standard time and spectral ones. With the portable ECG devices and cloud based telehealth applications, monitoring of outpatients could be done anytime anywhere. We appeal for early screening for cardiovascular abnormalities in depressive patients to prevent possible deleterious events.


Human Age Estimation from Gene Expression Data using Artificial Neural Networks. The study of signatures of aging in terms of genomic biomarkers can be uniquely helpful in understanding the mechanisms of aging and developing models to accurately predict the age. Prior studies have employed gene expression and DNA methylation data aiming at accurate prediction of age. In this line, we propose a new framework for human age estimation using information from human dermal fibroblast gene expression data. First, we propose a new spatial representation as well as a data augmentation approach for gene expression data. Next in order to predict the age, we design an architecture of neural network and apply it to this new representation of the original and augmented data, as an ensemble classification approach. Our experimental results suggest the superiority of the proposed framework over state of the art age estimation methods using DNA methylation and gene expression data.


On groups whose subnormal abelian subgroups are normal. In the current paper we study the groups, whose subnormal abelian subgroups are normal. We obtained a quite detailed description of such hyperabelian groups with a periodic Baer radical. The description of hyperabelian Lie algebras, whose abelian subideals are ideals, is also obtained.


Machine Learning Towards Intelligent Systems Applications, Challenges, and Opportunities. The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to understand such large amounts of data. Machine learning (ML) provides a mechanism for humans to process large amounts of data, gain insights about the behavior of the data, and make more informed decision based on the resulting analysis. ML has applications in various fields. This review focuses on some of the fields and applications such as education, healthcare, network security, banking and finance, and social media. Within these fields, there are multiple unique challenges that exist. However, ML can provide solutions to these challenges, as well as create further research opportunities. Accordingly, this work surveys some of the challenges facing the aforementioned fields and presents some of the previous literature works that tackled them. Moreover, it suggests several research opportunities that benefit from the use of ML to address these challenges.


Classifying grounded intersection graphs via ordered forbidden patterns. It was noted already in the 90s that many classic graph classes, such as interval, chordal, and bipartite graphs, can be characterized by the existence of an ordering of the vertices avoiding some ordered subgraphs, called patterns. Very recently, all the classes corresponding to patterns on three vertices (including the ones mentioned above) have been listed, and proved to be efficiently recognizable. In contrast, very little is known about patterns on four vertices. One of the few graph classes characterized by a pattern on four vertices is the class of intersection graphs of rectangles that are said to be grounded on a line. This class appears naturally in the study of intersection graphs, and similar grounded classes have recently attracted a lot of attention. This paper contains three parts. First, we make a survey of grounded intersection graph classes, summarizing all the known inclusions between these various classes. Second, we show that the correspondence between a pattern on four vertices and grounded rectangle graphs is not an isolated phenomenon. We establish several other pattern characterizations for geometric classes, and show that the hierarchy of grounded intersection graph classes is tightly interleaved with the classes defined patterns on four vertices. We claim that forbidden patterns are a useful tool to classify grounded intersection graphs. Finally, we give an overview of the complexity of the recognition of classes defined by forbidden patterns on four vertices and list several interesting open problems.


Niffler A Reference Architecture and System Implementation for View Discovery over Pathless Table Collections by Example. Identifying a project join view (PJ view) over collections of tables is the first step of many data management projects, e.g., assembling a dataset to feed into a business intelligence tool, creating a training dataset to fit a machine learning model, and more. When the table collections are large and lack join information such as when combining databases, or on data lakes query by example (QBE) systems can help identify relevant data, but they are designed under the assumption that join information is available in the schema, and do not perform well on pathless table collections that do not have join path information. We present a reference architecture that explicitly divides the end to end problem of discovering PJ views over pathless table collections into a human and a technical problem. We then present Niffler, a system built to address the technical problem. We introduce algorithms for the main components of Niffler, including a signal generation component that helps reduce the size of the candidate views that may be large due to errors and ambiguity in both the data and input queries. We evaluate Niffler on real datasets to demonstrate the effectiveness of the new engine in discovering PJ views over pathless table collections.


Helping People Deal With Disinformation A Socio Technical Perspective. At the latest since the advent of the Internet, disinformation and conspiracy theories have become ubiquitous. Recent examples like QAnon and Pizzagate prove that false information can lead to real violence. In this motivation statement for the Workshop on Human Aspects of Misinformation at CHI 2021, I explain my research agenda focused on 1. why people believe in disinformation, 2. how people can be best supported in recognizing disinformation, and 3. what the potentials and risks of different tools designed to fight disinformation are.


Adaptive Elastic Training for Sparse Deep Learning on Heterogeneous Multi GPU Servers. Motivated by extreme multi label classification applications, we consider training deep learning models over sparse data in multi GPU servers. The variance in the number of non zero features across training batches and the intrinsic GPU heterogeneity combine to limit accuracy and increase the time to convergence. We address these challenges with Adaptive SGD, an adaptive elastic model averaging stochastic gradient descent algorithm for heterogeneous multi GPUs that is characterized by dynamic scheduling, adaptive batch size scaling, and normalized model merging. Instead of statically partitioning batches to GPUs, batches are routed based on the relative processing speed. Batch size scaling assigns larger batches to the faster GPUs and smaller batches to the slower ones, with the goal to arrive at a steady state in which all the GPUs perform the same number of model updates. Normalized model merging computes optimal weights for every GPU based on the assigned batches such that the combined model achieves better accuracy. We show experimentally that Adaptive SGD outperforms four state of the art solutions in time to accuracy and is scalable with the number of GPUs.


AtteSTNet An attention and subword tokenization based approach for code switched Hindi English hate speech detection. Recent advancements in technology have led to a boost in social media usage which has ultimately led to large amounts of user generated data which also includes hateful and offensive speech. The language used in social media is often a combination of English and the native language in the region. In India, Hindi is used predominantly and is often code switched with English, giving rise to the Hinglish (Hindi English) language. Various approaches have been made in the past to classify the code mixed Hinglish hate speech using different machine learning and deep learning based techniques. However, these techniques make use of recurrence on convolution mechanisms which are computationally expensive and have high memory requirements. Past techniques also make use of complex data processing making the existing techniques very complex and non sustainable to change in data. We propose a much simpler approach which is not only at par with these complex networks but also exceeds performance with the use of subword tokenization algorithms like BPE and Unigram along with multi head attention based technique giving an accuracy of 87.41 and F1 score of 0.851 on standard datasets. Efficient use of BPE and Unigram algorithms help handle the non conventional Hinglish vocabulary making our technique simple, efficient and sustainable to use in the real world.


Compton driven beam formation and magnetisation via plasma microinstabilities. Compton scattering of gamma rays propagating in a pair plasma can drive the formation of a relativistic electron positron beam. This process is scrutinised theoretically and numerically via particle in cell simulations. In addition, we determine in which conditions the beam can prompt a beam plasma instability and convert its kinetic energy into magnetic energy. We argue that such conditions can be met at the photosphere radius of bright Gamma Ray Bursts.


4D Attention based Neural Network for EEG Emotion Recognition. Electroencephalograph (EEG) emotion recognition is a significant task in the brain computer interface field. Although many deep learning methods are proposed recently, it is still challenging to make full use of the information contained in different domains of EEG signals. In this paper, we present a novel method, called four dimensional attention based neural network (4D aNN) for EEG emotion recognition. First, raw EEG signals are transformed into 4D spatial spectral temporal representations. Then, the proposed 4D aNN adopts spectral and spatial attention mechanisms to adaptively assign the weights of different brain regions and frequency bands, and a convolutional neural network (CNN) is utilized to deal with the spectral and spatial information of the 4D representations. Moreover, a temporal attention mechanism is integrated into a bidirectional Long Short Term Memory (LSTM) to explore temporal dependencies of the 4D representations. Our model achieves state of the art performance on the SEED dataset under intra subject splitting. The experimental results have shown the effectiveness of the attention mechanisms in different domains for EEG emotion recognition.


Near ultraviolet photonic integrated lasers based on silicon nitride. Low phase noise lasers based on the combination of III V semiconductors and silicon photonics are well established in the near infrared spectral regime. Recent advances in the development of low loss silicon nitride based photonic integrated resonators have allowed to outperform bulk external diode and fiber lasers in both phase noise and frequency agility in the 1550 nm telecommunication window. Here, we demonstrate for the first time a hybrid integrated laser composed of a gallium nitride (GaN) based laser diode and a silicon nitride photonic chip based microresonator operating at record low wavelengths as low as 410 nm in the near ultraviolet wavelength region suitable for addressing atomic transitions of atoms and ions used in atomic clocks, quantum computing, or for underwater LiDAR. Using self injection locking to a high Q (0.4 times 10 6 ) photonic integrated microresonator we observe a phase noise reduction of the Fabry P 'erot laser at 461 nm by a factor greater than 100 times , limited by the device quality factor and back reflection.


Detecting Operational Adversarial Examples for Reliable Deep Learning. The utilisation of Deep Learning (DL) raises new challenges regarding its dependability in critical applications. Sound verification and validation methods are needed to assure the safe and reliable use of DL. However, state of the art debug testing methods on DL that aim at detecting adversarial examples (AEs) ignore the operational profile, which statistically depicts the software's future operational use. This may lead to very modest effectiveness on improving the software's delivered reliability, as the testing budget is likely to be wasted on detecting AEs that are unrealistic or encountered very rarely in real life operation. In this paper, we first present the novel notion of "operational AEs" which are AEs that have relatively high chance to be seen in future operation. Then an initial design of a new DL testing method to efficiently detect "operational AEs" is provided, as well as some insights on our prospective research plan.


The Two Dimensional Swept Rule Applied on Heterogeneous Architectures. The partial differential equations describing compressible fluid flows can be notoriously difficult to resolve on a pragmatic scale and often require the use of high performance computing systems and or accelerators. However, these systems face scaling issues such as latency, the fixed cost of communicating information between devices in the system. The swept rule is a technique designed to minimize these costs by obtaining a solution to unsteady equations at as many possible spatial locations and times prior to communicating. In this study, we implemented and tested the swept rule for solving two dimensional problems on heterogeneous computing systems across two distinct systems. Our solver showed a speedup range of 0.22 2.71 for the heat diffusion equation and 0.52 1.46 for the compressible Euler equations. We can conclude from this study that the swept rule offers both potential for speedups and slowdowns and that care should be taken when designing such a solver to maximize benefits. These results can help make decisions to maximize these benefits and inform designs.


Modeling Systems with Machine Learning based Differential Equations. The prediction of behavior in dynamical systems, is frequently subject to the design of models. When a time series obtained from observing the system is available, the task can be performed by designing the model from these observations without additional assumptions or by assuming a preconceived structure in the model, with the help of additional information about the system. In the second case, it is a question of adequately combining theory with observations and subsequently optimizing the mixture. In this work, we proposes the design of time continuous models of dynamical systems as solutions of differential equations, from non uniform sampled or noisy observations, using machine learning techniques. The performance of strategy is shown with both, several simulated data sets and experimental data from Hare Lynx population and Coronavirus 2019 outbreack. Our results suggest that this approach to the modeling systems, can be an useful technique in the case of synthetic or experimental data.


Rank of matrices with entries from a multiplicative group. We establish lower bounds on the rank of matrices in which all but the diagonal entries lie in a multiplicative group of small rank. Applying these bounds we show that the distance sets of finite pointsets in mathbb R d generate high rank multiplicative groups and that multiplicative groups of small rank cannot contain large sumsets.


Auto Tag Tagging Data By Example in Data Lakes. As data lakes become increasingly popular in large enterprises today, there is a growing need to tag or classify data assets (e.g., files and databases) in data lakes with additional metadata (e.g., semantic column types), as the inferred metadata can enable a range of downstream applications like data governance (e.g., GDPR compliance), and dataset search. Given the sheer size of today's enterprise data lakes with petabytes of data and millions of data assets, it is imperative that data assets can be auto tagged'', using lightweight inference algorithms and minimal user input. In this work, we develop Auto Tag, a corpus driven approach that automates data tagging of textit custom data types in enterprise data lakes. Using Auto Tag, users only need to provide textit one example column to demonstrate the desired data type to tag. Leveraging an index structure built offline using a lightweight scan of the data lake, which is analogous to pre training in machine learning, Auto Tag can infer suitable data patterns to best describe'' the underlying domain'' of the given column at an interactive speed, which can then be used to tag additional data of the same type'' in data lakes. The Auto Tag approach can adapt to custom data types, and is shown to be both accurate and efficient. Part of Auto Tag ships as a custom classification'' feature in a cloud based data governance and catalog solution textit Azure Purview .


Strong solutions to beta Jacobi processes. The purpose of this paper is to study the existence and uniqueness of solutions to a system of Stochastic Differential Equations (SDEs). The coordinates are bounded by zero and one, and repulse each other according to a Coulombian like interaction force. We show the existence of strong and pathwise unique solutions to the system until the first multiple collision at zero or one, and give a sufficient condition on the parameters of the SDEs for this multiple collision not to occur in finite time.


Polar degree and vanishing cycles. We prove that the polar degree of an arbitrarily singular projective hypersurface can be decomposed as a sum of non negative numbers which represent local vanishing cycles of two different types. This yields lower bounds for the polar degree of any singular projective hypersurface.


De identification of Unstructured Clinical Texts from Sequence to Sequence Perspective. In this work, we propose a novel problem formulation for de identification of unstructured clinical text. We formulate the de identification problem as a sequence to sequence learning problem instead of a token classification problem. Our approach is inspired by the recent state of the art performance of sequence to sequence learning models for named entity recognition. Early experimentation of our proposed approach achieved 98.91 recall rate on i2b2 dataset. This performance is comparable to current state of the art models for unstructured clinical text de identification.


Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection A Benchmark and Algorithms. Existing road pothole detection approaches can be classified as computer vision based or machine learning based. The former approaches typically employ 2 D image analysis understanding or 3 D point cloud modeling and segmentation algorithms to detect road potholes from vision sensor data. The latter approaches generally address road pothole detection using convolutional neural networks (CNNs) in an end to end manner. However, road potholes are not necessarily ubiquitous and it is challenging to prepare a large well annotated dataset for CNN training. In this regard, while computer vision based methods were the mainstream research trend in the past decade, machine learning based methods were merely discussed. Recently, we published the first stereo vision based road pothole detection dataset and a novel disparity transformation algorithm, whereby the damaged and undamaged road areas can be highly distinguished. However, there are no benchmarks currently available for state of the art (SoTA) CNNs trained using either disparity images or transformed disparity images. Therefore, in this paper, we first discuss the SoTA CNNs designed for semantic segmentation and evaluate their performance for road pothole detection with extensive experiments. Additionally, inspired by graph neural network (GNN), we propose a novel CNN layer, referred to as graph attention layer (GAL), which can be easily deployed in any existing CNN to optimize image feature representations for semantic segmentation. Our experiments compare GAL DeepLabv3 , our best performing implementation, with nine SoTA CNNs on three modalities of training data RGB images, disparity images, and transformed disparity images. The experimental results suggest that our proposed GAL DeepLabv3 achieves the best overall pothole detection accuracy on all training data modalities.


What Does Nature Minimize In Every Incompressible Flow?. In this paper, we discover the fundamental quantity that Nature minimizes in almost all flows encountered in everyday life river, rain, flow in a pipe, blood flow, airflow over an airplane, etc. We show that the norm of the pressure gradient over the field is minimum at every instant of time! We call it the principle of minimum pressure gradient (PMPG). The principle is deeply rooted in classical mechanics via Gauss' principle of least constraint. Therefore, while we prove mathematically that Navier Stokes' equation represents the necessary condition for minimization of the pressure gradient, the PMPG stands on its own philosophy independent of Navier Stokes'. It turns any fluid mechanics problem into a minimization one. We demonstrate this intriguing property by solving three of the classical problems in fluid mechanics using the PMPG without resorting to Navier Stokes' equation. In fact, the inviscid version of the PMPG allowed solving the long standing problem of the aerohydrodynamic lift over smooth cylindrical shapes where Euler's equation fails to provide a unique answer. Moreover, the result challenges the accepted wisdom about lift generation on an airfoil, which has prevailed over a century. The PMPG is expected to be transformative for theoretical modeling of fluid mechanics as it encodes a complicated nonlinear partial differential equation into a simple minimization problem. The principle even transcends Navier Stokes' equations in its applicability to non Newtonian fluids with arbitrary constitutive relations and fluids subject to arbitrary forcing (e.g. electric or magnetic).


Sentence Extraction Based Machine Reading Comprehension for Vietnamese. The development of natural language processing (NLP) in general and machine reading comprehension in particular has attracted the great attention of the research community. In recent years, there are a few datasets for machine reading comprehension tasks in Vietnamese with large sizes, such as UIT ViQuAD and UIT ViNewsQA. However, the datasets are not diverse in answers to serve the research. In this paper, we introduce UIT ViWikiQA, the first dataset for evaluating sentence extraction based machine reading comprehension in the Vietnamese language. The UIT ViWikiQA dataset is converted from the UIT ViQuAD dataset, consisting of comprises 23.074 question answers based on 5.109 passages of 174 Wikipedia Vietnamese articles. We propose a conversion algorithm to create the dataset for sentence extraction based machine reading comprehension and three types of approaches for sentence extraction based machine reading comprehension in Vietnamese. Our experiments show that the best machine model is XLM R Large, which achieves an exact match (EM) of 85.97 and an F1 score of 88.77 on our dataset. Besides, we analyze experimental results in terms of the question type in Vietnamese and the effect of context on the performance of the MRC models, thereby showing the challenges from the UIT ViWikiQA dataset that we propose to the language processing community.


Moments of Subsets of General Equiangular Tight Frames. This note outlines the steps for proving that the moments of a randomly selected subset of a general ETF (complex, with aspect ratio 0 gamma 1 ) converge to the corresponding MANOVA moments. We bring here an extension for the proof of the 'Kesten Mckay' moments (real ETF, gamma 1 2 ) cite magsino2020kesten . In particular, we establish a recursive computation of the r th moment, for r 1,2, ldots , and verify, using a symbolic program, that the recursion output coincides with the MANOVA moments.


Learning Multimodal Rewards from Rankings. Learning from human feedback has shown to be a useful approach in acquiring robot reward functions. However, expert feedback is often assumed to be drawn from an underlying unimodal reward function. This assumption does not always hold including in settings where multiple experts provide data or when a single expert provides data for different tasks we thus go beyond learning a unimodal reward and focus on learning a multimodal reward function. We formulate the multimodal reward learning as a mixture learning problem and develop a novel ranking based learning approach, where the experts are only required to rank a given set of trajectories. Furthermore, as access to interaction data is often expensive in robotics, we develop an active querying approach to accelerate the learning process. We conduct experiments and user studies using a multi task variant of OpenAI's LunarLander and a real Fetch robot, where we collect data from multiple users with different preferences. The results suggest that our approach can efficiently learn multimodal reward functions, and improve data efficiency over benchmark methods that we adapt to our learning problem.


Analysis of a class of Multi Level Markov Chain Monte Carlo algorithms based on Independent Metropolis Hastings. In this work, we present, analyze, and implement a class of Multi Level Markov chain Monte Carlo (ML MCMC) algorithms based on independent Metropolis Hastings proposals for Bayesian inverse problems. In this context, the likelihood function involves solving a complex differential model, which is then approximated on a sequence of increasingly accurate discretizations. The key point of this algorithm is to construct highly coupled Markov chains together with the standard Multi level Monte Carlo argument to obtain a better cost tolerance complexity than a single level MCMC algorithm. Our method extends the ideas of Dodwell, et al. "A hierarchical multilevel Markov chain Monte Carlo algorithm with applications to uncertainty quantification in subsurface flow," textit SIAM ASA Journal on Uncertainty Quantification 3.1 (2015) 1075 1108, to a wider range of proposal distributions. We present a thorough convergence analysis of the ML MCMC method proposed, and show, in particular, that (i) under some mild conditions on the (independent) proposals and the family of posteriors, there exists a unique invariant probability measure for the coupled chains generated by our method, and (ii) that such coupled chains are uniformly ergodic. We also generalize the cost tolerance theorem of Dodwell et al., to our wider class of ML MCMC algorithms. Finally, we propose a self tuning continuation type ML MCMC algorithm (C ML MCMC). The presented method is tested on an array of academic examples, where some of our theoretical results are numerically verified. These numerical experiments evidence how our extended ML MCMC method is robust when targeting some emph pathological posteriors, for which some of the previously proposed ML MCMC algorithms fail.


Direct amplification enabled harmonic generation for seeding a high repetition rate free electron laser. Various scientific and industrial researches such as spectroscopy and advanced lithography have been demanding high flux and coherent EUV and X ray radiation. These demands can be commendably satisfied with a MHz level repetition rate seeded free electron laser (FEL). Dictated by the seed laser system, seeded FELs have faced obstacles for the realization of MHz repetition rate. Reducing the required peak power of the seed laser is the most economic way to increase the repetition frequency of a seeded FEL. A novel technique named direct amplification enabled harmonic generation is presented in this paper, which holds the ability to reduce the peak power of the seed laser by about three orders of magnitude while possessing consistent high coherence and stability relative to conventional seeded FELs. The proposed technique paves the way for the realization of fully coherent EUV and soft X ray radiation with a repetition frequency of MHz.


A Blockchain based Carbon Credit Ecosystem. Climate change and global warming are the significant challenges of the new century. A viable solution to mitigate greenhouse gas emissions is via a globally incentivized market mechanism proposed in the Kyoto protocol. In this view, the carbon dioxide (or other greenhouse gases) emission is considered a commodity, forming a carbon trading system. There have been attempts in developing this idea in the past decade with limited success. The main challenges of current systems are fragmented implementations, lack of transparency leading to over crediting and double spending, and substantial transaction costs that transfer wealth to brokers and agents. We aim to create a Carbon Credit Ecosystem using smart contracts that operate in conjunction with blockchain technology in order to bring more transparency, accessibility, liquidity, and standardization to carbon markets. This ecosystem includes a tokenization mechanism to securely digitize carbon credits with clear minting and burning protocols, a transparent mechanism for distribution of tokens, a free automated market maker for trading the carbon tokens, and mechanisms to engage all stakeholders, including the energy industry, project verifiers, liquidity providers, NGOs, concerned citizens, and governments. This approach could be used in a variety of other credit trading systems.


mathrm K cowaist on complete foliated manifolds. Let (M,F) be a connected (not necessarily compact) foliated manifold carrying a complete Riemannian metric g TM . We generalize Gromov's mathrm K cowaist using the coverings of M , as well as defining a closely related concept called widehat mathrm A cowaist. Let k F be the associated leafwise scalar curvature of g F g TM F . We obtain some estimates on k F using these two concepts. In particular, assuming that the generalized mathrm K cowaist is infinity and either TM or F is spin, we show that inf(k F) leq 0 .


Circumneutral concentrated ammonium acetate solution as water in salt electrolyte. The exponentially growing market of electrochemical energy storage devices requires substitution of flammable, volatile, and toxic electrolytes. The use of Water in salt solutions (WiSE) regarded as green electrolyte might be of interest thanks to an association of key features such as high safety, low cost, wide electrochemical stability, and high ionic conductivity. Here, we report comprehensive chemical physical study of circumneutral WiSE based on ammonium acetate so as to investigate application in electrochemical energy storage systems, with focus on the effect of pH, density, viscosity, conductivity, and the ESW with salt concentration ranging from 1 to 30 mol kg . Data are reported and discussed with respect to the structure of the solutions investigated by complemental IR and molecular dynamic study. The study is addressed through the showcase of an asymmetric supercapacitor based on Argan shell derived carbon electrodes tested at temperatures ranging from 10 to 80 deg C.


Fragments in symmetric configurations with block size 3. We begin the study of collections of three blocks which can occur in a symmetric configuration with block size 3, v 3 . Formulae are derived for the number of occurrences of these and it is shown that the triangle, i.e. abf, ace, bcd is a basis. It is also shown that symmetric configurations without triangles exist if and only if v 15 or v geq 17 . Such configurations containing "many" triangles are also discussed and a complete analysis of the triangle content of those with a cyclic automorphism is given.


Towards responsible research in digital technology for health care. Digital technology is everywhere for the benefit of our daily and professional life. It strongly impacts our life and was crucial to maintain professional and social activities during the COVID19 crisis. Similarly, digital technologies are key within biomedical engineering research topics. Innovations have been generated and introduced over the last 40 years, demonstrating how computing and digital technologies have impacted health care. Although the benefits of digital technology are obvious now, we are at the convergence of several issues which makes us aware about social, societal and environmental challenges associated with this technology. In the social domain, digital technologies raise concern about exclusion (financial, geographical, educational, demographical, racial, gender, language, and disabled related exclusion) and physical and mental health. In the societal dimension, digital technologies raise concern about politics and democracy (sovereignty and governance, cognitive filters and citizen's engagement), privacy and security (data acquisition and usage transparency, level of personal approval, and level of anonymization), and economics. In the environmental dimension, digital technologies raise concern about energy consumption and hardware production. This paper introduces and defines these challenges for digital technology in general, as well as when applied to health care. The objective of this paper is to make the research community more aware about the challenges of digital technology and to promote more transparency for innovative and responsible research.


On high girth expander graphs with localized eigenvectors. The main purpose of this paper is to construct high girth regular expander graphs with localized eigenvectors for general degrees, which is inspired by a recent work due to Alon, Ganguly and Srivastava (to appear in Israel J. Math.).


Clockwork Finance Automated Analysis of Economic Security in Smart Contracts. We introduce the Clockwork Finance Framework (CFF), a general purpose, formal verification framework for mechanized reasoning about the economic security properties of composed decentralized finance (DeFi) smart contracts. CFF features three key properties. It is contract complete, meaning that it can model any smart contract platform and all its contracts Turing complete or otherwise. It does so with asymptotically optimal model size. It is also attack exhaustive by construction, meaning that it can automatically and mechanically extract all possible economic attacks on users' cryptocurrency across modeled contracts. Thanks to these properties, CFF can support multiple goals economic security analysis of contracts by developers, analysis of DeFi trading risks by users, and optimization of arbitrage opportunities by bots or miners. Because CFF offers composability, it can support these goals with reasoning over any desired set of potentially interacting smart contract models. We instantiate CFF as an executable model for Ethereum contracts that incorporates a state of the art deductive verifier. Building on previous work, we introduce extractable value (EV), a new formal notion of economic security in composed DeFi contracts that is both a basis for CFF analyses and of general interest. We construct modular, human readable, composable CFF models of four popular, deployed DeFi protocols in Ethereum Uniswap, Uniswap V2, Sushiswap, and MakerDAO, representing a combined 17 billion USD in value as of August 2021. We uses these models to show experimentally that CFF is practical and can drive useful, data based EV based insights from real world transaction activity. Without any explicitly programmed attack strategies, CFF uncovers on average an expected 56 million of EV per month in the recent past.


Persistence of periodic traveling waves and Abelian integrals. It is well known that the existence of traveling wave solutions (TWS) for many partial differential equations (PDE) is a consequence of the fact that an associated planar ordinary differential equation (ODE) has certain types of solutions defined for all time. In this paper we address the problem of persistence of TWS of a given PDE under small perturbations. Our main results deal with the situation where the associated ODE has a center and, as a consequence, the original PDE has a continuum of periodic traveling wave solutions. We prove that the TWS that persist are controlled by the zeroes of some Abelian integrals. We apply our results to several famous PDE, like the Ostrovsky, Klein Gordon, sine Gordon, Korteweg de Vries, Rosenau Hyman, Camassa Holm, and Boussinesq equations.


Estimation of Missing Data in Intelligent Transportation System. Missing data is a challenge in many applications, including intelligent transportation systems (ITS). In this paper, we study traffic speed and travel time estimations in ITS, where portions of the collected data are missing due to sensor instability and communication errors at collection points. These practical issues can be remediated by missing data analysis, which are mainly categorized as either statistical or machine learning(ML) based approaches. Statistical methods require the prior probability distribution of the data which is unknown in our application. Therefore, we focus on an ML based approach, Multi Directional Recurrent Neural Network (M RNN). M RNN utilizes both temporal and spatial characteristics of the data. We evaluate the effectiveness of this approach on a TomTom dataset containing spatio temporal measurements of average vehicle speed and travel time in the Greater Toronto Area (GTA). We evaluate the method under various conditions, where the results demonstrate that M RNN outperforms existing solutions,e.g., spline interpolation and matrix completion, by up to 58 decreases in Root Mean Square Error (RMSE).


Delta lenses as coalgebras for a comonad. Delta lenses are a kind of morphism between categories which are used to model bidirectional transformations between systems. Classical state based lenses, also known as very well behaved lenses, are both algebras for a monad and coalgebras for a comonad. Delta lenses generalise state based lenses, and while delta lenses have been characterised as certain algebras for a semi monad, it is natural to ask if they also arise as coalgebras. This short paper establishes that delta lenses are coalgebras for a comonad, through showing that the forgetful functor from the category of delta lenses over a base, to the category of cofunctors over a base, is comonadic. The proof utilises a diagrammatic approach to delta lenses, and clarifies several results in the literature concerning the relationship between delta lenses and cofunctors. Interestingly, while this work does not generalise the corresponding result for state based lenses, it does provide new avenues for exploring lenses as coalgebras.


Nonlinear Projection Based Gradient Estimation for Query Efficient Blackbox Attacks. Gradient estimation and vector space projection have been studied as two distinct topics. We aim to bridge the gap between the two by investigating how to efficiently estimate gradient based on a projected low dimensional space. We first provide lower and upper bounds for gradient estimation under both linear and nonlinear projections, and outline checkable sufficient conditions under which one is better than the other. Moreover, we analyze the query complexity for the projection based gradient estimation and present a sufficient condition for query efficient estimators. Built upon our theoretic analysis, we propose a novel query efficient Nonlinear Gradient Projection based Boundary Blackbox Attack (NonLinear BA). We conduct extensive experiments on four image datasets ImageNet, CelebA, CIFAR 10, and MNIST, and show the superiority of the proposed methods compared with the state of the art baselines. In particular, we show that the projection based boundary blackbox attacks are able to achieve much smaller magnitude of perturbations with 100 attack success rate based on efficient queries. Both linear and nonlinear projections demonstrate their advantages under different conditions. We also evaluate NonLinear BA against the commercial online API MEGVII Face , and demonstrate the high blackbox attack performance both quantitatively and qualitatively. The code is publicly available at https github.com AI secure NonLinear BA.


Multi Agent Training beyond Zero Sum with Correlated Equilibrium Meta Solvers. Two player, constant sum games are well studied in the literature, but there has been limited progress outside of this setting. We propose Joint Policy Space Response Oracles (JPSRO), an algorithm for training agents in n player, general sum extensive form games, which provably converges to an equilibrium. We further suggest correlated equilibria (CE) as promising meta solvers, and propose a novel solution concept Maximum Gini Correlated Equilibrium (MGCE), a principled and computationally efficient family of solutions for solving the correlated equilibrium selection problem. We conduct several experiments using CE meta solvers for JPSRO and demonstrate convergence on n player, general sum games.


Entropy and the Discrete Central Limit Theorem. A strengthened version of the central limit theorem for discrete random variables is established, relying only on information theoretic tools and elementary arguments. It is shown that the relative entropy between the standardised sum of n independent and identically distributed lattice random variables and an appropriately discretised Gaussian, vanishes as n to infty .


The Role of Cross Silo Federated Learning in Facilitating Data Sharing in the Agri Food Sector. Data sharing remains a major hindering factor when it comes to adopting emerging AI technologies in general, but particularly in the agri food sector. Protectiveness of data is natural in this setting data is a precious commodity for data owners, which if used properly can provide them with useful insights on operations and processes leading to a competitive advantage. Unfortunately, novel AI technologies often require large amounts of training data in order to perform well, something that in many scenarios is unrealistic. However, recent machine learning advances, e.g. federated learning and privacy preserving technologies, can offer a solution to this issue via providing the infrastructure and underpinning technologies needed to use data from various sources to train models without ever sharing the raw data themselves. In this paper, we propose a technical solution based on federated learning that uses decentralized data, (i.e. data that are not exchanged or shared but remain with the owners) to develop a cross silo machine learning model that facilitates data sharing across supply chains. We focus our data sharing proposition on improving production optimization through soybean yield prediction, and provide potential use cases that such methods can assist in other problem settings. Our results demonstrate that our approach not only performs better than each of the models trained on an individual data source, but also that data sharing in the agri food sector can be enabled via alternatives to data exchange, whilst also helping to adopt emerging machine learning technologies to boost productivity.


CAT(0) 4 manifolds are Euclidean. We prove that a topological 4 manifold of globally non positive curvature is homeomorphic to Euclidean space.


Self explaining Neural Network with Plausible Explanations. Explaining the predictions of complex deep learning models, often referred to as black boxes, is critical in high stakes domains like healthcare. However, post hoc model explanations often are not understandable by clinicians and are difficult to integrate into clinical workflow. Further, while most explainable models use individual clinical variables as units of explanation, human understanding often rely on higher level concepts or feature representations. In this paper, we propose a novel, self explaining neural network for longitudinal in hospital mortality prediction using domain knowledge driven Sequential Organ Failure Assessment (SOFA) organ specific scores as the atomic units of explanation. We also design a novel procedure to quantitatively validate the model explanations against gold standard discharge diagnosis information of patients. Our results provide interesting insights into how each of the SOFA organ scores contribute to mortality at different timesteps within longitudinal patient trajectory.


Comprehensive analysis of optimized near field tandem thermophotovoltaic system. It is well known that performance of a thermophotovoltaic (TPV) device can be enhanced if the vacuum gap between the thermal emitter and the TPV cell becomes nanoscale due to the photon tunneling of evanescent waves. Having multiple bandgaps, multi junction TPV cells have received attention as an alternative way to improve its performance by selectively absorbing the spectral radiation in each subcell. In this work, we comprehensively analyze the optimized near field tandem TPV system consisting of the thin ITO covered tungsten emitter (at 1500 K) and GaInAsSb InAs monolithic interconnected tandem TPV cell (at 300 K). We develop a simulation model by coupling the near field radiation solved by fluctuational electrodynamics and the diffusion recombination based charge transport equations. The optimal configuration of the near field tandem TPV system obtained by the genetic algorithm achieves the electrical power output of 8.41 W cm 2 and the conversion efficiency of 35.6 at the vacuum gap of 100 nm. We show that two resonance modes (i.e., surface plasmon polaritons supported by the ITO vacuum interface and the confined waveguide mode in the tandem TPV cell) greatly contribute to the enhanced performance of the optimized system. We also show that the near field tandem TPV system is superior to the single cell based near field TPV system in both power output and conversion efficiency through loss analysis. Interestingly, the optimization performed with the objective function of the conversion efficiency leads to the current matching condition for the tandem TPV system regardless of the vacuum gap distances.


Line Marching Algorithm For Planar Kinematic Swarm Robots A Dynamic Leader Follower Approach. Most of the existing formation algorithms for multiagent systems are fully label specified, i.e., the desired position for each agent in the formation is uniquely determined by its label, which would inevitably make the formation algorithms vulnerable to agent failures. To address this issue, in this paper, we propose a dynamic leader follower approach to solving the line marching problem for a swarm of planar kinematic robots. In contrast to the existing results, the desired positions for the robots in the line are not fully label specified, but determined in a dynamic way according to the current state of the robot swarm. By constantly forming a chain of leader follower pairs, exact formation can be achieved by pairwise leader following tracking. Since the order of the chain of leader follower pairs is constantly updated, the proposed algorithm shows strong robustness against robot failures. Comprehensive numerical results are provided to evaluate the performance of the proposed algorithm.


Are Transformers a Modern Version of ELIZA? Observations on French Object Verb Agreement. Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to predict the agreement between a verb and its subject. We take a critical look at this line of research by showing that it is possible to achieve high accuracy on this agreement task with simple surface heuristics, indicating a possible flaw in our assessment of neural networks' syntactic ability. Our fine grained analyses of results on the long range French object verb agreement show that contrary to LSTMs, Transformers are able to capture a non trivial amount of grammatical structure.


One Shot Affordance Detection. Affordance detection refers to identifying the potential action possibilities of objects in an image, which is an important ability for robot perception and manipulation. To empower robots with this ability in unseen scenarios, we consider the challenging one shot affordance detection problem in this paper, i.e., given a support image that depicts the action purpose, all objects in a scene with the common affordance should be detected. To this end, we devise a One Shot Affordance Detection (OS AD) network that firstly estimates the purpose and then transfers it to help detect the common affordance from all candidate images. Through collaboration learning, OS AD can capture the common characteristics between objects having the same underlying affordance and learn a good adaptation capability for perceiving unseen affordances. Besides, we build a Purpose driven Affordance Dataset (PAD) by collecting and labeling 4k images from 31 affordance and 72 object categories. Experimental results demonstrate the superiority of our model over previous representative ones in terms of both objective metrics and visual quality. The benchmark suite is at ProjectPage.


Deep Q Learning Market Makers in a Multi Agent Simulated Stock Market. Market makers play a key role in financial markets by providing liquidity. They usually fill order books with buy and sell limit orders in order to provide traders alternative price levels to operate. This paper focuses precisely on the study of these markets makers strategies from an agent based perspective. In particular, we propose the application of Reinforcement Learning (RL) for the creation of intelligent market markers in simulated stock markets. This research analyzes how RL market maker agents behaves in non competitive (only one RL market maker learning at the same time) and competitive scenarios (multiple RL market markers learning at the same time), and how they adapt their strategies in a Sim2Real scope with interesting results. Furthermore, it covers the application of policy transfer between different experiments, describing the impact of competing environments on RL agents performance. RL and deep RL techniques are proven as profitable market maker approaches, leading to a better understanding of their behavior in stock markets.


Complementary Evidence Identification in Open Domain Question Answering. This paper proposes a new problem of complementary evidence identification for open domain question answering (QA). The problem aims to efficiently find a small set of passages that covers full evidence from multiple aspects as to answer a complex question. To this end, we proposes a method that learns vector representations of passages and models the sufficiency and diversity within the selected set, in addition to the relevance between the question and passages. Our experiments demonstrate that our method considers the dependence within the supporting evidence and significantly improves the accuracy of complementary evidence selection in QA domain.


Integrating Transductive And Inductive Embeddings Improves Link Prediction Accuracy. In recent years, inductive graph embedding models, emph viz. , graph neural networks (GNNs) have become increasingly accurate at link prediction (LP) in online social networks. The performance of such networks depends strongly on the input node features, which vary across networks and applications. Selecting appropriate node features remains application dependent and generally an open question. Moreover, owing to privacy and ethical issues, use of personalized node features is often restricted. In fact, many publicly available data from online social network do not contain any node features (e.g., demography). In this work, we provide a comprehensive experimental analysis which shows that harnessing a transductive technique (e.g., Node2Vec) for obtaining initial node representations, after which an inductive node embedding technique takes over, leads to substantial improvements in link prediction accuracy. We demonstrate that, for a wide variety of GNN variants, node representation vectors obtained from Node2Vec serve as high quality input features to GNNs, thereby improving LP performance.