On the continuity of half plane capacity with respect to Carath 'eodory convergence. We study the continuity of half plane capacity as a function of boundary hulls with respect to the Carath 'eodory convergence. In particular, our interest lies in the case that hulls are unbounded. Under the assumption that every hull is contained in a fixed hull with finite imaginary part and finite half plane capacity, we show that the half plane capacity is indeed continuous. We also discuss the extension of this result to the case that the underlying domain is finitely connected.


Federated Distillation of Natural Language Understanding with Confident Sinkhorns. Enhancing the user experience is an essential task for application service providers. For instance, two users living wide apart may have different tastes of food. A food recommender mobile application installed on an edge device might want to learn from user feedback (reviews) to satisfy the client's needs pertaining to distinct domains. Retrieving user data comes at the cost of privacy while asking for model parameters trained on a user device becomes space inefficient at a large scale. In this work, we propose an approach to learn a central (global) model from the federation of (local) models which are trained on user devices, without disclosing the local data or model parameters to the server. We propose a federation mechanism for the problems with natural similarity metric between the labels which commonly appear in natural language understanding (NLU) tasks. To learn the global model, the objective is to minimize the optimal transport cost of the global model's predictions from the confident sum of soft targets assigned by local models. The confidence (a model weighting scheme) score of a model is defined as the L2 distance of a model's prediction from its probability bias. The method improves the global model's performance over the baseline designed on three NLU tasks with intrinsic label space semantics, i.e., fine grained sentiment analysis, emotion recognition in conversation, and natural language inference. We make our codes public at https github.com declare lab sinkhorn loss.


GenoML Automated Machine Learning for Genomics. GenoML is a Python package automating machine learning workflows for genomics (genetics and multi omics) with an open science philosophy. Genomics data require significant domain expertise to clean, pre process, harmonize and perform quality control of the data. Furthermore, tuning, validation, and interpretation involve taking into account the biology and possibly the limitations of the underlying data collection, protocols, and technology. GenoML's mission is to bring machine learning for genomics and clinical data to non experts by developing an easy to use tool that automates the full development, evaluation, and deployment process. Emphasis is put on open science to make workflows easily accessible, replicable, and transferable within the scientific community. Source code and documentation is available at https genoml.com.


Few Shot Learning of an Interleaved Text Summarization Model by Pretraining with Synthetic Data. Interleaved texts, where posts belonging to different threads occur in a sequence, commonly occur in online chat posts, so that it can be time consuming to quickly obtain an overview of the discussions. Existing systems first disentangle the posts by threads and then extract summaries from those threads. A major issue with such systems is error propagation from the disentanglement component. While end to end trainable summarization system could obviate explicit disentanglement, such systems require a large amount of labeled data. To address this, we propose to pretrain an end to end trainable hierarchical encoder decoder system using synthetic interleaved texts. We show that by fine tuning on a real world meeting dataset (AMI), such a system out performs a traditional two step system by 22 . We also compare against transformer models and observed that pretraining with synthetic data both the encoder and decoder outperforms the BertSumExtAbs transformer model which pretrains only the encoder on a large dataset.


Deformation Mechanics of Self expanding Venous Stents Modelling and Experiments. Deformation properties of venous stents based on braided design, chevron design, Z design, and diamond design are compared using in vitro experiments coupled with analytical and finite element modelling. Their suitability for deployment in different clinical contexts is assessed based on their deformation characteristics. Self expanding stainless steel stents possess superior collapse resistance compared to Nitinol stents. Consequently, they may be more reliable to treat diseases like May Thurner syndrome in which resistance against a concentrated (pinching) force applied on the stent is needed to prevent collapse. Braided design applies a larger radial pressure particularly for vessels of diameter smaller than 75 of its nominal diameter, making it suitable for a long lesion with high recoil. Z design has the least foreshortening, which aids in accurate deployment. Nitinol stents are more compliant than their stainless steel counterparts, which indicates their suitability in veins. The semi analytical method presented can aid in rapid assessment of topology governed deformation characteristics of stents and their design optimization


Early insights into the Arabic Citation Index. The Arabic Citation Index (ARCI) was launched in 2020. This study gives an overview of the scientific literature available in this new database. By using metadata available in scientific publications, I analyse ARCI to characterize the scientific literature published in Arabic. First, I describe the data and the methods used in the analyses. As of October 2020, ARCI indexed 65,208 records covering the 2015 2019 period. Second, I explore the literature distributions at various levels (research domains, countries, languages, open access). Close to 99 of documents indexed are articles. Results reveal the concentration of publications in the Arts Humanities and Social Sciences fields. Most journals indexed in ARCI are currently published from Egypt, Algeria, Iraq, Jordan and Saudi Arabia. Around 7 of publications in ARCI are published in languages other than Arabic. Then, I use an unsupervised machine learning model, LDA (Latent Dirichlet Allocation) and the text mining algorithms of VOSviewer to uncover the main topics in ARCI. These methods are particularly useful to better understand the topical structure of ARCI. Finally, I suggest few research opportunities after discussing the results of this study.


Camera Calibration and Player Localization in SoccerNet v2 and Investigation of their Representations for Action Spotting. Soccer broadcast video understanding has been drawing a lot of attention in recent years within data scientists and industrial companies. This is mainly due to the lucrative potential unlocked by effective deep learning techniques developed in the field of computer vision. In this work, we focus on the topic of camera calibration and on its current limitations for the scientific community. More precisely, we tackle the absence of a large scale calibration dataset and of a public calibration network trained on such a dataset. Specifically, we distill a powerful commercial calibration tool in a recent neural network architecture on the large scale SoccerNet dataset, composed of untrimmed broadcast videos of 500 soccer games. We further release our distilled network, and leverage it to provide 3 ways of representing the calibration results along with player localization. Finally, we exploit those representations within the current best architecture for the action spotting task of SoccerNet v2, and achieve new state of the art performances.


Topology and Routing Problems The Circular Frame. In this work, we solve the problem of finding non intersecting paths between points on a plane with a new approach by borrowing ideas from geometric topology, in particular, from the study of polygonal schema in mathematics. We use a topological transformation on the 2 dimensional planar routing environment that simplifies the routing problem into a problem of connecting points on a circle with straight line segments that do not intersect in the interior of the circle. These points are either the points that need to be connected by non intersecting paths or special reference' points that parametrize the topology of the original environment prior to the transformation. When all the necessary points on the circle are fully connected, the transformation is reversed such that the line segments combine to become the non intersecting paths that connect the start and end points in the original environment. We interpret the transformed environment in which the routing problem is solved as a new data structure where any routing problem can be solved efficiently. We perform experiments and show that the routing time and success rate of the new routing algorithm outperforms the ones for the A algorithm.


Evaluation of ambipolar potential barrier in the gas dynamic trap by Doppler spectroscopy. The recently developed Doppler spectroscopy diagnostic has been used to evaluate the height of the ambipolar potential barrier forming in the gas dynamic trap (GDT) plasma between the central cell and the region with a large magnetic expansion ratio beyond the mirror. The diagnostic technique based on the gas jet charge exchange target, allowed to measure the potential profile along the line of sight covering the radial range from the axis to the limiter. The on axis potential drop was found to be 2.6 div 3.1 in units of the central plane electron temperature, which supports the existing theoretical understanding of suppression of electron thermal conductivity in the GDT expander.


Delay Analysis of Base Station Flow Table in SDN enabled Radio Access Networks. Future generation wireless networks are designed with extremely low delay requirements which makes even small contributed delays important. On the other hand, software defined networking (SDN) has been introduced as a key enabler of future wireless and cellular networks in order to make them more flexible. In SDN, a central controller manages all network equipments by setting the match action pairs in flow tables of the devices. However, these flow tables have limited capacity and thus are not capable of storing the rules of all the users. In this paper, we consider an SDN enabled base station (SD BS) in a cell equipped with a limited capacity flow table. We analyze the expected delay incurred in processing of the incoming packets to the SD BS and present a mathematical expression for it in terms of density of the users and cell area.


D 2 ABS A Framework for Dynamic Dependence Abstraction of Distributed Programs. As modern software systems are increasingly developed for running in distributed environments, it is crucial to provide fundamental techniques such as dependence analysis for checking, diagnosing, and evolving those systems. However, traditional dependence analysis is either inapplicable or of very limited utility for distributed programs due to the decoupled components of these programs that run in concurrent processes at physically separated machines. Motivated by the need for dependence analysis of distributed software and the diverse cost effectiveness needs of dependence based applications, this paper presents D 2 ABS, a framework of dynamic dependence abstraction for distributed programs. By partial ordering distributed method execution events and inferring causality from the ordered events, D 2 ABS abstracts method level dependencies both within and across process boundaries. Further, by exploiting message passing semantics across processes, and incorporating static dependencies and statement coverage within individual components, we present three additional instantiations of D 2 ABS that trade efficiency for better precision. We present the design of the D 2 ABS framework and evaluate the four instantiations of D 2 ABS on distributed systems of various architectures and scales using our implementation for Java. Our empirical results show that D 2 ABS is significantly more effective than existing options while offering varied levels of cost effectiveness tradeoffs. As our framework essentially computes whole system run time dependencies, it naturally empowers a range of other dependence based applications.


Neutral Bremsstrahlung in TPCs. Traditionally, it has been assumed that electroluminescence (EL) in time projection chambers was purely an excimer based emission. This idea changed when neutral bremsstrahlung (NBrS) was observed first in argon and subsequently in xenon a few years ago. In this work we explore further the framework used to explain these observations, presenting results for noble gas based mixtures, as well as mixtures including small fractions of a molecular additive ( quencher'). Spectral content and yields are discussed in some cases of contemporary interest, together with their pressure scalings.


Laplace principle for large population games with control interaction. This work investigates continuous time stochastic differential games with a large number of players, whose costs and dynamics interact through the empirical distribution of both their states and their controls. The control processes are assumed to be open loop. We give regularity conditions guaranteeing that if the finite player game admits a Nash equilibrium, then both the sequence of equilibria and the corresponding states processes satisfy a Sanov type large deviation principle. The result requires existence of a Lipschitz continuous solution of the master equation of the corresponding mean field game, and is based on concentration inequalities for Lipschitz FBSDEs. The result carries over to cooperative (i.e. central planner) games. We study the linear quadratic case of such games in details.


A Warped Resolvent Algorithm to Construct Nash Equilibria. We propose an asynchronous block iterative decomposition algorithm to solve Nash equilibrium problems involving a mix of nonsmooth and smooth functions acting on linear mixtures of strategies. The methodology relies heavily on monotone operator theory and in particular on warped resolvents.


AGCM 3DLF Accelerating Atmospheric General Circulation Model via 3D Parallelization and Leap Format. The Atmospheric General Circulation Model (AGCM) has been an important research tool in the study of climate change for decades. As the demand for high resolution simulation is becoming urgent, the scalability and simulation efficiency is faced with great challenges, especially for the latitude longitude mesh based models. In this paper, we propose a highly scalable 3D atmospheric general circulation model based on leap format, namely AGCM 3DLF. Firstly, it utilizes a 3D decomposition method allowing for parallelism release in all three physical dimensions. Then the leap format difference computation scheme is adopted to maintain computational stability in grid updating and avoid additional filtering at the high latitudes. A novel shifting window communication algorithm is designed for parallelization of the unified model. Furthermore, a series of optimizations are conducted to improve the effectiveness of large scale simulations. Experiment results in different platforms demonstrate good efficiency and scalability of the model. AGCM 3DLF scales up to the entire CAS Xiandao1 supercomputer (196,608 CPU cores), attaining the speed of 11.1 simulation year per day (SYPD) at a high resolution of 25KM. In addition, simulations conducted on the Sunway TaihuLight supercomputer exhibit a 1.06 million cores scalability with 36.1 parallel efficiency.


Seeing and Believing Evaluating the Trustworthiness of Twitter Users. Social networking and micro blogging services, such as Twitter, play an important role in sharing digital information. Despite the popularity and usefulness of social media, there have been many instances where corrupted users found ways to abuse it, as for instance, through raising or lowering user's credibility. As a result, while social media facilitates an unprecedented ease of access to information, it also introduces a new challenge that of ascertaining the credibility of shared information. Currently, there is no automated way of determining which news or users are credible and which are not. Hence, establishing a system that can measure the social media user's credibility has become an issue of great importance. Assigning a credibility score to a user has piqued the interest of not only the research community but also most of the big players on both sides such as Facebook, on the side of industry, and political parties on the societal one. In this work, we created a model which, we hope, will ultimately facilitate and support the increase of trust in the social network communities. Our model collected data and analysed the behaviour of 50,000 politicians on Twitter. Influence score, based on several chosen features, was assigned to each evaluated user. Further, we classified the political Twitter users as either trusted or untrusted using random forest, multilayer perceptron, and support vector machine. An active learning model was used to classify any unlabelled ambiguous records from our dataset. Finally, to measure the performance of the proposed model, we used precision, recall, F1 score, and accuracy as the main evaluation metrics.


Complex impedance of TESs under AC bias using FDM readout system. The next generation of Far infrared and X ray space observatories will require detector arrays with thousands of transition edge sensor (TES) pixel. It is extremely important to have a tool that is able to characterize all the pixels and that can give a clear picture of the performance of the devices. In particular, we refer to those aspects that can affect the global energy resolution of the array logarithmic resistance sensitivity with respect to temperature and current ( alpha and beta parameters, respectively), uniformity of the TESs and the correct understanding of the detector thermal model. Complex impedance measurement of a TES is the only technique that can give all this information at once, but it has been established only for a single pixel under DC bias. We have developed a complex impedance measurement method for TESs that are AC biased since we are using a MHz frequency domain multiplexing (FDM) system to readout an array. We perform a complete set of AC impedance measurements for different X ray TES microcalorimeters based on superconducting TiAu bilayers with or without normal metal Au bar structures. We discuss the statistical analysis of the residual between impedance data and fitting model to determine the proper calorimeter thermal model for our detectors. Extracted parameters are used to improve our understanding of the differences and capabilities among the detectors and additionally the quality of the array. Moreover, we use the results to compare the calculated noise spectra with the measured data.


Rapid treatment planning for low dose rate prostate brachytherapy with TP GAN. Treatment planning in low dose rate prostate brachytherapy (LDR PB) aims to produce arrangement of implantable radioactive seeds that deliver a minimum prescribed dose to the prostate whilst minimizing toxicity to healthy tissues. There can be multiple seed arrangements that satisfy this dosimetric criterion, not all deemed 'acceptable' for implant from a physician's perspective. This leads to plans that are subjective to the physician's centre's preference, planning style, and expertise. We propose a method that aims to reduce this variability by training a model to learn from a large pool of successful retrospective LDR PB data (961 patients) and create consistent plans that mimic the high quality manual plans. Our model is based on conditional generative adversarial networks that use a novel loss function for penalizing the model on spatial constraints of the seeds. An optional optimizer based on a simulated annealing (SA) algorithm can be used to further fine tune the plans if necessary (determined by the treating physician). Performance analysis was conducted on 150 test cases demonstrating comparable results to that of the manual prehistorical plans. On average, the clinical target volume covering 100 of the prescribed dose was 98.9 for our method compared to 99.4 for manual plans. Moreover, using our model, the planning time was significantly reduced to an average of 2.5 mins plan with SA, and less than 3 seconds without SA. Compared to this, manual planning at our centre takes around 20 mins plan.


MegazordNet combining statistical and machine learning standpoints for time series forecasting. Forecasting financial time series is considered to be a difficult task due to the chaotic feature of the series. Statistical approaches have shown solid results in some specific problems such as predicting market direction and single price of stocks however, with the recent advances in deep learning and big data techniques, new promising options have arises to tackle financial time series forecasting. Moreover, recent literature has shown that employing a combination of statistics and machine learning may improve accuracy in the forecasts in comparison to single solutions. Taking into consideration the mentioned aspects, in this work, we proposed the MegazordNet, a framework that explores statistical features within a financial series combined with a structured deep learning model for time series forecasting. We evaluated our approach predicting the closing price of stocks in the S P 500 using different metrics, and we were able to beat single statistical and machine learning methods.


Tame Parahoric Higgs Torsors for a Complex Reductive Group. For a connected complex reductive group G , we introduce a notion of stability for parahoric mathcal G boldsymbol theta Higgs torsors over a smooth algebraic curve X , where mathcal G boldsymbol theta is a parahoric group scheme over X . In the case when the group G is the general linear group rm GL n , we show that the stability condition of a parahoric torsor reduces to stability of a parabolic bundle. A correspondence between semistable tame parahoric mathcal G boldsymbol theta Higgs torsors and semistable tame equivariant G Higgs bundles allows us to construct the moduli space explicitly. This moduli space is shown to be equipped with a complex algebraic Poisson structure.


Corks and exotic ribbons in B 4 . By using corks we construct diffeomorphic ribbon disks D subset B 4 , which are non isotopic rel boundary to each other.


Fast and Efficient Bit Level Precision Tuning. In this article, we introduce a new technique for precision tuning. This problem consists of finding the least data types for numerical values such that the result of the computation satisfies some accuracy requirement. State of the art techniques for precision tuning use a try and fail approach. They change the data types of some variables of the program and evaluate the accuracy of the result. Depending on what is obtained, they change more or less data types and repeat the process. Our technique is radically different. Based on semantic equations, we generate an Integer Linear Problem (ILP) from the program source code. Basically, this is done by reasoning on the most significant bit and the number of significant bits of the values which are integer quantities. The integer solution to this problem, computed in polynomial time by a (real) linear programming solver, gives the optimal data types at the bit level. A finer set of semantic equations is also proposed which does not reduce directly to an ILP problem. So we use policy iteration to find the solution. Both techniques have been implemented and we show that our results encompass the results of state of the art tools.


The Co Designed Post Pandemic University A Participatory and Continual Learning Approach for the Future of Work. The pandemic has shattered the traditional enclosures of learning. The post pandemic university (PPU) will no longer be contained within the 4 walls of a lecture theatre, and finish once students have left the premises. The use of online services has now blended home and university life, and the PPU needs to reflect this. Our proposal of a continuous learning model will take advantage of the newfound omnipresence of learning, while being dynamic enough to continually adapt to the ever evolving virus situation. Universities restricting themselves to fixed subject themes that are then forgotten once completed, will miss out on the "fresh start" presented by the virus.


Efficient Scaling of Dynamic Graph Neural Networks. We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi node, multi GPU systems. To the best of our knowledge, this is the first scaling study on dynamic GNN. We devise mechanisms for reducing the GPU memory usage and identify two execution time bottlenecks CPU GPU data transfer and communication volume. Exploiting properties of dynamic graphs, we design a graph difference based strategy to significantly reduce the transfer time. We develop a simple, but effective data distribution technique under which the communication volume remains fixed and linear in the input size, for any number of GPUs. Our experiments using billion size graphs on a system of 128 GPUs shows that (i) the distribution scheme achieves up to 30x speedup on 128 GPUs (ii) the graph difference technique reduces the transfer time by a factor of up to 4.1x and the overall execution time by up to 40


Spatial Content Alignment For Pose Transfer. Due to unreliable geometric matching and content misalignment, most conventional pose transfer algorithms fail to generate fine trained person images. In this paper, we propose a novel framework Spatial Content Alignment GAN (SCAGAN) which aims to enhance the content consistency of garment textures and the details of human characteristics. We first alleviate the spatial misalignment by transferring the edge content to the target pose in advance. Secondly, we introduce a new Content Style DeBlk which can progressively synthesize photo realistic person images based on the appearance features of the source image, the target pose heatmap and the prior transferred content in edge domain. We compare the proposed framework with several state of the art methods to show its superiority in quantitative and qualitative analysis. Moreover, detailed ablation study results demonstrate the efficacy of our contributions. Codes are publicly available at github.com rocketappslab SCA GAN.


Boundary value problems on non Lipschitz uniform domains Stability, compactness and the existence of optimal shapes. We study boundary value problems for bounded uniform domains in mathbb R n , n geq 2 , with non Lipschitz (and possibly fractal) boundaries. We prove Poincar 'e inequalities with trace terms and uniform constants for uniform ( varepsilon, infty) domains within bounded common confinements. We then introduce generalized Dirichlet, Robin and Neumann problems for Poisson type equations and prove the Mosco convergence of the associated energy functionals along sequences of suitably converging domains. This implies a stability result for weak solutions, and this also implies the norm convergence of the associated resolvents and the convergence of the corresponding eigenvalues and eigenfunctions. Based on our earlier work, we prove compactness results for parametrized classes of admissible domains, energy functionals and weak solutions. Using these results, we can verify the existence of optimal shapes in these classes.


An inequality for the compositions of convex functions with convolutions and an alternative proof of the Brunn Minkowski Kemperman inequality. Let m(G) be the infimum of the volumes of all open subgroups of a unimodular locally compact group G . Suppose integrable functions phi 1 , phi 2 colon G to 0,1 satisfy phi 1 leq phi 2 and phi 1 phi 2 leq m (G) , where cdot denotes the L 1 norm with respect to a Haar measure dg on G . We have the following inequality for any convex function f colon 0, phi 1 to mathbb R with f(0) 0 begin align int G f circ ( phi 1 phi 2 ) (g) dg leq 2 int 0 phi 1 f(y) dy ( phi 2 phi 1 ) f( phi 1 ). end align As a corollary, we have a slightly stronger version of Brunn Minkowski Kemperman inequality. That is, we have begin align mathrm vol ( B 1 B 2 ) geq mathrm vol ( g in G mid 1 B 1 1 B 2 (g) 0 ) geq mathrm vol (B 1) mathrm vol (B 2) end align for any non null measurable sets B 1 , B 2 subset G with mathrm vol (B 1) mathrm vol (B 2) leq m(G) , where mathrm vol denotes the inner measure and 1 B the characteristic function of B .


A heuristic for listing almost clique minimal separators of a graph. Bodlaender and Koster (Discrete Mathematics 2006) introduced the notion of almost clique separators in the context of computing the treewidth tw(G) of a given graph G . A separator S subseteq V(G) of G is an emph almost clique separator if S setminus v is a clique of G for some v in S . S is a emph minimal separator if S has at least two full components, where a full component of S is a connected component C of G setminus S such that N G(C) S . They observed that if S is an almost clique minimal separator of G then tw(G cup K(S)) tw(G) , where K(S) is the complete graph on vertex set S in words, filling an almost clique minimal separator into a clique does not increase the treewidth. Based on this observation, they proposed a preprocessing method for treewidth computation, a fundamental step of which is to find a preferably maximal set of pairwise non crossing almost clique minimal separators of a graph. In this paper, we present a heuristic for this step, which is based on the following empirical observation. For graph G and a minimal triangulation H of G , let QQ(H, G) denote the set of all almost clique minimal separators of G that are minimal separators of H . Note that since the minimal separators of H are pairwise non crossing, so are those in QQ(H, G) . We observe from experiments that QQ(H, G) is remarkably close to maximal, especially when the minimal triangulation H is computed by an algorithm aiming for small treewidth. This observation leads to an efficient implementation of the preprocessing method proposed by Bodlaender and Koster. Experiments on instances from PACE 2017 and other sources show that this implementation is extremely fast and effective for graphs of practical interest.


Associative algebra twisted bundles over compact topological spaces. For the associative algebra A( mathfrak g) of an infinite dimensional Lie algebra mathfrak g , we introduce twisted fiber bundles over arbitrary compact topological spaces. Fibers of such bundles are given by elements of algebraic completion of the space of formal series in complex parameters, sections are provided by rational functions with prescribed analytic properties. Homotopical invariance as well as covariance in terms of trivial bundles of twisted A( mathfrak g) bundles is proven. Further applications of the paper's results useful for studies of the cohomology of infinite dimensional Lie algebras on smooth manifolds, K theory, as well as for purposes of conformal field theory, deformation theory, and the theory of foliations are mentioned.


Nielsen equivalence in triangle groups. We extend the result of cite Dutra to generating pairs of triangle groups, that is, we show that any generating pair of a triangle group is represented by a special almost orbifold covering.


DroneTrap Drone Catching in Midair by Soft Robotic Hand with Color Based Force Detection and Hand Gesture Recognition. The paper proposes a novel concept of docking drones to make this process as safe and fast as possible. The idea behind the project is that a robot with a soft gripper grasps the drone in midair. The human operator navigates the robotic arm with the ML based gesture recognition interface. The 3 finger robot hand with soft fingers is equipped with touch sensors, making it possible to achieve safe drone catching and avoid inadvertent damage to the drone's propellers and motors. Additionally, the soft hand is featured with a unique color based force estimation technology based on a computer vision (CV) system. Moreover, the visual color changing system makes it easier for the human operator to interpret the applied forces. Without any additional programming, the operator has full real time control of the robot's motion and task execution by wearing a mocap glove with gesture recognition, which was developed and applied for the high level control of DroneTrap. The experimental results revealed that the developed color based force estimation can be applied for rigid object capturing with high precision (95.3 ). The proposed technology can potentially revolutionize the landing and deployment of drones for parcel delivery on uneven ground, structure maintenance and inspection, risque operations, and etc.


Nonzero sum stochastic impulse games with an application in competitive retail energy markets. We study a nonzero sum stochastic differential game with both players adopting impulse controls, on a finite time horizon. The objective of each player is to maximize her total expected discounted profits. The resolution methodology relies on the connection between Nash equilibrium and the corresponding system of quasi variational inequalities (QVIs in short). We prove, by means of the weak dynamic programming principle for the stochastic differential game, that the value function of each player is a constrained viscosity solution to the associated QVIs system in the class of linear growth functions. We also introduce a family of value functions converging to our value function of each player, and which is characterized as the unique constrained viscosity solutions of an approximation of our QVIs system. This convergence result is useful for numerical purpose. We apply a probabilistic numerical scheme which approximates the solution of the QVIs system to the case of the competition between two electricity retailers. We show how our model reproduces the qualitative behaviour of electricity retail competition.


A note on derivatives, expansions and Pi 1 1 ranks. Pi 1 1 ranks are a natural tool for studying coanalytic sets in descriptive set theory. In the book "Classical descriptive set theory", Kechris provided a technique to build Pi 1 1 ranks using derivatives. In this note we will prove a variant of this result that is applicable to the Gamma rank. Some dynamical ranks, like the entropy rank can be stated in terms of the Gamma rank.


Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD. We consider the decentralized stochastic optimization problems, where a network of n nodes, each owning a local cost function, cooperate to find a minimizer of the globally averaged cost. A widely studied decentralized algorithm for this problem is decentralized SGD (D SGD), in which each node averages only with its neighbors. D SGD is efficient in single iteration communication, but it is very sensitive to the network topology. For smooth objective functions, the transient stage (which measures the number of iterations the algorithm has to experience before achieving the linear speedup stage) of D SGD is on the order of Omega (n (1 beta) 2) and Omega(n 3 (1 beta) 4) for strongly and generally convex cost functions, respectively, where 1 beta in (0,1) is a topology dependent quantity that approaches 0 for a large and sparse network. Hence, D SGD suffers from slow convergence for large and sparse networks. In this work, we study the non asymptotic convergence property of the D 2 Exact diffusion algorithm. By eliminating the influence of data heterogeneity between nodes, D 2 Exact diffusion is shown to have an enhanced transient stage that is on the order of tilde Omega (n (1 beta)) and Omega(n 3 (1 beta) 2) for strongly and generally convex cost functions, respectively. Moreover, when D 2 Exact diffusion is implemented with gradient accumulation and multi round gossip communications, its transient stage can be further improved to tilde Omega (1 (1 beta) frac 1 2 ) and tilde Omega (n (1 beta)) for strongly and generally convex cost functions, respectively. These established results for D 2 Exact Diffusion have the best (i.e., weakest) dependence on network topology to our knowledge compared to existing decentralized algorithms. We also conduct numerical simulations to validate our theories.


Tensor Normal Training for Deep Learning Models. Despite the predominant use of first order methods for training deep learning models, second order methods, and in particular, natural gradient methods, remain of interest because of their potential for accelerating training through the use of curvature information. Several methods with non diagonal preconditioning matrices, including KFAC, Shampoo, and K BFGS, have been proposed and shown to be effective. Based on the so called tensor normal (TN) distribution, we propose and analyze a brand new approximate natural gradient method, Tensor Normal Training (TNT), which like Shampoo, only requires knowledge of the shape of the training parameters. By approximating the probabilistically based Fisher matrix, as opposed to the empirical Fisher matrix, our method uses the block wise covariance of the sampling based gradient as the pre conditioning matrix. Moreover, the assumption that the sampling based (tensor) gradient follows a TN distribution, ensures that its covariance has a Kronecker separable structure, which leads to a tractable approximation to the Fisher matrix. Consequently, TNT's memory requirements and per iteration computational costs are only slightly higher than those for first order methods. In our experiments, TNT exhibited superior optimization performance to state of the art first order methods, and comparable optimization performance to the state of the art second order methods KFAC and Shampoo. Moreover, TNT demonstrated its ability to generalize as well as first order methods, while using fewer epochs.


Approximating Defeasible Logics to Improve Scalability. Defeasible rules are used in providing computable representations of legal documents and, more recently, have been suggested as a basis for explainable AI. Such applications draw attention to the scalability of implementations. The defeasible logic DL( partial ) was introduced as a more scalable alternative to DL( partial) , which is better known. In this paper we consider the use of (implementations of) DL( partial ) as a computational aid to computing conclusions in DL( partial) and other defeasible logics, rather than as an alternative to DL( partial) . We identify conditions under which DL( partial ) can be substituted for DL( partial) with no change to the conclusions drawn, and conditions under which DL( partial ) can be used to draw some valid conclusions, leaving the remainder to be drawn by DL( partial) .


NewsEmbed Modeling News through Pre trained Document Representations. Effectively modeling text rich fresh content such as news articles at document level is a challenging problem. To ensure a content based model generalize well to a broad range of applications, it is critical to have a training dataset that is large beyond the scale of human labels while achieving desired quality. In this work, we address those two challenges by proposing a novel approach to mine semantically relevant fresh documents, and their topic labels, with little human supervision. Meanwhile, we design a multitask model called NewsEmbed that alternatively trains a contrastive learning with a multi label classification to derive a universal document encoder. We show that the proposed approach can provide billions of high quality organic training examples and can be naturally extended to multilingual setting where texts in different languages are encoded in the same semantic space. We experimentally demonstrate NewsEmbed's competitive performance across multiple natural language understanding tasks, both supervised and unsupervised.


Synthesis with Asymptotic Resource Bounds. We present a method for synthesizing recursive functions that satisfy both a functional specification and an asymptotic resource bound. Prior methods for synthesis with a resource metric require the user to specify a concrete expression exactly describing resource usage, whereas our method uses big O notation to specify the asymptotic resource usage. Our method can synthesize programs with complex resource bounds, such as a sort function that has complexity O(nlog(n)). Our synthesis procedure uses a type system that is able to assign an asymptotic complexity to terms, and can track recurrence relations of functions. These typing rules are justified by theorems used in analysis of algorithms, such as the Master Theorem and the Akra Bazzi method. We implemented our method as an extension of prior type based synthesis work. Our tool, SynPlexity, was able to synthesize complex divide and conquer programs that cannot be synthesized by prior solvers.


GraphSearchNet Enhancing GNNs via Capturing Global Dependency for Semantic Code Search. Code search aims to retrieve accurate code snippets based on a natural language query to improve software productivity and quality. With the massive amount of available programs such as (on GitHub or Stack Overflow), identifying and localizing the precise code is critical for the software developers. In addition, Deep learning has recently been widely applied to different code related scenarios, e.g., vulnerability detection, source code summarization. However, automated deep code search is still challenging due to the semantic gap between the program and the natural language query. Most existing deep learning based approaches for code search rely on the sequential text i.e., feeding the program and the query as a flat sequence of tokens to learn the program semantics while the structural information is not fully considered. Furthermore, the widely adopted Graph Neural Networks (GNNs) have proved the effectiveness in learning program semantics, however, they also suffer the problem of capturing the global dependency in the constructed graph, which limits the model learning capacity. To address these challenges, in this paper, we design a novel neural network framework, named GraphSearchNet, to enable an effective and accurate source code search by jointly learning rich semantics of both source code and natural language queries. Specifically, we propose to construct graphs for the source code and queries with bidirectional GGNN (BiGGNN) to capture the local structural information of the source code and queries. Furthermore, we enhance BiGGNN by utilizing the multi head attention module to supplement the global dependency that BiGGNN missed to improve the model learning capacity. The extensive experiments on Java and Python programming language from the public benchmark CodeSearchNet confirm that GraphSearchNet outperforms current state of the art works by a significant margin.


Self Supervised Keypoint Discovery in Behavioral Videos. We propose a method for learning the posture and structure of agents from unlabelled behavioral videos. Starting from the observation that behaving agents are generally the main sources of movement in behavioral videos, our method, Behavioral Keypoint Discovery (B KinD), uses an encoder decoder architecture with a geometric bottleneck to reconstruct the spatiotemporal difference between video frames. By focusing only on regions of movement, our approach works directly on input videos without requiring manual annotations. Experiments on a variety of agent types (mouse, fly, human, jellyfish, and trees) demonstrate the generality of our approach and reveal that our discovered keypoints represent semantically meaningful body parts, which achieve state of the art performance on keypoint regression among self supervised methods. Additionally, B KinD achieve comparable performance to supervised keypoints on downstream tasks, such as behavior classification, suggesting that our method can dramatically reduce model training costs vis a vis supervised methods.


Deep learning polarization distributions in ferroelectrics from STEM data with and without atom finding. Over the last decade, scanning transmission electron microscopy (STEM) has emerged as a powerful tool for probing atomic structures of complex materials with picometer precision, opening the pathway toward exploring ferroelectric, ferroelastic, and chemical phenomena on the atomic scale. Analyses to date extracting a polarization signal from lattice coupled distortions in STEM imaging rely on discovery of atomic positions from intensity maxima minima and subsequent calculation of polarization and other order parameter fields from the atomic displacements. Here, we explore the feasibility of polarization mapping directly from the analysis of STEM images using deep convolutional neural networks (DCNNs). In this approach, the DCNN is trained on the labeled part of the image (i.e., for human labelling), and the trained network is subsequently applied to other images. We explore the effects of the choice of the descriptors (centered on atomic columns and grid based), the effects of observational bias, and whether the network trained on one composition can be applied to a different one. This analysis demonstrates the tremendous potential of the DCNN for the analysis of high resolution STEM imaging and spectral data and highlights the associated limitations.


Gauss Seidel Method with Oblique Direction. In this paper, a Gauss Seidel method with oblique direction (GSO) is proposed for finding the least squares solution to a system of linear equations, where the coefficient matrix may be full rank or rank deficient and the system is overdetermined or underdetermined. Through this method, the number of iteration steps and running time can be reduced to a greater extent to find the least squares solution, especially when the columns of matrix A are close to linear correlation. It is theoretically proved that GSO method converges to the least squares solution. At the same time, a randomized version randomized Gauss Seidel method with oblique direction (RGSO) is established, and its convergence is proved. Theoretical proof and numerical results show that the GSO method and the RGSO method are more efficient than the coordinate descent (CD) method and the randomized coordinate descent (RCD) method.


RacketStore Measurements of ASO Deception in Google Play via Mobile and App Usage. Online app search optimization (ASO) platforms that provide bulk installs and fake reviews for paying app developers in order to fraudulently boost their search rank in app stores, were shown to employ diverse and complex strategies that successfully evade state of the art detection methods. In this paper we introduce RacketStore, a platform to collect data from Android devices of participating ASO providers and regular users, on their interactions with apps which they install from the Google Play Store. We present measurements from a study of 943 installs of RacketStore on 803 unique devices controlled by ASO providers and regular users, that consists of 58,362,249 data snapshots collected from these devices, the 12,341 apps installed on them and their 110,511,637 Google Play reviews. We reveal significant differences between ASO providers and regular users in terms of the number and types of user accounts registered on their devices, the number of apps they review, and the intervals between the installation times of apps and their review times. We leverage these insights to introduce features that model the usage of apps and devices, and show that they can train supervised learning algorithms to detect paid app installs and fake reviews with an F1 measure of 99.72 (AUC above 0.99), and detect devices controlled by ASO providers with an F1 measure of 95.29 (AUC 0.95). We discuss the costs associated with evading detection by our classifiers and also the potential for app stores to use our approach to detect ASO work with privacy.


On the unification of the graph edit distance and graph matching problems. Error tolerant graph matching gathers an important family of problems. These problems aim at finding correspondences between two graphs while integrating an error model. In the Graph Edit Distance (GED) problem, the insertion deletion of edges nodes from one graph to another is explicitly expressed by the error model. At the opposite, the problem commonly referred to as "graph matching" does not explicitly express such operations. For decades, these two problems have split the research community in two separated parts. It resulted in the design of different solvers for the two problems. In this paper, we propose a unification of both problems thanks to a single model. We give the proof that the two problems are equivalent under a reformulation of the error models. This unification makes possible the use on both problems of existing solving methods from the two communities.


HyperPocket Generative Point Cloud Completion. Scanning real life scenes with modern registration devices typically give incomplete point cloud representations, mostly due to the limitations of the scanning process and 3D occlusions. Therefore, completing such partial representations remains a fundamental challenge of many computer vision applications. Most of the existing approaches aim to solve this problem by learning to reconstruct individual 3D objects in a synthetic setup of an uncluttered environment, which is far from a real life scenario. In this work, we reformulate the problem of point cloud completion into an object hallucination task. Thus, we introduce a novel autoencoder based architecture called HyperPocket that disentangles latent representations and, as a result, enables the generation of multiple variants of the completed 3D point clouds. We split point cloud processing into two disjoint data streams and leverage a hypernetwork paradigm to fill the spaces, dubbed pockets, that are left by the missing object parts. As a result, the generated point clouds are not only smooth but also plausible and geometrically consistent with the scene. Our method offers competitive performances to the other state of the art models, and it enables a plethora of novel applications.


The composition series of ideals of the partial isometric crossed product by the semigroup mathbb N 2 . Suppose that mathbb N 2 is the positive cone of the abelian lattice ordered group mathbb Z 2 , and alpha an action of mathbb N 2 by extendible endomorphisms of a C algebra A . Let A times alpha textrm piso mathbb N 2 be the partial isometric crossed product by the endomorphic action alpha . A composition series 0 leq L 1 leq L 2 leq A times alpha textrm piso mathbb N 2 of essential ideals is obtained for which we identify the subquotients with familiar algebras.


Perfect refiners for permutation group backtracking algorithms. Backtrack search is a fundamental technique for computing with finite permutation groups, which has been formulated in terms of points, ordered partitions, and graphs. We provide a framework for discussing the most common forms of backtrack search in a generic way. We introduce the concept of perfect refiners to better understand and compare the pruning power available in these different settings. We also present a new formulation of backtrack search, which allows the use of graphs with additional vertices, and which is implemented in the software package Vole. For each setting, we classify the groups and cosets for which there exist perfect refiners. Moreover, we describe perfect refiners for many naturally occurring examples of stabilisers and transporter sets, including applications to normaliser and subgroup conjugacy problems for 2 closed groups.


ModelDiff Testing Based DNN Similarity Comparison for Model Reuse Detection. The knowledge of a deep learning model may be transferred to a student model, leading to intellectual property infringement or vulnerability propagation. Detecting such knowledge reuse is nontrivial because the suspect models may not be white box accessible and or may serve different tasks. In this paper, we propose ModelDiff, a testing based approach to deep learning model similarity comparison. Instead of directly comparing the weights, activations, or outputs of two models, we compare their behavioral patterns on the same set of test inputs. Specifically, the behavioral pattern of a model is represented as a decision distance vector (DDV), in which each element is the distance between the model's reactions to a pair of inputs. The knowledge similarity between two models is measured with the cosine similarity between their DDVs. To evaluate ModelDiff, we created a benchmark that contains 144 pairs of models that cover most popular model reuse methods, including transfer learning, model compression, and model stealing. Our method achieved 91.7 correctness on the benchmark, which demonstrates the effectiveness of using ModelDiff for model reuse detection. A study on mobile deep learning apps has shown the feasibility of ModelDiff on real world models.


How to Calibrate Your Event Camera. We propose a generic event camera calibration framework using image reconstruction. Instead of relying on blinking LED patterns or external screens, we show that neural network based image reconstruction is well suited for the task of intrinsic and extrinsic calibration of event cameras. The advantage of our proposed approach is that we can use standard calibration patterns that do not rely on active illumination. Furthermore, our approach enables the possibility to perform extrinsic calibration between frame based and event based sensors without additional complexity. Both simulation and real world experiments indicate that calibration through image reconstruction is accurate under common distortion models and a wide variety of distortion parameters


DyTox Transformers for Continual Learning with DYnamic TOken eXpansion. Deep network architectures struggle to continually learn new tasks without forgetting the previous tasks. A recent trend indicates that dynamic architectures based on an expansion of the parameters can reduce catastrophic forgetting efficiently in continual learning. However, existing approaches often require a task identifier at test time, need complex tuning to balance the growing number of parameters, and barely share any information across tasks. As a result, they struggle to scale to a large number of tasks without significant overhead. In this paper, we propose a transformer architecture based on a dedicated encoder decoder framework. Critically, the encoder and decoder are shared among all tasks. Through a dynamic expansion of special tokens, we specialize each forward of our decoder network on a task distribution. Our strategy scales to a large number of tasks while having negligible memory and time overheads due to strict control of the parameters expansion. Moreover, this efficient strategy doesn't need any hyperparameter tuning to control the network's expansion. Our model reaches excellent results on CIFAR100 and state of the art performances on the large scale ImageNet100 and ImageNet1000 while having less parameters than concurrent dynamic frameworks.


AEAD Modes for ZUC Family Stream Ciphers. In order to improve the efficiency of using ZUC primitives, we give two AEAD (Authenticated Encryption with Associated Data) modes for them, ZUC GXM and ZUC MUR. They are suitable for ZUC (ZUC 128) and two cases of ZUC 256. The former is a nonce based AEAD, which is following the GCM framework. The latter is a nonce misuse resistant one which is based on the framework of SIV variance, providing more robust applications for ZUC family stream ciphers.


On the gap between deterministic and probabilistic Lyapunov exponents for continuous time linear systems. Consider a non autonomous continuous time linear system in which the time dependent matrix determining the dynamics is piecewise constant and takes finitely many values A 1, dotsc, A N . This paper studies the equality cases between the maximal Lyapunov exponent associated with the set of matrices A 1, dotsc, A N , on the one hand, and the corresponding ones for piecewise deterministic Markov processes with modes A 1, dotsc, A N , on the other hand. A fundamental step in this study consists in establishing a result of independent interest, namely, that any sequence of Markov processes associated with the matrices A 1, dotsc, A N converges, up to extracting a subsequence, to a Markov process associated with a suitable convex combination of those matrices.


Star Structure Connectivity of Folded hypercubes and Augmented cubes. The connectivity is an important parameter to evaluate the robustness of a network. As a generalization, structure connectivity and substructure connectivity of graphs were proposed. For connected graphs G and H , the H structure connectivity kappa(G H) (resp. H substructure connectivity kappa s (G H) ) of G is the minimum cardinality of a set of subgraphs F of G that each is isomorphic to H (resp. to a connected subgraph of H ) so that G F is disconnected or the singleton. As popular variants of hypercubes, the n dimensional folded hypercubes FQ n and augmented cubes AQ n are attractive interconnected network prototypes for multiple processor systems. In this paper, we obtain that kappa(FQ n K 1,m ) kappa s (FQ n K 1,m ) lceil frac n 1 2 rceil for 2 leqslant m leqslant n 1 , n geqslant 7 , and kappa(AQ n K 1,m ) kappa s (AQ n K 1,m ) lceil frac n 1 2 rceil for 4 leqslant m leqslant frac 3n 15 4 .


GAN Prior Embedded Network for Blind Face Restoration in the Wild. Blind face restoration (BFR) from severely degraded face images in the wild is a very challenging problem. Due to the high illness of the problem and the complex unknown degradation, directly training a deep neural network (DNN) usually cannot lead to acceptable results. Existing generative adversarial network (GAN) based methods can produce better results but tend to generate over smoothed restorations. In this work, we propose a new method by first learning a GAN for high quality face image generation and embedding it into a U shaped DNN as a prior decoder, then fine tuning the GAN prior embedded DNN with a set of synthesized low quality face images. The GAN blocks are designed to ensure that the latent code and noise input to the GAN can be respectively generated from the deep and shallow features of the DNN, controlling the global face structure, local face details and background of the reconstructed image. The proposed GAN prior embedded network (GPEN) is easy to implement, and it can generate visually photo realistic results. Our experiments demonstrated that the proposed GPEN achieves significantly superior results to state of the art BFR methods both quantitatively and qualitatively, especially for the restoration of severely degraded face images in the wild. The source code and models can be found at https github.com yangxy GPEN.


On the ESL algorithm for solving energy games. We propose a variant of an algorithm introduced by Schewe and also studied by Luttenberger for solving parity or mean payoff games. We present it over energy games and call our variant the ESL algorithm (for Energy Schewe Luttenberger). We find that using potential reductions as introduced by Gurvich, Karzanov and Khachiyan allows for a simple and elegant presentation of the algorithm, which repeatedly applies a natural generalisation of Dijkstra's algorithm to the two player setting due to Khachiyan, Gurvich and Zhao.


On certain supercuspidal representations of symplectic groups associated with tamely ramified extensions the formal degree conjecture and the root number conjecture. The formal degree conjecture and the root number conjecture are verified with respect to supercuspidal representations of Sp 2n (F) and L parameters associated with tamely ramified extension K F of degree 2n . The supercuspidal representation is constructed as a compact induction from an irreducible unitary representation of the hyper special compact group Sp 2n (O F) , which is explicitly constructed, based upon the general theory developed by the author, by K and certain character theta of the multiplicative group K times . L parameter is constructed by the data K, theta by means of the local Langlands correspondence of tori and Langlands Schelstad procedure.


Physics Informed Neural Networks (PINNs) for Parameterized PDEs A Metalearning Approach. Physics informed neural networks (PINNs) as a means of discretizing partial differential equations (PDEs) are garnering much attention in the Computational Science and Engineering (CS E) world. At least two challenges exist for PINNs at present an understanding of accuracy and convergence characteristics with respect to tunable parameters and identification of optimization strategies that make PINNs as efficient as other computational science tools. The cost of PINNs training remains a major challenge of Physics informed Machine Learning (PiML) and, in fact, machine learning (ML) in general. This paper is meant to move towards addressing the latter through the study of PINNs for parameterized PDEs. Following the ML world, we introduce metalearning of PINNs for parameterized PDEs. By introducing metalearning and transfer learning concepts, we can greatly accelerate the PINNs optimization process. We present a survey of model agnostic metalearning, and then discuss our model aware metalearning applied to PINNs. We provide theoretically motivated and empirically backed assumptions that make our metalearning approach possible. We then test our approach on various canonical forward parameterized PDEs that have been presented in the emerging PINNs literature.


Magic Pyramid Accelerating Inference with Early Exiting and Token Pruning. Pre training and then fine tuning large language models is commonly used to achieve state of the art performance in natural language processing (NLP) tasks. However, most pre trained models suffer from low inference speed. Deploying such large models to applications with latency constraints is challenging. In this work, we focus on accelerating the inference via conditional computations. To achieve this, we propose a novel idea, Magic Pyramid (MP), to reduce both width wise and depth wise computation via token pruning and early exiting for Transformer based models, particularly BERT. The former manages to save the computation via removing non salient tokens, while the latter can fulfill the computation reduction by terminating the inference early before reaching the final layer, if the exiting condition is met. Our empirical studies demonstrate that compared to previous state of arts, MP is not only able to achieve a speed adjustable inference but also to surpass token pruning and early exiting by reducing up to 70 giga floating point operations (GFLOPs) with less than 0.5 accuracy drop. Token pruning and early exiting express distinctive preferences to sequences with different lengths. However, MP is capable of achieving an average of 8.06x speedup on two popular text classification tasks, regardless of the sizes of the inputs.


New method for residual amplitude modulation control in fibered optical experiments. When locking the frequency of a laser to an optical cavity resonance, the residual amplitude modulation (RAM), which accompanies the phase modulation necessary to build the error signal, is a major limitation to the frequency stability. We show that the popular method demonstrated by Wong and Hall to cancel this effect, based on the measurement of the RAM using an auxiliary detector, is limited in the case of optical setups exhibiting polarization dependent losses and an imperfect polarizer at the modulator output, such as guided wave optical systems. We propose and demonstrate a new method, using a single photodetector, to generate the two error signals and demonstrate its usefulness in the case of fibered systems.


Diagonal cubic forms and the large sieve. Let F( boldsymbol x ) be a diagonal integer coefficient cubic form in m in 4,5,6 variables. Excluding rational lines if m 4 , we bound the number of integral solutions boldsymbol x in X,X m to F( boldsymbol x ) 0 by O F, epsilon (X 3m 4 3 2 epsilon ) , conditionally on an "optimal large sieve inequality" (in a specific range of parameters) for "approximate Hasse Weil L functions" of smooth hyperplane sections F( boldsymbol x ) boldsymbol c cdot boldsymbol x 0 as boldsymbol c in mathbb Z m varies in natural boxes. When m is even, these results were previously established conditionally under Hooley's Hypothesis HW. Our ell 2 large sieve approach requires that certain bad factors be roughly 1 on average in ell 2 , while the ell infty Hypothesis HW approach only required the bound in ell 1 . Furthermore, the large sieve only accepts uniform vectors yet our "initially given" vectors are only approximately uniform over boldsymbol c , due to variation in bad factors and in the archimedean component. Nonetheless, after some bookkeeping, partial summation, and Cauchy, the large sieve will still apply. In an appendix, we suggest a framework for non diagonal cubics, up to Hessian issues.


Semiquantitative Group Testing in at Most Two Rounds. Semiquantitative group testing (SQGT) is a pooling method in which the test outcomes represent bounded intervals for the number of defectives. Alternatively, it may be viewed as an adder channel with quantized outputs. SQGT represents a natural choice for Covid 19 group testing as it allows for a straightforward interpretation of the cycle threshold values produced by polymerase chain reactions (PCR). Prior work on SQGT did not address the need for adaptive testing with a small number of rounds as required in practice. We propose conceptually simple methods for 2 round and nonadaptive SQGT that significantly improve upon existing schemes by using ideas on nonbinary measurement matrices based on expander graphs and list disjunct matrices.


Advantages of NOMA for Multi User BackCom Networks. Ambient backscatter communication (BackCom) is faced with the challenge that a single BackCom device can occupy multiple orthogonal resource blocks unintentionally. As a result, in order to avoid co channel interference, a conventional approach is to serve multiple BackCom devices in different time slots, which reduces both spectral efficiency and connectivity. This letter demonstrates that the use of non orthogonal multiple access (NOMA) can efficiently improve the system throughput and support massive connectivity in ambient BackCom networks. In particular, two transceiver design approaches are developed in the letter to realize different tradeoffs between system performance and complexity.


Comparing OpenMP Implementations With Applications Across A64FX Platforms. The development of the A64FX processor by Fujitsu has created a massive innovation in High Performance Computing and the birth of Fugaku the current world's fastest supercomputer. A variety of tools are used to analyze the run times and performances of several applications, and in particular, how these applications scale on the A64FX processor. We examine the performance and behavior of applications through OpenMP scaling and how their performance differs across different compilers on the new Ookami cluster at Stony Brook University as well as the Fugaku supercomputer at RIKEN in Japan.


A novel spectral method for the semi classical Schr "odinger equation based on the Gaussian wave packet transform. In this article, we develop and analyse a new spectral method to solve the semi classical Schr "odinger equation based on the Gaussian wave packet transform (GWPT) and Hagedorn's semi classical wave packets (HWP). The GWPT equivalently recasts the highly oscillatory wave equation as a much less oscillatory one (the w equation) coupled with a set of ordinary differential equations governing the dynamics of the so called GWPT parameters. The Hamiltonian of the w equation consists of a quadratic part and a small non quadratic perturbation, which is of order mathcal O ( sqrt varepsilon ) , where varepsilon ll 1 is the rescaled Planck's constant. By expanding the solution of the w equation as a superposition of Hagedorn's wave packets, we construct a spectral method while the mathcal O ( sqrt varepsilon ) perturbation part is treated by the Galerkin approximation. This numerical implementation of the GWPT avoids imposing artificial boundary conditions and facilitates rigorous numerical analysis. For arbitrary dimensional cases, we establish how the error of solving the semi classical Schr "odinger equation with the GWPT is determined by the errors of solving the w equation and the GWPT parameters. We prove that this scheme has the spectral convergence with respect to the number of Hagedorn's wave packets in one dimension. Extensive numerical tests are provided to demonstrate the properties of the proposed method.


Speech Tasks Relevant to Sleepiness Determined with Deep Transfer Learning. Excessive sleepiness in attention critical contexts can lead to adverse events, such as car crashes. Detecting and monitoring sleepiness can help prevent these adverse events from happening. In this paper, we use the Voiceome dataset to extract speech from 1,828 participants to develop a deep transfer learning model using Hidden Unit BERT (HuBERT) speech representations to detect sleepiness from individuals. Speech is an under utilized source of data in sleep detection, but as speech collection is easy, cost effective, and non invasive, it provides a promising resource for sleepiness detection. Two complementary techniques were conducted in order to seek converging evidence regarding the importance of individual speech tasks. Our first technique, masking, evaluated task importance by combining all speech tasks, masking selected responses in the speech, and observing systematic changes in model accuracy. Our second technique, separate training, compared the accuracy of multiple models, each of which used the same architecture, but was trained on a different subset of speech tasks. Our evaluation shows that the best performing model utilizes the memory recall task and categorical naming task from the Boston Naming Test, which achieved an accuracy of 80.07 (F1 score of 0.85) and 81.13 (F1 score of 0.89), respectively.


Red Dragon AI at TextGraphs 2021 Shared Task Multi Hop Inference Explanation Regeneration by Matching Expert Ratings. Creating explanations for answers to science questions is a challenging task that requires multi hop inference over a large set of fact sentences. This year, to refocus the Textgraphs Shared Task on the problem of gathering relevant statements (rather than solely finding a single 'correct path'), the WorldTree dataset was augmented with expert ratings of 'relevance' of statements to each overall explanation. Our system, which achieved second place on the Shared Task leaderboard, combines initial statement retrieval language models trained to predict the relevance scores and ensembling of a number of the resulting rankings. Our code implementation is made available at https github.com mdda worldtree corpus tree textgraphs 2021


Multi Task Meta Learning Modification with Stochastic Approximation. Meta learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low data regime. One of the main benchmarks of such an algorithms is a few shot learning problem. In this paper we investigate the modification of standard meta learning pipeline that takes a multi task approach during training. The proposed method simultaneously utilizes information from several meta training tasks in a common loss function. The impact of each of these tasks in the loss function is controlled by the corresponding weight. Proper optimization of these weights can have a big influence on training of the entire model and might improve the quality on test time tasks. In this work we propose and investigate the use of methods from the family of simultaneous perturbation stochastic approximation (SPSA) approaches for meta train tasks weights optimization. We have also compared the proposed algorithms with gradient based methods and found that stochastic approximation demonstrates the largest quality boost in test time. Proposed multi task modification can be applied to almost all methods that use meta learning pipeline. In this paper we study applications of this modification on Prototypical Networks and Model Agnostic Meta Learning algorithms on CIFAR FS, FC100, tieredImageNet and miniImageNet few shot learning benchmarks. During these experiments, multi task modification has demonstrated improvement over original methods. The proposed SPSA Tracking algorithm shows the largest accuracy boost that is competitive against the state of the art meta learning methods. Our code is available online.


Blockchain mining in pools Analyzing the trade off between profitability and ruin. The resource consuming mining of blocks on a blockchain equipped with a proof of work consensus protocol bears the risk of ruin, namely when the operational costs for the mining exceed the received rewards. In this paper we investigate to what extent it is of interest to join a mining pool that reduces the variance of the return of a miner for a specified cost for participation. Using methodology from ruin theory and risk sharing in insurance, we quantitatively study the effects of pooling in this context and derive several explicit formulas for quantities of interest. The results are illustrated in numerical examples for parameters of practical relevance.


On multilinear distorted multiplier estimate and its applications. In this article, we investigate the multilinear distorted multiplier estimate (Coifman Meyer type theorem) associated with the Schr " o dinger operator H Delta V in the framework of the corresponding distorted Fourier transform. Our result is the "distorted" analog of the multilinear Coifman Meyer multiplier operator theorem in cite CM1 , which extends the bilinear estimates of Germain, Hani and Walsh's in cite PZS to the multilinear case for all dimensions. As applications, we give the estimate of Leibniz's law of integer order derivations for the multilinear distorted multiplier for the first time and we obtain small data scattering for a kind of generalized mass critical NLS with good potential in low dimensions d 1,2 .


VDSM Unsupervised Video Disentanglement with State Space Modeling and Deep Mixtures of Experts. Disentangled representations support a range of downstream tasks including causal reasoning, generative modeling, and fair machine learning. Unfortunately, disentanglement has been shown to be impossible without the incorporation of supervision or inductive bias. Given that supervision is often expensive or infeasible to acquire, we choose to incorporate structural inductive bias and present an unsupervised, deep State Space Model for Video Disentanglement (VDSM). The model disentangles latent time varying and dynamic factors via the incorporation of hierarchical structure with a dynamic prior and a Mixture of Experts decoder. VDSM learns separate disentangled representations for the identity of the object or person in the video, and for the action being performed. We evaluate VDSM across a range of qualitative and quantitative tasks including identity and dynamics transfer, sequence generation, Fr 'echet Inception Distance, and factor classification. VDSM provides state of the art performance and exceeds adversarial methods, even when the methods use additional supervision.


On the influence of gravity in the dynamics of geophysical flows. In the present paper, we study a multiscale limit for the barotropic Navier Stokes system with Coriolis and gravitational forces, for vanishing values of the Mach, Rossby and Froude numbers ( rm Ma , rm Ro and rm Fr , respectively). The focus here is on the effects of gravity albeit remaining in a low stratification regime rm Ma rm Fr , rightarrow ,0 , we consider scaling for the Froude number which go beyond the "critical" value rm Fr , , sqrt rm Ma . The rigorous derivation of suitable limiting systems for the various choices of the scaling is shown by means of a compensated compactness argument. Exploiting the precise structure of the gravitational force is the key to get the convergence.


Quantitative Helly type theorems via sparse approximation. We prove the following sparse approximation result for polytopes. Assume that Q is a polytope in John's position. Then there exist at most 2d vertices of Q whose convex hull Q' satisfies Q subseteq 2d 2 , Q' . As a consequence, we retrieve the best bound for the quantitative Helly type result for the volume, achieved by Brazitikos, and improve on the strongest bound for the quantitative Helly type theorem for the diameter, shown by Ivanov and Nasz 'odi We prove that given a finite family mathcal F of convex bodies in mathbb R d with intersection K , we may select at most 2 d members of mathcal F such that their intersection has volume at most (c d) 3d 2 , mathrm vol , K , and it has diameter at most 2 d 2 , mathrm diam ,K , for some absolute constant c 0 .


The Soccer Game, bit by bit An information theoretic analysis. We modeled the dynamics of a soccer match based on a network representation where players are nodes discretely clustered into homogeneous groups. Players were grouped by physical proximity, supported by the intuitive notion that competing and same team players use relative position as a key tactical tool to contribute to the team's objectives. The model was applied to a set of matches from a major European national football league, with players' coordinates sampled at 10Hz, resulting in approx. 60,000 network samples per match. We took an information theoretic approach to measuring distance between samples and used it as a proxy for the game dynamics. Significant correlations were found between measurements and key match events that are empirically known to result in players jostling for position, such as when striving to get unmarked or to mark. These events increase the information distance, while breaks in game play have the opposite effect. By analyzing the frequency spectrum of players' cluster transitions and their corresponding information distance, it is possible to build a comprehensive view of player's interactions, useful for training and strategy development. This analysis can be drilled down to the level of individual players by quantifying their contribution to cluster breakup and emergence, building an overall multi level map that provides insights into the game dynamics, from the individual player, to the clusters of interacting players, all the way to the teams and their matches.


Language agnostic Topic Classification for Wikipedia. A major challenge for many analyses of Wikipedia dynamics e.g., imbalances in content quality, geographic differences in what content is popular, what types of articles attract more editor discussion is grouping the very diverse range of Wikipedia articles into coherent, consistent topics. This problem has been addressed using various approaches based on Wikipedia's category network, WikiProjects, and external taxonomies. However, these approaches have always been limited in their coverage typically, only a small subset of articles can be classified, or the method cannot be applied across (the more than 300) languages on Wikipedia. In this paper, we propose a language agnostic approach based on the links in an article for classifying articles into a taxonomy of topics that can be easily applied to (almost) any language and article on Wikipedia. We show that it matches the performance of a language dependent approach while being simpler and having much greater coverage.


Trillium Unifying Refinement and Higher Order Distributed Separation Logic. We present a unification of refinement and Hoare style reasoning in a foundational mechanized higher order distributed separation logic. This unification enables us to prove formally in the Coq proof assistant that concrete implementations of challenging distributed systems refine more abstract models and to combine refinement style reasoning with Hoare style program verification. We use our logic to prove correctness of concrete implementations of two phase commit and single decree Paxos by showing that they refine their abstract TLA specifications. We further use our notion of refinement to transfer fairness assumptions on program executions to model traces and then transfer liveness properties of fair model traces back to program executions, which enables us to prove liveness properties such as strong eventual consistency of a concrete implementation of a Conflict Free Replicated Data Type and fair termination of a concurrent program.


A Compact Neural Network based Algorithm for Robust Image Watermarking. Digital image watermarking seeks to protect the digital media information from unauthorized access, where the message is embedded into the digital image and extracted from it, even some noises or distortions are applied under various data processing including lossy image compression and interactive content editing. Traditional image watermarking solutions easily suffer from robustness when specified with some prior constraints, while recent deep learning based watermarking methods could not tackle the information loss problem well under various separate pipelines of feature encoder and decoder. In this paper, we propose a novel digital image watermarking solution with a compact neural network, named Invertible Watermarking Network (IWN). Our IWN architecture is based on a single Invertible Neural Network (INN), this bijective propagation framework enables us to effectively solve the challenge of message embedding and extraction simultaneously, by taking them as a pair of inverse problems for each other and learning a stable invertible mapping. In order to enhance the robustness of our watermarking solution, we specifically introduce a simple but effective bit message normalization module to condense the bit message to be embedded, and a noise layer is designed to simulate various practical attacks under our IWN framework. Extensive experiments demonstrate the superiority of our solution under various distortions.


Electromagnetically induced transparency based Rydberg atom sensor for quantum voltage measurements. We investigate the Stark shift in Rydberg rubidium atoms through electromagnetically induced transparency for the measurement of direct current (dc) and 60 Hz alternating current (ac) voltages. This technique has direct applications to atom based measurements of dc and ac voltage and the calibration of voltage instrumentation. We present experimental results for different atomic states that allow for dc and ac voltage measurements ranging from 0 V to 12 V. A Rydberg atom based voltage standard could become an alternative calibration method with more favorable size, weight, power consumption, and cost compared to the more precise Josephson voltage standard. In this study, we also demonstrate how the voltage measurements can be utilized to determine the atomic polarizability for the Rydberg states. The Rydberg atom based voltage measurement technology would become a complimentary method for dissemination of the voltage scale directly to the end user.


Structural Discrimination of Phosphate Contact Ion Pairs in Water by Femtosecond 2D IR Spectroscopy. The distinct structures of contact ion pairs in water are identified. Nonlinear infrared (IR) spectroscopy and theoretical calculations allow for the separation and assignment of spectral features and interactions.


Data Driven Extract Method Recommendations A Study at ING. The sound identification of refactoring opportunities is still an open problem in software engineering. Recent studies have shown the effectiveness of machine learning models in recommending methods that should undergo different refactoring operations. In this work, we experiment with such approaches to identify methods that should undergo an Extract Method refactoring, in the context of ING, a large financial organization. More specifically, we (i) compare the code metrics distributions, which are used as features by the models, between open source and ING systems, (ii) measure the accuracy of different machine learning models in recommending Extract Method refactorings, (iii) compare the recommendations given by the models with the opinions of ING experts. Our results show that the feature distributions of ING systems and open source systems are somewhat different, that machine learning models can recommend Extract Method refactorings with high accuracy, and that experts tend to agree with most of the recommendations of the model.


HELIX Data driven characterization of Brazilian land snails. Decision support systems benefit from hidden patterns extracted from digital information. In the specific domain of gastropod characterization, morphometrical measurements support biologists in the identification of land snail specimens. Although snails can be easily identified by their excretory and reproductive systems, the after death mollusk body is commonly inaccessible because of either soft material deterioration or fossilization. This study aims at characterizing Brazilian land snails by morphometrical data features manually taken from the shells. In particular, we examined a dataset of shells by using different learning models that labeled snail specimens with a precision up to 97.5 (F1 Score .975, CKC .967 and ROC Area .998). The extracted patterns describe similarities and trends among land snail species and indicates possible outliers physiologies due to climate traits and breeding. Finally, we show some morphometrical characteristics dominate others according to different feature selection biases. Those data based patterns can be applied to fast land snail identification whenever their bodies are unavailable, as in the recurrent cases of lost shells in nature or private and museum collections.


BV Functions and Sets of Finite Perimeter on Configuration Spaces. This paper contributes to foundations of the geometric measure theory in the infinite dimensional setting of the configuration space over the Euclidean space mathbb R n equipped with the Poisson measure pi . We first provide a rigorous meaning and construction of the m codimensional Poisson measure formally written as " ( infty m) dimensional Poisson measure" on the configuration space. We then show that our construction is consistent with potential analysis by establishing the absolute continuity with respect to Bessel capacities. Secondly, we introduce three different definitions of BV functions based on the variational, relaxation and the semigroup approaches, and prove the equivalence of them. Thirdly, we construct perimeter measures and introduce the notion of the reduced boundary. We then prove that the perimeter measure can be expressed by the 1 codimensional Poisson measure restricted on the reduced boundary, which is a generalisation of De Giorgi's identity to the configuration space. Finally, we construct the total variation measures for BV functions, and prove the Gau ss Green formula.


Positivity vs. slope semistability for bundles with vanishing discriminant. We give an algebraic proof valid in arbitrary characteristic for the known equivalence between (strongly) slope semistable vector bundles with vanishing discriminant and vanishing determinant and numerically flat bundles. We also address a related question of Misra.


Unified Analysis for Variational Time Discretizations of Higher Order and Higher Regularity Applied to Non stiff ODEs. We present a unified analysis for a family of variational time discretization methods, including discontinuous Galerkin methods and continuous Galerkin Petrov methods, applied to non stiff initial value problems. Besides the well definedness of the methods, the global error and superconvergence properties are analyzed under rather weak abstract assumptions which also allow considerations of a wide variety of quadrature formulas. Numerical experiments illustrate and support the theoretical results.


Changing the Mind of Transformers for Topically Controllable Language Generation. Large Transformer based language models can aid human authors by suggesting plausible continuations of text written so far. However, current interactive writing assistants do not allow authors to guide text generation in desired topical directions. To address this limitation, we design a framework that displays multiple candidate upcoming topics, of which a user can select a subset to guide the generation. Our framework consists of two components (1) a method that produces a set of candidate topics by predicting the centers of word clusters in the possible continuations, and (2) a text generation model whose output adheres to the chosen topics. The training of both components is self supervised, using only unlabeled text. Our experiments demonstrate that our topic options are better than those of standard clustering approaches, and our framework often generates fluent sentences related to the chosen topics, as judged by automated metrics and crowdsourced workers.


Hard Choices and Hard Limits for Artificial Intelligence. Artificial intelligence (AI) is supposed to help us make better choices. Some of these choices are small, like what route to take to work, or what music to listen to. Others are big, like what treatment to administer for a disease or how long to sentence someone for a crime. If AI can assist with these big decisions, we might think it can also help with hard choices, cases where alternatives are neither better, worse nor equal but on a par. The aim of this paper, however, is to show that this view is mistaken the fact of parity shows that there are hard limits on AI in decision making and choices that AI cannot, and should not, resolve.


On the multiplication of spherical functions of reductive spherical pairs of type A. Let G be a simple complex algebraic group and let K be a reductive subgroup of G such that the coordinate ring of G K is a multiplicity free G module. We consider the G algebra structure of C G K , and study the decomposition into irreducible summands of the product of irreducible G submodules in C G K . When the spherical roots of G K generate a root system of type A we propose a conjectural decomposition rule, which relies on a conjecture of Stanley on the multiplication of Jack symmetric functions. With the exception of one case, we show that the rule holds true whenever the root system generated by the spherical roots of G K is direct sum of subsystems of rank one.


q Casimir and q cut and join operators related to Reflection Equation Algebras. In this paper we are dealing with the Reflection Equation algebra cal M (R) , associated with a GL N type Hecke symmetry R . In this algebra we define the q analogs of the partial derivatives partial j i in generators m i j of cal M (R) . The product hat L MD of two matrices M m i j and D partial i j turns out to be a generating matrix of a modified Reflection Equation algebra hat cal L (R) which is similar to the universal enveloping algebra U(gl N) in many aspects. Central elements of the modified Reflection Equation algebra give rise to q Casimir operators in a representation of hat cal L (R) in the algebra cal M (R) . We perform a spectral analysis of the first q Casimir operator and formulate a conjecture about the spectrum of the higher ones. At last, we define the normal ordering for the q differential operators and inroduce the q cut and join operators. In several explicit examples we express some of q cut and join operators via the q Casimir ones by analogy with the classical case.


Learning Speech driven 3D Conversational Gestures from Video. We propose the first approach to automatically and jointly synthesize both the synchronous 3D conversational body and hand gestures, as well as 3D face and head animations, of a virtual character from speech input. Our algorithm uses a CNN architecture that leverages the inherent correlation between facial expression and hand gestures. Synthesis of conversational body gestures is a multi modal problem since many similar gestures can plausibly accompany the same input speech. To synthesize plausible body gestures in this setting, we train a Generative Adversarial Network (GAN) based model that measures the plausibility of the generated sequences of 3D body motion when paired with the input audio features. We also contribute a new way to create a large corpus of more than 33 hours of annotated body, hand, and face data from in the wild videos of talking people. To this end, we apply state of the art monocular approaches for 3D body and hand pose estimation as well as dense 3D face performance capture to the video corpus. In this way, we can train on orders of magnitude more data than previous algorithms that resort to complex in studio motion capture solutions, and thereby train more expressive synthesis algorithms. Our experiments and user study show the state of the art quality of our speech synthesized full 3D character animations.


S property for divergence operator rm div a(z, u(z), nabla u(z)) with p( cdot) growth condition and applications. We establish a result which provides the criteria for a divergence operator dependent both on the gradient and the function itself, to satisfy the S property. The result is complemented by several examples and an application.


Branching Frequency and Markov Entropy of Repetition Free Languages. We define a new quantitative measure for an arbitrary factorial language the entropy of a random walk in the prefix tree associated with the language we call it Markov entropy. We relate Markov entropy to the growth rate of the language and to the parameters of branching of its prefix tree. We show how to compute Markov entropy for a regular language. Finally, we develop a framework for experimental study of Markov entropy by modelling random walks and present the results of experiments with power free and Abelian power free languages.


Adapting Off the Shelf Source Segmenter for Target Medical Image Segmentation. Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a labeled source domain to an unlabeled and unseen target domain, which is usually trained on data from both domains. Access to the source domain data at the adaptation stage, however, is often limited, due to data storage or privacy issues. To alleviate this, in this work, we target source free UDA for segmentation, and propose to adapt an off the shelf" segmentation model pre trained in the source domain to the target domain, with an adaptive batch wise normalization statistics adaptation framework. Specifically, the domain specific low order batch statistics, i.e., mean and variance, are gradually adapted with an exponential momentum decay scheme, while the consistency of domain shareable high order batch statistics, i.e., scaling and shifting parameters, is explicitly enforced by our optimization objective. The transferability of each channel is adaptively measured first from which to balance the contribution of each channel. Moreover, the proposed source free UDA framework is orthogonal to unsupervised learning methods, e.g., self entropy minimization, which can thus be simply added on top of our framework. Extensive experiments on the BraTS 2018 database show that our source free UDA framework outperformed existing source relaxed UDA methods for the cross subtype UDA segmentation task and yielded comparable results for the cross modality UDA segmentation task, compared with a supervised UDA methods with the source data.


A Primer on Pretrained Multilingual Language Models. Multilingual Language Models ( MLLMs) such as mBERT, XLM, XLM R, textit etc. have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero shot transfer learning, there has emerged a large body of work in (i) building bigger MLLMs covering a large number of languages (ii) creating exhaustive benchmarks covering a wider variety of tasks and languages for evaluating MLLMs (iii) analysing the performance of MLLMs on monolingual, zero shot cross lingual and bilingual tasks (iv) understanding the universal language patterns (if any) learnt by MLLMs and (v) augmenting the (often) limited capacity of MLLMs to improve their performance on seen or even unseen languages. In this survey, we review the existing literature covering the above broad areas of research pertaining to MLLMs. Based on our survey, we recommend some promising directions of future research.


A Meta model for Process Failure Mode and Effects Analysis (PFMEA). Short product lifecycles and a high variety of products force industrial manufacturing processes to change frequently. Due to the manual approach of many quality analysis techniques, they can significantly slow down adaption processes of production systems or make production unprofitable. Therefore, automating them can be a key technology for keeping pace with market demand of the future. The methodology presented here aims at a meta model supporting automation for PFMEA. The method differentiates product requirements, production steps and quality measures in such a way, that complex quality requirements can be addressed in any instance of a factory using a common meta modeling language.