Data driven Analysis for Understanding Team Sports Behaviors. Understanding the principles of real world biological multi agent behaviors is a current challenge in various scientific and engineering fields. The rules regarding the real world biological multi agent behaviors such as team sports are often largely unknown due to their inherently higher order interactions, cognition, and body dynamics. Estimation of the rules from data, i.e., data driven approaches such as machine learning, provides an effective way for the analysis of such behaviors. Although most data driven models have non linear structures and high prediction performances, it is sometimes hard to interpret them. This survey focuses on data driven analysis for quantitative understanding of invasion team sports behaviors such as basketball and football, and introduces two main approaches for understanding such multi agent behaviors (1) extracting easily interpretable features or rules from data and (2) generating and controlling behaviors in visually understandable ways. The first approach involves the visualization of learned representations and the extraction of mathematical structures behind the behaviors. The second approach can be used to test hypotheses by simulating and controlling future and counterfactual behaviors. Lastly, the potential practical applications of extracted rules, features, and generated behaviors are discussed. These approaches can contribute to a better understanding of multi agent behaviors in the real world.


Invariant systems and character sheaves for graded Lie algebras. In this paper we explain how to construct all the character sheaves for type I graded classical Lie algebras which we expect to be cuspidal. A new ingredient is the use of invariant systems of differential equations.


Amenability and Acyclicity in Bounded Cohomology Theory. Johnson's characterization of amenable groups states that a discrete group Gamma is amenable if and only if H b n geq 1 ( Gamma V) 0 for all dual normed mathbb R Gamma modules V . In this paper, we extend the previous result to homomorphisms by proving the converse of the Mapping Theorem a surjective homomorphism phi colon Gamma to K has amenable kernel H if and only if the induced inflation map H bullet b(K V H) to H bullet b( Gamma V) is an isometric isomorphism for every dual normed mathbb R Gamma module V . In addition, we obtain an analogous characterization for the (smaller) class of surjective homomorphisms phi colon Gamma to K with the property that the inflation maps in bounded cohomology are isometric isomorphisms for all normed mathbb R Gamma modules. Finally, we also prove a characterization of the (larger) class of boundedly acyclic homomorphisms phi colon Gamma to K , for which the restriction maps in bounded cohomology H bullet b(K V) to H bullet b( Gamma phi 1 V) are isomorphisms for suitable dual normed mathbb R K module V . We then extend the first and third results to spaces and obtain characterizations of amenable maps and boundedly acyclic maps in terms of the vanishing of the bounded cohomology of their homotopy fibers with respect to appropriate choices of coefficients.


Real Time and Accurate Object Detection in Compressed Video by Long Short term Feature Aggregation. Video object detection is a fundamental problem in computer vision and has a wide spectrum of applications. Based on deep networks, video object detection is actively studied for pushing the limits of detection speed and accuracy. To reduce the computation cost, we sparsely sample key frames in video and treat the rest frames are non key frames a large and deep network is used to extract features for key frames and a tiny network is used for non key frames. To enhance the features of non key frames, we propose a novel short term feature aggregation method to propagate the rich information in key frame features to non key frame features in a fast way. The fast feature aggregation is enabled by the freely available motion cues in compressed videos. Further, key frame features are also aggregated based on optical flow. The propagated deep features are then integrated with the directly extracted features for object detection. The feature extraction and feature integration parameters are optimized in an end to end manner. The proposed video object detection network is evaluated on the large scale ImageNet VID benchmark and achieves 77.2 mAP, which is on par with state of the art accuracy, at the speed of 30 FPS using a Titan X GPU. The source codes are available at url https github.com hustvl LSFA .


Linear maximum rank distance codes of exceptional type. Scattered polynomials of a given index over finite fields are intriguing rare objects with many connections within mathematics. Of particular interest are the exceptional ones, as defined in 2018 by the first author and Zhou, for which partial classification results are known. In this paper we propose a unified algebraic description of mathbb F q n linear maximum rank distance codes, introducing the notion of exceptional linear maximum rank distance codes of a given index. Such a connection naturally extends the notion of exceptionality for a scattered polynomial in the rank metric framework and provides a generalization of Moore sets in the monomial MRD context. We move towards the classification of exceptional linear MRD codes, by showing that the ones of index zero are generalized Gabidulin codes and proving that in the positive index case the code contains an exceptional scattered polynomial of the same index.


Grauert Riemenschneider multiplier ideal sheaves and the (optimal) Brian c c on Skoda number. The goal of this note is to survey some recent results on the Grauert Riemenschneider multiplier ideal sheaves on any (reduced) complex space of pure dimension. In particular, we obtain the Brian c c on Skoda number for any Noetherian ring of weakly holomorphic functions with weakly rational singularities ( emph not essentially of finite type over mathbb C and Cohen Macaulay local rings), which will partially answer a question of Huneke.


Enhance Connectivity of Promising Regions for Sampling based Path Planning. Sampling based path planning algorithms usually implement uniform sampling methods to search the state space. However, uniform sampling may lead to unnecessary exploration in many scenarios, such as the environment with a few dead ends. Our previous work proposes to use the promising region to guide the sampling process to address the issue. However, the predicted promising regions are often disconnected, which means they cannot connect the start and goal state, resulting in a lack of probabilistic completeness. This work focuses on enhancing the connectivity of predicted promising regions. Our proposed method regresses the connectivity probability of the edges in the x and y directions. In addition, it calculates the weight of the promising edges in loss to guide the neural network to pay more attention to the connectivity of the promising regions. We conduct a series of simulation experiments, and the results show that the connectivity of promising regions improves significantly. Furthermore, we analyze the effect of connectivity on sampling based path planning algorithms and conclude that connectivity plays an essential role in maintaining algorithm performance.


Lazy tournaments and multidegrees of a projective embedding of overline M 0,n . We provide a new geometric interpretation of the multidegrees of the (iterated) Kapranov embedding Phi n overline M 0,n 3 hookrightarrow mathbb P 1 times mathbb P 2 times cdots times mathbb P n , where overline M 0,n 3 is the moduli space of stable genus 0 curves with n 3 marked points. We enumerate the multidegrees by disjoint sets of boundary points of overline M 0,n 3 via a combinatorial algorithm on trivalent trees that we call a lazy tournament. These sets are compatible with the forgetting maps used to derive the recursion for the multidegrees proven in 2020 by Gillespie, Cavalieri, and Monin. The lazy tournament points are easily seen to total (2n 1)!! (2n 1) cdot (2n 3) cdots 5 cdot 3 cdot 1 , giving a natural proof of the fact that the total degree of Phi n is the odd double factorial. This fact was first proven using an insertion algorithm on certain parking functions, and we additionally give a bijection to those parking functions.


Using Game Theory to maximize the chance of victory in two player sports. Game Theory concepts have been successfully applied in a wide variety of domains over the past decade. Sports and games are one of the popular areas of game theory application owing to its merits and benefits in solving complex scenarios. With recent advancements in technology, the technical and analytical assistance available to players before the match, during game play and after the match in the form of post match analysis for any kind of sport has improved to a great extent. In this paper, we propose three novel approaches towards the development of a tool that can assist the players by providing detailed analysis of optimal decisions so that the player is well prepared with the most appropriate strategy which would produce a favourable result for a given opponent's strategy. We also describe how the system changes when we consider real time game play wherein the history of the opponent's strategies in the current rally is also taken into consideration while suggesting.


Augmented Abstractive Summarization With Document LevelSemantic Graph. Previous abstractive methods apply sequence to sequence structures to generate summary without a module to assist the system to detect vital mentions and relationships within a document. To address this problem, we utilize semantic graph to boost the generation performance. Firstly, we extract important entities from each document and then establish a graph inspired by the idea of distant supervision citep mintz etal 2009 distant . Then, we combine a Bi LSTM with a graph encoder to obtain the representation of each graph node. A novel neural decoder is presented to leverage the information of such entity graphs. Automatic and human evaluations show the effectiveness of our technique.


Analysis of voxel based 3D object detection methods efficiency for real time embedded systems. Real time detection of objects in the 3D scene is one of the tasks an autonomous agent needs to perform for understanding its surroundings. While recent Deep Learning based solutions achieve satisfactory performance, their high computational cost renders their application in real life settings in which computations need to be performed on embedded platforms intractable. In this paper, we analyze the efficiency of two popular voxel based 3D object detection methods providing a good compromise between high performance and speed based on two aspects, their ability to detect objects located at large distances from the agent and their ability to operate in real time on embedded platforms equipped with high performance GPUs. Our experiments show that these methods mostly fail to detect distant small objects due to the sparsity of the input point clouds at large distances. Moreover, models trained on near objects achieve similar or better performance compared to those trained on all objects in the scene. This means that the models learn object appearance representations mostly from near objects. Our findings suggest that a considerable part of the computations of existing methods is focused on locations of the scene that do not contribute with successful detection. This means that the methods can achieve a speed up of 40 60 by restricting operation to near objects while not sacrificing much in performance.


Multiscale Domain Adaptive YOLO for Cross Domain Object Detection. The area of domain adaptation has been instrumental in addressing the domain shift problem encountered by many applications. This problem arises due to the difference between the distributions of source data used for training in comparison with target data used during realistic testing scenarios. In this paper, we introduce a novel MultiScale Domain Adaptive YOLO (MS DAYOLO) framework that employs multiple domain adaptation paths and corresponding domain classifiers at different scales of the recently introduced YOLOv4 object detector to generate domain invariant features. We train and test our proposed method using popular datasets. Our experiments show significant improvements in object detection performance when training YOLOv4 using the proposed MS DAYOLO and when tested on target data representing challenging weather conditions for autonomous driving applications.


Underexpanded Supersonic Jet in Imposed Oscillating Condition. In the present study, a computation study is performed to investigate the effect of imposed oscillation of nozzle pressure ratio (NPR) on the flow structure in a two dimensional, axisymmetric supersonic converging nozzle. In this study, the underexpanded flow conditions are considered which are dominated by diamond shock cell structure. The computational results are well validated with the available experimental measurements. The flow is initially computed to be fully developed and then oscillations are imposed. NPR is increased from 1.6 to 2.6 and then decreased again to 1.6 and thus completes a cycle. Results showed that the external flow structure of the nozzle is dependent on the process of change of pressure ratio during the oscillation. Distinct flow structures are observed during increasing and decreasing processes of the change of pressure ratio even when the nozzle is at the same NPR. Irreversible behaviors in the locations of jet centreline axis and off axis as well as expansion, compression and neutral zones, are observed at the same NPRs during this oscillation. Further, the effect of oscillation frequency is explored on this irreversible behavior at 100 Hz, 200 Hz, 500 Hz and 1000 Hz frequencies.


Dissipative Kerr soliton microcombs for FEC free optical communications over 100 channels. The demand for high speed and highly efficient optical communication techniques has been rapidly growing due to the ever increasing volume of data traffic. As well as the digital coherent communication used for core and metro networks, intensity modulation and direct detection (IM DD) are still promising schemes in intra inter data centers thanks to their low latency, high reliability, and good cost performance. In this work, we study a microresonator based frequency comb as a potential light source for future IM DD optical systems where applications may include replacing individual stabilized lasers with a continuous laser driven microresonator. Regarding comb line powers and spectral intervals, we compare a modulation instability comb and a soliton microcomb and provide a quantitative analysis with regard to telecom applications. Our experimental demonstration achieved a forward error correction (FEC) free operation of bit error rate (BER) 10 ( 9) with a 1.45 Tbps capacity using a total of 145 lines over the entire C band and revealed the possibility of soliton microcomb based ultra dense wavelength division multiplexing (WDM) with a simple, cost effective IM DD scheme, with a view to future practical use in data centers.


Field Synthesis with Azimuthally Varying, Cascaded, Cylindrical Metasurfaces using a Wave Matrix Approach. In recent years, there has been extensive research on planar metasurfaces capable of arbitrarily controlling scattered fields. However, rigorous studies on conformal metasurfaces, such as those that are cylindrical, have been few in number likely due to their more complex geometry. Here, wave propagation in cascaded cylindrical structures consisting of layers of dielectric spacers and azimuthally varying metasurfaces (subwavelength patterned metallic claddings) is investigated. A wave matrix approach, which incorporates the advantages of both ABCD matrices and scattering matrices (S matrices), is adopted. Wave matrices are used to model the higher order coupling between metasurface layers, overcoming fabrication difficulties associated with previous works. The proposed framework provides an efficient approach to synthesize the inhomogeneous sheet admittances that realize a desired cylindrical field transformation. Design examples are reported to illustrate the power and potential applications of the proposed method in antenna design and stealth technology.


Frame Replication and Elimination for Reliability in Time Sensitive Networks. In modern applications such as in the prospective smart factory, timely and faultfree communication is one of the main concerns. Communication failures may lead to huge economic losses. Moreover, they can even endanger human life. Therefore, the TimeSensitive Networking (TSN) task group has introduced new standards for real time capable Ethernet, which also include a fault tolerance mechanism called Frame Replication and Elimination for Reliability (FRER) as IEEE standard 802.1CB. This standard introduces procedures and protocols for bridges and end stations in time sensitive networks. It also provides mechanisms for the identification and duplication of frames to enable redundant transmissions. In this paper, a simulation model is developed that implements the IEEE 802.1CB standard in OMNeT . In addition, as supplement to the standard we propose a reliability mechanism for establishing redundant paths and an error model to model transient and permanent errors. As proof of concept, we evaluate the model with different topologies under various conditions.


Galois conjugates for some family of generalized beta maps. A real number beta 1 is called an Yrrap (or Ito Sadahiro) number if the corresponding negative beta transformation defined by x mapsto 1 beta x for x in 0,1 , where y denotes the fraction part of y in mathbb R , has a finite orbit at 1 . Yrrap numbers are an analogy of Parry numbers for positive beta transformations given by x mapsto beta x for x in 0,1 , beta 1 . In this paper, we determine the closure of the set of Galois conjugates of Yrrap numbers. In addition, we show an analogy of the result to the family of piecewise linear continuous maps each of which is obtained by changing the odd numbered branches (left most one is regarded as 0 th) of the beta transformation to negative ones for beta 1 . As an application, we see that the set of Yrrap numbers which are non Parry numbers is countable. Furthermore, we show that the set of Parry numbers which are non Yrrap numbers is dense in (1, infty) .


Neural Contextual Anomaly Detection for Time Series. We introduce Neural Contextual Anomaly Detection (NCAD), a framework for anomaly detection on time series that scales seamlessly from the unsupervised to supervised setting, and is applicable to both univariate and multivariate time series. This is achieved by effectively combining recent developments in representation learning for multivariate time series, with techniques for deep anomaly detection originally developed for computer vision that we tailor to the time series setting. Our window based approach facilitates learning the boundary between normal and anomalous classes by injecting generic synthetic anomalies into the available data. Moreover, our method can effectively take advantage of all the available information, be it as domain knowledge, or as training labels in the semi supervised setting. We demonstrate empirically on standard benchmark datasets that our approach obtains a state of the art performance in these settings.


Some results about equichordal convex bodies. Let K and L be two convex bodies in mathbb R n , n geq 2 , with L subset text int , K . We say that L is an equichordal body for K if every chord of K tangent to L has length equal to a given fixed value lambda . J. Barker and D. Larman proved that if L is a ball, then K is a ball concentric with L . In this paper we prove that there exist an infinite number of closed curves, different from circles, which possess an equichordal convex body. If the dimension of the space is more than or equal to 3, then only Euclidean balls possess an equichordal convex body. We also prove some results about isoptic curves and give relations between isoptic curves and convex rotors in the plane.


Super graphs on groups, I. Let G be a finite group. A number of graphs with the vertex set G have been studied, including the power graph, enhanced power graph, and commuting graph. These graphs form a hierarchy under the inclusion of edge sets, and it is useful to study them together. In addition, several authors have considered modifying the definition of these graphs by choosing a natural equivalence relation on the group such as equality, conjugacy, or equal orders, and joining two elements if there are elements in their equivalence class that are adjacent in the original graph. In this way, we enlarge the hierarchy into a second dimension. Using the three graph types and three equivalence relations mentioned gives nine graphs, of which in general only two coincide we find conditions on the group for some other pairs to be equal. These often define interesting classes of groups, such as EPPO groups, 2 Engel groups, and Dedekind groups. We study some properties of graphs in this new hierarchy. In particular, we characterize the groups for which the graphs are complete, and in most cases, we characterize the dominant vertices (those joined to all others). Also, we give some results about universality, perfectness, and clique number. The paper ends with some open problems and suggestions for further work.


Matching forcing polynomials of constructable hexagonal systems. In this paper, we derive recurrence relations of forcing polynomials for monotonic CHS and the other is CHS with one turning.


Density estimates for the exponential functionals of fractional Brownian motion. In this note, we investigate the density of the exponential functional of the fractional Brownian motion. Based on the techniques of Malliavin's calculus, we provide a log normal upper bound for the density.


Analytic functionals for the non commutative disc algebra. The main objects of study in this paper are those functionals that are analytic in the sense that they annihilate the non commutative disc algebra. In the classical univariate case, a theorem of F. and M. Riesz implies that such functionals must be given as integration against an absolutely continuous measure on the circle. We develop generalizations of this result to the multivariate non commutative setting, upon reinterpreting the classical result. In one direction, we show that the GNS representation naturally associated to an analytic functional on the Cuntz algebra cannot have any singular summand. Following a different interpretation, we seek weak continuous extensions of analytic functionals on the free disc operator system. In contrast with the classical setting, such extensions do not always exist, and we identify the obstruction precisely in terms of the so called universal structure projection. We also apply our ideas to commutative algebras of multipliers on some complete Nevanlinna Pick function spaces.


Three dimensional stochastic numerical breast phantoms for enabling virtual imaging trials of ultrasound computed tomography. Ultrasound computed tomography (USCT) is an emerging imaging modality for breast imaging that can produce quantitative images that depict the acoustic properties of tissues. Computer simulation studies, also known as virtual imaging trials, provide researchers with an economical and convenient route to systematically explore imaging system designs and image reconstruction methods. When simulating an imaging technology intended for clinical use, it is essential to employ realistic numerical phantoms that can facilitate the objective, or task based, assessment of image quality. Moreover, when computing objective image quality measures, an ensemble of such phantoms should be employed that display the variability in anatomy and object properties that is representative of the to be imaged patient cohort. Such stochastic phantoms for clinically relevant applications of USCT are currently lacking. In this work, a methodology for producing realistic three dimensional (3D) numerical breast phantoms for enabling clinically relevant computer simulation studies of USCT breast imaging is presented. By extending and adapting an existing stochastic 3D breast phantom for use withUSCT, methods for creating ensembles of numerical acoustic breast phantoms are established. These breast phantoms will possess clinically relevant variations in breast size, composition, acoustic properties, tumor locations, and tissue textures. To demonstrate the use of the phantoms in virtual USCT studies, two brief case studies are presented that address the development and assessment of image reconstruction procedures. Examples of breast phantoms produced by use of the proposed methods and a collection of 52 sets of simulated USCT measurement data have been made open source for use in image reconstruction development


Is First Person Vision Challenging for Object Tracking?. Understanding human object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Visual tracking solutions available in the computer vision literature have significantly improved their performance in the last years for a large variety of target objects and tracking scenarios. However, despite a few previous attempts to exploit trackers in FPV applications, a methodical analysis of the performance of state of the art trackers in this domain is still missing. In this paper, we fill the gap by presenting the first systematic study of object tracking in FPV. Our study extensively analyses the performance of recent visual trackers and baseline FPV trackers with respect to different aspects and considering a new performance measure. This is achieved through TREK 150, a novel benchmark dataset composed of 150 densely annotated video sequences. Our results show that object tracking in FPV is challenging, which suggests that more research efforts should be devoted to this problem so that tracking could benefit FPV tasks.


StylePTB A Compositional Benchmark for Fine grained Controllable Text Style Transfer. Text style transfer aims to controllably generate text with targeted stylistic changes while maintaining core meaning from the source sentence constant. Many of the existing style transfer benchmarks primarily focus on individual high level semantic changes (e.g. positive to negative), which enable controllability at a high level but do not offer fine grained control involving sentence structure, emphasis, and content of the sentence. In this paper, we introduce a large scale benchmark, StylePTB, with (1) paired sentences undergoing 21 fine grained stylistic changes spanning atomic lexical, syntactic, semantic, and thematic transfers of text, as well as (2) compositions of multiple transfers which allow modeling of fine grained stylistic changes as building blocks for more complex, high level transfers. By benchmarking existing methods on StylePTB, we find that they struggle to model fine grained changes and have an even more difficult time composing multiple styles. As a result, StylePTB brings novel challenges that we hope will encourage future research in controllable text style transfer, compositional models, and learning disentangled representations. Solving these challenges would present important steps towards controllable text generation.


Domain Agnostic Clustering with Self Distillation. Recent advancements in self supervised learning have reduced the gap between supervised and unsupervised representation learning. However, most self supervised and deep clustering techniques rely heavily on data augmentation, rendering them ineffective for many learning tasks where insufficient domain knowledge exists for performing augmentation. We propose a new self distillation based algorithm for domain agnostic clustering. Our method builds upon the existing deep clustering frameworks and requires no separate student model. The proposed method outperforms existing domain agnostic (augmentation free) algorithms on CIFAR 10. We empirically demonstrate that knowledge distillation can improve unsupervised representation learning by extracting richer dark knowledge' from the model than using predicted labels alone. Preliminary experiments also suggest that self distillation improves the convergence of DeepCluster v2.


Supporting Clustering with Contrastive Learning. Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the beginning of the learning process, which poses a significant challenge for distance based clustering in achieving good separation between different categories. To this end, we propose Supporting Clustering with Contrastive Learning (SCCL) a novel framework to leverage contrastive learning to promote better separation. We assess the performance of SCCL on short text clustering and show that SCCL significantly advances the state of the art results on most benchmark datasets with 3 11 improvement on Accuracy and 4 15 improvement on Normalized Mutual Information. Furthermore, our quantitative analysis demonstrates the effectiveness of SCCL in leveraging the strengths of both bottom up instance discrimination and top down clustering to achieve better intra cluster and inter cluster distances when evaluated with the ground truth cluster labels.


Self stabilizing Multivalued Consensus in Asynchronous Crash prone Systems. The problem of multivalued consensus is fundamental in the area of fault tolerant distributed computing since it abstracts a very broad set of agreement problems in which processes have to uniformly decide on a specific value v in V, where V 1. Existing solutions (that tolerate process failures) reduce the multivalued consensus problem to the one of binary consensus, e.g., Mostefaoui Raynal Tronel and Zhang Chen. Our study aims at the design of an even more reliable solution. We do so through the lenses of self stabilization a very strong notion of fault tolerance. In addition to node and communication failures, self stabilizing algorithms can recover after the occurrence of arbitrary transient faults these faults represent any violation of the assumptions according to which the system was designed to operate (as long as the algorithm code stays intact). This work proposes the first (to the best of our knowledge) self stabilizing algorithm for multivalued consensus for asynchronous message passing systems prone to process failures and arbitrary transient faults. Our solution is also the first (to the best of our knowledge) to support wait freedom. Moreover, using piggybacking techniques, our solution can invoke n binary consensus objects concurrently. Thus, the proposed self stabilizing wait free solution can terminate using fewer resources than earlier non self stabilizing solutions by Mostefaoui, Raynal, and Tronel, which uses an unbounded number of binary consensus objects, or Zhang and Chen, which is not wait free.


Specifics of coinfection and it's dynamics. It is essential to understand the dynamics of epidemics in the presence of coexisting pathogens. There are various phenomenon that can effect the dynamics. In this paper, we formulate a mathematical model using different assumptions to capture the effect of these additional phenomena such as partial cross immunity, density dependence in each class and a role of recovered population in the dynamics. We found the basic reproduction number for each model which is the threshold that describes the invasion of disease in population. The basic reproduction number in each model shows that the persistence of disease or strains depends on the carrying capacity. In the model of this paper, we present the local stability analysis of the boundary equilibrium points and observed that the recovered population is not uniformly bounded with respect to the carrying capacity.


Data Management in Microservices State of the Practice, Challenges, and Research Directions. Microservices have become a popular architectural style for data driven applications, given their ability to functionally decompose an application into small and autonomous services to achieve scalability, strong isolation, and specialization of database systems to the workloads and data formats of each service. Despite the accelerating industrial adoption of this architectural style, an investigation of the state of the practice and challenges practitioners face regarding data management in microservices is lacking. To bridge this gap, we conducted a systematic literature review of representative articles reporting the adoption of microservices, we analyzed a set of popular open source microservice applications, and we conducted an online survey to cross validate the findings of the previous steps with the perceptions and experiences of over 120 experienced practitioners and researchers. Through this process, we were able to categorize the state of practice of data management in microservices and observe several foundational challenges that cannot be solved by software engineering practices alone, but rather require system level support to alleviate the burden imposed on practitioners. We discuss the shortcomings of state of the art database systems regarding microservices and we conclude by devising a set of features for microservice oriented database systems.


SUM A Benchmark Dataset of Semantic Urban Meshes. Recent developments in data acquisition technology allow us to collect 3D texture meshes quickly. Those can help us understand and analyse the urban environment, and as a consequence are useful for several applications like spatial analysis and urban planning. Semantic segmentation of texture meshes through deep learning methods can enhance this understanding, but it requires a lot of labelled data. The contributions of this work are threefold (1) a new benchmark dataset of semantic urban meshes, (2) a novel semi automatic annotation framework, and (3) an annotation tool for 3D meshes. In particular, our dataset covers about 4 km2 in Helsinki (Finland), with six classes, and we estimate that we save about 600 hours of labelling work using our annotation framework, which includes initial segmentation and interactive refinement. We also compare the performance of several state of theart 3D semantic segmentation methods on the new benchmark dataset. Other researchers can use our results to train their networks the dataset is publicly available, and the annotation tool is released as open source.


ZeroVL A Strong Baseline for Aligning Vision Language Representations with Limited Resources. Pioneering dual encoder pre training works (e.g., CLIP and ALIGN) have revealed the potential of aligning multi modal representations with contrastive learning. However, these works require a tremendous amount of data and computational resources (e.g., billion level web data and hundreds of GPUs), which prevent researchers with limited resources from reproduction and further exploration. To this end, we explore a stack of simple but effective heuristics, and provide a comprehensive training guidance, which allows us to conduct dual encoder multi modal representation alignment with limited resources. We provide a reproducible strong baseline of competitive results, namely ZeroVL, with only 14M publicly accessible academic datasets and 8 V100 GPUs. Additionally, we collect 100M web data for pre training, and achieve comparable or superior results than state of the art methods, further proving the effectiveness of our method on large scale data. We hope that this work will provide useful data points and experience for future research in multi modal pre training. Our code is available at https github.com zerovl ZeroVL.


A Blueprint for the Study of the Brain's Spatiotemporal Patterns. The functioning of an organ such as the brain emerges from interactions between its constituent parts. Further, this interaction is not immutable in time but rather unfolds in a succession of patterns, thereby allowing the brain to adapt to constantly changing exterior and interior milieus. This calls for a framework able to study patterned spatiotemporal interactions between components of the brain. A theoretical and methodological framework is developed to study the brain's coordination dynamics. Here we present a toolset designed to decipher the continuous dynamics of electrophysiological data and its relation to (dys ) function. Understanding the spatiotemporal organization of brain patterns and their association with behavioral, cognitive and clinically relevant variables is an important challenge for the fields of neuroscience and biologically inspired engineering. It is hoped that such a comprehensive framework will shed light not only on human behavior and the human mind but also help in understanding the growing number of pathologies that are linked to disorders of brain connectivity.


Inviscid limit of the inhomogeneous incompressible Navier Stokes equations under the weak Kolmogorov hypothesis in mathbb R 3 . In this paper, we consider the inviscid limit of inhomogeneous incompressible Navier Stokes equations under the weak Kolmogorov hypothesis in mathbb R 3 . In particular, we first deduce the Kolmogorov type hypothesis in mathbb R 3 , which yields the uniform bounds of alpha th order fractional derivatives of sqrt rho mu bf u mu in L 2 x for some alpha 0 , independent of the viscosity. The uniform bounds can provide strong convergence of sqrt rho mu bf u mu in L 2 space. This shows that the inviscid limit is a weak solution to the corresponding Euler equations.


A Stroke Detection and Discrimination Framework using Broadband Microwave Scattering on Stochastic Models With Deep Learning. Stroke poses an immense public health burden and remains among the primary causes of death and disability worldwide. Emergent therapy is often precluded by late or indeterminate times of onset before initial clinical presentation. Rapid, mobile, safe and low cost stroke detection technology remains a deeply unmet clinical need. Past studies have explored the use of microwave and other small form factor strategies for rapid stroke detection however, widespread clinical adoption remains unrealized. Here, we investigated the use of microwave scattering perturbations from ultra wide band antenna arrays to learn dielectric signatures of disease. Two deep neural networks (DNNs) were used for 1) stroke detection ("classification network"), and 2) characterization of the hemorrhage location and size ("discrimination network"). Dielectric signatures were learned on a simulated cohort of 666 hemorrhagic stroke and control subjects using 2D stochastic head models. The classification network yielded a stratified K fold stroke detection accuracy of 94.60 with standard deviation of 2.86 and an AUC of 0.996, while the discrimination network resulted in a mean squared error of 0.004 cm and 0.02 cm, for the stroke localization and size estimation, respectively. We report a novel approach to intelligent diagnostics using microwave wide band scattering information thus circumventing conventional image formation.


On K stability for Fano threefolds of rank 3 and degree 28. We show that there exists a K stable smooth Fano threefold of the Picard rank 3, the anti canonical degree 28 and the third Betti number 2.


Study of polyelectrolyte capsule electrophoresis. This paper investigates the problem of electrophoretic motion of a polyelectrolyte capsule with a porous arbitrary charged conducting shell in an electrolyte under the action of an external electric field. The corresponding boundary value problem for the velocity components and pressure in the case of small electrical potentials is analytically solved in quadratures. The solution is analyzed numerically for different values of the specific permeability of the capsule, and the thickness of the porous and the electric double layers. The minimum of electrophoretic velocity dependence on the inverse permeability of the porous layer has been found. This means that the capsule can move with the same velocity at different permeabilities of the porous shell, other conditions being equal, which is relevant for the practical use of the discovered effect. It is shown that the electrophoretic mobility decreases upon decrease in the conductivity of the material of constituting the porous layer. This means that a dielectric capsule can be used for electrophoresis as well. Moreover, its velocity will be even greater than that of a conducting capsule, all other conditions being equal.


Augmenting the User Item Graph with Textual Similarity Models. This paper introduces a simple and effective form of data augmentation for recommender systems. A paraphrase similarity model is applied to widely available textual data, such as reviews and product descriptions, yielding new semantic relations that are added to the user item graph. This increases the density of the graph without needing further labeled data. The data augmentation is evaluated on a variety of recommendation algorithms, using Euclidean, hyperbolic, and complex spaces, and over three categories of Amazon product reviews with differing characteristics. Results show that the data augmentation technique provides significant improvements to all types of models, with the most pronounced gains for knowledge graph based recommenders, particularly in cold start settings, leading to state of the art performance.


Transductive Few Shot Learning Clustering is All You Need?. We investigate a general formulation for clustering and transductive few shot learning, which integrates prototype based objectives, Laplacian regularization and supervision constraints from a few labeled data points. We propose a concave convex relaxation of the problem, and derive a computationally efficient block coordinate bound optimizer, with convergence guarantee. At each iteration,our optimizer computes independent (parallel) updates for each point to cluster assignment. Therefore, it could be trivially distributed for large scale clustering and few shot tasks. Furthermore, we provides a thorough convergence analysis based on point to set maps. Were port comprehensive clustering and few shot learning experiments over various data sets, showing that our method yields competitive performances, in term of accuracy and optimization quality, while scaling up to large problems. Using standard training on the base classes, without resorting to complex meta learning and episodic training strategies, our approach outperforms state of the art few shot methods by significant margins, across various models, settings and data sets. Surprisingly, we found that even standard clustering procedures (e.g., K means), which correspond to particular, non regularized cases of our general model, already achieve competitive performances in comparison to the state of the art in few shot learning. These surprising results point to the limitations of the current few shot benchmarks, and question the viability of a large body of convoluted few shot learning techniques in the recent literature.


Quantization of the Willmore Energy in Riemannian Manifolds. We show that the quantization of energy for Willmore spheres into closed Riemannian manifolds holds provided that the Willmore energy and the area are uniformly bounded. The analogous energy quantization result holds for Willmore surfaces of arbitrary genus, under the additional assumptions that the immersion maps weakly converge to a limiting (possibly branched, weak immersion) map from the same surface, and that the conformal structures stay in a compact domain of the moduli space.


Local Edge Dynamics and Opinion Polarization. The proliferation of social media platforms, recommender systems, and their joint societal impacts have prompted significant interest in opinion formation and evolution within social networks. In this work, we study how local dynamics in a network can drive opinion polarization. In particular, we study time evolving networks under the classic Friedkin Johnsen opinion model. Edges are iteratively added or deleted according to simple local rules, modeling decisions based on individual preferences and network recommendations. We give theoretical bounds showing how individual edge updates affect polarization, and a related measure of disagreement across edges. Via simulations on synthetic and real world graphs, we find that the presence of two simple dynamics gives rise to high polarization 1) confirmation bias i.e., the preference for nodes to connect to other nodes with similar expressed opinions and 2) friend of friend link recommendations, which encourage new connections between closely connected nodes. We also investigate the role of fixed connections which are not subject to these dynamics. We find that even a small number of fixed edges can significantly limit polarization, but still lead to multimodal opinion distributions, which may be considered polarized in a different sense.


Proceedings of the 9th International Symposium on Symbolic Computation in Software Science. This volume contains papers presented at the Ninth International Symposium on Symbolic Computation in Software Science, SCSS 2021. Symbolic Computation is the science of computing with symbolic objects (terms, formulae, programs, representations of algebraic objects, etc.). Powerful algorithms have been developed during the past decades for the major subareas of symbolic computation computer algebra and computational logic. These algorithms and methods are successfully applied in various fields, including software science, which covers a broad range of topics about software construction and analysis. Meanwhile, artificial intelligence methods and machine learning algorithms are widely used nowadays in various domains and, in particular, combined with symbolic computation. Several approaches mix artificial intelligence and symbolic methods and tools deployed over large corpora to create what is known as cognitive systems. Cognitive computing focuses on building systems that interact with humans naturally by reasoning, aiming at learning at scale. The purpose of SCSS is to promote research on theoretical and practical aspects of symbolic computation in software science, combined with modern artificial intelligence techniques. These proceedings contain the keynote paper by Bruno Buchberger and ten contributed papers. Besides, the conference program included three invited talks, nine short and work in progress papers, and a special session on computer algebra and computational logic. Due to the COVID 19 pandemic, the symposium was held completely online. It was organized by the Research Institute for Symbolic Computation (RISC) of the Johannes Kepler University Linz on September 8 10, 2021.


A Theory Driven Self Labeling Refinement Method for Contrastive Representation Learning. For an image query, unsupervised contrastive learning labels crops of the same image as positives, and other image crops as negatives. Although intuitive, such a native label assignment strategy cannot reveal the underlying semantic similarity between a query and its positives and negatives, and impairs performance, since some negatives are semantically similar to the query or even share the same semantic class as the query. In this work, we first prove that for contrastive learning, inaccurate label assignment heavily impairs its generalization for semantic instance discrimination, while accurate labels benefit its generalization. Inspired by this theory, we propose a novel self labeling refinement approach for contrastive learning. It improves the label quality via two complementary modules (i) self labeling refinery (SLR) to generate accurate labels and (ii) momentum mixup (MM) to enhance similarity between query and its positive. SLR uses a positive of a query to estimate semantic similarity between a query and its positive and negatives, and combines estimated similarity with vanilla label assignment in contrastive learning to iteratively generate more accurate and informative soft labels. We theoretically show that our SLR can exactly recover the true semantic labels of label corrupted data, and supervises networks to achieve zero prediction error on classification tasks. MM randomly combines queries and positives to increase semantic similarity between the generated virtual queries and their positives so as to improves label accuracy. Experimental results on CIFAR10, ImageNet, VOC and COCO show the effectiveness of our method. PyTorch code and model will be released online.


VieSum How Robust Are Transformer based Models on Vietnamese Summarization?. Text summarization is a challenging task within natural language processing that involves text generation from lengthy input sequences. While this task has been widely studied in English, there is very limited research on summarization for Vietnamese text. In this paper, we investigate the robustness of transformer based encoder decoder architectures for Vietnamese abstractive summarization. Leveraging transfer learning and self supervised learning, we validate the performance of the methods on two Vietnamese datasets.


Asymptotic behavior of solutions to fractional stochastic multi term differential equation systems involving non permutable matrices. In this paper, we study the exact asymptotic separation rate of two distinct solutions of Caputo stochastic multi term differential equations (Caputo SMTDEs for short). Our goal in this paper is to establish results on the global existence and uniqueness and continuity dependence of the initial values of the solutions to Caputo SMTDEs with non permutable matrices of order alpha in ( frac 1 2 ,1) and beta in (0,1) whose coefficients satisfy a standard Lipschitz condition. For this class of systems, we then show the asymptotic separation property between two different solutions of Caputo SMTDEs with a more general condition based on lambda . Also, the asymptotic separation rate for the two distinct mild solutions reveals that our asymptotic results are general.


Optimal Expansion of Business Opportunity. Any firm whose business strategy has an exposure constraint that limits its potential gain naturally considers expansion, as this can increase its exposure. We model business expansion as an enlargement of the opportunity set for business policies. However, expansion is irreversible and has an opportunity cost attached. We use the expected optimization of utility to formulate this as a novel stochastic control problem combined with an optimal stopping time, and we derive an explicit solution for exponential utility. We apply the framework to an investment and a reinsurance scenario. In the investment problem, the cost and incentives to increase the trading exposure are analyzed, while the optimal timing for an insurer to launch its reinsurance business is investigated in the reinsurance problem. Our model predicts that the additional income gained through business expansion is the key incentive for a decision to expand. Interestingly, companies may have this incentive but are likely to wait for a period of time before expanding, although situations of zero opportunity cost or specific restrictive conditions on the model parameters are exceptions to waiting. The business policy remains on the boundary of the opportunity set before expansion during the waiting period. The length of the waiting period is related to the opportunity cost, return, and risk of the expanded business.


Tait coloring and a moduli space. We associate a moduli space M(G) to a planar trivalent graph G. We proved several decomposition properties of M(G), which implies that the Euler characteristic of M(G) equals to the number of Tait colorings of G when G is bipartite. Then we interpret M(G) as a representation space of the fundamental group of G to SU(3).


Differentiable Prompt Makes Pre trained Language Models Better Few shot Learners. Large scale pre trained language models have contributed significantly to natural language processing by demonstrating remarkable abilities as few shot learners. However, their effectiveness depends mainly on scaling the model parameters and prompt design, hindering their implementation in most real world applications. This study proposes a novel pluggable, extensible, and efficient approach named DifferentiAble pRompT (DART), which can convert small language models into better few shot learners without any prompt engineering. The main principle behind this approach involves reformulating potential natural language processing tasks into the task of a pre trained language model and differentially optimizing the prompt template as well as the target label with backpropagation. Furthermore, the proposed approach can be (i) Plugged to any pre trained language models (ii) Extended to widespread classification tasks. A comprehensive evaluation of standard NLP tasks demonstrates that the proposed approach achieves a better few shot performance. Code is available in https github.com zjunlp DART.


Training Heterogeneous Features in Sequence to Sequence Tasks Latent Enhanced Multi filter Seq2Seq Model. In language processing, training data with extremely large variance may lead to difficulty of language model's convergence. It is difficult for the network parameters to adapt sentences with largely varied semantics or grammatical structures. To resolve this problem, we introduce a model that concentrates the each of the heterogeneous features in the input sentences. Build upon the encoder decoder architecture, we design a latent enhanced multi filter seq2seq model (LEMS) that analyzes the input representations by introducing a latent space transformation and clustering. The representations are extracted from the final hidden state of the encoder and lie in the latent space. A latent space transformation is applied for enhancing the quality of the representations. Thus the clustering algorithm can easily separate samples based on the features of these representations. Multiple filters are trained by the features from their corresponding clusters, the heterogeneity of the training data can be resolved accordingly. We conduct two sets of comparative experiments on semantic parsing and machine translation, using the Geo query dataset and Multi30k English French to demonstrate the enhancement our model has made respectively.


CPSeg Cluster free Panoptic Segmentation of 3D LiDAR Point Clouds. A fast and accurate panoptic segmentation system for LiDAR point clouds is crucial for autonomous driving vehicles to understand the surrounding objects and scenes. Existing approaches usually rely on proposals or clustering to segment foreground instances. As a result, they struggle to achieve real time performance. In this paper, we propose a novel real time end to end panoptic segmentation network for LiDAR point clouds, called CPSeg. In particular, CPSeg comprises a shared encoder, a dual decoder, a task aware attention module (TAM) and a cluster free instance segmentation head. TAM is designed to enforce these two decoders to learn rich task aware features for semantic and instance embedding. Moreover, CPSeg incorporates a new cluster free instance segmentation head to dynamically pillarize foreground points according to the learned embedding. Then, it acquires instance labels by finding connected pillars with a pairwise embedding comparison. Thus, the conventional proposal based or clustering based instance segmentation is transformed into a binary segmentation problem on the pairwise embedding comparison matrix. To help the network regress instance embedding, a fast and deterministic depth completion algorithm is proposed to calculate surface normal of each point cloud in real time. The proposed method is benchmarked on two large scale autonomous driving datasets, namely, SemanticKITTI and nuScenes. Notably, extensive experimental results show that CPSeg achieves the state of the art results among real time approaches on both datasets.


Regularity of Boltzmann equation with Cercignani Lampis boundary in convex domain. The Boltzmann equation is a fundamental kinetic equation that describes the dynamics of dilute gas. In this paper we study the regularity of both dynamical and steady Boltzmann equation in strictly convex domain with the Cercignani Lampis (C L) boundary condition. The C L boundary condition describes the intermediate reflection law between diffuse reflection and specular reflection via two accommodation coefficients. We construct local weighted C 1 dynamical solution using repeated interaction through the characteristic. When we assume small fluctuation to the wall temperature and accommodation coefficients, we construct weighted C 1 steady solution.


Learning to Align Sequential Actions in the Wild. State of the art methods for self supervised sequential action alignment rely on deep networks that find correspondences across videos in time. They either learn frame to frame mapping across sequences, which does not leverage temporal information, or assume monotonic alignment between each video pair, which ignores variations in the order of actions. As such, these methods are not able to deal with common real world scenarios that involve background frames or videos that contain non monotonic sequence of actions. In this paper, we propose an approach to align sequential actions in the wild that involve diverse temporal variations. To this end, we propose an approach to enforce temporal priors on the optimal transport matrix, which leverages temporal consistency, while allowing for variations in the order of actions. Our model accounts for both monotonic and non monotonic sequences and handles background frames that should not be aligned. We demonstrate that our approach consistently outperforms the state of the art in self supervised sequential action representation learning on four different benchmark datasets.


Learning who is in the market from time series market participant discovery through adversarial calibration of multi agent simulators. In electronic trading markets often only the price or volume time series, that result from interaction of multiple market participants, are directly observable. In order to test trading strategies before deploying them to real time trading, multi agent market environments calibrated so that the time series that result from interaction of simulated agents resemble historical are often used. To ensure adequate testing, one must test trading strategies in a variety of market scenarios which includes both scenarios that represent ordinary market days as well as stressed markets (most recently observed due to the beginning of COVID pandemic). In this paper, we address the problem of multi agent simulator parameter calibration to allow simulator capture characteristics of different market regimes. We propose a novel two step method to train a discriminator that is able to distinguish between "real" and "fake" price and volume time series as a part of GAN with self attention, and then utilize it within an optimization framework to tune parameters of a simulator model with known agent archetypes to represent a market scenario. We conclude with experimental results that demonstrate effectiveness of our method.


Blind Bipedal Stair Traversal via Sim to Real Reinforcement Learning. Accurate and precise terrain estimation is a difficult problem for robot locomotion in real world environments. Thus, it is useful to have systems that do not depend on accurate estimation to the point of fragility. In this paper, we explore the limits of such an approach by investigating the problem of traversing stair like terrain without any external perception or terrain models on a bipedal robot. For such blind bipedal platforms, the problem appears difficult (even for humans) due to the surprise elevation changes. Our main contribution is to show that sim to real reinforcement learning (RL) can achieve robust locomotion over stair like terrain on the bipedal robot Cassie using only proprioceptive feedback. Importantly, this only requires modifying an existing flat terrain training RL framework to include stair like terrain randomization, without any changes in reward function. To our knowledge, this is the first controller for a bipedal, human scale robot capable of reliably traversing a variety of real world stairs and other stair like disturbances using only proprioception.


On the inverse Poletskii inequality in metric spaces and prime ends. We study mappings defined in the domain of a metric space that distort the modulus of families of paths by the type of the inverse Poletskii inequality. Under certain conditions, it is proved that such mappings have a continuous extension to the boundary of the domain in terms of prime ends. Under some additional conditions, the families of such mappings are equicontinuous in the closure of the domain with respect to the space of prime ends.


Influence of a Set of Variables on a Boolean Function. The influence of a set of variables on a Boolean function has three separate definitions in the literature, the first due to Ben Or and Linial (1989), the second due to Fischer et al. (2002) and Blais (2009) and the third due to Tal (2017). The goal of the present work is to carry out a comprehensive study of the notion of influence of a set of variables on a Boolean function. To this end, we introduce a definition of this notion using the auto correlation function. A modification of the definition leads to the notion of pseudo influence. Somewhat surprisingly, it turns out that the auto correlation based definition of influence is equivalent to the definition introduced by Fischer et al. (2002) and Blais (2009) and the notion of pseudo influence is equivalent to the definition of influence considered by Tal (2017). Extensive analysis of influence and pseduo influence as well as the Ben Or and Linial notion of influence is carried out and the relations between these notions are established.


Strategic COVID 19 vaccine distribution can simultaneously elevate social utility and equity. Balancing social utility and equity in distributing limited vaccines represents a critical policy concern for protecting against the prolonged COVID 19 pandemic. What is the nature of the trade off between maximizing collective welfare and minimizing disparities between more and less privileged communities? To evaluate vaccination strategies, we propose a novel epidemic model that explicitly accounts for both demographic and mobility differences among communities and their association with heterogeneous COVID 19 risks, then calibrate it with large scale data. Using this model, we find that social utility and equity can be simultaneously improved when vaccine access is prioritized for the most disadvantaged communities, which holds even when such communities manifest considerable vaccine reluctance. Nevertheless, equity among distinct demographic features are in tension due to their complex correlation in society. We design two behavior and demography aware indices, community risk and societal harm, which capture the risks communities face and those they impose on society from not being vaccinated, to inform the design of comprehensive vaccine distribution strategies. Our study provides a framework for uniting utility and equity based considerations in vaccine distribution, and sheds light on how to balance multiple ethical values in complex settings for epidemic control.


Multi domain Polarization Switching in Hf0.5Zr0.5O2 Dielectric Stack The Role of Dielectric Thickness. We investigate the polarization switching mechanism in ferroelectric dielectric (FE DE) stacks and its dependence on the dielectric thickness (TDE). We fabricate HZO Al2O3 (FE DE) stack and experimentally demonstrate a decrease in remnant polarization and an increase in coercive voltage of the FE DE stack with an increase in TDE. Using phase field simulations, we show that an increase in TDE results in a larger number of reverse domains in the FE layer to suppress the depolarization field, which leads to a decrease in remanent polarization and an increase in coercive voltage. Further, the applied voltage driven polarization switching suggests domain nucleation dominant characteristics for low TDE, and domain wall motion induced behavior for higher TDE. In addition, we show that the hysteretic charge voltage characteristics of the FE layer in the FE DE stack exhibit a negative slope region due to the multi domain polarization switching in the FE layer. Based on our analysis, the trends in charge voltage characteristics of the FE DE stack with respect to different TDE (which are out of the scope of single domain models) can be described well with multi domain polarization switching mechanisms.


Bag of Instances Aggregation Boosts Self supervised Distillation. Recent advances in self supervised learning have experienced remarkable progress, especially for contrastive learning based methods, which regard each image as well as its augmentations as an individual class and try to distinguish them from all other images. However, due to the large quantity of exemplars, this kind of pretext task intrinsically suffers from slow convergence and is hard for optimization. This is especially true for small scale models, in which we find the performance drops dramatically comparing with its supervised counterpart. In this paper, we propose a simple but effective distillation strategy for unsupervised learning. The highlight is that the relationship among similar samples counts and can be seamlessly transferred to the student to boost the performance. Our method, termed as BINGO, which is short for Bag of InstaNces aGgregatiOn, targets at transferring the relationship learned by the teacher to the student. Here bag of instances indicates a set of similar samples constructed by the teacher and are grouped within a bag, and the goal of distillation is to aggregate compact representations over the student with respect to instances in a bag. Notably, BINGO achieves new state of the art performance on small scale models, i.e., 65.5 and 68.9 top 1 accuracies with linear evaluation on ImageNet, using ResNet 18 and ResNet 34 as the backbones respectively, surpassing baselines (52.5 and 57.4 top 1 accuracies) by a significant margin. The code is available at https github.com haohang96 bingo.


Gorenstein weak global dimension is symmetric. We study the Gorenstein weak global dimension of associative rings and its relation to the Gorenstein global dimension. In particular, we prove the conjecture that the Gorenstein weak global dimension is a left right symmetric invariant just like the (absolute) weak global dimension.


Leveraging Good Representations in Linear Contextual Bandits. The linear contextual bandit literature is mostly focused on the design of efficient learning algorithms for a given representation. However, a contextual bandit problem may admit multiple linear representations, each one with different characteristics that directly impact the regret of the learning algorithm. In particular, recent works showed that there exist "good" representations for which constant problem dependent regret can be achieved. In this paper, we first provide a systematic analysis of the different definitions of "good" representations proposed in the literature. We then propose a novel selection algorithm able to adapt to the best representation in a set of M candidates. We show that the regret is indeed never worse than the regret obtained by running LinUCB on the best representation (up to a ln M factor). As a result, our algorithm achieves constant regret whenever a "good" representation is available in the set. Furthermore, we show that the algorithm may still achieve constant regret by implicitly constructing a "good" representation, even when none of the initial representations is "good". Finally, we empirically validate our theoretical findings in a number of standard contextual bandit problems.


On the Effectiveness of Transfer Learning for Code Search. The Transformer architecture and transfer learning have marked a quantum leap in natural language processing, improving the state of the art across a range of text based tasks. This paper examines how these advancements can be applied to and improve code search. To this end, we pre train a BERT based model on combinations of natural language and source code data and evaluate it on pairs of StackOverflow question titles and code answers. Our results show that the pre trained models consistently outperform the models that were not pre trained. In cases where the model was pre trained on natural language "and" source code data, it also outperforms an information retrieval baseline based on Lucene. Also, we demonstrated that combined use of an information retrieval based approach followed by a Transformer, leads to the best results overall, especially when searching into a large search pool. Furthermore, transfer learning is particularly effective when much pre training data is available and fine tuning data is limited. We demonstrate that natural language processing models based on the Transformer architecture can be directly applied to source code analysis tasks, such as code search. With the development of Transformer models designed more specifically for dealing with source code data, we believe the results on source code analysis tasks can be further improved.


Do Transformer Modifications Transfer Across Implementations and Applications?. The research community has proposed copious modifications to the Transformer architecture since it was introduced over three years ago, relatively few of which have seen widespread adoption. In this paper, we comprehensively evaluate many of these modifications in a shared experimental setting that covers most of the common uses of the Transformer in natural language processing. Surprisingly, we find that most modifications do not meaningfully improve performance. Furthermore, most of the Transformer variants we found beneficial were either developed in the same codebase that we used or are relatively minor changes. We conjecture that performance improvements may strongly depend on implementation details and correspondingly make some recommendations for improving the generality of experimental results.


Few Shot Learning for Information Verification. Information verification is quite a challenging task, this is because many times verifying a claim can require picking pieces of information from multiple pieces of evidence which can have a hierarchy of complex semantic relations. Previously a lot of researchers have mainly focused on simply concatenating multiple evidence sentences to accept or reject claims. These approaches are limited as evidence can contain hierarchical information and dependencies. In this research, we aim to verify facts based on evidence selected from a list of articles taken from Wikipedia. Pretrained language models such as XLNET are used to generate meaningful representations and graph based attention and convolutions are used in such a way that the system requires little additional training to learn to verify facts.


SimPLE Similar Pseudo Label Exploitation for Semi Supervised Classification. A common classification task situation is where one has a large amount of data available for training, but only a small portion is annotated with class labels. The goal of semi supervised training, in this context, is to improve classification accuracy by leverage information not only from labeled data but also from a large amount of unlabeled data. Recent works have developed significant improvements by exploring the consistency constrain between differently augmented labeled and unlabeled data. Following this path, we propose a novel unsupervised objective that focuses on the less studied relationship between the high confidence unlabeled data that are similar to each other. The new proposed Pair Loss minimizes the statistical distance between high confidence pseudo labels with similarity above a certain threshold. Combining the Pair Loss with the techniques developed by the MixMatch family, our proposed SimPLE algorithm shows significant performance gains over previous algorithms on CIFAR 100 and Mini ImageNet, and is on par with the state of the art methods on CIFAR 10 and SVHN. Furthermore, SimPLE also outperforms the state of the art methods in the transfer learning setting, where models are initialized by the weights pre trained on ImageNet or DomainNet Real. The code is available at github.com zijian hu SimPLE.


Algorithmic Information Design in Multi Player Games Possibility and Limits in Singleton Congestion. Most algorithmic studies on multi agent information design so far have focused on the restricted situation with no inter agent externalities a few exceptions investigated truly strategic games such as zero sum games and second price auctions but have all focused only on optimal public signaling. This paper initiates the algorithmic information design of both emph public and emph private signaling in a fundamental class of games with negative externalities, i.e., singleton congestion games, with wide application in today's digital economy, machine scheduling, routing, etc. For both public and private signaling, we show that the optimal information design can be efficiently computed when the number of resources is a constant. To our knowledge, this is the first set of efficient emph exact algorithms for information design in succinctly representable many player games. Our results hinge on novel techniques such as developing certain reduced forms'' to compactly characterize equilibria in public signaling or to represent players' marginal beliefs in private signaling. When there are many resources, we show computational intractability results. To overcome the issue of multiple equilibria, here we introduce a new notion of equilibrium emph oblivious hardness, which rules out any possibility of computing a good signaling scheme, irrespective of the equilibrium selection rule.


Next Steps Learning a Disentangled Gait Representation for Versatile Quadruped Locomotion. Quadruped locomotion is rapidly maturing to a degree where robots now routinely traverse a variety of unstructured terrains. However, while gaits can be varied typically by selecting from a range of pre computed styles, current planners are unable to vary key gait parameters continuously while the robot is in motion. The synthesis, on the fly, of gaits with unexpected operational characteristics or even the blending of dynamic manoeuvres lies beyond the capabilities of the current state of the art. In this work we address this limitation by learning a latent space capturing the key stance phases of a particular gait, via a generative model trained on a single trot style. This encourages disentanglement such that application of a drive signal to a single dimension of the latent state induces holistic plans synthesising a continuous variety of trot styles. In fact properties of this drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework. We evaluate our approach on a real ANYmal quadruped robot and demonstrate that our method achieves a continuous blend of dynamic trot styles whilst being robust and reactive to external perturbations.


Custom Object Detection via Multi Camera Self Supervised Learning. This paper proposes MCSSL, a self supervised learning approach for building custom object detection models in multi camera networks. MCSSL associates bounding boxes between cameras with overlapping fields of view by leveraging epipolar geometry and state of the art tracking and reID algorithms, and prudently generates two sets of pseudo labels to fine tune backbone and detection networks respectively in an object detection model. To train effectively on pseudo labels,a powerful reID like pretext task with consistency loss is constructed for model customization. Our evaluation shows that compared with legacy selftraining methods, MCSSL improves average mAP by 5.44 and 6.76 on WildTrack and CityFlow dataset, respectively.


Quadratic Chabauty for modular curves Algorithms and examples. We describe how the quadratic Chabauty method may be applied to explicitly determine the set of rational points on modular curves of genus g 1 whose Jacobians have Mordell Weil rank g . This extends our previous work on the split Cartan curve of level 13 and allows us to consider modular curves that may have few known rational points or nontrivial local height contributions at primes of bad reduction. We illustrate our algorithms with a number of examples where we determine the set of rational points on several modular curves of genus 2 and 3 this includes Atkin Lehner quotients X 0 (N) of prime level N , the curve X S 4 (13) , as well as a few other curves relevant to Mazur's Program B. We also describe the computation of rational points on the genus 6 non split Cartan modular curve X textrm ns (17) .


The rank of a CM elliptic curve and a recurrence formula. Let p be a prime number and E p denote the elliptic curve y 2 x 3 px . It is known that for p which is congruent to 1, 9 modulo 16 , the rank of E p over mathbb Q is equal to 0, 2 . Under the condition that the Birch and Swinnerton Dyer conjecture is true, we give a necessary and sufficient condition that the rank is 2 in terms of the constant term of some polynomial that is defined by a recurrence formula.


Optimization on Planning of Trajectory and Control of Autonomous Berthing and Unberthing for the Realistic Port Geometry. To realize autonomous shipping, autonomous berthing and unberthing are some of the technical challenges. In the past, numerous research have been done on the optimization of trajectory planning of berthing problems. However, these studies assumed only a simple berth and did not consider obstacles. Optimization of trajectory planning on berthing and unberthing in actual ports must consider the spatial constraints and maintain sufficient distance to obstacles. The main contributions of this study are as follows (i) a collision avoidance algorithm based on the ship domain which has variable size by the ship speed is proposed, to include the spatial constraints to optimization (ii) the effect of wind disturbance is taken into account to the trajectory planning to make a feasible trajectory based on the capacity limit of actuators (iii) showing that the optimization method for berthing is also eligible for the unberthing, which has been almost neglected (iv) waypoints are included to the optimization process, to make optimization easier on practical applications. The authors tested the proposed method on two existing ports. The proposed method performed well on both the berthing and the unberthing problem and optimized the control input and the trajectory while avoiding collision with the complex obstacles.


Distributed Symbolic Execution using Test Depth Partitioning. Symbolic execution is a classic technique for systematic bug finding, which has seen many applications in recent years but remains hard to scale. Recent work introduced ranged symbolic execution to distribute the symbolic execution task among different workers with minimal communication overhead using test inputs. However, each worker was restricted to perform only a depth first search. This paper introduces a new approach to ranging, called test depth partitioning, that allows the workers to employ different search strategies without compromising the completeness of the overall search. Experimental results show that the proposed approach provides a more flexible ranging solution for distributed symbolic execution. The core idea behind test depth partitioning is to use a test depth pair to define a region in the execution space. Such a pair represents a partial path or a prefix, and it obviates the need for complete tests to determine boundaries as was the case in the previous ranging scheme. Moreover, different workers have the freedom to select the search strategy of choice without affecting the functioning of the overall system. Test depth partitioning is implemented using KLEE, a well known symbolic execution tool. The preliminary results show that the proposed scheme can prove to be an efficient tool to speed up symbolic execution.


Low Rank Approximation in Simulations of Quantum Algorithms. Simulating quantum algorithms on classical computers is challenging when the system size, i.e., the number of qubits used in the quantum algorithm, is moderately large. However, some quantum algorithms and the corresponding quantum circuits can be simulated efficiently on a classical computer if the input quantum state is a low rank tensor and all intermediate states of the quantum algorithm can be represented or approximated by low rank tensors. In this paper, we examine the possibility of simulating a few quantum algorithms by using low rank canonical polyadic (CP) decomposition to represent the input and all intermediate states of these algorithms. Two rank reduction algorithms are used to enable efficient simulation. We show that some of the algorithms preserve the low rank structure of the input state and can thus be efficiently simulated on a classical computer. However, the rank of the intermediate states in other quantum algorithms can increase rapidly, making efficient simulation more difficult. To some extent, such difficulty reflects the advantage or superiority of a quantum computer over a classical computer. As a result, understanding the low rank structure of a quantum algorithm allows us to identify algorithms that can benefit significantly from quantum computers.


Zero Shot Learning Based on Knowledge Sharing. Zero Shot Learning (ZSL) is an emerging research that aims to solve the classification problems with very few training data. The present works on ZSL mainly focus on the mapping of learning semantic space to visual space. It encounters many challenges that obstruct the progress of ZSL research. First, the representation of the semantic feature is inadequate to represent all features of the categories. Second, the domain drift problem still exists during the transfer from semantic space to visual space. In this paper, we introduce knowledge sharing (KS) to enrich the representation of semantic features. Based on KS, we apply a generative adversarial network to generate pseudo visual features from semantic features that are very close to the real visual features. Abundant experimental results from two benchmark datasets of ZSL show that the proposed approach has a consistent improvement.


Neural to Tree Policy Distillation with Policy Improvement Criterion. While deep reinforcement learning has achieved promising results in challenging decision making tasks, the main bones of its success deep neural networks are mostly black boxes. A feasible way to gain insight into a black box model is to distill it into an interpretable model such as a decision tree, which consists of if then rules and is easy to grasp and be verified. However, the traditional model distillation is usually a supervised learning task under a stationary data distribution assumption, which is violated in reinforcement learning. Therefore, a typical policy distillation that clones model behaviors with even a small error could bring a data distribution shift, resulting in an unsatisfied distilled policy model with low fidelity or low performance. In this paper, we propose to address this issue by changing the distillation objective from behavior cloning to maximizing an advantage evaluation. The novel distillation objective maximizes an approximated cumulative reward and focuses more on disastrous behaviors in critical states, which controls the data shift effect. We evaluate our method on several Gym tasks, a commercial fight game, and a self driving car simulator. The empirical results show that the proposed method can preserve a higher cumulative reward than behavior cloning and learn a more consistent policy to the original one. Moreover, by examining the extracted rules from the distilled decision trees, we demonstrate that the proposed method delivers reasonable and robust decisions.


Counting Hyperbolic Components in the Main Molecule. We count the number of hyperbolic components of period n that lie on the main molecule of the Mandelbrot set. We give a formula for how to compute the number of these hyperbolic components of period n in terms of the divisors of n and in the prime power case, an explicit formula is derived.


Two pointsets in mathrm PG (2,q n) and the associated codes. In this paper we consider two pointsets in mathrm PG (2,q n) arising from a linear set L of rank n contained in a line of mathrm PG (2,q n) the first one is a linear blocking set of R 'edei type, the second one extends the construction of translation KM arcs. We point out that their intersections pattern with lines is related to the weight distribution of the considered linear set L . We then consider the Hamming metric codes associated with both these constructions, for which we can completely describe their weight distributions. By choosing L to be an mathbb F q linear set with a short weight distribution, then the associated codes have few weights. We conclude the paper by providing a connection between the Gamma mathrm L class of L and the number of inequivalent codes we can construct starting from it.


Multimodal Transportation with Ridesharing of Personal Vehicles. Many public transportation systems are unable to keep up with growing passenger demand as the population grows in urban areas. The slow or lack of improvements for public transportation pushes people to use private transportation modes, such as carpooling and ridesharing. However, the occupancy rate of personal vehicles has been dropping in many cities. In this paper, we describe a centralized transit system that integrates public transit and ridesharing, which matches drivers and transit riders such that the riders would result in shorter travel time using both transit and ridesharing. The optimization goal of the system is to assign as many riders to drivers as possible for ridesharing. We give an exact approach and approximation algorithms to achieve the optimization goal. As a case study, we conduct an extensive computational study to show the effectiveness of the transit system for different approximation algorithms, based on the real world traffic data in Chicago City the data sets include both public transit and ridesharing trip information. The experiment results show that our system is able to assign more than 60 of riders to drivers, leading to a substantial increase in occupancy rate of personal vehicles and reducing riders' travel time.


Towards More Efficient Federated Learning with Better Optimization Objects. Federated Learning (FL) is a privacy protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity of edge node data, which will slow down the convergence speed and degrade the performance of the model. For the above problems, a representative solution is to add additional constraints in the local training, such as FedProx, FedCurv and FedCL. However, the above algorithms still have room for improvement. We propose to use the aggregation of all models obtained in the past as new constraint target to further improve the performance of such algorithms. Experiments in various settings demonstrate that our method significantly improves the convergence speed and performance of the model.


Landau and Ramanujan approximations for divisor sums and coefficients of cusp forms. In 1961, Rankin determined the asymptotic behavior of the number S k,q (x) of positive integers n le x for which a given prime q does not divide sigma k(n), the k th divisor sum function. By computing the associated Euler Kronecker constant gamma k,q , which depends on the arithmetic of certain subfields of mathbb Q( zeta q) , we obtain the second order term in the asymptotic expansion of S k,q (x). Using a method developed by Ford, Luca and Moree (2014), we determine the pairs (k,q) with (k, q 1) 1 for which Ramanujan's approximation to S k,q (x) is better than Landau's. This entails checking whether gamma k,q 1 2 or not, and requires a substantial computational number theoretic input and extensive computer usage. We apply our results to study the non divisibility of Fourier coefficients of six cusp forms by certain exceptional primes, extending the earlier work of Moree (2004), who disproved several claims made by Ramanujan on the non divisibility of the Ramanujan tau function by five such exceptional primes.


Fog computing state of the art concept and classification of platforms to support distributed computing systems. As the Internet of Things (IoT) becomes a part of our daily life, there is a rapid growth in connected devices. A well established approach based on cloud computing technologies cannot provide the necessary quality of service in such an environment, particularly in terms of reducing data latency. Today, fog computing technology is seen as a novel approach for processing large amounts of critical and time sensitive data. This article reviews cloud computing technology and analyzes the prerequisites for the evolution of this approach and the emergence of the concept of fog computing. As part of an overview of the critical features of fog computing, we analyze the frequent confusion of the concepts of fog and edge computing. We provide an overview of fog computing technologies virtualization, containerization, orchestration, scalability, parallel computing environments, as well as a systematic analysis of the most popular platforms that support fog computing. As a result of the analysis, we offer two approaches to classification of the fog computing platforms by the principle of openness closure of components and a three level classification based on the provided platform functionality (Deploy , Platform and Ecosystem as a Service).


Failure Aware Semi Centralized Virtual Network Embedding in Cloud Computing Fat Tree Data Center Networks. In Cloud Computing, the tenants opting for the Infrastructure as a Service (IaaS) send the resource requirements to the Cloud Service Provider (CSP) in the form of Virtual Network (VN) consisting of a set of inter connected Virtual Machines (VM). Embedding the VN onto the existing physical network is known as Virtual Network Embedding (VNE) problem. One of the major research challenges is to allocate the physical resources such that the failure of the physical resources would bring less impact onto the users' service. Additionally, the major challenge is to handle the embedding process of growing number of incoming users' VNs from the algorithm design point of view. Considering both of the above mentioned research issues, a novel Failure aware Semi Centralized VNE (FSC VNE) algorithm is proposed for the Fat Tree data center network with the goal to reduce the impact of the resource failure onto the existing users. The impact of failure of the Physical Machines (PMs), physical links and network devices are taken into account while allocating the resources to the users. The beauty of the proposed algorithm is that the VMs are assigned to different PMs in a semi centralized manner. In other words, the embedding algorithm is executed by multiple physical servers in order to concurrently embed the VMs of a VN and reduces the embedding time. Extensive simulation results show that the proposed algorithm can outperform over other VNE algorithms.


The symmetric Kazdan Warner problem and applications. After R. Schoen completed the solution of the Yamabe problem, compact manifolds could be allocated in three classes depending on whether they admit a metric with positive, non negative or only negative scalar curvature. Here we follow Yamabe's first attempt to solve his problem through variational methods and provide an analogous equivalent classification for manifolds equipped with actions by non discrete compact Lie groups. Moreover, we apply the method, and the results to classify total spaces of fibre bundles with compact structure groups (concerning scalar curvature), to conclude density results, and compare realizable scalar curvature functions between some exotic manifolds their standard counterpart. We also provide an extended range of prescribed scalar curvature functions of warped products, especially with Calabi Yau manifolds.


End to end Speech Translation via Cross modal Progressive Training. End to end speech translation models have become a new trend in research due to their potential of reducing error propagation. However, these models still suffer from the challenge of data scarcity. How to effectively use unlabeled or other parallel corpora from machine translation is promising but still an open problem. In this paper, we propose Cross Speech Text Network (XSTNet), an end to end model for speech to text translation. XSTNet takes both speech and text as input and outputs both transcription and translation text. The model benefits from its three key design aspects a self supervised pre trained sub network as the audio encoder, a multi task training objective to exploit additional parallel bilingual text, and a progressive training procedure. We evaluate the performance of XSTNet and baselines on the MuST C En X and LibriSpeech En Fr datasets. In particular, XSTNet achieves state of the art results on all language directions with an average BLEU of 28.8, outperforming the previous best method by 3.2 BLEU. Code, models, cases, and more detailed analysis are available at https github.com ReneeYe XSTNet.


NAAS Neural Accelerator Architecture Search. Data driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper parameters while neglect searching the PE connectivities and compiler mappings. To tackle this challenge, we propose Neural Accelerator Architecture Search (NAAS) which holistically searches the neural network architecture, accelerator architecture, and compiler mapping in one optimization loop. NAAS composes highly matched architectures together with efficient mapping. As a data driven approach, NAAS rivals the human design Eyeriss by 4.4x EDP reduction with 2.7 accuracy improvement on ImageNet under the same computation resource, and offers 1.4x to 3.5x EDP reduction than only sizing the architectural hyper parameters.


Lesion characterization using spectral mammography. We present a novel method for characterizing mammographic findings using spectral imaging without the use of contrast agent. Within a statistical framework, suspicious findings are analyzed to determine if they are likely to be benign cystic lesions or malignant tissue. To evaluate the method, we have designed a phantom where combinations of different tissue types are realized by decomposition into the material bases aluminum and polyethylene. The results indicate that the lesion size limit for reliable characterization is below 10 mm diameter, when quantum noise is the only considered source of uncertainty. Furthermore, preliminary results using clinical images are encouraging, but allow no conclusions with significance.


Renormalised singular stochastic PDEs. Extended decorations on naturally decorated trees were introduced in the work of Bruned, Hairer and Zambotti on algebraic renormalization of regularity structures to provide a convenient framework for the renormalization of systems of singular stochastic PDEs within that setting. This non dynamical feature of the trees complicated the analysis of the dynamical counterpart of the renormalization process. We provide a new proof of the renormalized system by passing the use of extended decorations and working for a large class of renormalization maps, with the BPHZ renormalization as a special case. The proof reveals important algebraic properties connected to preparation maps.


Casting exploit analysis as a Weird Machine reconstruction problem. Exploits constitute malware in the form of application inputs. They take advantage of security vulnerabilities inside programs in order to yield execution control to attackers. The root cause of successful exploitation lies in emergent functionality introduced when programs are compiled and loaded in memory for execution, called Weird Machines' (WMs). Essentially WMs are unexpected virtual machines that execute attackers' bytecode, complicating malware analysis whenever the bytecode set is unknown. We take the direction that WM bytecode is best understood at the level of the process memory layout attained by exploit execution. Each step building towards this memory layout comprises an exploit primitive, an exploit's basic building block. This work presents a WM reconstruction algorithm that works by identifying pre defined exploit primitive related behaviour during the dynamic analysis of target binaries, associating it with the responsible exploit segment the WM bytecode. In this manner any analyst familiar with exploit programming will immediately recognise the reconstructed WM bytecode's semantics. This work is a first attempt at studying the feasibility of this method and focuses on web browsers when targeted by JavaScript exploits.