DQ SGD Dynamic Quantization in SGD for Communication Efficient Distributed Learning. Gradient quantization is an emerging technique in reducing communication costs in distributed learning. Existing gradient quantization algorithms often rely on engineering heuristics or empirical observations, lacking a systematic approach to dynamically quantize gradients. This paper addresses this issue by proposing a novel dynamically quantized SGD (DQ SGD) framework, enabling us to dynamically adjust the quantization scheme for each gradient descent step by exploring the trade off between communication cost and convergence error. We derive an upper bound, tight in some cases, of the convergence error for a restricted family of quantization schemes and loss functions. We design our DQ SGD algorithm via minimizing the communication cost under the convergence error constraints. Finally, through extensive experiments on large scale natural language processing and computer vision tasks on AG News, CIFAR 10, and CIFAR 100 datasets, we demonstrate that our quantization scheme achieves better tradeoffs between the communication cost and learning performance than other state of the art gradient quantization methods.


Contrained Generalization For Data Anonymization A Systematic Search Based Approach. Data generalization is a powerful technique for sanitizing multi attribute data for publication. In a multidimensional model, a subset of attributes called the quasi identifiers (QI) are used to define the space and a generalization scheme corresponds to a partitioning of the data space. The process of sanitization can be modeled as a constrained optimization problem where the information loss metric is to be minimized while ensuring that the privacy criteria are enforced. The privacy requirements translate into constraints on the partitions (bins), like minimum occupancy constraints for k anonymity, value diversity constraint for l diversity etc. Most algorithms proposed till date use some greedy search heuristic to search for a locally optimal generalization scheme. The performance of such algorithms degrade rapidly as the constraints are made more complex and numerous. To address this issue, in this paper we develop a complete enumeration based systematic search framework that searches for the globally optimal generalization scheme amongst all feasible candidates. We employ a novel enumeration technique that eliminates duplicates and develop effective pruning heuristics that cut down the solution space in order to make the search tractable. Our scheme is versatile enough to accommodate multiple constraints and information loss functions satisfying a set of generic properties (that are usually satisfied by most metrics proposed in literature). Additionally, our approach allows the user to specify various stopping criteria and can give a bound on the approximation factor achieved by any candidate solution. Finally, we carry out extensive experimentation whose results illustrate the power of our algorithm and its advantage over other competing approaches.


Composable Augmentation Encoding for Video Representation Learning. We focus on contrastive methods for self supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data instances as negatives. These methods implicitly assume a set of representational invariances to the view selection mechanism (eg, sampling frames with temporal shifts), which may lead to poor performance on downstream tasks which violate these invariances (fine grained video action recognition that would benefit from temporal information). To overcome this limitation, we propose an 'augmentation aware' contrastive learning framework, where we explicitly provide a sequence of augmentation parameterisations (such as the values of the time shifts used to create data views) as composable augmentation encodings (CATE) to our model when projecting the video representations for contrastive learning. We show that representations learned by our method encode valuable information about specified spatial or temporal augmentation, and in doing so also achieve state of the art performance on a number of video benchmarks.


Deep Neural Networks for the Assessment of Surgical Skills A Systematic Review. Surgical training in medical school residency programs has followed the apprenticeship model. The learning and assessment process is inherently subjective and time consuming. Thus, there is a need for objective methods to assess surgical skills. Here, we use the Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) guidelines to systematically survey the literature on the use of Deep Neural Networks for automated and objective surgical skill assessment, with a focus on kinematic data as putative markers of surgical competency. There is considerable recent interest in deep neural networks (DNN) due to the availability of powerful algorithms, multiple datasets, some of which are publicly available, as well as efficient computational hardware to train and host them. We have reviewed 530 papers, of which we selected 25 for this systematic review. Based on this review, we concluded that DNNs are powerful tools for automated, objective surgical skill assessment using both kinematic and video data. The field would benefit from large, publicly available, annotated datasets that are representative of the surgical trainee and expert demographics and multimodal data beyond kinematics and videos.


Cubic regularization methods with second order complexity guarantee based on a new subproblem reformulation. The cubic regularization (CR) algorithm has attracted a lot of attentions in the literature in recent years. We propose a new reformulation of the cubic regularization subproblem. The reformulation is an unconstrained convex problem that requires computing the minimum eigenvalue of the Hessian. Then based on this reformulation, we derive a variant of the (non adaptive) CR provided a known Lipschitz constant for the Hessian and a variant of adaptive regularization with cubics (ARC). We show that the iteration complexity of our variants matches the best known bounds for unconstrained minimization algorithms using first and second order information. Moreover, we show that the operation complexity of both of our variants also matches the state of the art bounds in the literature. Numerical experiments on test problems from CUTEst collection show that the ARC based on our new subproblem reformulation is comparable to existing algorithms.


Approximation of Discontinuous Signals by Exponential Sampling Series. We analyse the behaviour of the exponential sampling series S w chi f at jump discontinuity of the bounded signal f. We obtain a representation lemma that is used for analysing the series S w chi f and we establish approximation of jump discontinuity functions by the series S w chi f. The rate of approximation of the exponential sampling series S w chi f is obtained in terms of logarithmic modulus of continuity of functions and the round off and time jitter errors are also studied. Finally we give some graphical representation of approximation of discontinuous functions by S w chi f using suitable kernels.


Heteroclinic units acting as pacemakers Entrained dynamics for cognitive processes. Heteroclinic dynamics is a suitable framework for describing transient and reproducible dynamics such as cognitive processes in the brain. We demonstrate how heteroclinic units can act as pacemakers to entrain larger sets of units from a resting state to hierarchical heteroclinic motion as is observed in brain dynamics. An example is fast oscillations modulated by slow oscillations. The entrainment range depends on the type of coupling, the spatial location of the pacemaker and the individual bifurcation parameters of the pacemaker and the driven units. Noise as well as a small back coupling to the pacemaker facilitate synchronization. Units can be synchronously entrained to different temporal patterns, depending on the selected path in the hierarchical heteroclinic network. Such patterns are believed to code information in brain dynamics. Depending on the number and location of pacemakers on two dimensional grids, synchronization can be maintained in the presence of a large number of resting state units and mediated via target waves when the pacemakers are concentrated to a small area of such grids. In view of brain dynamics, our results indicate a possibly ample repertoire for coding information in temporal patterns, produced by sets of synchronized units entrained by pacemakers, without finetuning of the parameters, and distributed in space.


Large deviations principles of sample paths and invariant measures of numerical methods for parabolic SPDEs. For parabolic stochastic partial differential equations (SPDEs), we show that the numerical methods, including the spatial spectral Galerkin method and further the full discretization via the temporal accelerated exponential Euler method, satisfy the uniform sample path large deviations. Combining the exponential tail estimate of invariant measures, we establish the large deviations principles (LDPs) of invariant measures of these numerical methods. Based on the error estimate between the rate function of the considered numerical methods and that of the original equation, we prove that these numerical methods can weakly asymptotically preserve the LDPs of sample paths and invariant measures of the original equation. This work provides an approach to proving the weakly asymptotical preservation for the above two LDPs for SPDEs with small noise via numerical methods, by means of the minimization sequences.


On moments of downward passage times for spectrally negative L 'evy processes. The existence of moments of first downward passage times of a spectrally negative L 'evy process is governed by the general dynamics of the L 'evy process, i.e. whether the L 'evy process is drifting to infty , infty or oscillates. Whenever the L 'evy process drifts to infty , we prove that the kappa th moment of the first passage time (conditioned to be finite) exists if and only if the ( kappa 1) th moment of the L 'evy jump measure exists. This generalises a result shown earlier by Delbaen for Cram 'er Lundberg risk processes cite Delbaen1990 . Whenever the L 'evy process drifts to infty , we prove that all moments of the first passage time exist, while for an oscillating L 'evy process we derive conditions for non existence of the moments and in particular we show that no integer moments exist.


A computational theory for the production of limb movements. Motor control is a fundamental process that underlies all voluntary behavioral responses. Several different theories based on different principles (task dynamics, equilibrium point theory, passive motion paradigm, active inference, optimal control) account for specific aspects of how actions are produced, but fail to provide a unified view on this problem. Here we propose a concise theory of motor control based on three principles optimal feedback control, control with a receding time horizon, and task representation by a series of via points updated at fixed frequency. By construction, the theory provides a suitable solution to the degrees of freedom problem, i.e. trajectory formation in the presence of redundancies and noise. We show through computer simulations that the theory also explains the production of discrete, continuous, rhythmic and temporally constrained movements, and their parametric and statistical properties (scaling laws, power laws, speed accuracy tradeoffs). The theory has no free parameters and only limited variations in its implementation details and in the nature of noise are necessary to guarantee its explanatory power.


Boundary and interface conditions in the relaxed micromorphic model exploring finite size metastructures for elastic wave control. In this paper, we establish well posed boundary and interface conditions for the relaxed micromorphic model that are able to unveil the scattering response of fully finite size metamaterials' samples. The resulting relaxed micromorphic boundary value problem is implemented in finite element simulations describing the scattering of a square metamaterial's sample whose side counts 9 unit cells. The results are validated against a direct finite element simulation encoding all the details of the underlying metamaterial's microstructure. The relaxed micromorphic model can recover the scattering metamaterial's behavior for a wide range of frequencies and for all possible angles of incidence, thus showing that it is suitable to describe dynamic anisotropy. Finally, thanks to the model's computational performances, we can design a metastructure combining metamaterials and classical materials in such a way that it acts as a protection device while providing energy focusing in specific collection points. These results open important perspectives for the short term design of sustainable structures that can control elastic waves and recover energy.


Modular properties of elliptic algebras. Fix a pair of relatively prime integers n k ge 1 , and a point ( eta , , tau) in mathbb C times mathbb H , where mathbb H denotes the upper half complex plane, and let a ,b choose c , d in mathrm SL (2, mathbb Z ) . We show that Feigin and Odesskii's elliptic algebras Q n,k ( eta , , tau) have the property Q n,k big( frac eta c tau d , big vert , frac a tau b c tau d big) cong Q n,k ( eta , , tau) . As a consequence, given a pair (E, xi) consisting of a complex elliptic curve E and a point xi in E , one may unambiguously define Q n,k (E, xi) Q n,k ( eta , , tau) where tau in mathbb H is any point such that mathbb C mathbb Z mathbb Z tau cong E and eta in mathbb C is any point whose image in E is xi . This justifies Feigin and Odesskii's notation Q n,k (E, xi) for their algebras.


Distributed Optimization using Heterogeneous Compute Systems. Hardware compute power has been growing at an unprecedented rate in recent years. The utilization of such advancements plays a key role in producing better results in less time both in academia and industry. However, merging the existing hardware with the latest hardware within the same ecosystem poses a challenging task. One of the key challenges, in this case, is varying compute power. In this paper, we consider the training of deep neural networks on a distributed system of workers with varying compute power. A naive implementation of synchronous distributed training will result in the faster workers waiting for the slowest worker to complete processing. To mitigate this issue, we propose to dynamically adjust the data assigned for each worker during the training. We assign each worker a partition of total data proportional to its computing power. Our experiments show that dynamically adjusting the data partition helps to improve the utilization of the system and significantly reduces the time taken for training. Code is available at the repository url https github.com vineeths96 Heterogeneous Systems .


On derivatives of Kato's Euler system and the Mazur Tate Conjecture. We provide a new interpretation of the Mazur Tate Conjecture and then use it to obtain the first (unconditional) theoretical evidence in support of the conjecture for elliptic curves of strictly positive rank.


PhotoChat A Human Human Dialogue Dataset with Photo Sharing Behavior for Joint Image Text Modeling. We present a new human human dialogue dataset PhotoChat, the first dataset that casts light on the photo sharing behavior in onlin emessaging. PhotoChat contains 12k dialogues, each of which is paired with a user photo that is shared during the conversation. Based on this dataset, we propose two tasks to facilitate research on image text modeling a photo sharing intent prediction task that predicts whether one intends to share a photo in the next conversation turn, and a photo retrieval task that retrieves the most relevant photo according to the dialogue context. In addition, for both tasks, we provide baseline models using the state of the art models and report their benchmark performances. The best image retrieval model achieves 10.4 recall 1 (out of 1000 candidates) and the best photo intent prediction model achieves 58.1 F1 score, indicating that the dataset presents interesting yet challenging real world problems. We are releasing PhotoChat to facilitate future research work among the community.


A unified half integral Erd H o s P ' o sa theorem for cycles in graphs labelled by multiple abelian groups. Erd H o s and P ' o sa proved in 1965 that there is a duality between the maximum size of a packing of cycles and the minimum size of a vertex set hitting all cycles. Such a duality does not hold if we restrict to odd cycles. However, in 1999, Reed proved an analogue for odd cycles by relaxing packing to half integral packing. We prove a far reaching generalisation of the theorem of Reed if the edges of a graph are labelled by finitely many abelian groups, then there is a duality between the maximum size of a half integral packing of cycles whose values avoid a fixed finite set for each abelian group and the minimum size of a vertex set hitting all such cycles. A multitude of natural properties of cycles can be encoded in this setting, for example cycles of length at least ell , cycles of length p modulo q , cycles intersecting a prescribed set of vertices at least t times, and cycles contained in given mathbb Z 2 homology classes in a graph embedded on a fixed surface. Our main result allows us to prove a duality theorem for cycles satisfying a fixed set of finitely many such properties.


Socially acceptable route planning and trajectory behavior analysis of personal mobility device for mobility management with improved sensing. In urban cities, with increasing acceptability of shared spaces used by pedestrians and personal mobility devices (PMDs), there is need for pragmatic socially ac ceptable path planning and navigation management policies. Hence, we propose a socially acceptable global route planner and assess the legibility of the resulting global route. Our approach proposed for choosing global route avoids streets penetrating shared spaces and main routes with high probability of dense usage. The experimental study shows that socially acceptable routes can be effectively found with an average of 10 increment of route length with optimal hyperpa rameters. This helps PMDs to reach the goal while taking a socially acceptable and safe route with minimal interaction of different PMDs and pedestrians. When PMDs interact with pedestrians and other types of PMDs in shared spaces, mi cro mobility simulations are of prime usage for acceptable and safe navigation policy. Social force models being state of the art for pedestrian simulation are cal ibrated for capturing random movements of pedestrian behavior. Social force model with calibration can imitate the required behavior of PMDs in a pedestrian mix navigation scheme. Based on calibrated models, simulations on shared space links and gate structures are performed to assist policies related to deciding wait ing and stopping time. Also, based on simulated PMDs interaction with pedestri ans, location data with finer resolution can be obtained if the resolution of GPS sensor is 0.2 m or less. This will help in formalizing better modelling and hence better micro mobility policies.


Indian Kidney Exchange Program A Game Theoretic Perspective. We propose a way in which Kidney exchange can be feasibly, economically and efficiently implemented in Indian medical space, named as Indian Kidney Exchange Program(IKEP) along with Indian specific influence on compatibility and final outcomes. Kidney exchange is a boon for those suffering from renal kidney failure and do have a donor with an incompatible kidney (compatible kidney also encouraged for better matches). In such situations the patient, donor pair is matched to another patient, donor pair having the same problem and are compatible to each other. Hospitals put up their patient donor data. Using the biological data, compatibility scores(or weights) are generated and preferences are formed accordingly. Indian influence on weights, modify the compatibility scores generated and hence, the preferences. The pairs are then allocated using game theoretic matching algorithms for markets without money.


Calculation of force and torque between two arbitrarily oriented circular filaments using Kalantarov Zeitlin's method. In this article, formulas for the calculation of force and torque between two circular filaments arbitrarily oriented in space were derived by using Kalantarov Zeitlin's method. Formulas are presented in an analytical form through integral expressions, whose kernel function is expressed in terms of the elliptic integrals of the first and second kinds, and provide an alternative formulation to Babic's expressions. The derived new formulas were validated via comparison with a series of reference examples. Also, we obtained additional expressions for the calculation of force and torque between two circular filaments by means of differentiation of Grover's formula for the mutual inductance between two circular filaments with respect to appropriate coordinates. These additional expressions allow to verifying comprehensively and independently derived new formulas.


Stability Verification in Stochastic Control Systems via Neural Network Supermartingales. We consider the problem of formally verifying almost sure (a.s.) asymptotic stability in discrete time nonlinear stochastic control systems. While verifying stability in deterministic control systems is extensively studied in the literature, verifying stability in stochastic control systems is an open problem. The few existing works on this topic either consider only specialized forms of stochasticity or make restrictive assumptions on the system, rendering them inapplicable to learning algorithms with neural network policies. In this work, we present an approach for general nonlinear stochastic control problems with two novel aspects (a) instead of classical stochastic extensions of Lyapunov functions, we use ranking supermartingales (RSMs) to certify a.s. asymptotic stability, and (b) we present a method for learning neural network RSMs. We prove that our approach guarantees a.s. asymptotic stability of the system and provides the first method to obtain bounds on the stabilization time, which stochastic Lyapunov functions do not. Finally, we validate our approach experimentally on a set of nonlinear stochastic reinforcement learning environments with neural network policies.


A proof by foliation that Lawson's cones are A Phi minimizing. We give a proof by foliation that the cones over mathbb S k times mathbb S l minimize parametric elliptic functionals for each k, ,l geq 1 . We also analyze the behavior at infinity of the leaves in the foliations. This analysis motivates conjectures related to the existence and growth rates of nonlinear entire solutions to equations of minimal surface type that arise in the study of such functionals.


High Performance Ptychographic Reconstruction with Federated Facilities. Beamlines at synchrotron light source facilities are powerful scientific instruments used to image samples and observe phenomena at high spatial and temporal resolutions. Typically, these facilities are equipped only with modest compute resources for the analysis of generated experimental datasets. However, high data rate experiments can easily generate data in volumes that take days (or even weeks) to process on those local resources. To address this challenge, we present a system that unifies leadership computing and experimental facilities by enabling the automated establishment of data analysis pipelines that extend from edge data acquisition systems at synchrotron beamlines to remote computing facilities under the covers, our system uses Globus Auth authentication to minimize user interaction, funcX to run user defined functions on supercomputers, and Globus Flows to define and execute workflows. We describe the application of this system to ptychography, an ultra high resolution coherent diffraction imaging technique that can produce 100s of gigabytes to terabytes in a single experiment. When deployed on the DGX A100 ThetaGPU cluster at the Argonne Leadership Computing Facility and a microscopy beamline at the Advanced Photon Source, our system performs analysis as an experiment progresses to provide timely feedback.


Explicit presentation of relative Steinberg groups. We find an explicit presentation of relative linear Steinberg groups mathrm St (n, R, I) for any ring R and n geq 4 by generators and relations as abstract groups. We also prove a similar result for relative simply laced Steinberg groups mathrm St ( Phi R, I) for commutative R and Phi in mathsf A ell, mathsf D ell, mathsf E ell mid ell geq 3 .


Attention Guided Black box Adversarial Attacks with Large Scale Multiobjective Evolutionary Optimization. Fooling deep neural networks (DNNs) with the black box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black box adversarial attacks may struggle to balance their attack ability and visual quality of the generated adversarial examples (AEs) in tackling high resolution images. In this paper, we propose an attention guided black box adversarial attack based on the large scale multiobjective evolutionary optimization, termed as LMOA. By considering the spatial semantic information of images, we firstly take advantage of the attention map to determine the perturbed pixels. Instead of attacking the entire image, reducing the perturbed pixels with the attention mechanism can help to avoid the notorious curse of dimensionality and thereby improves the performance of attacking. Secondly, a large scale multiobjective evolutionary algorithm is employed to traverse the reduced pixels in the salient region. Benefiting from its characteristics, the generated AEs have the potential to fool target DNNs while being imperceptible by the human vision. Extensive experimental results have verified the effectiveness of the proposed LMOA on the ImageNet dataset. More importantly, it is more competitive to generate high resolution AEs with better visual quality compared with the existing black box adversarial attacks.


Managing Knowledge in Energy Data Spaces. Data in the energy domain grows at unprecedented rates and is usually generated by heterogeneous energy systems. Despite the great potential that big data driven technologies can bring to the energy sector, general adoption is still lagging. Several challenges related to controlled data exchange and data integration are still not wholly achieved. As a result, fragmented applications are developed against energy data silos, and data exchange is limited to few applications. In this paper, we analyze the challenges and requirements related to energy related data applications. We also evaluate the use of Energy Data Ecosystems (EDEs) as data driven infrastructures to overcome the current limitations of fragmented energy applications. EDEs are inspired by the International Data Space (IDS) initiative launched in Germany at the end of 2014 with an overall objective to take both the development and use of the IDS reference architecture model to a European global level. The reference architecture model consists of four architectures related to business, security, data and service, and software aspects. This paper illustrates the applicability of EDEs and IDS reference architecture in real world scenarios from the energy sector. The analyzed scenario is positioned in the context of the EU funded H2020 project PLATOON.


Symmetry breaking operators for dual pairs with one member compact. We consider a dual pair (G, G'), in the sense of Howe, with G compact acting on L 2( mathbb R n) , for an appropriate n , via the Weil representation omega . Let tilde mathrm G be the preimage of G in the metaplectic group. Given a genuine irreducible unitary representation Pi of tilde mathrm G , let Pi' be the corresponding irreducible unitary representation of tilde mathrm G ' in the Howe duality. The orthogonal projection onto L 2( mathbb R n) Pi , the Pi isotypic component, is the essentially unique symmetry breaking operator in mathrm Hom tilde mathrm G tilde mathrm G ' ( mathcal H omega infty , mathcal H Pi infty otimes mathcal H Pi' infty ) . We study this operator by computing its Weyl symbol. Our results allow us to compute the wavefront set of Pi' by elementary means.


On the existence and regularity of solutions of semi hyperbolic patches to 2 D Euler equations with van der Waals gas. This article is concerned in establishing the existence and regularity of solution of semi hyperbolic patch problem for two dimensional isentropic Euler equations with van der Waals gas. This type of solution appears in the transonic flow over an airfoil and Guderley reflection and is very common in the numerical solution of Riemann problems. We use the idea of characteristic decomposition and bootstrap method to prove the existence of global smooth solution which is uniformly C 1, frac 1 2 continuous up to the sonic curve. We also prove that the sonic curve is C 1, frac 1 2 continuous. Further, we show the formation of shock as an envelope for positive characteristics before reaching their sonic points.


Manual Evaluation Matters Reviewing Test Protocols of Distantly Supervised Relation Extraction. Distantly supervised (DS) relation extraction (RE) has attracted much attention in the past few years as it can utilize large scale auto labeled data. However, its evaluation has long been a problem previous works either took costly and inconsistent methods to manually examine a small sample of model predictions, or directly test models on auto labeled data which, by our check, produce as much as 53 wrong labels at the entity pair level in the popular NYT10 dataset. This problem has not only led to inaccurate evaluation, but also made it hard to understand where we are and what's left to improve in the research of DS RE. To evaluate DS RE models in a more credible way, we build manually annotated test sets for two DS RE datasets, NYT10 and Wiki20, and thoroughly evaluate several competitive models, especially the latest pre trained ones. The experimental results show that the manual evaluation can indicate very different conclusions from automatic ones, especially some unexpected observations, e.g., pre trained models can achieve dominating performance while being more susceptible to false positives compared to previous methods. We hope that both our manual test sets and novel observations can help advance future DS RE research.


Boundary aware Graph Reasoning for Semantic Segmentation. In this paper, we propose a Boundary aware Graph Reasoning (BGR) module to learn long range contextual features for semantic segmentation. Rather than directly construct the graph based on the backbone features, our BGR module explores a reasonable way to combine segmentation erroneous regions with the graph construction scenario. Motivated by the fact that most hard to segment pixels broadly distribute on boundary regions, our BGR module uses the boundary score map as prior knowledge to intensify the graph node connections and thereby guide the graph reasoning focus on boundary regions. In addition, we employ an efficient graph convolution implementation to reduce the computational cost, which benefits the integration of our BGR module into current segmentation backbones. Extensive experiments on three challenging segmentation benchmarks demonstrate the effectiveness of our proposed BGR module for semantic segmentation.


The genericity theorem for the essential dimension of tame stacks. Let X be a regular tame stack. If X is locally of finite type over a field, we prove that the essential dimension of X is equal to its generic essential dimension, this generalizes a previous result of P. Brosnan, Z. Reichstein and the second author. Now suppose that X is locally of finite type over a 1 dimensional noetherian local domain R with fraction field K and residue field k . We prove that operatorname ed k X k le operatorname ed K X K if X to operatorname Spec R is smooth and operatorname ed k X k le operatorname ed K X K 1 in general.


Say What? Collaborative Pop Lyric Generation Using Multitask Transfer Learning. Lyric generation is a popular sub field of natural language generation that has seen growth in recent years. Pop lyrics are of unique interest due to the genre's unique style and content, in addition to the high level of collaboration that goes on behind the scenes in the professional pop songwriting process. In this paper, we present a collaborative line level lyric generation system that utilizes transfer learning via the T5 transformer model, which, till date, has not been used to generate pop lyrics. By working and communicating directly with professional songwriters, we develop a model that is able to learn lyrical and stylistic tasks like rhyming, matching line beat requirements, and ending lines with specific target words. Our approach compares favorably to existing methods for multiple datasets and yields positive results from our online studies and interviews with industry songwriters.


Agent vs. Avatar Comparing Embodied Conversational Agents Concerning Characteristics of the Uncanny Valley. Visual appearance is an important aspect influencing the perception and consequent acceptance of Embodied Conversational Agents (ECA). To this end, the Uncanny Valley theory contradicts the common assumption that increased humanization of characters leads to better acceptance. Rather, it shows that anthropomorphic behavior may trigger feelings of eeriness and rejection in people. The work presented in this paper explores whether four different autonomous ECAs, specifically build for a European research project, are affected by this effect, and how they compare to two slightly more realistically looking human controlled, i.e. face tracked, ECAs with respect to perceived humanness, eeriness, and attractiveness. Short videos of the ECAs in combination with a validated questionnaire were used to investigate potential differences. Results support existing theories highlighting that increased perceived humanness correlates with increased perceived eeriness. Furthermore, it was found, that neither the gender of survey participants, their age, nor the sex of the ECA influences this effect, and that female ECAs are perceived to be significantly more attractive than their male counterparts.


Global ultradifferentiable hypoellipticity on compact manifolds. We study the global hypoellipticity problem for certain linear operators in Komatsu classes of Roumieu and Beurling type on compact manifolds. We present an approach by combining a characterization of these spaces via eigenfuction expansions, generated by an elliptic operator, and the analysis of matrix symbols obtained by these expansions.


Semi supervised Contrastive Learning with Similarity Co calibration. Semi supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi supervised Contrastive Learning (SsCL), which combines the well known contrastive loss in self supervised learning with the cross entropy loss in semi supervised learning, and jointly optimizes the two objectives in an end to end way. The highlight is that different from self training based semi supervised learning that conducts prediction and retraining over the same model weights, SsCL interchanges the predictions over the unlabeled data between the two branches, and thus formulates a co calibration procedure, which we find is beneficial for better prediction and avoid being trapped in local minimum. Towards this goal, the contrastive loss branch models pairwise similarities among samples, using the nearest neighborhood generated from the cross entropy branch, and in turn calibrates the prediction distribution of the cross entropy branch with the contrastive similarity. We show that SsCL produces more discriminative representation and is beneficial to few shot learning. Notably, on ImageNet with ResNet50 as the backbone, SsCL achieves 60.2 and 72.1 top 1 accuracy with 1 and 10 labeled samples, respectively, which significantly outperforms the baseline, and is better than previous semi supervised and self supervised methods.


Regenerative Terahertz Quantum Detectors. Because of the ultrafast and photon driven nature of the transport in their active region, we demonstrate that quantum cascade lasers can be operated as resonantly amplified terahertz detectors. Tunable responsivities up to 50 V W and noise equivalent powers down to 100 pW sqrt(Hz) are demonstrated at 4.7 THz. Constant peak responsivities with respect to the detector temperature are observed up to 80K. Thanks to the sub ps intersubband lifetime electrical bandwidths larger than 20 GHz can be obtained, allowing the detection of optical beatnotes from quantum cascade THz frequency combs.


Detecting Multi Sensor Fusion Errors in Advanced Driver Assistance Systems. Advanced Driver Assistance Systems (ADAS) have been thriving and widely deployed in recent years. In general, these systems receive sensor data, compute driving decisions, and output control signals to the vehicles. To smooth out the uncertainties brought by sensor inputs, they usually leverage multi sensor fusion (MSF) to fuse the sensor inputs and produce a more reliable understanding of the surroundings. However, multi sensor fusion cannot completely eliminate the uncertainties since it lacks the knowledge about which sensor provides the most accurate data and how to optimally integrate the data provided by the sensors. As a result, critical consequences might happen unexpectedly. In this work, we observed that the popular multi sensor fusion methods in an industry grade ADAS can mislead the car control and result in serious safety hazards. Misbehavior can happen regardless of the used fusion methods and the accurate data from at least one sensor. We call such errors as fusion errors and develop a novel evolutionary based domain specific search framework, FusED, for the efficient detection of fusion errors. We further apply causality analysis to show that the found fusion errors are indeed caused by the multi sensor fusion method. We evaluate our framework on two widely used multi sensor fusion methods in two driving environments. Experimental results show that FusED identifies more than 150 fusion errors. Finally, we provide several suggestions to improve the multi sensor fusion methods we study.


Sub seasonal forecasting with a large ensemble of deep learning weather prediction models. We present an ensemble prediction system using a Deep Learning Weather Prediction (DLWP) model that recursively predicts key atmospheric variables with six hour time resolution. This model uses convolutional neural networks (CNNs) on a cubed sphere grid to produce global forecasts. The approach is computationally efficient, requiring just three minutes on a single GPU to produce a 320 member set of six week forecasts at 1.4 deg resolution. Ensemble spread is primarily produced by randomizing the CNN training process to create a set of 32 DLWP models with slightly different learned weights. Although our DLWP model does not forecast precipitation, it does forecast total column water vapor, and it gives a reasonable 4.5 day deterministic forecast of Hurricane Irma. In addition to simulating mid latitude weather systems, it spontaneously generates tropical cyclones in a one year free running simulation. Averaged globally and over a two year test set, the ensemble mean RMSE retains skill relative to climatology beyond two weeks, with anomaly correlation coefficients remaining above 0.6 through six days. Our primary application is to subseasonal to seasonal (S2S) forecasting at lead times from two to six weeks. Current forecast systems have low skill in predicting one or 2 week average weather patterns at S2S time scales. The continuous ranked probability score (CRPS) and the ranked probability skill score (RPSS) show that the DLWP ensemble is only modestly inferior in performance to the European Centre for Medium Range Weather Forecasts (ECMWF) S2S ensemble over land at lead times of 4 and 5 6 weeks. At shorter lead times, the ECMWF ensemble performs better than DLWP.


Automated scholarly paper review Technologies and challenges. Peer review is a widely accepted mechanism for research evaluation, playing a pivotal role in scholarly publishing. However, criticisms have long been leveled on this mechanism, mostly because of its inefficiency and subjectivity. Recent years have seen the application of artificial intelligence (AI) in assisting the peer review process. Nonetheless, with the involvement of humans, such limitations remain inevitable. In this review paper, we propose the concept and pipeline of automated scholarly paper review (ASPR) and review the relevant literature and technologies of achieving a full scale computerized review process. On the basis of the review and discussion, we conclude that there is already corresponding research and implementation at each stage of ASPR. We further look into the challenges in ASPR with the existing technologies. The major difficulties lie in imperfect document parsing and representation, inadequate data, defective human computer interaction and flawed deep logical reasoning. Moreover, we discuss the possible moral ethical issues and point out the future directions of ASPR. In the foreseeable future, ASPR and peer review will coexist in a reinforcing manner before ASPR is able to fully undertake the reviewing workload from humans.


Non Parametric Few Shot Learning for Word Sense Disambiguation. Word sense disambiguation (WSD) is a long standing problem in natural language processing. One significant challenge in supervised all words WSD is to classify among senses for a majority of words that lie in the long tail distribution. For instance, 84 of the annotated words have less than 10 examples in the SemCor training data. This issue is more pronounced as the imbalance occurs in both word and sense distributions. In this work, we propose MetricWSD, a non parametric few shot learning approach to mitigate this data imbalance issue. By learning to compute distances among the senses of a given word through episodic training, MetricWSD transfers knowledge (a learned metric space) from high frequency words to infrequent ones. MetricWSD constructs the training episodes tailored to word frequencies and explicitly addresses the problem of the skewed distribution, as opposed to mixing all the words trained with parametric models in previous work. Without resorting to any lexical resources, MetricWSD obtains strong performance against parametric alternatives, achieving a 75.1 F1 score on the unified WSD evaluation benchmark (Raganato et al., 2017b). Our analysis further validates that infrequent words and senses enjoy significant improvement.


Resurgence and Partial Theta Series. A function of the form Theta( tau) sum n 0 n d f(n) e i pi n 2 tau M , with an integer d ge0 and an M periodic function f Z to C , is analytic in the half plane Im tau 0 . As tau tends non tangentially to any rational alpha , a formal power series appears in the asymptotic behaviour of Theta( tau) , depending on the parity of d and f . We discuss the summability and resurgence properties of these series by means of explicit formulas for their formal Borel transforms, and the consequences for the modularity properties of Theta , or its "quantum modularity" properties in the sense of Zagier's recent theory. We also illustrate the power of 'Ecalle's alien calculus applied to analytic combinatorics in this class of examples. The Discrete Fourier Transform of f plays an unexpected role and leads to a number theoretic analogue of 'Ecalle's "Bridge Equations".


Self Reorganizing and Rejuvenating CNNs for Increasing Model Capacity Utilization. In this paper, we propose self reorganizing and rejuvenating convolutional neural networks a biologically inspired method for improving the computational resource utilization of neural networks. The proposed method utilizes the channel activations of a convolution layer in order to reorganize that layers parameters. The reorganized parameters are clustered to avoid parameter redundancies. As such, redundant neurons with similar activations are merged leaving room for the remaining parameters to rejuvenate. The rejuvenated parameters learn different features to supplement those learned by the reorganized surviving parameters. As a result, the network capacity utilization increases improving the baseline network performance without any changes to the network structure. The proposed method can be applied to various network architectures during the training stage, or applied to a pre trained model improving its performance. Experimental results showed that the proposed method is model agnostic and can be applied to any backbone architecture increasing its performance due to the elevated utilization of the network capacity.


Inference of Recyclable Objects with Convolutional Neural Networks. Population growth in the last decades has resulted in the production of about 2.01 billion tons of municipal waste per year. The current waste management systems are not capable of providing adequate solutions for the disposal and use of these wastes. Recycling and reuse have proven to be a solution to the problem, but large scale waste segregation is a tedious task and on a small scale it depends on public awareness. This research used convolutional neural networks and computer vision to develop a tool for the automation of solid waste sorting. The Fotini10k dataset was constructed, which has more than 10,000 images divided into the categories of 'plastic bottles', 'aluminum cans' and 'paper and cardboard'. ResNet50, MobileNetV1 and MobileNetV2 were retrained with ImageNet weights on the Fotini10k dataset. As a result, top 1 accuracy of 99 was obtained in the test dataset with all three networks. To explore the possible use of these networks in mobile applications, the three nets were quantized in float16 weights. By doing so, it was possible to obtain inference times twice as low for Raspberry Pi and three times as low for computer processing units. It was also possible to reduce the size of the networks by half. When quantizing the top 1 accuracy of 99 was maintained with all three networks. When quantizing MobileNetV2 to int 8, it obtained a top 1 accuracy of 97 .


GRIHA Synthesizing 2 Dimensional Building Layouts from Images Captured using a Smart Phone. Reconstructing an indoor scene and generating a layout floor plan in 3D or 2D is a widely known problem. Quite a few algorithms have been proposed in the literature recently. However, most existing methods either use RGB D images, thus requiring a depth camera, or depending on panoramic photos, assuming that there is little to no occlusion in the rooms. In this work, we proposed GRIHA (Generating Room Interior of a House using ARCore), a framework for generating a layout using an RGB image captured using a simple mobile phone camera. We take advantage of Simultaneous Localization and Mapping (SLAM) to assess the 3D transformations required for layout generation. SLAM technology is built in in recent mobile libraries such as ARCore by Google. Hence, the proposed method is fast and efficient. It gives the user freedom to generate layout by merely taking a few conventional photos, rather than relying on specialized depth hardware or occlusion free panoramic images. We have compared GRIHA with other existing methods and obtained superior results. Also, the system is tested on multiple hardware platforms to test the dependency and efficiency.


An extension theory for partial groups. Partial groups are a natural generalization of discrete groups recently introduced by Chermak in connection with the theory of fusion systems. In this paper we develop an extension theory for partial groups based in the classical theory of fibre bundles of simplicial sets.


Knowledge Graph for Microdata of Statistics Netherlands. Statistics Netherlands (CBS) hosted a huge amount of data not only on the statistical level but also on the individual level. With the development of data science technologies, more and more researchers request to conduct their research by using high quality individual data from CBS (called CBS Microdata) or combining them with other data sources. Making great use of these data for research and scientific purposes can tremendously benefit the whole society. However, CBS Microdata has been collected and maintained in different ways by different departments in and out of CBS. The representation, quality, metadata of datasets are not sufficiently harmonized. The project converts the descriptions of all CBS microdata sets into one knowledge graph with comprehensive metadata in Dutch and English using text mining and semantic web technologies. Researchers can easily query the metadata, explore the relations among multiple datasets, and find the needed variables. For example, if a researcher searches a dataset about "Age at Death" in the Health and Well being category, all information related to this dataset will appear including keywords and variable names. "Age at Death" dataset has a keyword "Death". This keyword will lead to other datasets such as "Date of Death". "Cause of Death", "Production statistics Health and welfare" from Population, Business categories, and Health and well being categories. This will tremendously save time and costs for the data requester but also data maintainers.


Compiler Driven FPGA Virtualization with SYNERGY. FPGAs are increasingly common in modern applications, and cloud providers now support on demand FPGA acceleration in data centers. Applications in data centers run on virtual infrastructure, where consolidation, multi tenancy, and workload migration enable economies of scale that are fundamental to the provider's business. However, a general strategy for virtualizing FPGAs has yet to emerge. While manufacturers struggle with hardware based approaches, we propose a compiler runtime based solution called Synergy. We show a compiler transformation for Verilog programs that produces code able to yield control to software at sub clock tick granularity according to the semantics of the original program. Synergy uses this property to efficiently support core virtualization primitives suspend and resume, program migration, and spatial temporal multiplexing, on hardware which is available today. We use Synergy to virtualize FPGA workloads across a cluster of Altera SoCs and Xilinx FPGAs on Amazon F1. The workloads require no modification, run within 3 4x of unvirtualized performance, and incur a modest increase in FPGA fabric utilization.


Design of an Instrumentation Unit with Datalogger for Heat Flow Measurement in Solid Metals. An instrumentation unit that measures heat flow along the test column of solid metal samples is described. The study also describes the design of a datalogger using Arduino Mega Microcontroller. The designed instrumentation unit incorporates current and voltage sensing unit, ten thermocouple sensors and amplifiers, microSD card shield, two LCDs, four microcontrolled switching relays and a 12 V DC water pump motor. The heat flow parameters measured by the instrumentation unit includes temperature gradient, heater current and heater voltage. The designed datalogger logs the measured value of temperature, current and voltage at a time of ten minutes. An area of application for this study is in the development of a device for measurement of thermal conductivity of solid metals. It is an improvement over existing heat flow measurement techniques.


A transition from boundary to bulk driven acoustic streaming due to nonlinear thermoviscous effects at high acoustic energy densities. Acoustic streaming is studied in a rectangular microfluidic channel. It is demonstrated theoretically, numerically, and experimentally with good agreement, frictional heating can alter the streaming pattern qualitatively at high acoustic energy densities E ac above 500 J m 3. The study shows, how as a function of increasing E ac at fixed frequency, the traditional boundary driven four streaming rolls created at a half wave standing wave resonance, transition into two large streaming rolls. This nonlinear transition occurs because friction heats up the fluid resulting in a temperature gradient, which spawns an acoustic body force in the bulk that drives thermoacoustic streaming.


Active learning for reducing labeling effort in text classification tasks. Labeling data can be an expensive task as it is usually performed manually by domain experts. This is cumbersome for deep learning, as it is dependent on large labeled datasets. Active learning (AL) is a paradigm that aims to reduce labeling effort by only using the data which the used model deems most informative. Little research has been done on AL in a text classification setting and next to none has involved the more recent, state of the art Natural Language Processing (NLP) models. Here, we present an empirical study that compares different uncertainty based algorithms with BERT base as the used classifier. We evaluate the algorithms on two NLP classification datasets Stanford Sentiment Treebank and KvK Frontpages. Additionally, we explore heuristics that aim to solve presupposed problems of uncertainty based AL namely, that it is unscalable and that it is prone to selecting outliers. Furthermore, we explore the influence of the query pool size on the performance of AL. Whereas it was found that the proposed heuristics for AL did not improve performance of AL our results show that using uncertainty based AL with BERT base outperforms random sampling of data. This difference in performance can decrease as the query pool size gets larger.


Complex interpolation of Orlicz sequence spaces and its higher order Rochberg spaces. We show that if ( ell phi 0 , ell phi 1 ) is a couple of suitable Orlicz sequence spaces then the corresponding Rochberg derived spaces of all orders associated to the complex interpolation method are Fenchel Orlicz spaces. In particular, the induced twisted sums have the (C 0, 1 , mathbb C ) extension property.


You Only Need End to End Training for Long Tailed Recognition. The generalization gap on the long tailed data sets is largely owing to most categories only occupying a few training samples. Decoupled training achieves better performance by training backbone and classifier separately. What causes the poorer performance of end to end model training (e.g., logits margin based methods)? In this work, we identify a key factor that affects the learning of the classifier the channel correlated features with low entropy before inputting into the classifier. From the perspective of information theory, we analyze why cross entropy loss tends to produce highly correlated features on the imbalanced data. In addition, we theoretically analyze and prove its impacts on the gradients of classifier weights, the condition number of Hessian, and logits margin based approach. Therefore, we firstly propose to use Channel Whitening to decorrelate ("scatter") the classifier's inputs for decoupling the weight update and reshaping the skewed decision boundary, which achieves satisfactory results combined with logits margin based method. However, when the number of minor classes are large, batch imbalance and more participation in training cause over fitting of the major classes. We also propose two novel modules, Block based Relatively Balanced Batch Sampler (B3RS) and Batch Embedded Training (BET) to solve the above problems, which makes the end to end training achieve even better performance than decoupled training. Experimental results on the long tailed classification benchmarks, CIFAR LT and ImageNet LT, demonstrate the effectiveness of our method.


Energy Based Learning for Scene Graph Generation. Traditional scene graph generation methods are trained using cross entropy losses that treat objects and relationships as independent entities. Such a formulation, however, ignores the structure in the output space, in an inherently structured prediction problem. In this work, we introduce a novel energy based learning framework for generating scene graphs. The proposed formulation allows for efficiently incorporating the structure of scene graphs in the output space. This additional constraint in the learning framework acts as an inductive bias and allows models to learn efficiently from a small number of labels. We use the proposed energy based framework to train existing state of the art models and obtain a significant performance improvement, of up to 21 and 27 , on the Visual Genome and GQA benchmark datasets, respectively. Furthermore, we showcase the learning efficiency of the proposed framework by demonstrating superior performance in the zero and few shot settings where data is scarce.


Persistent Covering of a Graph under Latency and Energy Constraints. Most consumer level low cost unmanned aerial vehicles (UAVs) have limited battery power and long charging time. Due to these energy constraints, they cannot accomplish many practical tasks, such as monitoring a sport or political event for hours. The problem of providing the service to cover an area for an extended time is known as persistent covering in the literature. In the past, researchers have proposed various hardware platforms, such as battery swapping mechanisms, to provide persistent covering. However, algorithmic approaches are limited mostly due to the computational complexity and intractability of the problem. Approximation algorithms have been considered to segment a large area into smaller cells that require periodic visits under the latency constraints. However, these methods assume unlimited energy. In this paper, we explore geometric and topological properties that allow us to significantly reduce the size of the optimization problem. Consequently, the proposed method can efficiently determine the minimum number of UAVs needed and schedule their routes to cover an area persistently. We demonstrated experimentally that the proposed algorithm has better performance than the baseline methods.


PartGlot Learning Shape Part Segmentation from Language Reference Games. We introduce PartGlot, a neural framework and associated architectures for learning semantic part segmentation of 3D shape geometry, based solely on part referential language. We exploit the fact that linguistic descriptions of a shape can provide priors on the shape's parts as natural language has evolved to reflect human perception of the compositional structure of objects, essential to their recognition and use. For training, we use the paired geometry language data collected in the ShapeGlot work for their reference game, where a speaker creates an utterance to differentiate a target shape from two distractors and the listener has to find the target based on this utterance. Our network is designed to solve this target discrimination problem, carefully incorporating a Transformer based attention module so that the output attention can precisely highlight the semantic part or parts described in the language. Furthermore, the network operates without any direct supervision on the 3D geometry itself. Surprisingly, we further demonstrate that the learned part information is generalizable to shape classes unseen during training. Our approach opens the possibility of learning 3D shape parts from language alone, without the need for large scale part geometry annotations, thus facilitating annotation acquisition.


Evidence suggests that SARS CoV 2 rapid antigen tests provide benefits for epidemic control observations from Austrian schools. Rapid antigen tests detect proteins at the surface of virus particles, identifying the disease during its infectious phase. In contrast, PCR tests detect viral genomes they can thus diagnose COVID 19 before the infectious phase but also react to remnants of the virus genome, even weeks after live virus ceases to be detectable in the respiratory tract. Furthermore, the logistics for administering the tests are different, with rapid antigen tests being much easier to administer at scale. In this article, we discuss the relative advantages of the different testing procedures and summarise evidence that shows that using antigen tests 2 3 times per week could become a powerful tool to suppress the COVID 19 pandemic. We also discuss the results of recent large scale rapid antigen testing in Austrian schools. While our report on testing predates Delta, we have updated the review with recent data on viral loads in breakthrough infections and more information about testing efficacy, especially in children.


iCurb Imitation Learning based Detection of Road Curbs using Aerial Images for Autonomous Driving. Detection of road curbs is an essential capability for autonomous driving. It can be used for autonomous vehicles to determine drivable areas on roads. Usually, road curbs are detected on line using vehicle mounted sensors, such as video cameras and 3 D Lidars. However, on line detection using video cameras may suffer from challenging illumination conditions, and Lidar based approaches may be difficult to detect far away road curbs due to the sparsity issue of point clouds. In recent years, aerial images are becoming more and more worldwide available. We find that the visual appearances between road areas and off road areas are usually different in aerial images, so we propose a novel solution to detect road curbs off line using aerial images. The input to our method is an aerial image, and the output is directly a graph (i.e., vertices and edges) representing road curbs. To this end, we formulate the problem as an imitation learning problem, and design a novel network and an innovative training strategy to train an agent to iteratively find the road curb graph. The experimental results on a public dataset confirm the effectiveness and superiority of our method. This work is accompanied with a demonstration video and a supplementary document at https tonyxuqaq.github.io iCurb .


Calculus of variations on locally finite graphs. Let G (V,E) be a locally finite graph. Firstly, using calculus of variations, including a direct method of variation and the mountain pass theory, we get sequences of solutions to several local equations on G (the Schr "odinger equation, the mean field equation, and the Yamabe equation). Secondly, we derive uniform estimates for those local solution sequences. Finally, we obtain global solutions by extracting convergent sequence of solutions. Our method can be described as a variational method from local to global.


On the automorphisms of Mukai varieties. Mukai varieties are Fano varieties of Picard number one and coindex three. In genus seven to ten they are linear sections of some special homogeneous varieties. We describe the generic automorphism groups of these varieties. When they are expected to be trivial for dimensional reasons, we show they are indeed trivial, up to three interesting and unexpected exceptions in genera 7, 8, 9, and codimension 4, 3, 2 respectively. We conclude in particular that a generic prime Fano threefold of genus g has no automorphisms for 7 le g le 10. In the Appendix by Y. Prokhorov, the latter statement is extended to g 12.


Named Entity Recognition and Linking Augmented with Large Scale Structured Data. In this paper we describe our submissions to the 2nd and 3rd SlavNER Shared Tasks held at BSNLP 2019 and BSNLP 2021, respectively. The tasks focused on the analysis of Named Entities in multilingual Web documents in Slavic languages with rich inflection. Our solution takes advantage of large collections of both unstructured and structured documents. The former serve as data for unsupervised training of language models and embeddings of lexical units. The latter refers to Wikipedia and its structured counterpart Wikidata, our source of lemmatization rules, and real world entities. With the aid of those resources, our system could recognize, normalize and link entities, while being trained with only small amounts of labeled data.


A Topology Shape Metrics Framework for Ortho Radial Graph Drawing. Orthogonal drawings, i.e., embeddings of graphs into grids, are a classic topic in Graph Drawing. Often the goal is to find a drawing that minimizes the number of bends on the edges. A key ingredient for bend minimization algorithms is the existence of an orthogonal representation that describes such drawings combinatorially by only listing the angles between the edges around each vertex and the directions of bends on the edges, but neglecting any kind of geometric information such as vertex coordinates or edge lengths. We generalize this idea to ortho radial representations of ortho radial drawings, which are embeddings into an ortho radial grid, whose gridlines are concentric circles around the origin and straight line spokes emanating from the origin but excluding the origin itself. Unlike the orthogonal case, there exist ortho radial representations that do not admit a corresponding drawing, for example so called strictly monotone cycles. An ortho radial drawing is called valid if it does not contain a strictly monotone cycle. Our first result is that an ortho radial representation admits a corresponding drawing if and only if it is valid. Previously such a characterization was only known for ortho radial drawings of paths, cycles, and theta graphs, and in the special case of rectangular drawings of cubic graphs, where the contour of each face is required to be a rectangle. Further, we give a quadratic time algorithm that tests for an ortho radial representation whether it is valid, and we show how to draw a valid ortho radial representation in the same running time. Altogether, this reduces the problem of computing a minimum bend ortho radial drawing to the task of computing a valid ortho radial representation with the minimum number of bends, and hence establishes an ortho radial analogue of the topology shape metrics framework for planar orthogonal drawings by Tamassia.


AttnMove History Enhanced Trajectory Recovery via Attentional Network. A considerable amount of mobility data has been accumulated due to the proliferation of location based service. Nevertheless, compared with mobility data from transportation systems like the GPS module in taxis, this kind of data is commonly sparse in terms of individual trajectories in the sense that users do not access mobile services and contribute their data all the time. Consequently, the sparsity inevitably weakens the practical value of the data even it has a high user penetration rate. To solve this problem, we propose a novel attentional neural network based model, named AttnMove, to densify individual trajectories by recovering unobserved locations at a fine grained spatial temporal resolution. To tackle the challenges posed by sparsity, we design various intra and inter trajectory attention mechanisms to better model the mobility regularity of users and fully exploit the periodical pattern from long term history. We evaluate our model on two real world datasets, and extensive results demonstrate the performance gain compared with the state of the art methods. This also shows that, by providing high quality mobility data, our model can benefit a variety of mobility oriented down stream applications.


Jacobians with with automorphisms of prime order. In this paper we study principally polarized abelian varieties that admit an automorphism of prime order p 2 . It turns out that certain natural conditions on the multiplicities of its action on the differentials of the first kind do guarantee that those polarized varieties are not jacobians of curves.


Upper heat kernel estimates for nonlocal operators via Aronson's method. In his celebrated article, Aronson established Gaussian bounds for the fundamental solution to the Cauchy problem governed by a second order divergence form operator with uniformly elliptic coefficients. We extend Aronson's proof of upper heat kernel estimates to nonlocal operators whose jumping kernel satisfies a pointwise upper bound and whose energy form is coercive. A detailed proof is given in the Euclidean space and extensions to doubling metric measure spaces are discussed.


High level Decisions from a Safe Maneuver Catalog with Reinforcement Learning for Safe and Cooperative Automated Merging. Reinforcement learning (RL) has recently been used for solving challenging decision making problems in the context of automated driving. However, one of the main drawbacks of the presented RL based policies is the lack of safety guarantees, since they strive to reduce the expected number of collisions but still tolerate them. In this paper, we propose an efficient RL based decision making pipeline for safe and cooperative automated driving in merging scenarios. The RL agent is able to predict the current situation and provide high level decisions, specifying the operation mode of the low level planner which is responsible for safety. In order to learn a more generic policy, we propose a scalable RL architecture for the merging scenario that is not sensitive to changes in the environment configurations. According to our experiments, the proposed RL agent can efficiently identify cooperative drivers from their vehicle state history and generate interactive maneuvers, resulting in faster and more comfortable automated driving. At the same time, thanks to the safety constraints inside the planner, all of the maneuvers are collision free and safe.


Self Attentive Constituency Parsing for UCCA based Semantic Parsing. Semantic parsing provides a way to extract the semantic structure of a text that could be understood by machines. It is utilized in various NLP applications that require text comprehension such as summarization and question answering. Graph based representation is one of the semantic representation approaches to express the semantic structure of a text. Such representations generate expressive and adequate graph based target structures. In this paper, we focus primarily on UCCA graph based semantic representation. The paper not only presents the existing approaches proposed for UCCA representation, but also proposes a novel self attentive neural parsing model for the UCCA representation. We present the results for both single lingual and cross lingual tasks using zero shot and few shot learning for low resource languages.


Energy method for the Boltzmann equation of monatomic gaseous mixtures. In this paper, we present an energy method for the system of Boltzmann equations in the multicomponent mixture case, based on a micro macro decomposition. More precisely, the perturbation of a solution to the Bolzmann equation around a global equilibrium is decomposed into the sum of a macroscopic and a microscopic part, for which we obtain a priori estimates at both lower and higher orders. These estimates are obtained under a suitable smallness assumption. The assumption can be justified a posteriori in the higher order case, leading to the closure of the corresponding estimate.


SOS SDP an Exact Solver for Minimum Sum of Squares Clustering. The minimum sum of squares clustering problem (MSSC) consists of partitioning n observations into k clusters in order to minimize the sum of squared distances from the points to the centroid of their cluster. In this paper, we propose an exact algorithm for the MSSC problem based on the branch and bound technique. The lower bound is computed by using a cutting plane procedure where valid inequalities are iteratively added to the Peng Wei SDP relaxation. The upper bound is computed with the constrained version of k means where the initial centroids are extracted from the solution of the SDP relaxation. In the branch and bound procedure, we incorporate instance level must link and cannot link constraints to express knowledge about which data points should or should not be grouped together. We manage to reduce the size of the problem at each level preserving the structure of the SDP problem itself. The obtained results show that the approach allows to successfully solve for the first time real world instances up to 4000 data points.


Acoustic Structure Inverse Design and Optimization Using Deep Learning. From ancient to modern times, acoustic structures have been used to control the propagation of acoustic waves. However, the design of the acoustic structures has remained widely a time consuming and computational resource consuming iterative process. In recent years, Deep Learning has attracted unprecedented attention for its ability to tackle hard problems with huge datasets, which has achieved state of the art results in various tasks. In this work, an acoustic structure design method is proposed based on deep learning. Taking the design of multi order Helmholtz resonator for instance, we experimentally demonstrate the effectiveness of the proposed method. Our method is not only able to give a very accurate prediction of the geometry of the acoustic structures with multiple strong coupling parameters, but also capable of improving the performance of evolutionary approaches in optimization for a desired property. Compared with the conventional numerical methods, our method is more efficient, universal and automatic, which has a wide range of potential applications, such as speech enhancement, sound absorption and insulation.


On Meritocracy in Optimal Set Selection. We consider the problem of selecting a set of individuals from a candidate population in order to maximise utility. When the utility function is defined over sets, this raises the question of how to define meritocracy. We define and analyse an appropriate notion of meritocracy derived from the utility function. We introduce the notion of expected marginal contributions of individuals and analyse its links to the underlying optimisation problem, our notion of meritocracy, and other notions of fairness such as the Shapley value. We also experimentally analyse the effect of different policy structures on the utility and meritocracy in a simulated college admission setting including constraints on statistical parity.


Auxiliary Heuristics for Frontier Based Planners. Autonomous exploration of unknown environments is a vital function for robots and has applications in a wide variety of scenarios. Our focus primarily lies in its application for the task of efficient coverage of unknown environments. Various methods have been proposed for this task and frontier based methods are an efficient category in this class of methods. Efficiency is of utmost importance in exploration and heuristics play a critical role in guiding our search. In this work we demonstrate the ability of heuristics that are learnt by imitating clairvoyant oracles. These learnt heuristics can be used to predict the expected future return from selected states without building search trees, which are inefficient and limited by on board compute. We also propose an additional filter based heuristic which results in an enhancement in the performance of the frontier based planner with respect to certain tasks such as coverage planning.


Clustering to the Fewest Clusters Under Intra Cluster Dissimilarity Constraints. This paper introduces the equiwide clustering problem, where valid partitions must satisfy intra cluster dissimilarity constraints. Unlike most existing clustering algorithms, equiwide clustering relies neither on density nor on a predefined number of expected classes, but on a dissimilarity threshold. Its main goal is to ensure an upper bound on the error induced by ultimately replacing any object with its cluster representative. Under this constraint, we then primarily focus on minimizing the number of clusters, along with potential sub objectives. We argue that equiwide clustering is a sound clustering problem, and discuss its relationship with other optimization problems, existing and novel implementations as well as approximation strategies. We review and evaluate suitable clustering algorithms to identify trade offs between the various practical solutions for this clustering problem.


Combinatorial proofs of the Ramanujan type congruences modulo 3. The partition statistic V R rank is introduced to give combinatorial proofs of the Ramanujan type congruences mod 3 for certain classes of partition functions.


Extracting total Amb programs from proofs. We present a logical system CFP (Concurrent Fixed Point Logic) from whose proofs one can extract nondeterministic and concurrent programs that are provably total and correct with respect to the proven formula. CFP is an intuitionistic first order logic with inductive and coinductive definitions extended by two propositional operators, A B (restriction, a strengthening of the implication B A) and ddownarrow(A) (total concurrency). The target of the extraction is a lambda calculus with constructors and recursion extended by a constructor Amb (for McCarthy's amb) which is interpreted operationally as globally angelic choice. The correctness of extracted programs is proven via an intermediate domain theoretic denotational semantics. We demonstrate the usefulness of our system by extracting a concurrent program that translates infinite Gray code into the signed digit representation. A noteworthy feature of our system is that the proof rules for restriction and concurrency involve variants of the classical law of excluded middle that would not be interpretable computationally without Amb.


FIND an SDR based Tool for Fine Indoor Localization. An indoor localization approach uses Wi Fi Access Points (APs) to estimate the Direction of Arrival (DoA) of the WiFi signals. This paper demonstrates FIND, a tool for Fine INDoor localization based on a software defined radio, which receives Wi Fi frames in the 80 MHz band with four antennas. To the best of our knowledge, it is the first ever prototype that extracts from such frames data in both frequency and time domains to calculate the DoA of Wi Fi signals in real time. Apart from other prototypes, we retrieve from frames comprehensive information that could be used to DoA estimation all preamble fields in the time domain, Channels State Information, and signal to noise ratio. Using our device, we collect a dataset for comparing different algorithms estimating the angle of arrival in the same scenario. Furthermore, we propose a novel calibration method, eliminating the constant phase shift between receiving paths caused by hardware imperfections. All calibration data, as well as a gathered dataset with various DoA in an anechoic chamber and in a classroom, are provided to facilitate further research in the area of indoor localization, intelligence surfaces, and multi user transmissions in dense deployments.


Continuum Deformation Coordination of Multi Agent Systems Using Cooperative Localization. This paper studies the problem of decentralized continuum deformation coordination of multi agent systems aided by cooperative localization. We treat agents as particles inside a triangular continuum (deformable body) in a2 D motion space and let the continuum deformation coordination be defined by three leaders located at vertices of a triangle, called the leading triangle. The leaders desired trajectories are assigned as the solution of a constrained optimal control problem such that safety requirements are satisfied in the presence of disturbance and measurement noise. Followers distributed inside the leading tri angle acquire continuum deformation in a decentralized fashion by integrating cooperative localization and local communication. Specifically, cooperative localization estimates the global positions of all agents using relative position measurements based primarily on proximity of agents. Simulation results are presented for a network of ten agents.


Enhancement of the efficiency of acousto optic Bragg diffraction due to optical activity. A case of Pb 5 Ge 3 O 11 crystals. We show that the existence of optical activity in an optical material can lead to essential enhancement of acousto optic (AO) figure of merit for this material. The reason is that the ellipticity of interacting optical eigenwaves approaches unity near the optic axis and so additional elasto optic (EO) tensor components with relatively large values become involved into the effective EO coefficient. We demonstrate on the example of lead germanate crystals, Pb 5 Ge 3 O 11 , that the increase in the efficiency of AO diffraction manifests itself for all the types of isotropic and anisotropic interactions, whenever the incident optical wave propagates close to the optic axis. We find that, in the particular case of diffraction in the interaction plane XZ of Pb 5 Ge 3 O 11 crystals, the maximal enhancement of the AO figure of merit takes place under conditions of the types V and VI of isotropic diffraction, with the AO figure of merit increasing from zero up to 13.3x10 15 s 3 kg, and the type IX of anisotropic diffraction when the AO figure of merit increases more than twice (from 12.5x10 15 up to 26.5x10 15 s 3 kg). The maximal AO efficiency in the XZ interaction plane is reached at the types I and II of isotropic AO interactions. In these cases the AO figure of merit increases from 6.8x10 15 up to 37.9x10 15 s 3 kg and from 31.1x10 15 to 37.9x10 15 s 3 kg, respectively.


Blockchain based Security Framework for Critical Industry 4.0 Cyber physical System. There has been an intense concern for security alternatives because of the recent rise of cyber attacks, mainly targeting critical systems such as industry, medical, or energy ecosystem. Though the latest industry infrastructures largely depend on AI driven maintenance, the prediction based on corrupted data undoubtedly results in loss of life and capital. Admittedly, an inadequate data protection mechanism can readily challenge the security and reliability of the network. The shortcomings of the conventional cloud or trusted certificate driven techniques have motivated us to exhibit a unique Blockchain based framework for a secure and efficient industry 4.0 system. The demonstrated framework obviates the long established certificate authority after enhancing the consortium Blockchain that reduces the data processing delay, and increases cost effective throughput. Nonetheless, the distributed industry 4.0 security model entails cooperative trust than depending on a single party, which in essence indulges the costs and threat of the single point of failure. Therefore, multi signature technique of the proposed framework accomplishes the multi party authentication, which confirms its applicability for the real time and collaborative cyber physical system.


The Good, the Bad and the Ugly Pitfalls and Best Practices in Automated Sound Static Analysis of Ethereum Smart Contracts. Ethereum smart contracts are distributed programs running on top of the Ethereum blockchain. Since program flaws can cause significant monetary losses and can hardly be fixed due to the immutable nature of the blockchain, there is a strong need of automated analysis tools which provide formal security guarantees. Designing such analyzers, however, proved to be challenging and error prone. We review the existing approaches to automated, sound, static analysis of Ethereum smart contracts and highlight prevalent issues in the state of the art. Finally, we overview eThor, a recent static analysis tool that we developed following a principled design and implementation approach based on rigorous semantic foundations to overcome the problems of past works.


The HRT conjecture for two classes of special configurations. The HRT (Heil Ramanathan Topiwala) conjecture stipulates that the set of any finitely many time frequency shifts of a non zero square Lebesgue integrable function is linearly independent. The present work settles two special cases of this conjecture, namely, the cases where the set of time frequency shifts has cardinality N 1 such that either N of the points lie on some integer lattice and the last point is arbitrary, or N of the points are on a line, while the last point does not belong this line. In both cases, we prove that the HRT conjecture holds appealing mainly to various forms of the ergodic theorem. We note that, in recent years, the latter case has been the subject of many investigations notably, the subcase where N 3 and our work completely resolves it.


Solving Quadratic and Cubic Diophantine Equations using 2 adic Valuation Trees. For fixed integers D geq 0 and c geq 3 , we demonstrate how to use 2 adic valuation trees of sequences to analyze Diophantine equations of the form x 2 D 2 cy and x 3 D 2 cy , for y odd. Further, we show for what values D in mathbb Z , the numbers x 3 D will generate infinite valuation trees, which lead to infinite solutions to the above Diophantine equations.


Scale Normalized Image Pyramids with AutoFocus for Object Detection. We present an efficient foveal framework to perform object detection. A scale normalized image pyramid (SNIP) is generated that, like human vision, only attends to objects within a fixed size range at different scales. Such a restriction of objects' size during training affords better learning of object sensitive filters, and therefore, results in better accuracy. However, the use of an image pyramid increases the computational cost. Hence, we propose an efficient spatial sub sampling scheme which only operates on fixed size sub regions likely to contain objects (as object locations are known during training). The resulting approach, referred to as Scale Normalized Image Pyramid with Efficient Resampling or SNIPER, yields up to 3 times speed up during training. Unfortunately, as object locations are unknown during inference, the entire image pyramid still needs processing. To this end, we adopt a coarse to fine approach, and predict the locations and extent of object like regions which will be processed in successive scales of the image pyramid. Intuitively, it's akin to our active human vision that first skims over the field of view to spot interesting regions for further processing and only recognizes objects at the right resolution. The resulting algorithm is referred to as AutoFocus and results in a 2.5 5 times speed up during inference when used with SNIP.


Gravitational Orbits and the Lambert Problem. The Lambert problem is to determine the gravitational orbit between two points that has a specified time of flight, allowing the second point to be a moving target such as a satellite. After a review of gravitational orbits, a solution of the Lambert problem is presented using the path equation directly. However, because the time interval is specified, the solution requires a search procedure. An example is given to illustrate the method.


The extremal function for structured sparse minors. Let c(H) be the smallest value for which e(G) G geq c(H) implies H is a minor of G . We show a new upper bound on c(H) , which improves previous bounds for graphs with a vertex partition where some pairs of parts have many more edges than others for instance a complete bipartite graph with a small number of edges placed inside one class. We also show a tight matching lower bound for almost all such graphs. We apply these results to show c(K ft log t,t ) (0.638 dotsc o f (1))t sqrt f , for f o( log t) omega(1) .


The Einstein Hilbert Palatini formalism in Pseudo Finsler Geometry. A systematic development of the so called Palatini formalism is carried out for pseudo Finsler metrics L of any signature. Substituting in the classical Einstein Hilbert Palatini functional the scalar curvature by the Finslerian Ricci scalar constructed with an independent nonlinear connection N , the affine and metric equations for ( N,L) are obtained. In Lorentzian signature with vanishing mean Landsberg tensor la i , both the Finslerian Hilbert metric equation and the classical Palatini conclusions are recovered by means of a combination of techniques involving the (Riemannian) maximum principle and an original argument about divisibility and fiberwise analyticity. Some of these findings are also extended to (positive definite) Riemannian metrics by using the eigenvalues of the Laplacian. When la i neq 0 , the Palatini conclusions fail necessarily, however, a good number of properties of the solutions remain. The framework and proofs are built up in detail.


On the stability of a multi agent system satisfying a generalized Lienard equation. We study the stability of the system of n coupled second order differential equations ddot r k (1 dot r k 2) dot r k (r k R) , r k in mathbb R 2 , where R (r 1 cdots r n) n . Previous numerical experiments have shown that for a large set of initial conditions the system converges to a rotating limit cycle with a fixed center of mass (the coordinates of the center of mass depend on the initial conditions), dubbed a it ring state . We prove that a ring state with particles spinning in the same direction is stable and we show that every solution that starts near a stable ring state asymptotically approaches a ring state. The proof uses singular perturbations ideas to improve the approximations of the flow on the center manifold in the presence of non isolated fixed points. We also provide the full description of limit cycles and the stability analysis for the decoupled system ( R textrm const ).


The probabilistic Weisfeiler Leman algorithm. A probabilistic version of the Weisfeiler Leman algorithm for computing the coherent closure of a colored graph is suggested. The algorithm is Monte Carlo and runs in time O(n 1 omega log 2 n) , where n is the number of vertices of the graph and omega 2.273 is the matrix multiplication exponent.


Decoder Fusion RNN Context and Interaction Aware Decoders for Trajectory Prediction. Forecasting the future behavior of all traffic agents in the vicinity is a key task to achieve safe and reliable autonomous driving systems. It is a challenging problem as agents adjust their behavior depending on their intentions, the others' actions, and the road layout. In this paper, we propose Decoder Fusion RNN (DF RNN), a recurrent, attention based approach for motion forecasting. Our network is composed of a recurrent behavior encoder, an inter agent multi headed attention module, and a context aware decoder. We design a map encoder that embeds polyline segments, combines them to create a graph structure, and merges their relevant parts with the agents' embeddings. We fuse the encoded map information with further inter agent interactions only inside the decoder and propose to use explicit training as a method to effectively utilize the information available. We demonstrate the efficacy of our method by testing it on the Argoverse motion forecasting dataset and show its state of the art performance on the public benchmark.


An equitable and effective approach to introductory mechanics. Introductory mechanics ("physics 1") is a critical gateway course for students desiring to pursue a STEM career. A major challenge with this course is that there is a large spread in the students' incoming physics preparation, and this level of preparation is strongly predictive of a students' performance. The level of incoming preparation is also largely determined by a student's educational privilege, and so this course can amplify inequities in K 12 education and provide a barrier to a STEM career for students from marginalized groups. Here, we present a novel introductory course design to address such equity challenges in physics 1. We designed the course based on the concept of deliberate practice to give students targeted, scaffolded, and repeated opportunities to engage in research identified practices and decisions required for effective problem solving. We used real world problems, as they carry less resemblance to physics high school problems, and so even the students with the best high school physics instruction have little experience or skill in solving them. The students learned the physics content knowledge they needed in future courses, particularly in engineering, and their problem solving skills improved substantially. Furthermore, the success in the course was not correlated with incoming physics preparation, in stark contrast to the outcomes from traditional physics 1 courses. These findings suggest that we made physics 1 more equitable by employing a deliberate practice approach in the context of real world problem solving.


Dispersion estimates for the boundary integral operator associated with the fourth order Schr "odinger equation posed on the half line. In this paper, we prove dispersion estimates for the boundary integral operator associated with the fourth order Schr "odinger equation posed on the half line. Proofs of such estimates for domains with boundaries are rare and generally require highly technical approaches, as opposed to our simple treatment which is based on constructing a boundary integral operator of oscillatory nature via the Fokas method. Our method is uniform and can be extended to other higher order partial differential equations where the main equation possibly involves more than one spatial derivatives.


An Approach to Detecting Bugs in Pattern Based Bug Detectors. Static bug finders have been widely adopted by developers to find bugs in real world software projects. They leverage predefined heuristic static analysis rules to scan source code or binary code of a software project, and report violations to these rules as warnings to be verified. However, the advantages of static bug finders are overshadowed by such issues as uncovered obvious bugs, false positives, etc. To improve these tools, many techniques have been proposed to filter out false positives reported or design new static analysis rules. Nevertheless, the under performance of bug finders can also be caused by the incorrectness of current rules contained in the static bug finders, which is not explored yet. In this work, we propose a differential testing approach to detect bugs in the rules of four widely used static bug finders, i.e., SonarQube, PMD, SpotBugs, and ErrorProne, and conduct a qualitative study about the bugs found. To retrieve paired rules across static bug finders for differential testing, we design a heuristic based rule mapping method which combines the similarity in rules description and the overlap in warning information reported by the tools. The experiment on 2,728 open source projects reveals 46 bugs in the static bug finders, among which 24 are fixed or confirmed and the left are awaiting confirmation. We also summarize 13 bug patterns in the static analysis rules based on their context and root causes, which can serve as the checklist for designing and implementing other rules and or in other tools. This study indicates that the commonly used static bug finders are not as reliable as they might have been envisaged. It not only demonstrates the effectiveness of our approach, but also highlights the need to continue improving the reliability of the static bug finders.


On the Complexity of the Geometric Median Problem with Outliers. In the Geometric Median problem with outliers, we are given a finite set of points in d dimensional real space and an integer m, the goal is to locate a new point in space (center) and choose m of the input points to minimize the sum of the Euclidean distances from the center to the chosen points. This problem can be solved "almost exactly" in polynomial time if d is fixed and admits an approximation scheme PTAS in high dimensions. However, the complexity of the problem was an open question. We prove that, if the dimension of space is not fixed, Geometric Median with outliers is strongly NP hard, does not admit approximation schemes FPTAS unless P NP, and is W 1 hard with respect to the parameter m. The proof is done by a reduction from the Independent Set problem. Based on a similar reduction, we also get the NP hardness of closely related geometric 2 clustering problems in which it is required to partition a given set of points into two balanced clusters minimizing the cost of median clustering. Finally, we study Geometric Median with outliers in ell infty space and prove the same complexity results as for the Euclidean problem.


Newton methods based convolution neural networks using parallel processing. Training of convolutional neural networks is a high dimensional and a non convex optimization problem. At present, it is inefficient in situations where parametric learning rates can not be confidently set. Some past works have introduced Newton methods for training deep neural networks. Newton methods for convolutional neural networks involve complicated operations. Finding the Hessian matrix in second order methods becomes very complex as we mainly use the finite differences method with the image data. Newton methods for convolutional neural networks deals with this by using the sub sampled Hessian Newton methods. In this paper, we have used the complete data instead of the sub sampled methods that only handle partial data at a time. Further, we have used parallel processing instead of serial processing in mini batch computations. The results obtained using parallel processing in this study, outperform the time taken by the previous approach.