Efficient SPARQL Autocompletion via SPARQL. We show how to achieve fast autocompletion for SPARQL queries on very large knowledge bases. At any position in the body of a SPARQL query, the autocompletion suggests matching subjects, predicates, or objects. The suggestions are context sensitive in the sense that they lead to a non empty result and are ranked by their relevance to the part of the query already typed. The suggestions can be narrowed down by prefix search on the names and aliases of the desired subject, predicate, or object. All suggestions are themselves obtained via SPARQL queries, which we call autocompletion queries. For existing SPARQL engines, these queries are impractically slow on large knowledge bases. We present various algorithmic and engineering improvements of an existing SPARQL engine such that these autocompletion queries are executed efficiently. We provide an extensive evaluation of a variety of suggestion methods on three large knowledge bases, including Wikidata (6.9B triples). We explore the trade off between the relevance of the suggestions and the processing time of the autocompletion queries. We compare our results with two widely used SPARQL engines, Virtuoso and Blazegraph. On Wikidata, we achieve fully sensitive suggestions with sub second response times for over 90 of a large and diverse set of thousands of autocompletion queries. Materials for full reproducibility, an interactive evaluation web app, and a demo are available on https ad.informatik.uni freiburg.de publications .


Nature of the orbital angular momentum (OAM) fields in a multilayered fiber. We provide a theoretical analysis of the nature of the orbital angular momentum (OAM) modal fields in a multilayered fiber, such as the step index fiber and the ring core fiber. In a detailed study of the vector field solutions of the step index fiber (in the exponential basis), we discover that the polarization induced field component is a modified scalar OAM field (as opposed to a standard OAM scalar field) with a shifted intensity pattern in the weakly guiding approximation (WGA) the familiar intensity donut pattern is reduced or increased in radius depending upon whether it is a case of spin alignment or anti alignment with the OAM. Such a shift in the intensity pattern appears to be a general feature of the field of a multilayered fiber as seen from an extension to the ring core fiber. Additionally, we derive a general expression for the polarization correction to the scalar propagation constant, which includes, for the first time, the contribution of the polarization induced field. All the analytic expressions are illustrated and validated numerically with application to a step index fiber, whose analytic solutions are well known.


Neural content aware collaborative filtering for cold start music recommendation. State of the art music recommender systems are based on collaborative filtering, which builds upon learning similarities between users and songs from the available listening data. These approaches inherently face the cold start problem, as they cannot recommend novel songs with no listening history. Content aware recommendation addresses this issue by incorporating content information about the songs on top of collaborative filtering. However, methods falling in this category rely on a shallow user item interaction that originates from a matrix factorization framework. In this work, we introduce neural content aware collaborative filtering, a unified framework which alleviates these limits, and extends the recently introduced neural collaborative filtering to its content aware counterpart. We propose a generative model which leverages deep learning for both extracting content information from low level acoustic features and for modeling the interaction between users and songs embeddings. The deep content feature extractor can either directly predict the item embedding, or serve as a regularization prior, yielding two variants (strict and relaxed) of our model. Experimental results show that the proposed method reaches state of the art results for a cold start music recommendation task. We notably observe that exploiting deep neural networks for learning refined user item interactions outperforms approaches using a more simple interaction model in a content aware framework.


Variational Hodge conjecture for complete intersections on hypersurfaces in projective space. In this paper we give a new and simplified proof of the variational Hodge conjecture for complete intersection cycles on a hypersurface in projective space.


The ring of modular forms for the even unimodular lattice of signature (2,18). We show that the ring of modular forms with characters for the even unimodular lattice of signature (2,18) is obtained from the invariant ring of mathrm Sym ( mathrm Sym 8(V) oplus mathrm Sym 12 (V)) with respect to the action of mathrm SL (V) by adding a Borcherds product of weight 132 with one relation of weight 264, where V is a 2 dimensional mathbb C vector space. The proof is based on the study of the moduli space of elliptic K3 surfaces with a section.


The Eisenstein ideal of weight k and ranks of Hecke algebras. Let p and ell be primes such that p 3 and p mid ell 1 and k be an even integer. We use deformation theory of pseudo representations to study the completion of the Hecke algebra acting on the space of cuspidal modular forms of weight k and level Gamma 0( ell) at the maximal Eisenstein ideal containing p . We give a necessary and sufficient condition for the mathbb Z p rank of this Hecke algebra to be greater than 1 in terms of vanishing of the cup products of certain global Galois cohomology classes. We also recover some of the results proven by Wake and Wang Erickson for k 2 using our methods. In addition, we prove some R mathbb T theorems under certain hypothesis.


Rapid Replanning in Consecutive Pick and Place Tasks with Lazy Experience Graph. In an environment where a manipulator needs to execute multiple pick and place tasks, the act of object manoeuvre will change the underlying configuration space, which in turn affects all subsequent tasks. Previously free configurations might now be occupied by the newly placed objects, and previously occupied space might now open up new paths. We propose Lazy Tree based Replanner (LTR ) a novel hybrid planner that inherits the rapid planning nature of existing anytime incremental sampling based planners, and at the same time allows subsequent tasks to leverage prior experience via a lazy experience graph. Previous experience is summarised in a lazy graph structure, and LTR is formulated such that it is robust and beneficial regardless of the extent of changes in the workspace. Our hybrid approach attains a faster speed in obtaining an initial solution than existing roadmap based planners and often with a lower cost in trajectory length. Subsequent tasks can utilise the lazy experience graph to speed up finding a solution and take advantage of the optimised graph to minimise the cost objective. We provide rigorous proofs of probabilistic completeness and asymptotic optimal guarantees. Experimentally, we show that in repeated pick and place tasks, LTR attains a high gain in performance when planning for subsequent tasks.


HHF Hashing guided Hinge Function for Deep Hashing Retrieval. Deep hashing has shown promising performance in large scale image retrieval. However, latent codes extracted by Deep Neural Networks (DNNs) will inevitably lose semantic information during the binarization process, which damages the retrieval accuracy and makes it challenging. Although many existing approaches perform regularization to alleviate quantization errors, we figure out an incompatible conflict between metric learning and quantization learning. The metric loss penalizes the inter class distances to push different classes unconstrained far away. Worse still, it tends to map the latent code deviate from ideal binarization point and generate severe ambiguity in the binarization process. Based on the minimum distance of the binary linear code, we creatively propose Hashing guided Hinge Function (HHF) to avoid such conflict. In detail, the carefully designed inflection point, which relies on the hash bit length and category numbers, is explicitly adopted to balance the metric term and quantization term. Such a modification prevents the network from falling into local metric optimal minima in deep hashing. Extensive experiments in CIFAR 10, CIFAR 100, ImageNet, and MS COCO show that HHF consistently outperforms existing techniques, and is robust and flexible to transplant into other methods. Code is available at https github.com JerryXu0129 HHF.


A short memory operator splitting scheme for constant Q viscoelastic wave equation. We propose a short memory operator splitting scheme for solving the constant Q wave equation, where the fractional stress strain relation contains multiple Caputo fractional derivatives with order much smaller than 1. The key is to exploit its extension problem by converting the flat singular kernels into strongly localized ones, so that the major contribution of weakly singular integrals over a semi infinite interval can be captured by a few Laguerre functions with proper asymptotic behavior. Despite its success in reducing both memory requirement and arithmetic complexity, we show that numerical accuracy under prescribed memory variables may deteriorate in time due to the dynamical increments of projection errors. Fortunately, it can be considerably alleviated by introducing a suitable scaling factor beta 1 and pushing the collocation points closer to origin. An operator splitting scheme is introduced to solve the resulting set of equations, where the auxiliary dynamics can be solved exactly, so that it gets rid of the numerical stiffness and discretization errors. Numerical experiments on both 1 D diffusive wave equation and 2 D constant Q P and S wave equations are presented to validate the accuracy and efficiency of the proposed scheme.


A large scale bibliometric analysis of global climate change research between 2001 and 2018. Global climate change is attracting widespread scientific, political, and public attention owing to the involvement of international initiatives such as the Paris Agreement and the Intergovernmental Panel on Climate Change. We present a large scale bibliometric analysis based on approximately 120,000 climate change publications between 2001 and 2018 to examine how climate change is studied in scientific research. Our analysis provides an overview of scientific knowledge, shifts of research hotspots, global geographical distribution of research, and focus of individual countries. In our analysis, we identify five key fields in climate change research physical sciences, paleoclimatology, climate change ecology, climate technology, and climate policy. We draw the following key conclusions (1) Over the investigated time period, the focus of climate change research has shifted from understanding the climate system toward climate technologies and policies, such as efficient energy use and legislation. (2) There is an imbalance in scientific production between developed and developing countries. (3) Geography, national demands, and national strategies have been important drivers that influence the research interests and concerns of researchers in different countries. Our study can be used by researchers and policy makers to reflect on the directions in which climate change research is developing and discuss priorities for future research.


Decomposition of multicorrelation sequences and joint ergodicity. We show that, under finitely many ergodicity assumptions, any multicorrelation sequence defined by invertible measure preserving mathbb Z d actions with multivariable integer polynomial iterates is the sum of a nilsequence and a null sequence, extending a recent result of the second author. To this end, we develop a new seminorm bound estimate for multiple averages by improving the results in a previous work of the first, third and fourth authors. We also use this approach to obtain new criteria for joint ergodicity of multiple averages with multivariable polynomial iterates on mathbb Z d systems.


Non weight modules over the mirror Heisenberg Virasoro algebra. In this paper, we study irreducible non weight modules over the mirror Heisenberg Virasoro algebra mathcal D , including Whittaker modules, mathcal U ( mathbb C d 0) free modules, and their tensor products. More precisely, we give the necessary and sufficient conditions for the Whittaker modules to be irreducible. We determine all mathcal D module structures on mathcal U ( mathbb C d 0) , and find the necessary and sufficient conditions for these modules to be irreducible. At last we determine the necessary and sufficient conditions for the tensor products of Whittaker modules and mathcal U ( mathbb C d 0) free modules to be irreducible, and obtain that any two such tensor products are isomorphic if and only if the corresponding Whittaker modules and mathcal U ( mathbb C d 0) free modules are isomorphic. These lead to many new irreducible non weight modules over mathcal D .


Trees, forests, and total positivity I. q trees and q forests matrices. We consider matrices with entries that are polynomials in q arising from natural q generalisations of two well known formulas that count forests on n vertices with k components and trees on n 1 vertices where k children of the root are smaller than the root. We give a combinatorial interpretation of the corresponding statistic on forests and trees and show, via the construction of various planar networks and the Lindstr "om Gessel Viennot lemma, that these matrices are coefficientwise totally positive. We also exhibit generalisations of the entries of these matrices to polynomials in emph eight indeterminates, and present some conjectures concerning the coefficientwise Hankel total positivity of their row generating polynomials.


HyperStyle StyleGAN Inversion with HyperNetworks for Real Image Editing. The inversion of real images into StyleGAN's latent space is a well studied problem. Nevertheless, applying existing approaches to real world scenarios remains an open challenge, due to an inherent trade off between reconstruction and editability latent space regions which can accurately represent real images typically suffer from degraded semantic control. Recent work proposes to mitigate this trade off by fine tuning the generator to add the target image to well behaved, editable regions of the latent space. While promising, this fine tuning scheme is impractical for prevalent use as it requires a lengthy training phase for each new image. In this work, we introduce this approach into the realm of encoder based inversion. We propose HyperStyle, a hypernetwork that learns to modulate StyleGAN's weights to faithfully express a given image in editable regions of the latent space. A naive modulation approach would require training a hypernetwork with over three billion parameters. Through careful network design, we reduce this to be in line with existing encoders. HyperStyle yields reconstructions comparable to those of optimization techniques with the near real time inference capabilities of encoders. Lastly, we demonstrate HyperStyle's effectiveness on several applications beyond the inversion task, including the editing of out of domain images which were never seen during training.


Learn to Grasp with Less Supervision A Data Efficient Maximum Likelihood Grasp Sampling Loss. Robotic grasping for a diverse set of objects is essential in many robot manipulation tasks. One promising approach is to learn deep grasping models from large training datasets of object images and grasp labels. However, empirical grasping datasets are typically sparsely labeled (i.e., a small number of successful grasp labels in each image). The data sparsity issue can lead to insufficient supervision and false negative labels and thus results in poor learning results. This paper proposes a Maximum Likelihood Grasp Sampling Loss (MLGSL) to tackle the data sparsity issue. The proposed method supposes that successful grasps are stochastically sampled from the predicted grasp distribution and maximizes the observing likelihood. MLGSL is utilized for training a fully convolutional network that generates thousands of grasps simultaneously. Training results suggest that models based on MLGSL can learn to grasp with datasets composing of 2 labels per image. Compared to previous works, which require training datasets of 16 labels per image, MLGSL is 8x more data efficient. Meanwhile, physical robot experiments demonstrate an equivalent performance at a 90.7 grasp success rate on household objects.


Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles. The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion framework to achieve high map quality despite unknown numbers of objects in fields of view (FoVs), various sensing and model uncertainties, and missing data labels for online learning. The novelty of this work is threefold (1) developing a three stage fusion scheme to predict the number of objects effectively and to fuse multiple local maps with fidelity scores (2) developing an FL algorithm which fine tunes feature models (i.e., representation learning networks for feature extraction) distributively by aggregating model parameters (3) developing a knowledge distillation method to generate FL training labels when data labels are unavailable. The proposed framework is implemented in the Car Learning to Act (CARLA) simulation platform. Extensive experimental results are provided to verify the superior performance and robustness of the developed map fusion and FL schemes.


Equivalence of solutions for non homogeneous p(x) Laplace equations. We establish the equivalence between weak and viscosity solutions for non homogeneous p(x) Laplace equations with a right hand side term depending on the spatial variable, the unknown, and its gradient. We employ inf and sup convolution techniques to state that viscosity solutions are also weak solutions, and comparison principles to prove the converse. The new aspects of the p(x) Laplacian compared to the constant case are the presence of log terms and the lack of the invariance under translations.


'They're all about pushing the products and shiny things rather than fundamental security' Mapping Socio technical Challenges in Securing the Smart Home. Insecure connected devices can cause serious threats not just to smart home owners, but also the underlying infrastructural network as well. There has been increasing academic and regulatory interest in addressing cybersecurity risks from both the standpoint of Internet of Things (IoT) vendors and that of end users. In addition to the current data protection and network security legal frameworks, for example, the UK government has initiated the 'Secure by Design' campaign. While there has been work on how organisations and individuals manage their own cybersecurity risks, it remains unclear to what extent IoT vendors are supporting end users to perform day to day management of such risks in a usable way, and what is stopping the vendors from improving such support. We interviewed 13 experts in the field of IoT and identified three main categories of barriers to making IoT products usably secure technical, legal and organisational. In this paper we further discuss the policymaking implications of these findings and make some recommendations.


Anharmonic oscillator A playground to get insight into renormalization. In the presence of interactions the frequency of a simple harmonic oscillator deviates from the noninteracting one. Various methods can be used to compute the changes to the frequency perturbatively. Some of them resemble the methods used in quantum field theory where the bare values of the parameters of the theory run when an interaction is added. In this paper, we review some of these techniques and introduce some new ones in line with quantum field theory methods. Moreover, we investigate the case of more than one oscillator to see how the frequencies of small oscillations change when non linear terms are added to a linear system and observe an interesting beat phenomenon in degenerate coupled oscillatory systems.


Integrating Novelty Detection Capabilities with MSL Mastcam Operations to Enhance Data Analysis. While innovations in scientific instrumentation have pushed the boundaries of Mars rover mission capabilities, the increase in data complexity has pressured Mars Science Laboratory (MSL) and future Mars rover operations staff to quickly analyze complex data sets to meet progressively shorter tactical and strategic planning timelines. MSLWEB is an internal data tracking tool used by operations staff to perform first pass analysis on MSL image sequences, a series of products taken by the Mast camera, Mastcam. Mastcam's multiband multispectral image sequences require more complex analysis compared to standard 3 band RGB images. Typically, these are analyzed using traditional methods to identify unique features within the sequence. Given the short time frame of tactical planning in which downlinked images might need to be analyzed (within 5 10 hours before the next uplink), there exists a need to triage analysis time to focus on the most important sequences and parts of a sequence. We address this need by creating products for MSLWEB that use novelty detection to help operations staff identify unusual data that might be diagnostic of new or atypical compositions or mineralogies detected within an imaging scene. This was achieved in two ways 1) by creating products for each sequence to identify novel regions in the image, and 2) by assigning multispectral sequences a sortable novelty score. These new products provide colorized heat maps of inferred novelty that operations staff can use to rapidly review downlinked data and focus their efforts on analyzing potentially new kinds of diagnostic multispectral signatures. This approach has the potential to guide scientists to new discoveries by quickly drawing their attention to often subtle variations not detectable with simple color composites.


Poncelet Parabola Pirouettes. We describe some three dozen curious phenomena manifested by parabolas inscribed or circumscribed about certain Poncelet triangle families. Despite their pirouetting motion, parabolas' focus, vertex, directrix, etc., will often sweep or envelop rather elementary loci such as lines, circles, or points. Most phenomena are unproven though supported by solid numerical evidence (proofs are welcome). Some yet unrealized experiments are posed as "challenges" (results are welcome!).


Spherical Schubert varieties and pattern avoidance. A normal variety X is called H spherical for the action of the complex reductive group H if it contains a dense orbit of some Borel subgroup of H . We resolve a conjecture of Hodges Yong by showing that their spherical permutations are characterized by permutation pattern avoidance. Together with results of Gao Hodges Yong this implies that the sphericality of a Schubert variety X w with respect to the largest possible Levi subgroup is characterized by this same pattern avoidance condition.


Normalized solutions to the fractional Kirchhoff equations with combined nonlinearities. In this paper, we study the existence and asymptotic properties of solutions to the following fractional Kirchhoff equation begin equation left(a b int mathbb R 3 ( Delta) frac s 2 u 2 dx right)( Delta) s u lambda u mu u q 2 u u p 2 u quad hbox in mathbb R 3 , end equation with a prescribed mass begin equation int mathbb R 3 u 2 dx c 2 , end equation where s in(0, 1) , a, b, c 0 , 2 q p 2 s ast frac 6 3 2s , mu 0 and lambda in mathbb R as a Lagrange multiplier. Under different assumptions on q p , c 0 and mu 0 , we prove some existence results about the normalized solutions. Our results extend the results of Luo and Zhang (Calc. Var. Partial Differential Equations 59, 1 35, 2020) to the fractional Kirchhoff equations. Moreover, we give some results about the behavior of the normalized solutions obtained above as mu rightarrow0 .


Iterative Refinement for Real Time Multi Robot Path Planning. We study the iterative refinement of path planning for multiple robots, known as multi agent pathfinding (MAPF). Given a graph, agents, their initial locations, and destinations, a solution of MAPF is a set of paths without collisions. Iterative refinement for MAPF is desirable for three reasons 1) optimization is intractable, 2) sub optimal solutions can be obtained instantly, and 3) it is anytime planning, desired in online scenarios where time for deliberation is limited. Despite the high demand, this is under explored in MAPF because finding good neighborhoods has been unclear so far. Our proposal uses a sub optimal MAPF solver to obtain an initial solution quickly, then iterates the two procedures 1) select a subset of agents, 2) use an optimal MAPF solver to refine paths of selected agents while keeping other paths unchanged. Since the optimal solvers are used on small instances of the problem, this scheme yields efficient enough solutions rapidly while providing high scalability. We also present reasonable candidates on how to select a subset of agents. Evaluations in various scenarios show that the proposal is promising the convergence is fast, scalable, and with reasonable quality.


Experimental and computational comparison of freeze thaw induced pressure generation in red and sugar maple. Sap exudation is the process whereby trees such as sugar (Acer saccharum) and red maple (A. rubrum) generate high positive stem pressure in response to repeated freeze thaw cycles. This elevated xylem pressure permits sap to be harvested over a period of several weeks and hence is a major factor in the viability of the maple syrup industry. The extensive literature on sap exudation documents various competing hypotheses regarding the physical and biological mechanisms driving positive pressure generation in maple, but to date relatively little effort has been expended on devising detailed mathematical models for the exudation process. In this paper, we utilize an existing model of Graf et al. J. Roy. Soc. Interface 12 20150665, 2015 that describes heat and mass transport within the multiphase gas liquid ice mixture within the porous xylem tissue. The model captures the inherent multiscale nature of xylem transport by including phase change and osmotic transport within wood cells on the microscale, which is coupled to heat transport through the tree stem on the macroscale. We extend this model by incorporating a root reflection coefficient that introduces an asymmetry in root water flux and hence permits a more realistic accumulation of stem pressure. A parametric study based on simulations with synthetic temperature data singles out the essential model parameters that have greatest impact on stem pressure build up. Measured daily temperature fluctuations are then used as model inputs and the resulting simulated pressures are compared directly with experimental measurements taken from mature red and sugar maple stems during the sap harvest season. The results demonstrate that our multiscale freeze thaw model reproduces realistic exudation behavior, thereby providing novel insights into the specific physical mechanisms that dominate positive pressure generation in maple trees.


Graphene oxide doped ethanol droplet combustion Ignition delay and contribution of atomization to burning rate. Effects of graphene oxide nanomaterials addition and oxidation level on ignition delay and burning rate of ethanol droplets are experimentally investigated. Three graphene oxide samples are synthesized and characterized. Separate high speed OH chemiluminescence and high speed shadowgraphy images are collected. The results suggest that increasing the loading concentration from 0 to 0.1 generally increases the ignition delay, except for ethanol doped with the highly oxidized graphene. The probability density function of the atomized baby droplet diameter, initial projected velocity, and length of the projected trajectory are similar for all tested conditions and independent of the oxidation level and loading concentration of the additives. The joint probability density function calculated for the atomization related parameters against one another suggests that the majority of the baby droplets feature a relatively short lifetime, indicating they may potentially burn inside the flame envelope. Using droplet surface regression curves versus time, the burning rate for periods in which the atomization does not occur, and for the periods that the atomization is present are estimated. The former burning rate is shown to enhance by increasing the loading concentration and reducing the oxidation level of graphene. However, it is found that a maximum increase in the latter burning rate for both loading concentrations occurs for ethanol doped with the graphene oxide that features maximum amount of infrared radiation absorption. It is shown that relatively intense atomization suppresses the mass loss. Doping ethanol with graphene oxide and increasing the loading concentration from 0.01 to 0.1 enhances the overall burning rate, with a maximum enhancement of 8.4 pertaining to addition of reduced oxidized graphene oxide and for the loading concentration of 0.1 .


Buying time in software development how estimates become commitments?. Despite years of research for improving accuracy, software practitioners still face software estimation difficulties. Expert judgment has been the prevalent method used in industry, and researchers' focus on raising realism in estimates when using it seems not to be enough for the much expected improvements. Instead of focusing on the estimation process's technicalities, we investigated the interaction of the establishment of commitments with customers and software estimation. By observing estimation sessions and interviewing software professionals from companies in varying contexts, we found that defensible estimates and padding of software estimates are crucial in converting estimates into commitments. Our findings show that software professionals use padding for three different reasons contingency buffer, completing other tasks, or improving the overall quality of the product. The reasons to pad have a common theme buying time to balance short and long term software development commitments, including the repayment of technical debt. Such a theme emerged from the human aspects of the interaction of estimation and the establishment of commitments pressures and customers' conflicting short and long term needs play silent and unrevealed roles in between the technical activities. Therefore, our study contributes to untangling the underlying phenomena, showing how the practices used by software practitioners help to deal with the human and social context in which estimation is embedded.


Lie algebroid connections, twisted Higgs bundles and motives of moduli spaces. Let mathcal L (L, cdot ,, cdot , delta) be an algebraic Lie algebroid over a smooth projective curve of genus g geq 2 such that L is a line bundle whose degree is less than 2 2g . Let r and d be coprime numbers. We prove that the motivic class (in the Grothendieck ring of varieties) of the moduli space of mathcal L connections of rank r and degree d over X does not depend on the Lie algebroid structure cdot ,, cdot and delta of mathcal L and neither on the line bundle L itself, but only the degree of L (and of course on r,d,g and X ). In particular it is equal to the motivic class of the moduli space of K X(D) twisted Higgs bundles of rank r and degree d , for D any divisor of positive degree. As a consequence, similar results (actually a little stronger) are obtained for the corresponding E polynomials. Some applications of these results are then deduced.


High dimensional distributed semantic spaces for utterances. High dimensional distributed semantic spaces have proven useful and effective for aggregating and processing visual, auditory, and lexical information for many tasks related to human generated data. Human language makes use of a large and varying number of features, lexical and constructional items as well as contextual and discourse specific data of various types, which all interact to represent various aspects of communicative information. Some of these features are mostly local and useful for the organisation of e.g. argument structure of a predication others are persistent over the course of a discourse and necessary for achieving a reasonable level of understanding of the content. This paper describes a model for high dimensional representation for utterance and text level data including features such as constructions or contextual data, based on a mathematically principled and behaviourally plausible approach to representing linguistic information. The implementation of the representation is a straightforward extension of Random Indexing models previously used for lexical linguistic items. The paper shows how the implemented model is able to represent a broad range of linguistic features in a common integral framework of fixed dimensionality, which is computationally habitable, and which is suitable as a bridge between symbolic representations such as dependency analysis and continuous representations used e.g. in classifiers or further machine learning approaches. This is achieved with operations on vectors that constitute a powerful computational algebra, accompanied with an associative memory for the vectors. The paper provides a technical overview of the framework and a worked through implemented example of how it can be applied to various types of linguistic features.


Real Time Optimal Trajectory Planning for Autonomous Vehicles and Lap Time Simulation Using Machine Learning. Widespread development of driverless vehicles has led to the formation of autonomous racing, where technological development is accelerated by the high speeds and competitive environment of motorsport. A particular challenge for an autonomous vehicle is that of identifying a target trajectory or, in the case of a competition vehicle, the racing line. Many existing approaches to finding the racing line are either not time optimal solutions, or are computationally expensive rendering them unsuitable for real time application using on board processing hardware. This study describes a machine learning approach to generating an accurate prediction of the racing line in real time on desktop processing hardware. The proposed algorithm is a feed forward neural network, trained using a dataset comprising racing lines for a large number of circuits calculated via traditional optimal control lap time simulation. The network predicts the racing line with a mean absolute error of 0.27m, and just 0.11m at corner apex comparable to human drivers, and autonomous vehicle control subsystems. The approach generates predictions within 33ms, making it over 9,000 times faster than traditional methods of finding the optimal trajectory. Results suggest that for certain applications data driven approaches to find near optimal racing lines may be favourable to traditional computational methods.


Beyond the Tip of the Iceberg Assessing Coherence of Text Classifiers. As large scale, pre trained language models achieve human level and superhuman accuracy on existing language understanding tasks, statistical bias in benchmark data and probing studies have recently called into question their true capabilities. For a more informative evaluation than accuracy on text classification tasks can offer, we propose evaluating systems through a novel measure of prediction coherence. We apply our framework to two existing language understanding benchmarks with different properties to demonstrate its versatility. Our experimental results show that this evaluation framework, although simple in ideas and implementation, is a quick, effective, and versatile measure to provide insight into the coherence of machines' predictions.


Reverse Engineering of Generative Models Inferring Model Hyperparameters from Generated Images. State of the art (SOTA) Generative Models (GMs) can synthesize photo realistic images that are hard for humans to distinguish from genuine photos. We propose to perform reverse engineering of GMs to infer the model hyperparameters from the images generated by these models. We define a novel problem, "model parsing", as estimating GM network architectures and training loss functions by examining their generated images a task seemingly impossible for human beings. To tackle this problem, we propose a framework with two components a Fingerprint Estimation Network (FEN), which estimates a GM fingerprint from a generated image by training with four constraints to encourage the fingerprint to have desired properties, and a Parsing Network (PN), which predicts network architecture and loss functions from the estimated fingerprints. To evaluate our approach, we collect a fake image dataset with 100 K images generated by 100 GMs. Extensive experiments show encouraging results in parsing the hyperparameters of the unseen models. Finally, our fingerprint estimation can be leveraged for deepfake detection and image attribution, as we show by reporting SOTA results on both the recent Celeb DF and image attribution benchmarks.


Enhancing the third order optical nonlinear performance in CMOS devices with integrated 2D graphene oxide films. We report enhanced nonlinear optics in complementary metal oxide semiconductor compatible photonic platforms through the use of layered two dimensional (2D) graphene oxide (GO) films. We integrate GO films with silicon on insulator nanowires (SOI), high index doped silica glass (Hydex) and silicon nitride (SiN) waveguides and ring resonators, to demonstrate an enhanced optical nonlinearity including Kerr nonlinearity and four wave mixing (FWM). The GO films are integrated using a large area, transfer free, layer by layer method while the film placement and size are controlled by photolithography. In SOI nanowires we observe a dramatic enhancement in both the Kerr nonlinearity and nonlinear figure of merit (FOM) due to the highly nonlinear GO films. Self phase modulation (SPM) measurements show significant spectral broadening enhancement for SOI nanowires coated with patterned films of GO. The dependence of GO Kerr nonlinearity on layer number and pulse energy shows trends of the layered GO films from 2D to quasi bulk like behavior. The nonlinear parameter of GO coated SOI nanowires is increased 16 fold, with the nonlinear FOM increasing over 20 times to a FOM greater than 5. We also observe an improved FWM efficiency in SiN waveguides integrated with 2D layered GO films. FWM measurements for samples with different numbers of GO layers and at different pump powers are performed, achieving up to 7.3 dB conversion efficiency (CE) enhancement for a uniformly coated device with 1 layer of GO and 9.1 dB for a patterned device with 5 layers of GO. These results reveal the strong potential of GO films to improve the nonlinear optics of silicon, Hydex and SiN photonic devices.


Explicit equations of 800 conics on a Barth Bauer quartic. We present equations of 800 conics on a Mukai's smooth quartic which is an explicit model of a K3 surface recently considered by Alex Degtyarev. The number 800 is a current record for the number of irreducible conics on a smooth quartic in ordinary projective space.


A Novel Algorithm to Solve for an Underwater Line Source Sound Field Based on the Theory of Global Matrix Coupled Modes and the Chebyshev Tau Spectral Method. High precision numerical sound field is the basis of underwater target detection, positioning and communication. A line source in the plane is a common type of sound source in computational ocean acoustics, and the exciting waveguide in a range dependent marine environment is often structurally complicated. However, traditional algorithms often assume that the waveguide has a simple seabed boundary, and the line source is located at a horizontal range of 0 m, which is an ideal and rare situation in the actual ocean. In this paper, a novel algorithm is designed that can solve for the sound field generated by a line source at any position in a range dependent ocean environment. The proposed algorithm uses the classic stepwise approximation to address the range dependence of the environment and uses the Chebyshev Tau spectral method to solve for the horizontal wavenumbers and modes of approximately range independent segments. After obtaining the modal information of flat segments, a global matrix is assembled to solve for the coupling coefficients of all segments, and finally, a complete sound field is synthesized. Numerical experiments using a robust numerical program we developed based on this algorithm verify the correctness and usability of the novel algorithm and software. Furthermore, a detailed analysis and test of the computational cost of this algorithm show that it is extremely efficient.


A Novel GPR Based Prediction Model for Cylic Backbone Curves of Reinforced Concrete Shear Walls. Backbone curves are used to characterize nonlinear responses of structural elements by simplifying the cyclic force deformation relationships. Accurate modeling of cyclic behavior can be achieved with a reliable backbone curve model. In this paper, a novel machine learning based model is proposed to predict the backbone curve of reinforced concrete shear (structural) walls based on key wall design properties. Reported experimental responses of a detailed test database consisting of 384 reinforced concrete shear walls under cyclic loading were utilized to predict seven critical points to define the backbone curves, namely shear at cracking point shear and displacement at yielding point and peak shear force and corresponding displacement and ultimate displacement and corresponding shear. The predictive models were developed based on the Gaussian Process Regression method (GPR), which adopts a non parametric Bayesian approach. The ability of the proposed GPR based model to make accurate and robust estimations for the backbone curves was validated based on unseen data using a hundred random sampling procedure. The prediction accuracies (i.e., ratio of predicted actual values) are close to 1.0, whereas the coefficient of determination (R2) values range between 0.90 0.97 for all backbone points. The proposed GPR based backbone models are shown to reflect cyclic behavior more accurately than the traditional methods, therefore, they would serve the earthquake engineering community for better evaluation of the seismic performance of existing buildings.


Adaptive Dynamic Pruning for Non IID Federated Learning. Federated Learning (FL) has emerged as a new paradigm of training machine learning models without sacrificing data security and privacy. Learning models at edge devices such as cell phones is one of the most common use case of FL. However, the limited computing power and energy constraints of edge devices hinder the adoption of FL for both model training and deployment, especially for the resource hungry Deep Neural Networks (DNNs). To this end, many model compression methods have been proposed and network pruning is among the most well known. However, a pruning policy for a given model is highly dataset dependent, which is not suitable for non Independent and Identically Distributed (Non IID) FL edge devices. In this paper, we present an adaptive pruning scheme for edge devices in an FL system, which applies dataset aware dynamic pruning for inference acceleration on Non IID datasets. Our evaluation shows that the proposed method accelerates inference by 2 times ( 50 FLOPs reduction) while maintaining the model's quality on edge devices.


DeepStyle User Style Embedding for Authorship Attribution of Short Texts. Authorship attribution (AA), which is the task of finding the owner of a given text, is an important and widely studied research topic with many applications. Recent works have shown that deep learning methods could achieve significant accuracy improvement for the AA task. Nevertheless, most of these proposed methods represent user posts using a single type of feature (e.g., word bi grams) and adopt a text classification approach to address the task. Furthermore, these methods offer very limited explainability of the AA results. In this paper, we address these limitations by proposing DeepStyle, a novel embedding based framework that learns the representations of users' salient writing styles. We conduct extensive experiments on two real world datasets from Twitter and Weibo. Our experiment results show that DeepStyle outperforms the state of the art baselines on the AA task.


Computer Vision Tool for Detection, Mapping and Fault Classification of PV Modules in Aerial IR Videos. Increasing deployment of photovoltaics (PV) plants demands for cheap and fast inspection. A viable tool for this task is thermographic imaging by unmanned aerial vehicles (UAV). In this work, we develop a computer vision tool for the semi automatic extraction of PV modules from thermographic UAV videos. We use it to curate a dataset containing 4.3 million IR images of 107842 PV modules from thermographic videos of seven different PV plants. To demonstrate its use for automated PV plant inspection, we train a ResNet 50 to classify ten common module anomalies with more than 90 test accuracy. Experiments show that our tool generalizes well to different PV plants. It successfully extracts PV modules from 512 out of 561 plant rows. Failures are mostly due to an inappropriate UAV trajectory and erroneous module segmentation. Including all manual steps our tool enables inspection of 3.5 MW p to 9 MW p of PV installations per day, potentially scaling to multi gigawatt plants due to its parallel nature. While we present an effective method for automated PV plant inspection, we are also confident that our approach helps to meet the growing demand for large thermographic datasets for machine learning tasks, such as power prediction or unsupervised defect identification.


Shift relations and reducibility of some Fuchsian differential equations of order 2,...,6 with three singular points. A Fuchsian differential equation of order six with nine free exponents as parameters and with three singular points is presented. This equation has various symmetries, which specify the accessory parameter as a polynomial of the local exponents. For some shifts of exponents, the shift operators are found, which lead to reducibility conditions of the equation. By several specializations of the parameters and successive factorizations of the equation, it produces several new equations and also known ones. For each equation, shift operators are studied, and when the equation is reducible, we observe the way of factorization and discuss the relation with the shift operators.


Fixed Point Theoreme In C Algebras Valued Asymmetric Spaces. In this work, we introduce the concept of C algebra valued asymetric metric space, the concept of forward and the concept of backward C valued asymetric contractions. We discuss the existence and uniqueness of fixed points for a self mapping defined on a C algebra valued asymetric, and we give an application.


Feature Decomposition and Reconstruction Learning for Effective Facial Expression Recognition. In this paper, we propose a novel Feature Decomposition and Reconstruction Learning (FDRL) method for effective facial expression recognition. We view the expression information as the combination of the shared information (expression similarities) across different expressions and the unique information (expression specific variations) for each expression. More specifically, FDRL mainly consists of two crucial networks a Feature Decomposition Network (FDN) and a Feature Reconstruction Network (FRN). In particular, FDN first decomposes the basic features extracted from a backbone network into a set of facial action aware latent features to model expression similarities. Then, FRN captures the intra feature and inter feature relationships for latent features to characterize expression specific variations, and reconstructs the expression feature. To this end, two modules including an intra feature relation modeling module and an inter feature relation modeling module are developed in FRN. Experimental results on both the in the lab databases (including CK , MMI, and Oulu CASIA) and the in the wild databases (including RAF DB and SFEW) show that the proposed FDRL method consistently achieves higher recognition accuracy than several state of the art methods. This clearly highlights the benefit of feature decomposition and reconstruction for classifying expressions.


Multilayer Network Analysis The Identification of Key Actors in a Sicilian Mafia Operation. Recently, Social Network Analysis studies have led to an improvement and to a generalization of existing tools to networks with multiple subsystems and layers of connectivity. These kind of networks are usually called multilayer networks. Multilayer networks in which each layer shares at least one node with some other layer in the network are called multiplex networks. Being a multiplex network does not require all nodes to exist on every layer. In this paper, we built a criminal multiplex network which concerns an anti mafia operation called "Montagna" and it is based on the examination of a pre trial detention order issued on March 14, 2007 by the judge for preliminary investigations of the Court of Messina (Sicily). "Montagna" focus on two Mafia families called "Mistretta" and "Batanesi" who infiltrated several economic activities including the public works in the north eastern part of Sicily, through a cartel of entrepreneurs close to the Sicilian Mafia. Originally we derived two single layer networks, the former capturing meetings between suspected individuals and the latter recording phone calls. But some networked systems can be better modeled by multilayer structures where the individual nodes develop relationships in multiple layers. For this reason we built a two layer network from the single layer ones. These two layers share 47 nodes. We followed three different approaches to measure the importance of nodes in multilayer networks using degree as descriptor. Our analysis can aid in the identification of key players in criminal networks.


On self gravitating polytropic elastic balls. A new four parameters family of constitutive functions for spherically symmetric elastic bodies is introduced which extends the two parameters class of polytropic fluid models widely used in several applications of fluid mechanics. The four parameters in the polytropic elastic model are the polytropic exponent gamma , the bulk modulus kappa , the shear exponent beta and the Poisson ratio nu in ( 1,1 2 . The two parameters class of polytropic fluid models arises as a special case when nu 1 2 and beta gamma . In contrast to the standard Lagrangian approach in elasticity theory, the polytropic elastic model in this paper is formulated directly in physical space, i.e., in terms of Eulerian state variables, which is particularly useful for the applications e.g. to astrophysics where the reference state of the bodies of interest (stars, planets, etc.) is not observable. After discussing some general properties of the polytropic elastic model, the steady states and the homologous motion of Newtonian self gravitating polytropic elastic balls are investigated. It is shown numerically that static balls exist when the parameters gamma, beta are contained in a particular region mathcal O of the plane, depending on nu , and proved analytically for ( gamma, beta) in mathcal V , where mathcal V subset mathcal O is a disconnected set which also depends on the Poisson ratio nu . Homologous solutions describing continuously collapsing balls are constructed numerically when gamma 4 3 . The radius of these solutions shrinks to zero in finite time, causing the formation of a center singularity with infinite density and pressure. Expanding self gravitating homologous elastic balls are also constructed analytically for some special values of the shear parameter beta .


Smart Contract Security a Practitioners' Perspective. Smart contracts have been plagued by security incidents, which resulted in substantial financial losses. Given numerous research efforts in addressing the security issues of smart contracts, we wondered how software practitioners build security into smart contracts in practice. We performed a mixture of qualitative and quantitative studies with 13 interviewees and 156 survey respondents from 35 countries across six continents to understand practitioners' perceptions and practices on smart contract security. Our study uncovers practitioners' motivations and deterrents of smart contract security, as well as how security efforts and strategies fit into the development lifecycle. We also find that blockchain platforms have a statistically significant impact on practitioners' security perceptions and practices of smart contract development. Based on our findings, we highlight future research directions and provide recommendations for practitioners.


Online Risk Averse Submodular Maximization. We present a polynomial time online algorithm for maximizing the conditional value at risk (CVaR) of a monotone stochastic submodular function. Given T i.i.d. samples from an underlying distribution arriving online, our algorithm produces a sequence of solutions that converges to a ( 1 1 e ) approximate solution with a convergence rate of O(T 1 4 ) for monotone continuous DR submodular functions. Compared with previous offline algorithms, which require Omega(T) space, our online algorithm only requires O( sqrt T ) space. We extend our online algorithm to portfolio optimization for monotone submodular set functions under a matroid constraint. Experiments conducted on real world datasets demonstrate that our algorithm can rapidly achieve CVaRs that are comparable to those obtained by existing offline algorithms.


Algebraic Varieties and Automorphic Functions. Let (G, X) be a Shimura datum, let Omega be a connected component of X , let Gamma be a congruence subgroup of G( mathbb Q ) , and consider the quotient map q Omega to S Gamma backslash Omega . Consider the Harish Chandra embedding Omega subset mathbb C N , where N dim X . We prove two results that give geometric conditions which if satisfied by an algebraic variety V subset mathbb C N times S , ensure that there is a Zariski dense subset of V of points of the form (x,q(x)) .


PLM Partial Label Masking for Imbalanced Multi label Classification. Neural networks trained on real world datasets with long tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class skews network output probabilities further from ground truth distributions. We propose a method, Partial Label Masking (PLM), which utilizes this ratio during training. By stochastically masking labels during loss computation, the method balances this ratio for each class, leading to improved recall on minority classes and improved precision on frequent classes. The ratio is estimated adaptively based on the network's performance by minimizing the KL divergence between predicted and ground truth distributions. Whereas most existing approaches addressing data imbalance are mainly focused on single label classification and do not generalize well to the multi label case, this work proposes a general approach to solve the long tail data imbalance issue for multi label classification. PLM is versatile it can be applied to most objective functions and it can be used alongside other strategies for class imbalance. Our method achieves strong performance when compared to existing methods on both multi label (MultiMNIST and MSCOCO) and single label (imbalanced CIFAR 10 and CIFAR 100) image classification datasets.


An Alignment Agnostic Model for Chinese Text Error Correction. This paper investigates how to correct Chinese text errors with types of mistaken, missing and redundant characters, which is common for Chinese native speakers. Most existing models based on detect correct framework can correct mistaken characters errors, but they cannot deal with missing or redundant characters. The reason is that lengths of sentences before and after correction are not the same, leading to the inconsistence between model inputs and outputs. Although the Seq2Seq based or sequence tagging methods provide solutions to the problem and achieved relatively good results on English context, but they do not perform well in Chinese context according to our experimental results. In our work, we propose a novel detect correct framework which is alignment agnostic, meaning that it can handle both text aligned and non aligned occasions, and it can also serve as a cold start model when there are no annotated data provided. Experimental results on three datasets demonstrate that our method is effective and achieves the best performance among existing published models.


A Survey Based Qualitative Study to Characterize Expectations of Software Developers from Five Stakeholders. Background Studies on developer productivity and well being find that the perceptions of productivity in a software team can be a socio technical problem. Intuitively, problems and challenges can be better handled by managing expectations in software teams. Aim Our goal is to understand whether the expectations of software developers vary towards diverse stakeholders in software teams. Method We surveyed 181 professional software developers to understand their expectations from five different stakeholders (1) organizations, (2) managers, (3) peers, (4) new hires, and (5) government and educational institutions. The five stakeholders are determined by conducting semi formal interviews of software developers. We ask open ended survey questions and analyze the responses using open coding. Results We observed 18 multi faceted expectations types. While some expectations are more specific to a stakeholder, other expectations are cross cutting. For example, developers expect work benefits from their organizations, but expect the adoption of standard software engineering (SE) practices from their organizations, peers, and new hires. Conclusion Out of the 18 categories, three categories are related to career growth. This observation supports previous research that happiness cannot be assured by simply offering more money or a promotion. Among the most number of responses, we find expectations from educational institutions to offer relevant teaching and from governments to improve job stability, which indicate the increasingly important roles of these organizations to help software developers. This observation can be especially true during the COVID 19 pandemic.


A spatially dependent fragmentation process. We define a spatially dependent fragmentation process, which involves rectangles breaking up into progressively smaller pieces at rates that depend on their shape. Long, thin rectangles are more likely to break quickly, and are also more likely to split along their longest side. We are interested in how the system evolves over time how many fragments are there of different shapes and sizes, and how did they reach that state? Our theorem gives an almost sure growth rate along paths, which does not match the growth rate in expectation there are paths where the expected number of fragments of that shape and size is exponentially large, but in reality no such fragments exist at large times almost surely.


How to decay your learning rate. Complex learning rate schedules have become an integral part of deep learning. We find empirically that common fine tuned schedules decay the learning rate after the weight norm bounces. This leads to the proposal of ABEL an automatic scheduler which decays the learning rate by keeping track of the weight norm. ABEL's performance matches that of tuned schedules and is more robust with respect to its parameters. Through extensive experiments in vision, NLP, and RL, we show that if the weight norm does not bounce, we can simplify schedules even further with no loss in performance. In such cases, a complex schedule has similar performance to a constant learning rate with a decay at the end of training.


On the conditional measures on the orbits of the complex torus. We explore the structure of invariant measures on compact K "ahler manifolds with Hamiltonian torus actions. We derive the formula for conditional measures on the orbits of the complex torus and use it to prove a conditional statement about uniqueness of solutions to the g Monge Amp ere equation.


Approximately Strategyproof Tournament Rules in the Probabilistic Setting. We consider the manipulability of tournament rules which map the results of binom n 2 pairwise matches and select a winner. Prior work designs simple tournament rules such that no pair of teams can manipulate the outcome of their match to improve their probability of winning by more than 1 3 , and this is the best possible among any Condorcet consistent tournament rule (which selects an undefeated team whenever one exists) Schneider et al., 2017, Schvartzman et al., 2020 . These lower bounds require the manipulators to know precisely the outcome of all future matches. We take a beyond worst case view and instead consider tournaments which are "close to uniform" the outcome of all matches are independent, and no team is believed to win any match with probability exceeding 1 2 varepsilon . We show that Randomized Single Elimination Bracket Schneider et al., 2017 and a new tournament rule we term Randomized Death Match have the property that no pair of teams can manipulate the outcome of their match to improve their probability of winning by more than varepsilon 3 2 varepsilon 2 3 , for all varepsilon , and this is the best possible among any Condorcet consistent tournament rule. Our main technical contribution is a recursive framework to analyze the manipulability of certain forms of tournament rules. In addition to our main results, this view helps streamline previous analysis of Randomized Single Elimination Bracket, and may be of independent interest.


A Mathematical Analysis of Learning Loss for Active Learning in Regression. Active learning continues to remain significant in the industry since it is data efficient. Not only is it cost effective on a constrained budget, continuous refinement of the model allows for early detection and resolution of failure scenarios during the model development stage. Identifying and fixing failures with the model is crucial as industrial applications demand that the underlying model performs accurately in all foreseeable use cases. One popular state of the art technique that specializes in continuously refining the model via failure identification is Learning Loss. Although simple and elegant, this approach is empirically motivated. Our paper develops a foundation for Learning Loss which enables us to propose a novel modification we call LearningLoss . We show that gradients are crucial in interpreting how Learning Loss works, with rigorous analysis and comparison of the gradients between Learning Loss and LearningLoss . We also propose a convolutional architecture that combines features at different scales to predict the loss. We validate LearningLoss for regression on the task of human pose estimation (using MPII and LSP datasets), as done in Learning Loss. We show that LearningLoss outperforms in identifying scenarios where the model is likely to perform poorly, which on model refinement translates into reliable performance in the open world.


Extraction of Hierarchical Functional Connectivity Components in human brain using Adversarial Learning. The estimation of sparse hierarchical components reflecting patterns of the brain's functional connectivity from rsfMRI data can contribute to our understanding of the brain's functional organization, and can lead to biomarkers of diseases. However, inter scanner variations and other confounding factors pose a challenge to the robust and reproducible estimation of functionally interpretable brain networks, and especially to reproducible biomarkers. Moreover, the brain is believed to be organized hierarchically, and hence single scale decompositions miss this hierarchy. The paper aims to use current advancements in adversarial learning to estimate interpretable hierarchical patterns in the human brain using rsfMRI data, which are robust to "adversarial effects" such as inter scanner variations. We write the estimation problem as a minimization problem and solve it using alternating updates. Extensive experiments on simulation and a real world dataset show high reproducibility of the components compared to other well known methods.


Three Attacks on Proof of Stake Ethereum. Recently, two attacks were presented against Proof of Stake (PoS) Ethereum one where short range reorganizations of the underlying consensus chain are used to increase individual validators' profits and delay consensus decisions, and one where adversarial network delay is leveraged to stall consensus decisions indefinitely. We provide refined variants of these attacks, considerably relaxing the requirements on adversarial stake and network timing, and thus rendering the attacks more severe. Combining techniques from both refined attacks, we obtain a third attack which allows an adversary with vanishingly small fraction of stake and no control over network message propagation (assuming instead probabilistic message propagation) to cause even long range consensus chain reorganizations. Honest but rational or ideologically motivated validators could use this attack to increase their profits or stall the protocol, threatening incentive alignment and security of PoS Ethereum. The attack can also lead to destabilization of consensus from congestion in vote processing.


On the weighted orthogonal Ricci curvature. We introduce the weighted orthogonal Ricci curvature a two parameter version of Ni Zheng's orthogonal Ricci curvature. This curvature serves as a very natural object in the study of the relationship between the Ricci curvature(s) and the holomorphic sectional curvature. In particular, in determining optimal curvature constraints for a compact K "ahler manifold to be projective. In this direction, we prove a number of vanishing theorems using the weighted orthogonal Ricci curvature(s) in both the K "ahler and Hermitian category.


Hall instability origin, properties, and asymptotic theory for its tearing mode. Hall instability in electron magnetohydrodynamics is interpreted as the shear Hall instability driven jointly by helicoidal oscillations and shear in the electron current velocity. This explanation suggests an antiparallel orientation of the background magnetic field and vorticity of the current velocity as the necessary condition for Hall instability. The condition is tested and generally confirmed by numerical computations in plane slab geometry. Unstable eigenmodes are localized in the spatial regions of the antiparallel field and vorticity. Computations of the tearing type mode of the instability are complemented by (and generally agree with) asymptotic analytical estimations for large Hall numbers. The stabilizing effect of perfect conductor boundary conditions is found and explained. For large Hall numbers, the growth rates approach the power law dependence sigma propto B alpha eta 1 alpha on the magnetic field ( B ) and diffusivity ( eta ). Almost all computations give the power index alpha 3 4 with one exception of the tearing type mode with vacuum boundary conditions for which case alpha 2 3 .


WIP Medical Incident Prediction Through Analysis of Electronic Medical Records Using Machine Lerning Fall Prediction. This paper reports our preliminary work on medical incident prediction in general, and fall risk prediction in specific, using machine learning. Data for the machine learning are generated only from the particular subset of the electronic medical records (EMR) at Osaka Medical and Pharmaceutical University Hospital. As a result of conducting three experiments such as (1) machine learning algorithm comparison, (2) handling imbalance, and (3) investigation of explanatory variable contribution to the fall incident prediction, we find the investigation of explanatory variables the most effective.


On the Reproducibility of Neural Network Predictions. Standard training techniques for neural networks involve multiple sources of randomness, e.g., initialization, mini batch ordering and in some cases data augmentation. Given that neural networks are heavily over parameterized in practice, such randomness can cause em churn for the same input, disagreements between predictions of the two models independently trained by the same algorithm, contributing to the reproducibility challenges' in modern machine learning. In this paper, we study this problem of churn, identify factors that cause it, and propose two simple means of mitigating it. We first demonstrate that churn is indeed an issue, even for standard image classification tasks (CIFAR and ImageNet), and study the role of the different sources of training randomness that cause churn. By analyzing the relationship between churn and prediction confidences, we pursue an approach with two components for churn reduction. First, we propose using emph minimum entropy regularizers to increase prediction confidences. Second, changes we present a novel variant of co distillation approach citep anil2018large to increase model agreement and reduce churn . We present empirical results showing the effectiveness of both techniques in reducing churn while improving the accuracy of the underlying model.


Sublinear Approximation Algorithm for Nash Social Welfare with XOS Valuations. We study the problem of allocating indivisible goods among n agents with the objective of maximizing Nash social welfare (NSW). This welfare function is defined as the geometric mean of the agents' valuations and, hence, it strikes a balance between the extremes of social welfare (arithmetic mean) and egalitarian welfare (max min value). Nash social welfare has been extensively studied in recent years for various valuation classes. In particular, a notable negative result is known when the agents' valuations are complement free and are specified via value queries for XOS valuations, one necessarily requires exponentially many value queries to find any sublinear (in n ) approximation for NSW. Indeed, this lower bound implies that stronger query models are needed for finding better approximations. Towards this, we utilize demand oracles and XOS oracles both of these query models are standard and have been used in prior work on social welfare maximization with XOS valuations. We develop the first sublinear approximation algorithm for maximizing Nash social welfare under XOS valuations, specified via demand and XOS oracles. Hence, this work breaks the O(n) approximation barrier for NSW maximization under XOS valuations. We obtain this result by developing a novel connection between NSW and social welfare under a capped version of the agents' valuations. In addition to this insight, which might be of independent interest, this work relies on an intricate combination of multiple technical ideas, including the use of repeated matchings and the discrete moving knife method.


Multi target tracking for video surveillance using deep affinity network a brief review. Deep learning models are known to function like the human brain. Due to their functional mechanism, they are frequently utilized to accomplish tasks that require human intelligence. Multi target tracking (MTT) for video surveillance is one of the important and challenging tasks, which has attracted the researcher's attention due to its potential applications in various domains. Multi target tracking tasks require locating the objects individually in each frame, which remains a huge challenge as there are immediate changes in appearances and extreme occlusions of objects. In addition to that, the Multitarget tracking framework requires multiple tasks to perform i.e. target detection, estimating trajectory, associations between frame, and re identification. Various methods have been suggested, and some assumptions are made to constrain the problem in the context of a particular problem. In this paper, the state of the art MTT models, which leverage from deep learning representational power are reviewed.


Leopoldt type theorems for non abelian extensions of Q. We prove new results concerning the additive Galois module structure of certain wildly ramified finite non abelian extensions of Q. In particular, when K Q is a Galois extension with Galois group G isomorphic to A4, S4 or A5, we give necessary and sufficient conditions for the ring of integers of K to be free over its associated order in the rational group algebra Q G .


Convex bodies with equipotential circles. Given a convex body K subset mathbb R 2 we say that a circle Omega subset text int K is an equipotential circle if every tangent line of Omega cuts a chord AB in K such that for the contact point P Omega cap AB it holds that AP cdot PB lambda , for a suitable constant number lambda . The main result in this article is the following Let K subset mathbb R 2 be a convex body which has an equipotential circle mathcal B with centre O in its interior. Then K has centre of symmetry at O , moreover, if none chord of K which is tangent to mathcal B subtends an angle pi 2 from O , then K is a disc. We also derive some results which characterizes the ellipsoid and the sphere in mathbb R 3 and introduce also the concept of equireciprocal disc.


GPU Acceleration of 3D Agent Based Biological Simulations. Researchers in biology are faced with the tough challenge of developing high performance computer simulations of their increasingly complex agent based models. BioDynaMo is an open source agent based simulation platform that aims to alleviate researchers from the intricacies that go into the development of high performance computing. Through a high level interface, researchers can implement their models on top of BioDynaMo's multi threaded core execution engine to rapidly develop simulations that effectively utilize parallel computing hardware. In biological agent based modeling, the type of operations that are typically the most compute intensive are those that involve agents interacting with their local neighborhood. In this work, we investigate the currently implemented method of handling neighborhood interactions of cellular agents in BioDynaMo, and ways to improve the performance to enable large scale and complex simulations. We propose to replace the kd tree implementation to find and iterate over the neighborhood of each agent with a uniform grid method that allows us to take advantage of the massively parallel architecture of graphics processing units (GPUs). We implement the uniform grid method in both CUDA and OpenCL to address GPUs from all major vendors and evaluate several techniques to further improve the performance. Furthermore, we analyze the performance of our implementations for models with a varying density of neighboring agents. As a result, the performance of the mechanical interactions method improved by up to two orders of magnitude in comparison to the multithreaded baseline version. The implementations are open source and publicly available on Github.


RESPER Computationally Modelling Resisting Strategies in Persuasive Conversations. Modelling persuasion strategies as predictors of task outcome has several real world applications and has received considerable attention from the computational linguistics community. However, previous research has failed to account for the resisting strategies employed by an individual to foil such persuasion attempts. Grounded in prior literature in cognitive and social psychology, we propose a generalised framework for identifying resisting strategies in persuasive conversations. We instantiate our framework on two distinct datasets comprising persuasion and negotiation conversations. We also leverage a hierarchical sequence labelling neural architecture to infer the aforementioned resisting strategies automatically. Our experiments reveal the asymmetry of power roles in non collaborative goal directed conversations and the benefits accrued from incorporating resisting strategies on the final conversation outcome. We also investigate the role of different resisting strategies on the conversation outcome and glean insights that corroborate with past findings. We also make the code and the dataset of this work publicly available at https github.com americast resper.


Some uniform bounds for elliptic curves over mathbb Q . We give explicit uniform bounds for several quantities relevant to the study of Galois representations attached to elliptic curves E mathbb Q . We consider in particular the subgroup of scalars in the image of Galois, the first Galois cohomology group with values in the torsion of E , and the Kummer extensions generated by points of infinite order in E( mathbb Q) .


Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models. Recent studies indicate that NLU models are prone to rely on shortcut features for prediction, without achieving true language understanding. As a result, these models fail to generalize to real world out of distribution data. In this work, we show that the words in the NLU training set can be modeled as a long tailed distribution. There are two findings 1) NLU models have strong preference for features located at the head of the long tailed distribution, and 2) Shortcut features are picked up during very early few iterations of the model training. These two observations are further employed to formulate a measurement which can quantify the shortcut degree of each training sample. Based on this shortcut measurement, we propose a shortcut mitigation framework LTGR, to suppress the model from making overconfident predictions for samples with large shortcut degree. Experimental results on three NLU benchmarks demonstrate that our long tailed distribution explanation accurately reflects the shortcut learning behavior of NLU models. Experimental analysis further indicates that LTGR can improve the generalization accuracy on OOD data, while preserving the accuracy on in distribution data.


TSDAE Using Transformer based Sequential Denoising Auto Encoder for Unsupervised Sentence Embedding Learning. Learning sentence embeddings often requires a large amount of labeled data. However, for most tasks and domains, labeled data is seldom available and creating it is expensive. In this work, we present a new state of the art unsupervised method based on pre trained Transformers and Sequential Denoising Auto Encoder (TSDAE) which outperforms previous approaches by up to 6.4 points. It can achieve up to 93.1 of the performance of in domain supervised approaches. Further, we show that TSDAE is a strong domain adaptation and pre training method for sentence embeddings, significantly outperforming other approaches like Masked Language Model. A crucial shortcoming of previous studies is the narrow evaluation Most work mainly evaluates on the single task of Semantic Textual Similarity (STS), which does not require any domain knowledge. It is unclear if these proposed methods generalize to other domains and tasks. We fill this gap and evaluate TSDAE and other recent approaches on four different datasets from heterogeneous domains.


Advancing Mixture Models for Least Squares Optimization. Gaussian mixtures are a powerful and widely used tool to model non Gaussian estimation problems. They are able to describe measurement errors that follow arbitrary distributions and can represent ambiguity in assignment tasks like point set registration or tracking. However, using them with common least squares solvers is still difficult. Existing approaches are either approximations of the true mixture or prone to convergence issues due to their strong nonlinearity. We propose a novel least squares representation of a Gaussian mixture, which is an exact and almost linear model of the corresponding log likelihood. Our approach provides an efficient, accurate and flexible model for many probabilistic estimation problems and can be used as cost function for least squares solvers. We demonstrate its superior performance in various Monte Carlo experiments, including different kinds of point set registration. Our implementation is available as open source code for the state of the art solvers Ceres and GTSAM.


Cross Lingual GenQA A Language Agnostic Generative Question Answering Approach for Open Domain Question Answering. Open Retrieval Generative Question Answering (GenQA) is proven to deliver high quality, natural sounding answers in English. In this paper, we present the first generalization of the GenQA approach for the multilingual environment. To this end, we present the GenTyDiQA dataset, which extends the TyDiQA evaluation data (Clark et al., 2020) with natural sounding, well formed answers in Arabic, Bengali, English, Japanese, and Russian. For all these languages, we show that a GenQA sequence to sequence based model outperforms a state of the art Answer Sentence Selection model. We also show that a multilingually trained model competes with, and in some cases outperforms, its monolingual counterparts. Finally, we show that our system can even compete with strong baselines, even when fed with information from a variety of languages. Essentially, our system is able to answer a question in any language of our language set using information from many languages, making it the first Language Agnostic GenQA system.


On Stability in the Borg's Theorem for Non normal Periodic Jacobi Operators. We consider the non normal periodic Jacobi operator and the discrete versions of the well known Borg's Theorem. In this article, we extend the stability results obtained recently to non normal cases. The existing stability results connect the oscillations of the matrix entries and the spectral gap size. Our result covers the present self adjoint versions of Borg's theorem and its recent quantitative versions. Here the oscillations of the matrix entries are linked with the path connectedness of the pseudospectrum. We discuss the finite difference approximations of various linear differential equations as specific applications.


GEASI Geodesic based Earliest Activation Sites Identification in cardiac models. The identification of the initial ventricular activation sequence is a critical step for the correct personalization of patient specific cardiac models. In healthy conditions, the Purkinje network is the main source of the electrical activation, but under pathological conditions the so called earliest activation sites (EASs) are possibly sparser and more localized. Yet, their number, location and timing may not be easily inferred from remote recordings, such as the epicardial activation or the 12 lead electrocardiogram (ECG), due to the underlying complexity of the model. In this work, we introduce GEASI (Geodesic based Earliest Activation Sites Identification) as a novel approach to simultaneously identify all EASs. To this end, we start from the anisotropic eikonal equation modeling cardiac electrical activation and exploit its Hamilton Jacobi formulation to minimize a given objective function, e.g. the quadratic mismatch to given activation measurements. This versatile approach can be extended to estimate the number of activation sites by means of the topological gradient, or fitting a given ECG. We conducted various experiments in 2D and 3D for in silico models and an in vivo intracardiac recording collected from a patient undergoing cardiac resynchronization therapy. The results demonstrate the clinical applicability of GEASI for potential future personalized models and clinical intervention.


Ideals of general linear Lie algebras of infinite dimensional vector spaces. Let V be an infinite dimensional vector space over a field of characteristic not equal to 2. We classify ideals of the Lie algebra gl(V) of all linear transformations of the space V.


CCPM A Chinese Classical Poetry Matching Dataset. Poetry is one of the most important art forms of human languages. Recently many studies have focused on incorporating some linguistic features of poetry, such as style and sentiment, into its understanding or generation system. However, there is no focus on understanding or evaluating the semantics of poetry. Therefore, we propose a novel task to assess a model's semantic understanding of poetry by poem matching. Specifically, this task requires the model to select one line of Chinese classical poetry among four candidates according to the modern Chinese translation of a line of poetry. To construct this dataset, we first obtain a set of parallel data of Chinese classical poetry and modern Chinese translation. Then we retrieve similar lines of poetry with the lines in a poetry corpus as negative choices. We name the dataset Chinese Classical Poetry Matching Dataset (CCPM) and release it at https github.com THUNLP AIPoet CCPM. We hope this dataset can further enhance the study on incorporating deep semantics into the understanding and generation system of Chinese classical poetry. We also preliminarily run two variants of BERT on this dataset as the baselines for this dataset.


Choosing is Losing How to combine the benefits of shallow and deep embeddings through reflection. Dependently typed host languages empower users to verify a wide range of properties of embedded languages and programs written in them. Designers of such embedded languages are faced with a difficult choice between using a shallow or a deep embedding. The former is easier to use because the entire infrastructure of the host langauge is immediately available. Meanwhile, the latter gives full access to the structure of embedded programs, but is difficult to use in practice, especially when the embedded language is itself dependently typed. The main insight presented in this paper is that the choice between shallow and deep embedding can be eliminated by working in a host language with reflection capabilities we start from a shallow embedding that can use all libraries and tools of the host language, and later use reflection to expose the deep structure of the embedded programs. Concretely, we apply this technique to embed three programming languages Kaleidoscope, SaC, and (a subset of) APL into the dependently typed theorem prover Agda, using dependent types to statically enforce several properties of interest. We then use Agda's reflection capabilities to extract the embedded programs back into the original language, so that the existing toolchain can be leveraged. In this process, statically verified properties of the host language are mapped onto runtime checks in the target language, allowing extracted programs to interact safely with existing code. Finally, we demonstrate the feasibility of our approach with the implementation and extraction of a convolutional neural network in our embedding of APL.


On the Value of Multistage Stochastic Facility Location with Risk Aversion. We consider a multi period capacitated facility location problem over a finite time horizon under uncertain demand in each period. We formulate a multistage stochastic integer program using a scenario tree representation of the uncertainty, and compare it with a two stage approach that decides which facilities to open for all periods up front. In the multistage model, in each stage, after realizing the demand, a decision maker optimizes facility locations and product flows from open facilities to demand sites, with the goal of minimizing certain measures of the future random cost associated with locating facilities and satisfying demand. Using expected conditional risk measures (ECRMs), we provide tight lower bounds for the gaps between optimal objective values of risk averse multistage models and their two stage counterparts. Moreover, two approximation algorithms are proposed to efficiently solve risk averse two stage and multistage stochastic programs, whose approximation ratios are independent of the underlying stochastic process, structure of the scenario tree, number of stages, and risk preference related parameters. We conduct numerical studies using both randomly generated and real world network instances to demonstrate the tightness of the analytical bounds and computational efficacy of the proposed approximation algorithms. We also provide managerial insights for guiding locating facilities with risk aversion in practice, based on various types of uncertainty cases and parameter settings.


Supercritical elliptic problems on nonradial domains via a nonsmooth variational approach. In this paper we are interested in positive classical solutions of begin equation label eqx left begin array ll Delta u a(x) u p 1 mbox in Omega, u 0 mbox in Omega, u 0 mbox on pOm, end array right. end equation where Omega is a bounded annular domain (not necessarily an annulus) in IR N (N ge3) and a(x) is a nonnegative continuous function. We show the existence of a classical positive solution for a range of supercritical values of p when the problem enjoys certain mild symmetry and monotonicity conditions. As a consequence of our results, we shall show that ( ref eqx ) has Bigl lfloor frac N 2 Bigr rfloor (the floor of frac N 2 ) positive nonradial solutions when a(x) 1 and Omega is an annulus with certain assumptions on the radii. We also obtain the existence of positive solutions in the case of toroidal domains. Our approach is based on a new variational principle that allows one to deal with supercritical problems variationally by limiting the corresponding functional on a proper convex subset instead of the whole space at the expense of a mild invariance property.


KLUE Korean Language Understanding Evaluation. We introduce Korean Language Understanding Evaluation (KLUE) benchmark. KLUE is a collection of 8 Korean natural language understanding (NLU) tasks, including Topic Classification, SemanticTextual Similarity, Natural Language Inference, Named Entity Recognition, Relation Extraction, Dependency Parsing, Machine Reading Comprehension, and Dialogue State Tracking. We build all of the tasks from scratch from diverse source corpora while respecting copyrights, to ensure accessibility for anyone without any restrictions. With ethical considerations in mind, we carefully design annotation protocols. Along with the benchmark tasks and data, we provide suitable evaluation metrics and fine tuning recipes for pretrained language models for each task. We furthermore release the pretrained language models (PLM), KLUE BERT and KLUE RoBERTa, to help reproducing baseline models on KLUE and thereby facilitate future research. We make a few interesting observations from the preliminary experiments using the proposed KLUE benchmark suite, already demonstrating the usefulness of this new benchmark suite. First, we find KLUE RoBERTa large outperforms other baselines, including multilingual PLMs and existing open source Korean PLMs. Second, we see minimal degradation in performance even when we replace personally identifiable information from the pretraining corpus, suggesting that privacy and NLU capability are not at odds with each other. Lastly, we find that using BPE tokenization in combination with morpheme level pre tokenization is effective in tasks involving morpheme level tagging, detection and generation. In addition to accelerating Korean NLP research, our comprehensive documentation on creating KLUE will facilitate creating similar resources for other languages in the future. KLUE is available at https klue benchmark.com.


Combinatorial Bandits without Total Order for Arms. We consider the combinatorial bandits problem, where at each time step, the online learner selects a size k subset s from the arms set mathcal A , where left mathcal A right n , and observes a stochastic reward of each arm in the selected set s . The goal of the online learner is to minimize the regret, induced by not selecting s which maximizes the expected total reward. Specifically, we focus on a challenging setting where 1) the reward distribution of an arm depends on the set s it is part of, and crucially 2) there is textit no total order for the arms in mathcal A . In this paper, we formally present a reward model that captures set dependent reward distribution and assumes no total order for arms. Correspondingly, we propose an Upper Confidence Bound (UCB) algorithm that maintains UCB for each individual arm and selects the arms with top k UCB. We develop a novel regret analysis and show an O left( frac k 2 n log T epsilon right) gap dependent regret bound as well as an O left(k 2 sqrt n T log T right) gap independent regret bound. We also provide a lower bound for the proposed reward model, which shows our proposed algorithm is near optimal for any constant k . Empirical results on various reward models demonstrate the broad applicability of our algorithm.


A note on the validity of the Schr "odinger approximation for the Helmholtz equation. Time harmonic electromagnetic waves in vacuum are described by the Helmholtz equation Delta u omega 2 u 0 for (x,y,z) in mathbb R 3 . For the evolution of such waves along the z axis a Schr "odinger equation can be derived through a multiple scaling ansatz. It is the purpose of this paper to justify this formal approximation by proving bounds between this formal approximation and true solutions of the original system. The challenge of the presented validity analysis is the fact that the Helmholtz equation is ill posed as an evolutionary system along the z axis.


The Dynamics of Faculty Hiring Networks. Faculty hiring networks who hires whose graduates as faculty exhibit steep hierarchies, which can reinforce both social and epistemic inequalities in academia. Understanding the mechanisms driving these patterns would inform efforts to diversify the academy and shed new light on the role of hiring in shaping which scientific discoveries are made. Here, we investigate the degree to which structural mechanisms can explain hierarchy and other network characteristics observed in empirical faculty hiring networks. We study a family of adaptive rewiring network models, which reinforce institutional prestige within the hierarchy in five distinct ways. Each mechanism determines the probability that a new hire comes from a particular institution according to that institution's prestige score, which is inferred from the hiring network's existing structure. We find that structural inequalities and centrality patterns in real hiring networks are best reproduced by a mechanism of global placement power, in which a new hire is drawn from a particular institution in proportion to the number of previously drawn hires anywhere. On the other hand, network measures of biased visibility are better recapitulated by a mechanism of local placement power, in which a new hire is drawn from a particular institution in proportion to the number of its previous hires already present at the hiring institution. These contrasting results suggest that the underlying structural mechanism reinforcing hierarchies in faculty hiring networks is a mixture of global and local preference for institutional prestige. Under these dynamics, we show that each institution's position in the hierarchy is remarkably stable, due to a dynamic competition that overwhelmingly favors more prestigious institutions.


Lane Change Decision Making through Deep Reinforcement Learning. Due to the complexity and volatility of the traffic environment, decision making in autonomous driving is a significantly hard problem. In this project, we use a Deep Q Network, along with rule based constraints to make lane changing decision. A safe and efficient lane change behavior may be obtained by combining high level lateral decision making with low level rule based trajectory monitoring. The agent is anticipated to perform appropriate lane change maneuvers in a real world like udacity simulator after training it for a total of 100 episodes. The results shows that the rule based DQN performs better than the DQN method. The rule based DQN achieves a safety rate of 0.8 and average speed of 47 MPH


Explicitly solvable algebraic equations of degree 8 and 9. The generic monic polynomial of degree N features N a priori arbitrary coefficients c m and N zeros z n . In this paper we limit consideration to N 8 and N 9 . We show that if the N a priori arbitrary coefficients c m of these polynomials are appropriately defined as it were, a posteriori in terms of 6 arbitrary parameters, then the N roots of these polynomials can be explicitly computed in terms of radicals of these 6 parameters. We also report the constraints on the N coefficients c m implied by the fact that they are so defined in terms of 6 arbitrary parameters as well as the explicit determination of these 6 parameters in terms of the N coefficients c m .


Control of diffusion driven pattern formation behind a wave of competency. In certain biological contexts, such as the plumage patterns of birds and stripes on certain species of fishes, pattern formation takes place behind a so called "wave of competency". Currently, the effects of a wave of competency on the patterning outcome is not well understood. In this study, we use Turing's diffusion driven instability model to study pattern formation behind a wave of competency, under a range of wave speeds. Numerical simulations show that in one spatial dimension a slower wave speed drives a sequence of peak splittings in the pattern, whereas a higher wave speed leads to peak insertions. In two spatial dimensions, we observe stripes that are either perpendicular or parallel to the moving boundary under slow or fast wave speeds, respectively. We argue that there is a correspondence between the one and two dimensional phenomena, and that pattern formation behind a wave of competency can account for the pattern organization observed in many biological systems.