One shot Policy Elicitation via Semantic Reward Manipulation. Synchronizing expectations and knowledge about the state of the world is an essential capability for effective collaboration. For robots to effectively collaborate with humans and other autonomous agents, it is critical that they be able to generate intelligible explanations to reconcile differences between their understanding of the world and that of their collaborators. In this work we present Single shot Policy Explanation for Augmenting Rewards (SPEAR), a novel sequential optimization algorithm that uses semantic explanations derived from combinations of planning predicates to augment agents' reward functions, driving their policies to exhibit more optimal behavior. We provide an experimental validation of our algorithm's policy manipulation capabilities in two practically grounded applications and conclude with a performance analysis of SPEAR on domains of increasingly complex state space and predicate counts. We demonstrate that our method makes substantial improvements over the state of the art in terms of runtime and addressable problem size, enabling an agent to leverage its own expertise to communicate actionable information to improve another's performance.


Machine Learning based Lie Detector applied to a Novel Annotated Game Dataset. Lie detection is considered a concern for everyone in their day to day life given its impact on human interactions. Thus, people normally pay attention to both what their interlocutors are saying and also to their visual appearances, including faces, to try to find any signs that indicate whether the person is telling the truth or not. While automatic lie detection may help us to understand this lying characteristics, current systems are still fairly limited, partly due to lack of adequate datasets to evaluate their performance in realistic scenarios. In this work, we have collected an annotated dataset of facial images, comprising both 2D and 3D information of several participants during a card game that encourages players to lie. Using our collected dataset, We evaluated several types of machine learning based lie detectors in terms of their generalization, person specific and cross domain experiments. Our results show that models based on deep learning achieve the best accuracy, reaching up to 57 for the generalization task and 63 when dealing with a single participant. Finally, we also highlight the limitation of the deep learning based lie detector when dealing with cross domain lie detection tasks.


Better than BERT but Worse than Baseline. This paper compares BERT SQuAD and Ab3P on the Abbreviation Definition Identification (ADI) task. ADI inputs a text and outputs short forms (abbreviations acronyms) and long forms (expansions). BERT with reranking improves over BERT without reranking but fails to reach the Ab3P rule based baseline. What is BERT missing? Reranking introduces two new features charmatch and freq. The first feature identifies opportunities to take advantage of character constraints in acronyms and the second feature identifies opportunities to take advantage of frequency constraints across documents.


EaZy Learning An Adaptive Variant of Ensemble Learning for Fingerprint Liveness Detection. In the field of biometrics, fingerprint recognition systems are vulnerable to presentation attacks made by artificially generated spoof fingerprints. Therefore, it is essential to perform liveness detection of a fingerprint before authenticating it. Fingerprint liveness detection mechanisms perform well under the within dataset environment but fail miserably under cross sensor (when tested on a fingerprint acquired by a new sensor) and cross dataset (when trained on one dataset and tested on another) settings. To enhance the generalization abilities, robustness and the interoperability of the fingerprint spoof detectors, the learning models need to be adaptive towards the data. We propose a generic model, EaZy learning which can be considered as an adaptive midway between eager and lazy learning. We show the usefulness of this adaptivity under cross sensor and cross dataset environments. EaZy learning examines the properties intrinsic to the dataset while generating a pool of hypotheses. EaZy learning is similar to ensemble learning as it generates an ensemble of base classifiers and integrates them to make a prediction. Still, it differs in the way it generates the base classifiers. EaZy learning develops an ensemble of entirely disjoint base classifiers which has a beneficial influence on the diversity of the underlying ensemble. Also, it integrates the predictions made by these base classifiers based on their performance on the validation data. Experiments conducted on the standard high dimensional datasets LivDet 2011, LivDet 2013 and LivDet 2015 prove the efficacy of the model under cross dataset and cross sensor environments.


Machine Learning Constructives and Local Searches for the Travelling Salesman Problem. The ML Constructive heuristic is a recently presented method and the first hybrid method capable of scaling up to real scale traveling salesman problems. It combines machine learning techniques and classic optimization techniques. In this paper we present improvements to the computational weight of the original deep learning model. In addition, as simpler models reduce the execution time, the possibility of adding a local search phase is explored to further improve performance. Experimental results corroborate the quality of the proposed improvements.


Development of a cryocooler conduction cooled 650 MHz SRF cavity operating at 10 MV m cw accelerating gradient. SRF cavities for particle acceleration are conventionally operated immersed in a bath of liquid helium at 4.2 K and below. Although this cooling configuration is practically and economically viable for large scientific accelerator installations, it may not be so for smaller accelerators intended for industrial applications such as the treatment of wastewater, sludge, flue gases, etc. In this paper, we describe a procedure to operate SRF cavities without liquid helium that can be used to construct electron beam sources for industrial applications of electron irradiation (1 10 MeV electron energy). In this procedure, an elliptical single cell 650 MHz niobium tin coated niobium cavity is coupled to a closed cycle 4 K cryocooler using high purity aluminum thermal links. The cryocooler conductively extracts heat (RF dissipation) from the cavity without requiring liquid helium around the cavity. We present construction details of this cryocooler conduction cooling technique and systematic experiments that have demonstrated 10 MV m cw gradient on the cavity. By straightforward scaling up the cavity length and number of cryocoolers, the technique will provide the complete range of 1 10 MeV electron energy for industrial applications.


A regularity upgrade of pressure. For the incompressible Euler equations the pressure formally scales as a quadratic function of velocity. We provide several optimal regularity estimates on the pressure by using regularity of velocity in various Sobolev, Besov and Hardy spaces. Our proof exploits the incompressibility condition in an essential way and is deeply connected with the classic Div Curl lemma which we also generalise as a fractional Leibniz rule in Hardy spaces. To showcase the sharpness of results, we construct a class of counterexamples at several end points.


Effective fronts of polygon shapes in two dimensions. We study the effective fronts of first order front propagations in two dimensions ( n 2 ) in the periodic setting. Using PDE based approaches, we show that for every alpha in (0,1) , the class of centrally symmetric polygons with rational vertices and nonempty interior is admissible as effective fronts for given front speeds in C 1, alpha ( mathbb T 2,(0, infty)) . This result can also be formulated in the language of stable norms corresponding to periodic metrics in mathbb T 2 . Similar results were known long time ago when n geq 3 for front speeds in C infty ( mathbb T n,(0, infty)) . Due to topological restrictions, the two dimensional case is much more subtle. In fact, the effective front is C 1 , which cannot be a polygon, for given C 1,1 ( mathbb T 2,(0, infty)) front speeds. Our regularity requirements on front speeds are hence optimal. To the best of our knowledge, this is the first time that polygonal effective fronts have been constructed in two dimensions.


Cross Modal Focal Loss for RGBD Face Anti Spoofing. Automatic methods for detecting presentation attacks are essential to ensure the reliable use of facial recognition technology. Most of the methods available in the literature for presentation attack detection (PAD) fails in generalizing to unseen attacks. In recent years, multi channel methods have been proposed to improve the robustness of PAD systems. Often, only a limited amount of data is available for additional channels, which limits the effectiveness of these methods. In this work, we present a new framework for PAD that uses RGB and depth channels together with a novel loss function. The new architecture uses complementary information from the two modalities while reducing the impact of overfitting. Essentially, a cross modal focal loss function is proposed to modulate the loss contribution of each channel as a function of the confidence of individual channels. Extensive evaluations in two publicly available datasets demonstrate the effectiveness of the proposed approach.


Hippocampus heuristic Character Recognition Network for Zero shot Learning. The recognition of Chinese characters has always been a challenging task due to their huge variety and complex structures. The latest research proves that such an enormous character set can be decomposed into a collection of about 500 fundamental Chinese radicals, and based on which this problem can be solved effectively. While with the constant advent of novel Chinese characters, the number of basic radicals is also expanding. The current methods that entirely rely on existing radicals are not flexible for identifying these novel characters and fail to recognize these Chinese characters without learning all of their radicals in the training stage. To this end, this paper proposes a novel Hippocampus heuristic Character Recognition Network (HCRN), which references the way of hippocampus thinking, and can recognize unseen Chinese characters (namely zero shot learning) only by training part of radicals. More specifically, the network architecture of HCRN is a new pseudo siamese network designed by us, which can learn features from pairs of input training character samples and use them to predict unseen Chinese characters. The experimental results show that HCRN is robust and effective. It can accurately predict about 16,330 unseen testing Chinese characters relied on only 500 trained Chinese characters. The recognition accuracy of HCRN outperforms the state of the art Chinese radical recognition approach by 15 (from 85.1 to 99.9 ) for recognizing unseen Chinese characters.


On the Evolution of Word Order. Most natural languages have a predominant or fixed word order. For example in English the word order is usually Subject Verb Object. This work attempts to explain this phenomenon as well as other typological findings regarding word order from a functional perspective. In particular, we examine whether fixed word order provides a functional advantage, explaining why these languages are prevalent. To this end, we consider an evolutionary model of language and demonstrate, both theoretically and using genetic algorithms, that a language with a fixed word order is optimal. We also show that adding information to the sentence, such as case markers and noun verb distinction, reduces the need for fixed word order, in accordance with the typological findings.


The life, work and legacy of P. L. Chebyshev. We survey briefly the life and work of P. L. Chebyshev, and his ongoing influence. We discuss his contributions to probability, number theory and mechanics, his pupils and mathematical descendants, and his role as the founding father of Russian mathematics in general and of the Russian school of probability in particular.


Introducing Traceability in GitHub for Medical Software Development. Assuring traceability from requirements to implementation is a key element when developing safety critical software systems. Traditionally, this traceability is ensured by a waterfall like process, where phases follow each other, and tracing between different phases can be managed. However, new software development paradigms, such as continuous software engineering and DevOps, which encourage a steady stream of new features, committed by developers in a seemingly uncontrolled fashion in terms of former phasing, challenge this view. In this paper, we introduce our approach that adds traceability capabilities to GitHub, so that the developers can act like they normally do in GitHub context but produce the documentation needed by the regulatory purposes in the process.


A Payload Optimization Method for Federated Recommender Systems. We introduce the payload optimization method for federated recommender systems (FRS). In federated learning (FL), the global model payload that is moved between the server and users depends on the number of items to recommend. The model payload grows when there is an increasing number of items. This becomes challenging for an FRS if it is running in production mode. To tackle the payload challenge, we formulated a multi arm bandit solution that selected part of the global model and transmitted it to all users. The selection process was guided by a novel reward function suitable for FL systems. So far as we are aware, this is the first optimization method that seeks to address item dependent payloads. The method was evaluated using three benchmark recommendation datasets. The empirical validation confirmed that the proposed method outperforms the simpler methods that do not benefit from the bandits for the purpose of item selection. In addition, we have demonstrated the usefulness of our proposed method by rigorously evaluating the effects of a payload reduction on the recommendation performance degradation. Our method achieved up to a 90 reduction in model payload, yielding only a sim 4 8 loss in the recommendation performance for highly sparse datasets


Ideal triangles, hyperbolic surfaces and the Thurston metric on Teichm "u ller space. These are notes on the hyperbolic geometry of surfaces, Teichm "u ller spaces and Thurston's metric on these spaces. They are associated with lectures I gave at the Morningside Center of Mathematics of the Chinese Academy of Sciences in March 2019 and at the Chebyshev Laboratory of the Saint Petersburg State University in May 2019. In particular, I survey several results on the behavior of stretch lines, a distinguished class of geodesics for Thurston's metric and I point out several analogies between this metric and Teichm "u ller's metric. Several open questions are addressed. The final version of these notes will appear in the book "Moduli Spaces and Locally Symmetric Spaces", edited by L. Ji and S. T. Yau, International Press, 2021.


Modeling Transverse Space Charge effects in IOTA with pyORBIT. The role and mitigation of space charge effects are important aspects of the beam physics research to be performed at the Integrable Optics Test Accelerator (IOTA) at Fermilab. The impact of nonlinear integrability (partial and complete) on space charge driven incoherent and coherent resonances will be a new feature of this accelerator and has the potential to influence the design of future low energy proton synchrotrons. In this report we model transverse space charge effects using the PIC code pyORBIT. First we benchmark the single particle tracking results against MADX with checks on symplecticity, tune footprints, and dynamic aperture in a partially integrable lattice realized with a special octupole string insert. Our space charge calculations begin with an examination of the 4D symplecticity. Short term tracking is done first with the initial bare lattice and then with a matching of the rms values with space charge. Next, we explore slow initialization of charge as a technique to establish steady state and reduce emittance growth and beam loss following injection into a mismatched lattice. We establish values of space charge simulation parameters so as to ensure numerical convergence. Finally, we compare the simulated space charge induced tune shifts and footprints against theory.


Impact of Multi connectivity on Channel Capacity and Outage Probability in Wireless Networks. Multi connectivity facilitates higher throughput, shorter delay, and lower outage probability for a user in a wireless network. Considering these promises, a rationale policy for a network operator would be to implement multi connectivity for all of its users. In this paper, we investigate whether the promises of multi connectivity also hold in such a setting where all users of a network are connected through multiple links. In particular, we consider a network where every user connects to its k closest base stations. Using a framework of stochastic geometry and probability theory, we obtain analytic expressions for per user throughput and outage probability of k connectivity networks under several failure models. In contrast to the conclusions of previous research, our analysis shows that per user throughput decreases with increasing k. However, multi connected networks are more resilient against failures than single connected networks as reflected with lower outage probability and lead to higher fairness among the users. Consequently, we conclude that rather than implementing multi connectivity for all users, a network operator should consider it for its users who would benefit from additional links the most, e.g., cell edge users.


Moduli of mathbb Q Gorenstein pairs and applications. We develop a framework to construct moduli spaces of mathbb Q Gorenstein pairs. To do so, we fix certain invariants these choices are encoded in the notion of p stable pair. We show that these choices give a proper moduli space with projective coarse moduli space and they prevent some pathologies of the moduli space of stable pairs when the coefficients are smaller than frac 1 2 . Lastly, we apply this machinery to provide an alternative proof of the projectivity of the moduli space of stable pairs.


Speed of excited random walks with long backward steps. We study a model of multi excited random walk with non nearest neighbour steps on mathbb Z , in which the walk can jump from a vertex x to either x 1 or x i with i in 1,2, dots,L , L ge 1 . We first point out the multi type branching structure of this random walk and then prove a limit theorem for a related multi type Galton Watson process with emigration, which is of independent interest. Combining this result and the method introduced by Basdevant and Singh Probab. Theory Related Fields (2008), 141 (3 4) , we extend their result (w.r.t the case L 1 ) to our model. More specifically, we show that in the regime of transience to the right, the walk has positive speed if and only if the expected total drift delta 2 . This confirms a special case of a conjecture proposed by Davis and Peterson.


Re designing cities with conditional adversarial networks. This paper introduces a conditional generative adversarial network to redesign a street level image of urban scenes by generating 1) an urban intervention policy, 2) an attention map that localises where intervention is needed, 3) a high resolution street level image (1024 X 1024 or 1536 X1536) after implementing the intervention. We also introduce a new dataset that comprises aligned street level images of before and after urban interventions from real life scenarios that make this research possible. The introduced method has been trained on different ranges of urban interventions applied to realistic images. The trained model shows strong performance in re modelling cities, outperforming existing methods that apply image to image translation in other domains that is computed in a single GPU. This research opens the door for machine intelligence to play a role in re thinking and re designing the different attributes of cities based on adversarial learning, going beyond the mainstream of facial landmarks manipulation or image synthesis from semantic segmentation.


Effect of random noise on solutions to the modified two component Camassa Holm system on mathbb T d . This paper studies the high dimensional modified two component Camassa Holm (MCH2) system with random perturbation on the torus mathbb T d ( d geq1 ). The MCH2 system reduces to the Euler Poincar ' e equation without considering the averaged density, and to the two component Euler Poincar ' e system as the potential energy term weaken to L 2 norm in the Lagrangian. First, we establish the local well posedness of strong pathwise solutions in the sense of Hadamard for the MCH2 system driven by general nonlinear multiplicative noise. Moreover, we prove that the data to solution map does not uniformly depend on the initial data, assuming that the noise coefficients can be controlled by the nonlocal terms of the system itself. Second, when the noise coefficients are in the form of polynomial, say c f delta f with c neq0 , we find that the random noises with sufficiently large intensity parameters delta 1 geq frac 1 2 and delta 2 geq1 have a regularization effect on the t variable, which improves the local strong pathwise solutions to be global in time ones. Note that the global existence problem with small intensity 0 leq delta 1 frac 1 2 and 0 leq delta 2 1 remains to be an open problem. As a partial positive answer, we prove that, in the case of delta 1 delta 2 0 , the stochastic MCH2 system admits a unique global strong pathwise solution with high probability for sufficiently small initial data. Nevertheless, when d 1 , we show that the solutions will break in finite time for any small initial data satisfying a proper shape condition.


Effects of Head locked Augmented Reality on User's performance and perceived workload. An augmented reality (AR) environment includes a set of digital elements with which the users interact while performing certain tasks. Recent AR head mounted displays allow users to select how these elements are presented. However, few studies have been conducted to examine the effect of the way of presenting augmented content on user performance and workload. This study aims to evaluate two methods of presenting augmented content world locked and head locked modes in a data entry task. A total of eighteen participants performed the data entry task in this study. The effectiveness of each mode is evaluated in terms of task performance, muscle activity, perceived workload, and usability. The results show that the task completion time is shorter and the typing speed is significantly faster in the head locked mode while the world locked mode achieved higher scores in terms of preference. The findings of this study can be applied to AR user interfaces to improve content presentation and enhance the user experience.


Extension groups of Tautological Bundles on Symmetric Products of Curves. We provide a spectral sequence computing the extension groups of tautological bundles on symmetric products of curves. One main consequence is that, if E neq mathcal O X is simple, then the natural map operatorname Ext 1(E,E) to operatorname Ext 1(E n ,E n ) is injective for every n . Along with previous results, this implies that E mapsto E n defines an embedding of the moduli space of stable bundles of slope mu notin 1,n 1 on the curve X into the moduli space of stable bundles on the symmetric product X (n) . The image of this embedding is, in most cases, contained in the singular locus. For line bundles on a non hyperelliptic curve, the embedding identifies the Brill Noether loci of X with the loci in the moduli space of stable bundles on X (n) where the dimension of the tangent space jumps. We also prove that E n is simple if E is simple.


Learnable Expansion and Compression Network for Few shot Class Incremental Learning. Few shot class incremental learning (FSCIL), which targets at continuously expanding model's representation capacity under few supervisions, is an important yet challenging problem. On the one hand, when fitting new tasks (novel classes), features trained on old tasks (old classes) could significantly drift, causing catastrophic forgetting. On the other hand, training the large amount of model parameters with few shot novel class examples leads to model over fitting. In this paper, we propose a learnable expansion and compression network (LEC Net), with the aim to simultaneously solve catastrophic forgetting and model over fitting problems in a unified framework. By tentatively expanding network nodes, LEC Net enlarges the representation capacity of features, alleviating feature drift of old network from the perspective of model regularization. By compressing the expanded network nodes, LEC Net purses minimal increase of model parameters, alleviating over fitting of the expanded network from a perspective of compact representation. Experiments on the CUB CIFAR 100 datasets show that LEC Net improves the baseline by 5 7 while outperforms the state of the art by 5 6 . LEC Net also demonstrates the potential to be a general incremental learning approach with dynamic model expansion capability.


Biquotient vector bundles with no inverse. In previous work, the second author and others have found conditions on a homogeneous space G H which imply that, up to stabilization, all vector bundles over G H admit Riemannian metrics of non negative sectional curvature. One important ingredient of their approach is Segal's result that the set of vector bundles of the form G times H V for a representation V of H contains inverses within the class. We show that this approach cannot work for biquotients G ! ! H , where we consider vector bundles of the form G times H V . We call such vector bundles biquotient bundles. Specifically, we show that in each dimension n geq 4 except n 5 , there is a simply connected biquotient of dimension n with a biquotient bundle which does not contain an inverse within the class of biquotient bundles. In addition, we show that for n geq 6 except n 7 , there are infinitely many homotopy types of biquotients with the property that no non trivial biquotient bundle has an inverse. Lastly, we show that every biquotient bundle over every simply connected biquotient M n G ! ! H with G simply connected and with n in 2,3,5 has an inverse in the class of biquotient bundles.


ML Decoder Scalable and Versatile Classification Head. In this paper, we introduce ML Decoder, a new attention based classification head. ML Decoder predicts the existence of class labels via queries, and enables better utilization of spatial data compared to global average pooling. By redesigning the decoder architecture, and using a novel group decoding scheme, ML Decoder is highly efficient, and can scale well to thousands of classes. Compared to using a larger backbone, ML Decoder consistently provides a better speed accuracy trade off. ML Decoder is also versatile it can be used as a drop in replacement for various classification heads, and generalize to unseen classes when operated with word queries. Novel query augmentations further improve its generalization ability. Using ML Decoder, we achieve state of the art results on several classification tasks on MS COCO multi label, we reach 91.4 mAP on NUS WIDE zero shot, we reach 31.1 ZSL mAP and on ImageNet single label, we reach with vanilla ResNet50 backbone a new top score of 80.7 , without extra data or distillation. Public code is available at https github.com Alibaba MIIL ML Decoder


Discrete Yamabe problem for polyhedral surfaces. We study a new discretization of the Gaussian curvature for polyhedral surfaces. This discrete Gaussian curvature is defined on each conical singularity of a polyhedral surface as the quotient of the angle defect and the area of the Voronoi cell corresponding to the singularity. We divide polyhedral surfaces into discrete conformal classes using a generalization of discrete conformal equivalence pioneered by Feng Luo. We subsequently show that, in every discrete conformal class, there exists a polyhedral surface with constant discrete Gaussian curvature. We also provide explicit examples to demonstrate that this surface is in general not unique.


An Interpretable Web based Glioblastoma Multiforme Prognosis Prediction Tool using Random Forest Model. We propose predictive models that estimate GBM patients' health status of one year after treatments (Classification task), predict the long term prognosis of GBM patients at an individual level (Survival task). We used total of 467 GBM patients' clinical profile consists of 13 features and two follow up dates. For baseline models of random forest classifier(RFC) and random survival forest model (RSF), we introduced generalized linear model (GLM), support vector machine (SVM) and Cox proportional hazardous model (COX), accelerated failure time model (AFT) respectively. After preprocessing and prefixing stratified 5 fold data set, we generated best performing models for model types using recursive feature elimination process. Total 10, 4, and 13 features were extracted for best performing one year survival progression status RFC models and RSF model via the recursive feature elimination process. In classification task, AUROC of best performing RFC recorded 0.6990 (for one year survival status classification) and 0.7076 (for one year progression classification) while that of second best baseline models (GLM in both cases) recorded 0.6691 and 0.6997 respectively. About survival task, the highest C index of 0.7157 and the lowest IBS of 0.1038 came from the best performing RSF model while that of second best baseline models were 0.6556 and 0.1139 respectively. A simplified linear correlation (extracted from LIME and virtual patient group analysis) between each feature and prognosis of GBM patient were consistent with proven medical knowledge. Our machine learning models suggest that the top three prognostic factors for GBM patient survival were MGMT gene promoter, the extent of resection, and age. To the best of our knowledge, this study is the very first study introducing a interpretable and medical knowledge consistent GBM prognosis predictive models.


Learning Competitive Equilibria in Exchange Economies with Bandit Feedback. The sharing of scarce resources among multiple rational agents is one of the classical problems in economics. In exchange economies, which are used to model such situations, agents begin with an initial endowment of resources and exchange them in a way that is mutually beneficial until they reach a competitive equilibrium (CE). The allocations at a CE are Pareto efficient and fair. Consequently, they are used widely in designing mechanisms for fair division. However, computing CEs requires the knowledge of agent preferences which are unknown in several applications of interest. In this work, we explore a new online learning mechanism, which, on each round, allocates resources to the agents and collects stochastic feedback on their experience in using that allocation. Its goal is to learn the agent utilities via this feedback and imitate the allocations at a CE in the long run. We quantify CE behavior via two losses and propose a randomized algorithm which achieves sublinear loss under a parametric class of utilities. Empirically, we demonstrate the effectiveness of this mechanism through numerical simulations.


Machine learning identification of the variability of mean velocity and turbulence intensity for wakes generated by onshore wind turbines Cluster analysis of wind LiDAR measurements. Wind turbine wakes are the result of the extraction of kinetic energy from the incoming atmospheric wind exerted from a wind turbine rotor. Therefore, the reduced mean velocity and enhanced turbulence intensity within the wake are affected by the characteristics of the incoming wind, turbine blade aerodynamics, and the turbine control settings. In this work, LiDAR measurements of isolated wakes generated by wind turbines installed at an onshore wind farm are leveraged to characterize the variability of the wake mean velocity and turbulence intensity during typical operations encompassing a breadth of atmospheric stability regimes, levels of power capture, and, in turn, rotor thrust coefficients. For the statistical analysis of the wake velocity fields, the LiDAR measurements are clustered through a k means algorithm, which enables to identify of the most representative realizations of the wind turbine wakes while avoiding the imposition of thresholds for the various wind and turbine parameters, which can be biased by preconceived, and potentially incorrect, notions. Considering the large number of LiDAR samples collected to probe the wake velocity field over the horizontal plane at hub height, the dimensionality of the experimental dataset is reduced by projecting the LiDAR data on an intelligently truncated basis obtained with the proper orthogonal decomposition (POD). The coefficients of only five physics informed POD modes, which are considered sufficient to reproduce the observed wake variability, are then injected in the k means algorithm for clustering the LiDAR dataset. The analysis of the clustered LiDAR data, and the associated SCADA and meteorological data, enables the study of the variability of the wake velocity deficit, wake extent, and wake added turbulence intensity for different thrust coefficients of the turbine rotor and regimes of atmospheric stability.


The importance of overcoming MOVPE surface evolution instabilities for 1.3 mu m metamorphic lasers on GaAs. We investigated and demonstrated a 1.3 mu m band laser grown by metalorganic vapour phase epitaxy (MOVPE) on a specially engineered metamorphic parabolic graded In x Ga 1 x As buffer and epitaxial structure on a GaAs substrate. Bottom and upper cladding layers were built as a combination of AlInGaAs and InGaP alloys in a superlattice sequence. This was implemented to overcome (previously unreported) detrimental surface epitaxial dynamics and instabilities when single alloys are utilised to achieve thick layers on metamorphic structures, surface instabilities induce defect generation. This has represented a historically limiting factor for metamorphic lasers by MOVPE. We describe a number of alternative strategies to achieve smooth surface morphology to obtain efficient compressively strained In 0.4 Ga 0.6 As quantum wells in the active layer. The resulting lasers exhibited low lasing threshold with total slope efficiency of 0.34 W A for a 500 mu m long ridge waveguide device. The emission wavelength is extended as far as 1360 nm.


CO2 driven diffusiophoresis and water cleaning Similarity solutions for predicting the exclusion zone in a channel flow. We investigate experimentally and theoretically diffusiophoretic separation of negatively charged particles in a rectangular channel flow, driven by CO2 dissolution from one side wall. Since the negatively charged particles create an exclusion zone near the boundary where CO2 is introduced, we model the problem by applying a shear flow approximation in a two dimensional configuration. From the form of the equations we define a similarity variable to transform the reaction diffusion equations for CO2 and ions and the advection diffusion equation for the particle distribution to ordinary differential equations. The definition of the similarity variable suggests a characteristic length scale for the particle exclusion zone. We consider height averaged flow behaviors in rectangular channels to rationalize and connect our experimental observations with the model, by calculating the wall shear rate as functions of channel dimensions. Our observations and the theoretical model provide the design parameters such as flow speed, channel dimensions and CO2 pressure for the in flow water cleaning systems.


Energy time series forecasting Analytical and empirical assessment of conventional and machine learning models. Machine learning methods have been adopted in the literature as contenders to conventional methods to solve the energy time series forecasting (TSF) problems. Recently, deep learning methods have been emerged in the artificial intelligence field attaining astonishing performance in a wide range of applications. Yet, the evidence about their performance in to solve the energy TSF problems, in terms of accuracy and computational requirements, is scanty. Most of the review articles that handle the energy TSF problem are systematic reviews, however, a qualitative and quantitative study for the energy TSF problem is not yet available in the literature. The purpose of this paper is twofold, first it provides a comprehensive analytical assessment for conventional,machine learning, and deep learning methods that can be utilized to solve various energy TSF problems. Second, the paper carries out an empirical assessment for many selected methods through three real world datasets. These datasets related to electrical energy consumption problem, natural gas problem, and electric power consumption of an individual household problem.The first two problems are univariate TSF and the third problem is a multivariate TSF. Com pared to both conventional and machine learning contenders, the deep learning methods attain a significant improvement in terms of accuracy and forecasting horizons examined. In the mean time, their computational requirements are notably greater than other contenders. Eventually,the paper identifies a number of challenges, potential research directions, and recommendations to the research community may serve as a basis for further research in the energy forecasting domain.


Meta Path based Fake News Detection Leveraging Multi level Social Context Information. Fake news, false or misleading information presented as news, has a significant impact on many aspects of society, such as in politics or healthcare domains. Due to the deceiving nature of fake news, applying Natural Language Processing (NLP) techniques to the news content alone is insufficient. The multi level social context information (news publishers and engaged users in social media) and temporal information of user engagement are important information in fake news detection. The proper usage of this information, however, introduces three chronic difficulties 1) multi level social context information is hard to be used without information loss, 2) temporal information is hard to be used along with multi level social context information, 3) news representation with multi level social context and temporal information is hard to be learned in an end to end manner. To overcome all three difficulties, we propose a novel fake news detection framework, Hetero SCAN. We use Meta Path to extract meaningful multi level social context information without loss. Meta Path, a composite relation connecting two node types, is proposed to capture the semantics in the heterogeneous graph. We then propose Meta Path instance encoding and aggregation methods to capture the temporal information of user engagement and produce news representation end to end. According to our experiment, Hetero SCAN yields significant performance improvement over state of the art fake news detection methods.


A degenerate fully nonlinear free transmission problem with variable exponents. We study degenerate fully nonlinear free transmission problems, where the degeneracy rate varies in the domain. We prove optimal pointwise regularity depending on the degeneracy rate. Our arguments consist of perturbation methods, relating our problem to a homogeneous, fully nonlinear, uniformly elliptic equation.


Consistency checks of results from a Monte Carlo code intercomparison for emitted electron spectra and energy deposition around a single gold nanoparticle irradiated by X rays. Organized by the European Radiation Dosimetry Group (EURADOS), a Monte Carlo code intercomparison exercise was conducted where participants simulated the emitted electron spectra and energy deposition around a single gold nanoparticle (GNP) irradiated by X rays. In the exercise, the participants scored energy imparted in concentric spherical shells around a spherical volume filled with gold or water as well as the spectral distribution of electrons leaving the GNP. Initially, only the ratio of energy deposition with and without GNP was to be reported. During the evaluation of the exercise, however, the data for energy deposition in the presence and absence of the GNP were also requested. A GNP size of 50 nm and 100 nm diameter was considered as well as two different X ray spectra (50 kVp and 100kVp). This introduced a redundancy that can be used to cross validate the internal consistency of the simulation results. In this work, evaluation of the reported results is presented in terms of integral quantities that can be benchmarked against values obtained from physical properties of the radiation spectra and materials involved. The impact of different interaction cross section datasets and their implementation in the different Monte Carlo codes is also discussed.


Deep Permutation Equivariant Structure from Motion. Existing deep methods produce highly accurate 3D reconstructions in stereo and multiview stereo settings, i.e., when cameras are both internally and externally calibrated. Nevertheless, the challenge of simultaneous recovery of camera poses and 3D scene structure in multiview settings with deep networks is still outstanding. Inspired by projective factorization for Structure from Motion (SFM) and by deep matrix completion techniques, we propose a neural network architecture that, given a set of point tracks in multiple images of a static scene, recovers both the camera parameters and a (sparse) scene structure by minimizing an unsupervised reprojection loss. Our network architecture is designed to respect the structure of the problem the sought output is equivariant to permutations of both cameras and scene points. Notably, our method does not require initialization of camera parameters or 3D point locations. We test our architecture in two setups (1) single scene reconstruction and (2) learning from multiple scenes. Our experiments, conducted on a variety of datasets in both internally calibrated and uncalibrated settings, indicate that our method accurately recovers pose and structure, on par with classical state of the art methods. Additionally, we show that a pre trained network can be used to reconstruct novel scenes using inexpensive fine tuning with no loss of accuracy.


A modified discrepancy principle to attain optimal convergence rates under unknown noise. We consider a linear ill posed equation in the Hilbert space setting. Multiple independent unbiased measurements of the right hand side are available. A natural approach is to take the average of the measurements as an approximation of the right hand side and to estimate the data error as the inverse of the square root of the number of measurements. We calculate the optimal convergence rate (as the number of measurements tends to infinity) under classical source conditions and introduce a modified discrepancy principle, which asymptotically attains this rate.


Studying Eventual Connectivity Issues in Android Apps. Mobile apps have become indispensable for daily life, not only for individuals but also for companies organizations that offer their services digitally. Inherited by the mobility of devices, there are no limitations regarding the locations or conditions in which apps are being used. For example, apps can be used where no internet connection is available. Therefore, offline first is a highly desired quality of mobile apps. Accordingly, inappropriate handling of connectivity issues and miss implementation of good practices lead to bugs and crashes occurrences that reduce the confidence of users on the apps' quality. In this paper, we present the first study on Eventual Connectivity (ECn) issues exhibited by Android apps, by manually inspecting 971 scenarios related to 50 open source apps. We found 304 instances of ECn issues (6 issues per app, on average) that we organized in a taxonomy of 10 categories. We found that the majority of ECn issues are related to the use of messages not providing correct information to the user about the connectivity status and to the improper use of external libraries apps to which the check of the connectivity status is delegated. Based on our findings, we distill a list of lessons learned for both practitioners and researchers, indicating directions for future work.


Length Preserving Directions and Some Diophantine Equations. We study directions along which the norms of vectors are preserved under a linear map. In particular, we find families of matrices for which these directions are determined by integer vectors. We consider the two dimensional case in detail, and also discuss the extension to the three dimensional case.


The Efficient Hedging Frontier with Deep Neural Networks. The trade off between risks and returns gives rise to multi criteria optimisation problems that are well understood in finance, efficient frontiers being the tool to navigate their set of optimal solutions. Motivated by the recent advances in the use of deep neural networks in the context of hedging vanilla options when markets have frictions, we introduce the Efficient Hedging Frontier (EHF) by enriching the pipeline with a filtering step that allows to trade off costs and risks. This way, a trader's risk preference is matched with an expected hedging cost on the frontier, and the corresponding hedging strategy can be computed with a deep neural network. We further develop our framework to improve the EHF and find better hedging strategies. By adding a random forest classifier to the pipeline to forecast market movements, we show how the frontier shifts towards lower costs and reduced risks, which indicates that the overall hedging performances have improved. In addition, by designing a new recurrent neural network, we also find strategies on the frontier where hedging costs are even lower.


Triplot model agnostic measures and visualisations for variable importance in predictive models that take into account the hierarchical correlation structure. One of the key elements of explanatory analysis of a predictive model is to assess the importance of individual variables. Rapid development of the area of predictive model exploration (also called explainable artificial intelligence or interpretable machine learning) has led to the popularization of methods for local (instance level) and global (dataset level) methods, such as Permutational Variable Importance, Shapley Values (SHAP), Local Interpretable Model Explanations (LIME), Break Down and so on. However, these methods do not use information about the correlation between features which significantly reduce the explainability of the model behaviour. In this work, we propose new methods to support model analysis by exploiting the information about the correlation between variables. The dataset level aspect importance measure is inspired by the block permutations procedure, while the instance level aspect importance measure is inspired by the LIME method. We show how to analyze groups of variables (aspects) both when they are proposed by the user and when they should be determined automatically based on the hierarchical structure of correlations between variables. Additionally, we present the new type of model visualisation, triplot, which exploits a hierarchical structure of variable grouping to produce a high information density model visualisation. This visualisation provides a consistent illustration for either local or global model and data exploration. We also show an example of real world data with 5k instances and 37 features in which a significant correlation between variables affects the interpretation of the effect of variable importance. The proposed method is, to our knowledge, the first to allow direct use of the correlation between variables in exploratory model analysis.


Chow Groups of Quadrics in Characteristic Two. Let X be a smooth projective quadric defined over a field of characteristic 2. We prove that in the Chow group of codimension 2 or 3 of X the torsion subgroup has at most two elements. In codimension 2, we determine precisely when this torsion subgroup is nontrivial. In codimension 3, we show that there is no torsion if dim X ge 11 . This extends the analogous results in characteristic different from 2, obtained by Karpenko in the nineteen nineties.


Rethinking Soft Labels for Knowledge Distillation A Bias Variance Tradeoff Perspective. Knowledge distillation is an effective approach to leverage a well trained network or an ensemble of them, named as the teacher, to guide the training of a student network. The outputs from the teacher network are used as soft labels for supervising the training of a new network. Recent studies citep muller2019does,yuan2020revisiting revealed an intriguing property of the soft labels that making labels soft serves as a good regularization to the student network. From the perspective of statistical learning, regularization aims to reduce the variance, however how bias and variance change is not clear for training with soft labels. In this paper, we investigate the bias variance tradeoff brought by distillation with soft labels. Specifically, we observe that during training the bias variance tradeoff varies sample wisely. Further, under the same distillation temperature setting, we observe that the distillation performance is negatively associated with the number of some specific samples, which are named as regularization samples since these samples lead to bias increasing and variance decreasing. Nevertheless, we empirically find that completely filtering out regularization samples also deteriorates distillation performance. Our discoveries inspired us to propose the novel weighted soft labels to help the network adaptively handle the sample wise bias variance tradeoff. Experiments on standard evaluation benchmarks validate the effectiveness of our method. Our code is available at url https github.com bellymonster Weighted Soft Label Distillation .


Higher rank Brill Noether theory and coherent systems Open questions. This article presents a list of open questions on higher rank Brill Noether theory and coherent systems. Background material and appropriate references are included.


Collaborative Mapping of Archaeological Sites using multiple UAVs. UAVs have found an important application in archaeological mapping. Majority of the existing methods employ an offline method to process the data collected from an archaeological site. They are time consuming and computationally expensive. In this paper, we present a multi UAV approach for faster mapping of archaeological sites. Employing a team of UAVs not only reduces the mapping time by distribution of coverage area, but also improves the map accuracy by exchange of information. Through extensive experiments in a realistic simulation (AirSim), we demonstrate the advantages of using a collaborative mapping approach. We then create the first 3D map of the Sadra Fort, a 15th Century Fort located in Gujarat, India using our proposed method. Additionally, we present two novel archaeological datasets recorded in both simulation and real world to facilitate research on collaborative archaeological mapping. For the benefit of the community, we make the AirSim simulation environment, as well as the datasets publicly available.


GrASP A Library for Extracting and Exploring Human Interpretable Textual Patterns. Data exploration is an important step of every data science and machine learning project, including those involving textual data. We provide a Python library for GrASP, an existing algorithm for drawing patterns from textual data. The library is equipped with a web based interface empowering human users to conveniently explore the data and the extracted patterns. We also demonstrate the use of the library in two settings (spam detection and argument mining) and discuss future deployments of the library, e.g., beyond textual data exploration.


Genetic Meta Structure Search for Recommendation on Heterogeneous Information Network. In the past decade, the heterogeneous information network (HIN) has become an important methodology for modern recommender systems. To fully leverage its power, manually designed network templates, i.e., meta structures, are introduced to filter out semantic aware information. The hand crafted meta structure rely on intense expert knowledge, which is both laborious and data dependent. On the other hand, the number of meta structures grows exponentially with its size and the number of node types, which prohibits brute force search. To address these challenges, we propose Genetic Meta Structure Search (GEMS) to automatically optimize meta structure designs for recommendation on HINs. Specifically, GEMS adopts a parallel genetic algorithm to search meaningful meta structures for recommendation, and designs dedicated rules and a meta structure predictor to efficiently explore the search space. Finally, we propose an attention based multi view graph convolutional network module to dynamically fuse information from different meta structures. Extensive experiments on three real world datasets suggest the effectiveness of GEMS, which consistently outperforms all baseline methods in HIN recommendation. Compared with simplified GEMS which utilizes hand crafted meta paths, GEMS achieves over 6 performance gain on most evaluation metrics. More importantly, we conduct an in depth analysis on the identified meta structures, which sheds light on the HIN based recommender system design.


NVCell Standard Cell Layout in Advanced Technology Nodes with Reinforcement Learning. High quality standard cell layout automation in advanced technology nodes is still challenging in the industry today because of complex design rules. In this paper we introduce an automatic standard cell layout generator called NVCell that can generate layouts with equal or smaller area for over 90 of single row cells in an industry standard cell library on an advanced technology node. NVCell leverages reinforcement learning (RL) to fix design rule violations during routing and to generate efficient placements.


Regular solutions of the stationary Navier Stokes equations on high dimensional Euclidean space. We study the existence of regular solutions of the incompressible stationary Navier Stokes equations in n dimensional Euclidean space with a given bounded external force of compact support. In dimensions n le 5 , the existence of such solutions was known. In this paper, we extend it to dimensions n le 15 .


Absolute model companionship, forcibility, and the continuum problem. Absolute model companionship (AMC) is a strict strengthening of model companionship defined as follows For a theory T , T exists vee forall denotes the logical consequences of T which are boolean combinations of universal sentences. T is the AMC of T if it is model complete and T exists vee forall T exists vee forall . The , cdot,0,1 theory mathsf ACF of algebraically closed field is the model companion of the theory of mathsf Fields but not its AMC as exists x(x 2 1 0) is in mathsf ACF exists vee forall setminus mathsf Fields exists vee forall . We use AMC to study the continuum problem and to gauge the expressive power of forcing. We show that (a definable version of) 2 aleph 0 aleph 2 is the unique solution to the continuum problem which can be in the AMC of a "partial Morleyization" of the in theory mathsf ZFC "there are class many supercompact cardinals". We also show that (assuming large cardinals) forcibility overlaps with the apparently weaker notion of consistency for any mathematical problem psi expressible as a Pi 2 sentence of a (very large fragment of) third order arithmetic ( mathsf CH , the Suslin hypothesis, the Whitehead conjecture for free groups are a small sample of such problems psi ). Partial Morleyizations can be described as follows let mathsf Form tau be the set of first order tau formulae for A subseteq mathsf Form tau , tau A is the expansion of tau adding atomic relation symbols R phi for all formulae phi in A and T tau,A is the tau A theory asserting that each tau formula phi( vec x ) in A is logically equivalent to the corresponding atomic formula R phi( vec x ) . For a tau theory T T T tau,A is the partial Morleyization of T induced by A subseteq mathsf Form tau .


Robust near diagonal Green function estimates. We prove sharp near diagonal pointwise bounds for the Green function G Omega(x,y) for nonlocal operators of fractional order alpha in (0,2) . The novelty of our results is two fold the estimates are robust as alpha to 2 and we prove the bounds without making use of the Dirichlet heat kernel p Omega(t x,y) . In this way we can cover cases, in which the Green function satisfies isotropic bounds but the heat kernel does not.


On finitely summable Fredholm modules from Smale spaces. We prove that all K homology classes of the stable (and unstable) Ruelle algebra of a Smale space have explicit Fredholm module representatives that are finitely summable on the same smooth subalgebra and with the same degree of summability. The smooth subalgebra is induced by a metric on the underlying Smale space groupoid and fine transversality relations between stable and unstable sets. The degree of summability is related to the fractal dimension of the Smale space. Further, the Fredholm modules are obtained by taking Kasparov products with a fundamental class of the Spanier Whitehead K duality between the Ruelle algebras. Finally, we obtain general results on stability under holomorphic functional calculus and construct Lipschitz algebras on 'etale groupoids.


A synergic approach to enhance long term culture and manipulation of MiaPaCa 2 pancreatic cancer spheroids. Tumour spheroids have the potential to be used as preclinical chemosensitivity assays. However, the production of three dimensional (3D) tumour spheroids remains challenging as not all tumour cell lines form spheroids with regular morphologies and spheroid transfer often induces disaggregation. In the field of pancreatic cancer, the MiaPaCa 2 cell line is an interesting model for research but it is known for its difficulty to form stable spheroids also, when formed, spheroids from this cell line are weak and arduous to manage and to harvest for further analyses such as multiple staining and imaging. In this work, we compared different methods (i.e. hanging drop, round bottom wells and Matrigel embedding, each of them with or without methylcellulose in the media) to evaluate which one allowed to better overpass these limitations. Morphometric analysis indicated that hanging drop in presence of methylcellulose leaded to well organized spheroids interestingly, quantitative PCR (qPCR) analysis reflected the morphometric characterization, indicating that same spheroids expressed the highest values of CD44, VIMENTIN, TGF beta1 and Ki67. In addition, we investigated the generation of MiaPaCa 2 spheroids when cultured on substrates of different hydrophobicity, in order to minimize the area in contact with the culture media and to further improve spheroid formation.


Automatic Main Character Recognition for Photographic Studies. Main characters in images are the most important humans that catch the viewer's attention upon first look, and they are emphasized by properties such as size, position, color saturation, and sharpness of focus. Identifying the main character in images plays an important role in traditional photographic studies and media analysis, but the task is performed manually and can be slow and laborious. Furthermore, selection of main characters can be sometimes subjective. In this paper, we analyze the feasibility of solving the main character recognition needed for photographic studies automatically and propose a method for identifying the main characters. The proposed method uses machine learning based human pose estimation along with traditional computer vision approaches for this task. We approach the task as a binary classification problem where each detected human is classified either as a main character or not. To evaluate both the subjectivity of the task and the performance of our method, we collected a dataset of 300 varying images from multiple sources and asked five people, a photographic researcher and four other persons, to annotate the main characters. Our analysis showed a relatively high agreement between different annotators. The proposed method achieved a promising F1 score of 0.83 on the full image set and 0.96 on a subset evaluated as most clear and important cases by the photographic researcher.


Sylvester Cayley vector partitions algorithm and the Gaussian polynomials. We extend an algorithm suggested in 1858 by Sylvester and implemented in 1860 by Cayley for a problem of double partitions and apply it to derivation of explicit expressions for coefficients of the Gaussian polynomials through convolution of restricted partition functions.


Faster Sparse Matrix Inversion and Rank Computation in Finite Fields. We improve the current best running time value to invert sparse matrices over finite fields, lowering it to an expected O big(n 2.2131 big) time for the current values of fast rectangular matrix multiplication. We achieve the same running time for the computation of the rank and nullspace of a sparse matrix over a finite field. This improvement relies on two key techniques. First, we adopt the decomposition of an arbitrary matrix into block Krylov and Hankel matrices from Eberly et al. (ISSAC 2007). Second, we show how to recover the explicit inverse of a block Hankel matrix using low displacement rank techniques for structured matrices and fast rectangular matrix multiplication algorithms. We generalize our inversion method to block structured matrices with other displacement operators and strengthen the best known upper bounds for explicit inversion of block Toeplitz like and block Hankel like matrices, as well as for explicit inversion of block Vandermonde like matrices with structured blocks. As a further application, we improve the complexity of several algorithms in topological data analysis and in finite group theory.


RADAMS Resilient and Adaptive Alert and Attention Management Strategy against Informational Denial of Service (IDoS) Attacks. Attacks exploiting human attentional vulnerability have posed severe threats to cybersecurity. In this work, we identify and formally define a new type of proactive attentional attacks called Informational Denial of Service (IDoS) attacks that generate a large volume of feint attacks to overload human operators and hide real attacks among feints. We incorporate human factors (e.g., levels of expertise, stress, and efficiency) and empirical results (e.g., the Yerkes Dodson law and the sunk cost fallacy) to model the operators' attention dynamics and their decision making processes along with the real time alert monitoring and inspection. To assist human operators in timely and accurately dismissing the feints and escalating the real attacks, we develop a Resilient and Adaptive Data driven alert and Attention Management Strategy (RADAMS) that de emphasizes alerts selectively based on the alerts' observable features. RADAMS uses reinforcement learning to achieve a customized and transferable design for various human operators and evolving IDoS attacks. The integrated modeling and theoretical analysis lead to the Product Principle of Attention (PPoA), fundamental limits, and the tradeoff among crucial human and economic factors. Experimental results corroborate that the proposed strategy outperforms the default strategy and can reduce the IDoS risk by as much as 20 . Besides, the strategy is resilient to large variations of costs, attack frequencies, and human attention capacities. We have recognized interesting phenomena such as attentional risk equivalency, attacker's dilemma, and the half truth optimal attack strategy.


A zero forcing technique for bounding sums of eigenvalue multiplicities. Given a graph G , one may ask "What sets of eigenvalues are possible over all weighted adjacency matrices of G ?" (The weight of an edge is positive or negative, while the diagonal entries can be any real numbers.) This is known as the Inverse Eigenvalue Problem for graphs (IEP G ). A mild relaxation of this question considers the multiplicity list instead of the exact eigenvalues themselves. That is, given a graph G on n vertices and an ordered partition mathbf m (m 1, ldots, m ell) of n , is there a weighted adjacency matrix where the i th distinct eigenvalue has multiplicity m i ? This is known as the ordered multiplicity IEP G . Recent work solved the ordered multiplicity IEP G for all graphs on 6 vertices. In this work, we develop zero forcing methods for the ordered multiplicity IEP G in a multitude of different contexts. Namely, we utilize zero forcing parameters on powers of graphs to achieve bounds on consecutive multiplicities. We are able to provide general bounds on sums of multiplicities of eigenvalues for graphs. This includes new bounds on the the sums of multiplicities of consecutive eigenvalues as well as more specific bounds for trees. Using these results, we verify the previous results above regarding the IEP G on six vertices. In addition, applying our techniques to skew symmetric matrices, we are able to determine all possible ordered multiplicity lists for skew symmetric matrices for connected graphs on five vertices.


FrugalScore Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation. Fast and reliable evaluation metrics are key to R D progress. While traditional natural language generation metrics are fast, they are not very reliable. Conversely, new metrics based on large pretrained language models are much more reliable, but require significant computational resources. In this paper, we propose FrugalScore, an approach to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performance. Experiments with BERTScore and MoverScore on summarization and translation show that FrugalScore is on par with the original metrics (and sometimes better), while having several orders of magnitude less parameters and running several times faster. On average over all learned metrics, tasks, and variants, FrugalScore retains 96.8 of the performance, runs 24 times faster, and has 35 times less parameters than the original metrics. We make our trained metrics publicly available, to benefit the entire NLP community and in particular researchers and practitioners with limited resources.


Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence. Typical fact verification models use retrieved written evidence to verify claims. Evidence sources, however, often change over time as more information is gathered and revised. In order to adapt, models must be sensitive to subtle differences in supporting evidence. We present VitaminC, a benchmark infused with challenging cases that require fact verification models to discern and adjust to slight factual changes. We collect over 100,000 Wikipedia revisions that modify an underlying fact, and leverage these revisions, together with additional synthetically constructed ones, to create a total of over 400,000 claim evidence pairs. Unlike previous resources, the examples in VitaminC are contrastive, i.e., they contain evidence pairs that are nearly identical in language and content, with the exception that one supports a given claim while the other does not. We show that training using this design increases robustness improving accuracy by 10 on adversarial fact verification and 6 on adversarial natural language inference (NLI). Moreover, the structure of VitaminC leads us to define additional tasks for fact checking resources tagging relevant words in the evidence for verifying the claim, identifying factual revisions, and providing automatic edits via factually consistent text generation.


Continuous Learning and Adaptation with Membrane Potential and Activation Threshold Homeostasis. Most classical (non spiking) neural network models disregard internal neuron dynamics and treat neurons as simple input integrators. However, biological neurons have an internal state governed by complex dynamics that plays a crucial role in learning, adaptation and the overall network activity and behaviour. This paper presents the Membrane Potential and Activation Threshold Homeostasis (MPATH) neuron model, which combines several biologically inspired mechanisms to efficiently simulate internal neuron dynamics with a single parameter analogous to the membrane time constant in biological neurons. The model allows neurons to maintain a form of dynamic equilibrium by automatically regulating their activity when presented with fluctuating input. One consequence of the MPATH model is that it imbues neurons with a sense of time without recurrent connections, paving the way for modelling processes that depend on temporal aspects of neuron activity. Experiments demonstrate the model's ability to adapt to and continually learn from its input.


physics.plasm-ph cs.NA math.NA physics.comp-ph

First equilibrium reconstruction for ITER with the code NICE. In this short paper we present the first application of the IMAS compatible code NICE to equilibrium reconstrution for ITER geometry. The inverse problem is formulated as a least square problem and the numerical methods implemented in NICE in order to solve it are presented. The results of a numerical experiment are shown a reference equilibrium is computed from which a set of synthetic magnetic measurements are extracted. Then these measurements are used successfully to reconstruct the equilibrium of the plasma.


TEA A Sequential Recommendation Framework via Temporally Evolving Aggregations. Sequential recommendation aims to choose the most suitable items for a user at a specific timestamp given historical behaviors. Existing methods usually model the user behavior sequence based on the transition based methods like Markov Chain. However, these methods also implicitly assume that the users are independent of each other without considering the influence between users. In fact, this influence plays an important role in sequence recommendation since the behavior of a user is easily affected by others. Therefore, it is desirable to aggregate both user behaviors and the influence between users, which are evolved temporally and involved in the heterogeneous graph of users and items. In this paper, we incorporate dynamic user item heterogeneous graphs to propose a novel sequential recommendation framework. As a result, the historical behaviors as well as the influence between users can be taken into consideration. To achieve this, we firstly formalize sequential recommendation as a problem to estimate conditional probability given temporal dynamic heterogeneous graphs and user behavior sequences. After that, we exploit the conditional random field to aggregate the heterogeneous graphs and user behaviors for probability estimation, and employ the pseudo likelihood approach to derive a tractable objective function. Finally, we provide scalable and flexible implementations of the proposed framework. Experimental results on three real world datasets not only demonstrate the effectiveness of our proposed method but also provide some insightful discoveries on sequential recommendation.


Mobility strategies based on percolation theory to avoid the spread of diseases COVID 19. Human mobility is an important factor in the propagation of infectious diseases. In particular, the spatial spread of a disease is a consequence of human mobility. On the other hand, the control strategies based on mobility restrictions are generally unpopular and costly. These high social and economic costs make it very important to design global protocols where the cost is minimized and effects maximized. In this work, we calculate the percolation threshold of the spread in a network of a disease. In particular, we found the number of roads to close and regions to isolate in the Puebla State, Mexico, to avoid the global spread of COVID 19. Computational simulations taking into account the proposed strategy show a potential reduction of 94 of infections. This methodology can be used in broader and different areas to help in the design of health policies. La movilidad de las personas es uno de los principales factores que propician la propagaci 'on de epidemias. En particular, es el factor que genera el esparcimiento de la enfermedad en diferentes regiones. Las medidas de control epidemiol 'ogico basadas en la restricci 'on de movilidad son generalmente poco populares y las consecuencias econ 'omicas pueden llegar a ser muy grandes. Debido a los altos costos de estas medidas, es de gran relevancia tener estrategias globales que optimicen las medidas minimizando los costos. En este trabajo, se calcula el umbral de percolaci 'on de la propagaci 'on de enfermedades en redes. De manera particular, se encuentra el n 'umero de caminos a restringir y localidades que tienen que ser aisladas para limitar la propagaci 'on global de COVID 19 en el Estado de Puebla, M 'exico. Simulaciones computacionales donde se implementan las medidas de restricci 'on de movilidad entre los diferentes municipios, junto con las medidas de confinamiento, muestran que es posible reducir un 94 de la poblaci 'on afectada comparado con el caso en el que no se implementa ninguna medida. Esta metodolog 'ia puede ser aplicada a distintas zonas para ayudar a las autoridades de salud en la toma de decisiones.


Scheduling Servers with Stochastic Bilinear Rewards. In this paper we study a multi class, multi server queueing system with stochastic rewards of job server assignments following a bilinear model in feature vectors representing jobs and servers. Our goal is regret minimization against an oracle policy that has a complete information about system parameters. We propose a scheduling algorithm that uses a linear bandit algorithm along with dynamic allocation of jobs to servers. For the baseline setting, in which mean job service times are identical for all jobs, we show that our algorithm has a sub linear regret, as well as a sub linear bound on the mean queue length, in the horizon time. We further show that similar bounds hold under more general assumptions, allowing for non identical mean job service times for different job classes and a time varying set of server classes. We also show that better regret and mean queue length bounds can be guaranteed by an algorithm having access to traffic intensities of job classes. We present results of numerical experiments demonstrating how regret and mean queue length of our algorithms depend on various system parameters and compare their performance against a previously proposed algorithm using synthetic randomly generated data and a real world cluster computing data trace.


Symmetries of exotic smoothings of aspherical space forms. We study finite group actions on smooth manifolds of the form W Sigma , where Sigma is an exotic n sphere and W is either a hyperbolic or a flat manifold. In the flat case, we classify the finite cyclic groups that act freely on an exotic torus T n Sigma . For hyperbolic manifolds M , we produce examples M Sigma that admit no nontrivial smooth action of a finite group, while Isom( M ) is arbitrarily large.


Giant Terahertz Polarization Rotation in Ultrathin Films of Aligned Carbon Nanotubes. For facile manipulation of polarization states of light for applications in communications, imaging, and information processing, an efficient mechanism is desired for rotating light polarization with a minimum interaction length. Here, we report giant polarization rotations for terahertz (THz) electromagnetic waves in ultrathin ( 45 nm), high density films of aligned carbon nanotubes. We observed polarization rotations of up to 20 deg and 110 deg for transmitted and reflected THz pulses, respectively. The amount of polarization rotation was a sensitive function of the angle between the incident THz polarization and the nanotube alignment direction, exhibiting a magic' angle at which the total rotation through transmission and reflection becomes exactly 90 deg . Our model quantitatively explains these giant rotations as a result of extremely anisotropic optical constants, demonstrating that aligned carbon nanotubes promise ultrathin, broadband, and tunable THz polarization devices.


Clustering Word Embeddings with Self Organizing Maps. Application on LaRoSeDa A Large Romanian Sentiment Data Set. Romanian is one of the understudied languages in computational linguistics, with few resources available for the development of natural language processing tools. In this paper, we introduce LaRoSeDa, a Large Romanian Sentiment Data Set, which is composed of 15,000 positive and negative reviews collected from one of the largest Romanian e commerce platforms. We employ two sentiment classification methods as baselines for our new data set, one based on low level features (character n grams) and one based on high level features (bag of word embeddings generated by clustering word embeddings with k means). As an additional contribution, we replace the k means clustering algorithm with self organizing maps (SOMs), obtaining better results because the generated clusters of word embeddings are closer to the Zipf's law distribution, which is known to govern natural language. We also demonstrate the generalization capacity of using SOMs for the clustering of word embeddings on another recently introduced Romanian data set, for text categorization by topic.


On Automatic Data Augmentation for 3D Point Cloud Classification. Data augmentation is an important technique to reduce overfitting and improve learning performance, but existing works on data augmentation for 3D point cloud data are based on heuristics. In this work, we instead propose to automatically learn a data augmentation strategy using bilevel optimization. An augmentor is designed in a similar fashion to a conditional generator and is optimized by minimizing a base model's loss on a validation set when the augmented input is used for training the model. This formulation provides a more principled way to learn data augmentation on 3D point clouds. We evaluate our approach on standard point cloud classification tasks and a more challenging setting with pose misalignment between training and validation test sets. The proposed strategy achieves competitive performance on both tasks and we provide further insight into the augmentor's ability to learn the validation set distribution.


Partial order alignment by adjacencies and breakpoints. Linearizing two partial orders to maximize the number of adjacencies and minimize the number of breakpoints is APX hard. This holds even if one of the two partial orders is already a linear order and the other is an interval order, or if both partial orders are weak orders.


Injectivity of non singular planar maps with one convex component. We prove that if a non singular planar map Lambda in C 2(R 2,R 2) has a convex component, then Lambda is injective. We do not assume strict convexity.


The cohomology of C 2 surfaces with underline mathbb Z coefficients. Let C 2 denote the cyclic group of order 2. We compute the RO(C 2) graded cohomology of all C 2 surfaces with constant integral coefficients. We show when the action is nonfree, the answer depends only on the genus, the orientability of the underlying surface, the number of isolated fixed points, the number of fixed circles with trivial normal bundles, and the number of fixed circles with nontrivial normal bundles. When the action on the surface is free, we show the answer depends only on the genus, the orientability of the underlying surface, whether the action is orientation preserving versus reversing in the orientable case, and one other invariant.


Neural Network Module Decomposition and Recomposition. We propose a modularization method that decomposes a deep neural network (DNN) into small modules from a functionality perspective and recomposes them into a new model for some other task. Decomposed modules are expected to have the advantages of interpretability and verifiability due to their small size. In contrast to existing studies based on reusing models that involve retraining, such as a transfer learning model, the proposed method does not require retraining and has wide applicability as it can be easily combined with existing functional modules. The proposed method extracts modules using weight masks and can be applied to arbitrary DNNs. Unlike existing studies, it requires no assumption about the network architecture. To extract modules, we designed a learning method and a loss function to maximize shared weights among modules. As a result, the extracted modules can be recomposed without a large increase in the size. We demonstrate that the proposed method can decompose and recompose DNNs with high compression ratio and high accuracy and is superior to the existing method through sharing weights between modules.


Extracting Variable Depth Logical Document Hierarchy from Long Documents Method, Evaluation, and Application. In this paper, we study the problem of extracting variable depth "logical document hierarchy" from long documents, namely organizing the recognized "physical document objects" into hierarchical structures. The discovery of logical document hierarchy is the vital step to support many downstream applications. However, long documents, containing hundreds or even thousands of pages and variable depth hierarchy, challenge the existing methods. To address these challenges, we develop a framework, namely Hierarchy Extraction from Long Document (HELD), where we "sequentially" insert each physical object at the proper on of the current tree. Determining whether each possible position is proper or not can be formulated as a binary classification problem. To further improve its effectiveness and efficiency, we study the design variants in HELD, including traversal orders of the insertion positions, heading extraction explicitly or implicitly, tolerance to insertion errors in predecessor steps, and so on. The empirical experiments based on thousands of long documents from Chinese, English financial market and English scientific publication show that the HELD model with the "root to leaf" traversal order and explicit heading extraction is the best choice to achieve the tradeoff between effectiveness and efficiency with the accuracy of 0.9726, 0.7291 and 0.9578 in Chinese financial, English financial and arXiv datasets, respectively. Finally, we show that logical document hierarchy can be employed to significantly improve the performance of the downstream passage retrieval task. In summary, we conduct a systematic study on this task in terms of methods, evaluations, and applications.


It's always personal Using Early Exits for Efficient On Device CNN Personalisation. On device machine learning is becoming a reality thanks to the availability of powerful hardware and model compression techniques. Typically, these models are pretrained on large GPU clusters and have enough parameters to generalise across a wide variety of inputs. In this work, we observe that a much smaller, personalised model can be employed to fit a specific scenario, resulting in both higher accuracy and faster execution. Nevertheless, on device training is extremely challenging, imposing excessive computational and memory requirements even for flagship smartphones. At the same time, on device data availability might be limited and samples are most frequently unlabelled. To this end, we introduce PersEPhonEE, a framework that attaches early exits on the model and personalises them on device. These allow the model to progressively bypass a larger part of the computation as more personalised data become available. Moreover, we introduce an efficient on device algorithm that trains the early exits in a semi supervised manner at a fraction of the whole network's personalisation time. Results show that PersEPhonEE boosts accuracy by up to 15.9 while dropping the training cost by up to 2.2x and inference latency by 2.2 3.2x on average for the same accuracy, depending on the availability of labels on device.


Most rigid representation and Cayley index of finitely generated groups. If G is a group and S a generating set, G canonically embeds into the automorphism group of its Cayley graph and it is natural to try to minimize, over all generating sets, the index of this inclusion. This infimum is called the Cayley index of the group. In a recent series of works, we have characterized the infinite finitely generated groups with Cayley index 1 . We complement this characterization by showing that the Cayley index is 2 in the remaining cases and is attained for a finite generating set.


BackREST A Model Based Feedback Driven Greybox Fuzzer for Web Applications. Following the advent of the American Fuzzy Lop (AFL), fuzzing had a surge in popularity, and modern day fuzzers range from simple blackbox random input generators to complex whitebox concolic frameworks that are capable of deep program introspection. Web application fuzzers, however, did not benefit from the tremendous advancements in fuzzing for binary programs and remain largely blackbox in nature. This paper introduces BackREST, a fully automated, model based, coverage and taint driven fuzzer that uses its feedback loops to find more critical vulnerabilities, faster (speedups between 7.4x and 25.9x). To model the server side of web applications, BackREST automatically infers REST specifications through directed state aware crawling. Comparing BackREST against three other web fuzzers on five large ( 500 KLOC) Node.js applications shows how it consistently achieves comparable coverage while reporting more vulnerabilities than state of the art. Finally, using BackREST, we uncovered nine 0 days, out of which six were not reported by any other fuzzer. All the 0 days have been disclosed and most are now public, including two in the highly popular Sequelize and Mongodb libraries.


A note on spacelike hypersurfaces and timelike conformal vectors. Any compact spacelike hypersurface immersed in a doubly warped product spacetime I h times rho mathbb P with nondecreasing warping factor rho must be a spacelike slice, provided that the mean curvature satisfies H geq rho' h rho everywhere on the hypersurface. The conclusion also holds, under suitable assumptions on the immersion, when the hypersurface is complete and noncompact. A similar rigidity property is shown for compact hypersurfaces in spacetimes carrying a conformal, strictly expanding, timelike vector field.


Natural Gradient Variational Inference with Gaussian Mixture Models. Bayesian methods estimate a measure of uncertainty by using the posterior distribution. One source of difficulty in these methods is the computation of the normalizing constant. Calculating exact posterior is generally intractable and we usually approximate it. Variational Inference (VI) methods approximate the posterior with a distribution usually chosen from a simple family using optimization. The main contribution of this work is described is a set of update rules for natural gradient variational inference with mixture of Gaussians, which can be run independently for each of the mixture components, potentially in parallel.


Weakly Supervised Video Anomaly Detection via Center guided Discriminative Learning. Anomaly detection in surveillance videos is a challenging task due to the diversity of anomalous video content and duration. In this paper, we consider video anomaly detection as a regression problem with respect to anomaly scores of video clips under weak supervision. Hence, we propose an anomaly detection framework, called Anomaly Regression Net (AR Net), which only requires video level labels in training stage. Further, to learn discriminative features for anomaly detection, we design a dynamic multiple instance learning loss and a center loss for the proposed AR Net. The former is used to enlarge the inter class distance between anomalous and normal instances, while the latter is proposed to reduce the intra class distance of normal instances. Comprehensive experiments are performed on a challenging benchmark ShanghaiTech. Our method yields a new state of the art result for video anomaly detection on ShanghaiTech dataset


An anisotropic cohesive fracture model advantages and limitations of length scale insensitive phase field damage models. The goal of the current work is to explore direction dependent damage initiation and propagation within an arbitrary anisotropic solid. In particular, we aim at developing anisotropic cohesive phase field (PF) damage models by extending the idea introduced in cite REZAEI2021a for direction dependent fracture energy and also anisotropic PF damage models based on structural tensors. The cohesive PF damage formulation used in the current contribution is motivated by the works of cite LORENTZ201120, wu2018, GEELEN2019 . The results of the latter models are shown to be insensitive with respect to the length scale parameter for the isotropic case. This is because they manage to formulate the fracture energy as a function of diffuse displacement jumps in the localized damaged zone. In the present paper, we discuss numerical examples and details on finite element implementations where the fracture energy, as well as the material strength, are introduced as an arbitrary function of the crack direction. Using the current formulation for anisotropic cohesive fracture, the obtained results are almost insensitive with respect to the length scale parameter. The latter is achieved by including the direction dependent strength of the material in addition to its fracture energy. Utilizing the current formulation, one can increase the mesh size which reduces the computational time significantly without any severe change in the predicted crack path and overall obtained load displacement curves. We also argue that these models still lack to capture mode dependent fracture properties. Open issues and possible remedies for future developments are finally discussed as well.


MEPG A Minimalist Ensemble Policy Gradient Framework for Deep Reinforcement Learning. Ensemble reinforcement learning (RL) aims to mitigate instability in Q learning and to learn a robust policy, which introduces multiple value and policy functions. In this paper, we consider finding a novel but simple ensemble Deep RL algorithm to solve the resource consumption issue. Specifically, we consider integrating multiple models into a single model. To this end, we propose the underline M inimalist underline E nsemble underline P olicy underline G radient framework (MEPG), which introduces minimalist ensemble consistent Bellman update. And we find one value network is sufficient in our framework. Moreover, we theoretically show that the policy evaluation phase in the MEPG is mathematically equivalent to a deep Gaussian Process. To verify the effectiveness of the MEPG framework, we conduct experiments on the gym simulator, which show that the MEPG framework matches or outperforms the state of the art ensemble methods and model free methods without additional computational resource costs.


MSR Mining Challenge The SmartSHARK Repository Mining Data. The SmartSHARK repository mining data is a collection of rich and detailed information about the evolution of software projects. The data is unique in its diversity and contains detailed information about each change, issue tracking data, continuous integration data, as well as pull request and code review data. Moreover, the data does not contain only raw data scraped from repositories, but also annotations in form of labels determined through a combination of manual analysis and heuristics, as well as links between the different parts of the data set. The SmartSHARK data set provides a rich source of data that enables us to explore research questions that require data from different sources and or longitudinal data over time.


Strategies of Network Intervention A Pragmatic Approach to Policy Implementation and Public Problem Resolution through Network Science. Public administration has yet to examine networks in terms of intervention, where network mechanisms are manipulated to promote behavioral change and improve social, organizational, and community outcomes. We argue that to fulfill the potential of network scholarship in public administration, the field requires a framework for intervention approaches tailored to the relational and interdependent context of public problems. Building on Valente's (2012) typology, we develop a framework for strategies of public sector network intervention. First, we describe the core concepts in the theory of network interventions found primarily in public health. Next, we expand the existing typology of interventions to include macro institutional strategies suited to public administration settings. We then identify extant public sector literature that provides the building blocks for a framework for intervention. Finally, we classify the modes of intervention along three dimensions (i) the processes targeted for change (network formation versus network effects), (ii) the types of nodes in the network (organizations versus individuals), and (iii) the level at which the intervention operates (macro versus micro). We provide scholars and practitioners with a useful way to conceptualize where, why, and how network interventions might be deployed.


A family of irreducible supersingular representations of mathrm GL 2(F) for some ramified p adic fields. We construct infinite families of irreducible supersingular mod p representations of mathrm GL 2(F) with mathrm GL 2( mathcal O F) socle compatible with Serre's modularity conjecture, where F mathbb Q p is any finite extension with residue field mathbb F p 2 and ramification degree e leq (p 1) 2 . These are the first such examples for ramified F mathbb Q p .


Toward Co creative Dungeon Generation via Transfer Learning. Co creative Procedural Content Generation via Machine Learning (PCGML) refers to systems where a PCGML agent and a human work together to produce output content. One of the limitations of co creative PCGML is that it requires co creative training data for a PCGML agent to learn to interact with humans. However, acquiring this data is a difficult and time consuming process. In this work, we propose approximating human AI interaction data and employing transfer learning to adapt learned co creative knowledge from one game to a different game. We explore this approach for co creative Zelda dungeon room generation.


Explainable Fact checking through Question Answering. Misleading or false information has been creating chaos in some places around the world. To mitigate this issue, many researchers have proposed automated fact checking methods to fight the spread of fake news. However, most methods cannot explain the reasoning behind their decisions, failing to build trust between machines and humans using such technology. Trust is essential for fact checking to be applied in the real world. Here, we address fact checking explainability through question answering. In particular, we propose generating questions and answers from claims and answering the same questions from evidence. We also propose an answer comparison model with an attention mechanism attached to each question. Leveraging question answering as a proxy, we break down automated fact checking into several steps this separation aids models' explainability as it allows for more detailed analysis of their decision making processes. Experimental results show that the proposed model can achieve state of the art performance while providing reasonable explainable capabilities.


Low Precision Reinforcement Learning Running Soft Actor Critic in Half Precision. Low precision training has become a popular approach to reduce compute requirements, memory footprint, and energy consumption in supervised learning. In contrast, this promising approach has not yet enjoyed similarly widespread adoption within the reinforcement learning (RL) community, partly because RL agents can be notoriously hard to train even in full precision. In this paper we consider continuous control with the state of the art SAC agent and demonstrate that a na "ive adaptation of low precision methods from supervised learning fails. We propose a set of six modifications, all straightforward to implement, that leaves the underlying agent and its hyperparameters unchanged but improves the numerical stability dramatically. The resulting modified SAC agent has lower memory and compute requirements while matching full precision rewards, demonstrating that low precision training can substantially accelerate state of the art RL without parameter tuning.


Generalized Fock space and fractional derivatives with Applications to Uniqueness of Sampling and Interpolation Sets. In this paper we introduce a Fock space related to derivatives of Gelfond Leontiev type, a class of derivatives which includes many classic examples like fractional derivatives or Dunkl operators. For this space we establish a modified Bargmann transform as well as density theorems for sampling and interpolation. These density theorems allow us to establish lattice conditions for the construction of frames arising from integral transforms which are linked by the modified Bargmann transform with the Fock space.


A blind spot in undergraduate mathematics The circular definition of the length of the circle, and how it can be turned into an enlightening example. We highlight the fact that in undergraduate calculus, the number pi is defined via the length of the circle, the length of the circle is defined as a certain value of an inverse trigonometric function, and this value is defined via pi, thus forming a circular definition. We present a way in which this error can be rectified. We explain that this error is instructive and can be used as an enlightening topic for discussing different approaches to mathematics with undergraduate students.