Thermodynamics approach to near future of civilization. The purpose of this study is to consider the near future of civilization in the framework of thermodynamics. Kardashev's proposal to evaluate the development of celestial civilizations by the amount of energy they are able to use was adopted to translate the concept of human activity into the language of physics. The discussion is limited to considering the last 500 years of history from the beginning of the scientific and technological revolutions to our immediate future. The application of classical and nonequilibrium thermodynamics is discussed. In the framework of classical thermodynamics, two systems are compared a) the first is a hypothetical quasi equilibrium system, Earth without a population. Since biological evolution becomes almost imperceptible for a short period of time, such a system remains in the same pristine state for the entire period (b) the second is our habitable planet, which is not in equilibrium due to rapid anthropogenic evolution and can be considered as a combination of the first system with human civilization. It is shown that in response to the development of civilization (a) the equilibrium of the hypothetical system is disturbed and processes are initiated aimed at reducing the amount of energy produced, and (b) there is a maximum on the path of civilization development over time. The resistance of nature will continue until a new balance is established, corresponding to a lower level of energy production. The central problem is whether humanity is ready and able to agree on a new balance, otherwise the degradation of our planet can lead to the collapse of civilization.


Projection free Graph based Classifier Learning using Gershgorin Disc Perfect Alignment. In semi supervised graph based binary classifier learning, a subset of known labels hat x i are used to infer unknown labels, assuming that the label signal x is smooth with respect to a similarity graph specified by a Laplacian matrix. When restricting labels x i to binary values, the problem is NP hard. While a conventional semi definite programming (SDP) relaxation can be solved in polynomial time using, for example, the alternating direction method of multipliers (ADMM), the complexity of iteratively projecting a candidate matrix M onto the positive semi definite (PSD) cone ( M succeq 0 ) remains high. In this paper, leveraging a recent linear algebraic theory called Gershgorin disc perfect alignment (GDPA), we propose a fast projection free method by solving a sequence of linear programs (LP) instead. Specifically, we first recast the SDP relaxation to its SDP dual, where a feasible solution H succeq 0 can be interpreted as a Laplacian matrix corresponding to a balanced signed graph sans the last node. To achieve graph balance, we split the last node into two that respectively contain the original positive and negative edges, resulting in a new Laplacian bar H . We repose the SDP dual for solution bar H , then replace the PSD cone constraint bar H succeq 0 with linear constraints derived from GDPA sufficient conditions to ensure bar H is PSD so that the optimization becomes an LP per iteration. Finally, we extract predicted labels from our converged LP solution bar H . Experiments show that our algorithm enjoyed a 40 times speedup on average over the next fastest scheme while retaining comparable label prediction performance.


Finite by nilpotent groups and a variation of the BFC theorem. For a group G and an element a in G let a k denote the cardinality of the set of commutators a,x 1,...,x k , where x 1,...,x k range over G. The main result of the paper states that a group G is finite by nilpotent if and only if there are positive integers k and n such that x k n for every x in G. More precisely, if x k n for every x in G then gamma k 1 (G) has finite (k,n) bounded order.


Povzner Wienholtz type theorems for Sturm Liouville operators with singular coefficients. We introduce and investigate symmetric operators L 0 associated in the complex Hilbert space L 2( mathbb R ) with a formal differential expression l u (pu')' qu i((ru)' ru') under minimal conditions on the regularity of the coefficients. They are assumed to satisfy conditions q Q' s quad frac 1 sqrt p , frac Q sqrt p , frac r sqrt p in L 2 loc left( mathbb R right), quad s in L 1 loc left( mathbb R right), quad frac 1 p neq 0 , , text a.e., where the derivative of the function Q is understood in the sense of distributions, and all functions p , Q , r , s are real valued. In particular, the coefficients q and r' may be Radon measures on mathbb R , while function p may be discontinuous. The main result of the paper are constructive sufficient conditions on the coefficient p which provide that the operator L 0 being semi bounded implies it being self adjoint.


Exploration and Incentives in Reinforcement Learning. How do you incentivize self interested agents to textit explore when they prefer to textit exploit ? We consider complex exploration problems, where each agent faces the same (but unknown) MDP. In contrast with traditional formulations of reinforcement learning, agents control the choice of policies, whereas an algorithm can only issue recommendations. However, the algorithm controls the flow of information, and can incentivize the agents to explore via information asymmetry. We design an algorithm which explores all reachable states in the MDP. We achieve provable guarantees similar to those for incentivizing exploration in static, stateless exploration problems studied previously. To the best of our knowledge, this is the first work to consider mechanism design in a stateful, reinforcement learning setting.


Discovering Drug Target Interaction Knowledge from Biomedical Literature. The Interaction between Drugs and Targets (DTI) in human body plays a crucial role in biomedical science and applications. As millions of papers come out every year in the biomedical domain, automatically discovering DTI knowledge from biomedical literature, which are usually triplets about drugs, targets and their interaction, becomes an urgent demand in the industry. Existing methods of discovering biological knowledge are mainly extractive approaches that often require detailed annotations (e.g., all mentions of biological entities, relations between every two entity mentions, etc.). However, it is difficult and costly to obtain sufficient annotations due to the requirement of expert knowledge from biomedical domains. To overcome these difficulties, we explore the first end to end solution for this task by using generative approaches. We regard the DTI triplets as a sequence and use a Transformer based model to directly generate them without using the detailed annotations of entities and relations. Further, we propose a semi supervised method, which leverages the aforementioned end to end model to filter unlabeled literature and label them. Experimental results show that our method significantly outperforms extractive baselines on DTI discovery. We also create a dataset, KD DTI, to advance this task and will release it to the community.


Input Admittance, Directivity and Quality Factor of Biconical Antenna of Arbitrary Cone Angle. New analytical expressions and numerical results for the mode coefficients, the directivity and the quality factor as well as computationally convenient expressions for the input admittance of a symmetrical biconical antenna of arbitrary length L and cone angle theta 0 are presented. The quality factor for a wide angle biconical antenna is evaluated using three alternative formulations (i) the evanescent energy stored outside the circumscribing sphere, (ii) the total evanescent energy stored in all space and (iii) by equivalent circuit model, and these are all compared with Chu's lower limit for an ideal antenna. Numerical calculations based on the analytical formula for antenna admittance confirm the conjecture that Foster's reactance theorem remains invalid even for perfectly conducting antennas. Furthermore, the variation of directivity of a wide angle biconical antenna is a slowly varying function of its electrical length and is shown to depart significantly from that of a thin cylindrical dipole. Lastly, the ratio of directivity to Q of an electrically small biconical antenna is shown to approach 78 of the value of an ideal omnidirectional antenna.


Enhancing the Insertion of NOP Instructions to Obfuscate Malware via Deep Reinforcement Learning. Current state of the art research for tackling the problem of malware detection and classification is centered on the design, implementation and deployment of systems powered by machine learning because of its ability to generalize to never before seen malware families and polymorphic mutations. However, it has been shown that machine learning models, in particular deep neural networks, lack robustness against crafted inputs (adversarial examples). In this work, we have investigated the vulnerability of a state of the art shallow convolutional neural network malware classifier against the dead code insertion technique. We propose a general framework powered by a Double Q network to induce misclassification over malware families. The framework trains an agent through a convolutional neural network to select the optimal positions in a code sequence to insert dead code instructions so that the machine learning classifier mislabels the resulting executable. The experiments show that the proposed method significantly drops the classification accuracy of the classifier to 56.53 while having an evasion rate of 100 for the samples belonging to the Kelihos ver3, Simda, and Kelihos ver1 families. In addition, the average number of instructions needed to mislabel malware in comparison to a random agent decreased by 33 .


Infinite color randomly reinforced urns with dominant colors. We define and prove limit results for a class of dominant P 'olya sequences, which are randomly reinforced urn processes with color specific random weights and unbounded number of possible colors. Under fairly mild assumptions on the expected reinforcement, we show that the predictive and the empirical distributions converge almost surely (a.s.) in total variation to the same random probability measure tilde P moreover, tilde P ( mathcal D ) 1 a.s., where mathcal D denotes the set of dominant colors for which the expected reinforcement is maximum. In the general case, the predictive probabilities and the empirical frequencies of any delta neighborhood of mathcal D converge a.s. to one. That is, although non dominant colors continue to be regularly observed, their distance to mathcal D converges in probability to zero. We refine the above results with rates of convergence. We further hint potential applications of dominant P 'olya sequences in randomized clinical trials and species sampling, and use our central limit results for Bayesian inference.


Robustness Evaluation of Stacked Generative Adversarial Networks using Metamorphic Testing. Synthesising photo realistic images from natural language is one of the challenging problems in computer vision. Over the past decade, a number of approaches have been proposed, of which the improved Stacked Generative Adversarial Network (StackGAN v2) has proven capable of generating high resolution images that reflect the details specified in the input text descriptions. In this paper, we aim to assess the robustness and fault tolerance capability of the StackGAN v2 model by introducing variations in the training data. However, due to the working principle of Generative Adversarial Network (GAN), it is difficult to predict the output of the model when the training data are modified. Hence, in this work, we adopt Metamorphic Testing technique to evaluate the robustness of the model with a variety of unexpected training dataset. As such, we first implement StackGAN v2 algorithm and test the pre trained model provided by the original authors to establish a ground truth for our experiments. We then identify a metamorphic relation, from which test cases are generated. Further, metamorphic relations were derived successively based on the observations of prior test results. Finally, we synthesise the results from our experiment of all the metamorphic relations and found that StackGAN v2 algorithm is susceptible to input images with obtrusive objects, even if it overlaps with the main object minimally, which was not reported by the authors and users of StackGAN v2 model. The proposed metamorphic relations can be applied to other text to image synthesis models to not only verify the robustness but also to help researchers understand and interpret the results made by the machine learning models.


Sensitivity as a Complexity Measure for Sequence Classification Tasks. We introduce a theoretical framework for understanding and predicting the complexity of sequence classification tasks, using a novel extension of the theory of Boolean function sensitivity. The sensitivity of a function, given a distribution over input sequences, quantifies the number of disjoint subsets of the input sequence that can each be individually changed to change the output. We argue that standard sequence classification methods are biased towards learning low sensitivity functions, so that tasks requiring high sensitivity are more difficult. To that end, we show analytically that simple lexical classifiers can only express functions of bounded sensitivity, and we show empirically that low sensitivity functions are easier to learn for LSTMs. We then estimate sensitivity on 15 NLP tasks, finding that sensitivity is higher on challenging tasks collected in GLUE than on simple text classification tasks, and that sensitivity predicts the performance both of simple lexical classifiers and of vanilla BiLSTMs without pretrained contextualized embeddings. Within a task, sensitivity predicts which inputs are hard for such simple models. Our results suggest that the success of massively pretrained contextual representations stems in part because they provide representations from which information can be extracted by low sensitivity decoders.


BERT Based Sentiment Analysis A Software Engineering Perspective. Sentiment analysis can provide a suitable lead for the tools used in software engineering along with the API recommendation systems and relevant libraries to be used. In this context, the existing tools like SentiCR, SentiStrength SE, etc. exhibited low f1 scores that completely defeats the purpose of deployment of such strategies, thereby there is enough scope for performance improvement. Recent advancements show that transformer based pre trained models (e.g., BERT, RoBERTa, ALBERT, etc.) have displayed better results in the text classification task. Following this context, the present research explores different BERT based models to analyze the sentences in GitHub comments, Jira comments, and Stack Overflow posts. The paper presents three different strategies to analyse BERT based model for sentiment analysis, where in the first strategy the BERT based pre trained models are fine tuned in the second strategy an ensemble model is developed from BERT variants, and in the third strategy a compressed model (Distil BERT) is used. The experimental results show that the BERT based ensemble approach and the compressed BERT model attain improvements by 6 12 over prevailing tools for the F1 measure on all three datasets.


Gauss Bonnet theorems associated to deformed Schouten Van Kampen connection in the affine group and the group of rigid motions of the Minkowski plane. In this paper, we define deformed Schouten Van Kampen connections which are metric connections and compute sub Riemannian limits of Gaussian curvature for a Euclidean C2 smooth surface associated to deformed Schouten Van Kampen connections with two kinds of distributions in the affine group and the group of rigid motions of the Minkowski plane away from characteristic points and signed geodesic curvature for Euclidean C2 smooth curves on surfaces. According to above results, we get Gauss Bonnet theorems associated to two kinds of deformed Schouten Van Kampen connections in the affine group and the group of rigid motions of the Minkowski plane.


Autonomous Fire Fighting with a UAV UGV Team at MBZIRC 2020. Every day, burning buildings threaten the lives of occupants and first responders trying to save them. Quick action is of essence, but some areas might not be accessible or too dangerous to enter. Robotic systems have become a promising addition to firefighting, but at this stage, they are mostly manually controlled, which is error prone and requires specially trained personal. We present two systems for autonomous firefighting from air and ground we developed for the Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2020. The systems use LiDAR for reliable localization within narrow, potentially GNSS restricted environments while maneuvering close to obstacles. Measurements from LiDAR and thermal cameras are fused to track fires, while relative navigation ensures successful extinguishing. We analyze and discuss our successful participation during the MBZIRC 2020, present further experiments, and provide insights into our lessons learned from the competition.


Should Semantic Vector Composition be Explicit? Can it be Linear?. Vector representations have become a central element in semantic language modelling, leading to mathematical overlaps with many fields including quantum theory. Compositionality is a core goal for such representations given representations for 'wet' and 'fish', how should the concept 'wet fish' be represented? This position paper surveys this question from two points of view. The first considers the question of whether an explicit mathematical representation can be successful using only tools from within linear algebra, or whether other mathematical tools are needed. The second considers whether semantic vector composition should be explicitly described mathematically, or whether it can be a model internal side effect of training a neural network. A third and newer question is whether a compositional model can be implemented on a quantum computer. Given the fundamentally linear nature of quantum mechanics, we propose that these questions are related, and that this survey may help to highlight candidate operations for future quantum implementation.


Land use identification through social network interaction. The Internet generates large volumes of data at a high rate, in particular, posts on social networks. Although social network data has numerous semantic adulterations, and is not intended to be a source of geo spatial information, in the text of posts we find pieces of important information about how people relate to their environment, which can be used to identify interesting aspects of how human beings interact with portions of land based on their activities. This research proposes a methodology for the identification of land uses using Natural Language Processing (NLP) from the contents of the popular social network Twitter. It will be approached by identifying keywords with linguistic patterns from the text, and the geographical coordinates associated with the publication. Context specific innovations are introduced to deal with data across South America and, in particular, in the city of Arequipa, Peru. The objective is to identify the five main land uses residential, commercial, institutional governmental, industrial offices and unbuilt land. Within the framework of urban planning and sustainable urban management, the methodology contributes to the optimization of the identification techniques applied for the updating of land use cadastres, since the results achieved an accuracy of about 90 , which motivates its application in the real context. In addition, it would allow the identification of land use categories at a more detailed level, in situations such as a complex mixed distribution building based on the amount of data collected. Finally, the methodology makes land use information available in a more up to date fashion and, above all, avoids the high economic cost of the non automatic production of land use maps for cities, mostly in developing countries.


Liouville theorems for semilinear differential inequalities on sub Riemannian manifolds. In this paper, we generalize Liouville type theorems for some semilinear partial differential inequalities to sub Riemannian manifolds satisfying a nonnegative generalized curvature dimension inequality introduced by Baudoin and Garofalo in 5 . In particular, our results apply to all Sasakian manifolds with nonnegative horizontal Webster Tanaka Ricci curvature. The key ingredient is to construct a class of "good" cut off functions. We also provide some upper bounds for lifespan to parabolic and hyperbolic inequalities.


Combinatorial approach to the category Theta 0 of cubical pasting diagrams. In these notes we describe models of globular weak ( infty,m) categories ( m in mathbb N ) in the Grothendieck style, i.e for each m in mathbb N we define a globular coherator Theta infty mathbb M m whose set models are globular weak ( infty,m) categories. Then we describe the combinatorics of the small category Theta 0 whose objects are cubical pasting diagrams and whose morphisms are morphisms of cubical sets. This provides an accurate description of the monad, on the category of cubical sets (without degeneracies and connections), of cubical strict infty categories with connections. We prove that it is a cartesian monad, solving a conjecture in cite camark cub 1 . This puts us in a position to describe the cubical coherator Theta infty W whose set models are cubical weak infty categories with connections and the cubical coherator Theta infty W 0 whose set models are cubical weak infty groupoids with connections.


Semantic Image Matting. Natural image matting separates the foreground from background in fractional occupancy which can be caused by highly transparent objects, complex foreground (e.g., net or tree), and or objects containing very fine details (e.g., hairs). Although conventional matting formulation can be applied to all of the above cases, no previous work has attempted to reason the underlying causes of matting due to various foreground semantics. We show how to obtain better alpha mattes by incorporating into our framework semantic classification of matting regions. Specifically, we consider and learn 20 classes of matting patterns, and propose to extend the conventional trimap to semantic trimap. The proposed semantic trimap can be obtained automatically through patch structure analysis within trimap regions. Meanwhile, we learn a multi class discriminator to regularize the alpha prediction at semantic level, and content sensitive weights to balance different regularization losses. Experiments on multiple benchmarks show that our method outperforms other methods and has achieved the most competitive state of the art performance. Finally, we contribute a large scale Semantic Image Matting Dataset with careful consideration of data balancing across different semantic classes.


Understanding the Applicability of Terahertz Flow guided Nano Networks for Medical Applications. Terahertz based nano networks are emerging as a groundbreaking technology able to play a decisive role in future medical applications owing to their ability to precisely quantify figures, such as the viral load in a patient or to predict sepsis shock or heart attacks before they occur. Due to the extremely limited size of the devices composing these nano networks, the use of the Terahertz (THz) band has emerged as the enabling technology for their communication. However, the characteristics of the THz band, which strictly reduce the communication range inside the human body, together with the energy limitations of nano nodes make the in body deployment of nano nodes a challenging task. To overcome these problems, we propose a novel in body flow guided nano network architecture consisting of three different devices i) nano node, ii) nano router, and iii) bio sensor. As the performance of this type of nano network has not been previously explored, a theoretical framework capturing all its particularities is derived to properly model its behavior and evaluate its feasibility in real medical applications. Employing this analytical model, a thorough sensitivity study of its key parameters is accomplished. Finally, we analyze the terahertz flow guided nano network design to satisfy the requirements of several medical applications of interest.


Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching. Successful visual navigation depends upon capturing images that contain sufficient useful information. In this paper, we explore a data driven approach to account for environmental lighting changes, improving the quality of images for use in visual odometry (VO) or visual simultaneous localization and mapping (SLAM). We train a deep convolutional neural network model to predictively adjust camera gain and exposure time parameters such that consecutive images contain a maximal number of matchable features. The training process is fully self supervised our training signal is derived from an underlying VO or SLAM pipeline and, as a result, the model is optimized to perform well with that specific pipeline. We demonstrate through extensive real world experiments that our network can anticipate and compensate for dramatic lighting changes (e.g., transitions into and out of road tunnels), maintaining a substantially higher number of inlier feature matches than competing camera parameter control algorithms.


Higher Order Charge Conserving Electromagnetic Finite Element Particle in Cell Method. Until recently, electromagnetic finite element PIC (EM FEMPIC) methods that demonstrated charge conservation used explicit field solvers. It is only recently, that a series of papers developed the mathematics necessary for charge conservation within an implicit field solve and demonstrated for a number of examples. This permits using time steps sizes that are necessary to capture the physics as opposed to being restricted to those constrained by geometry. One aspect that is missing is higher order basis functions to represent both fields and particles. Higher order basis can be particularly helpful in effectively capturing complex field layouts with fewer degrees of freedom. Developing a framework for higher order EM FEMPIC that maintains stability, improves accuracy, and conserves charge is the principal goal of this paper. A number of results are presented that attest to its efficacy.


Relational Self Attention What's Missing in Attention for Video Understanding. Convolution has been arguably the most important feature transform for modern neural networks, leading to the advance of deep learning. Recent emergence of Transformer networks, which replace convolution layers with self attention blocks, has revealed the limitation of stationary convolution kernels and opened the door to the era of dynamic feature transforms. The existing dynamic transforms, including self attention, however, are all limited for video understanding where correspondence relations in space and time, i.e., motion information, are crucial for effective representation. In this work, we introduce a relational feature transform, dubbed the relational self attention (RSA), that leverages rich structures of spatio temporal relations in videos by dynamically generating relational kernels and aggregating relational contexts. Our experiments and ablation studies show that the RSA network substantially outperforms convolution and self attention counterparts, achieving the state of the art on the standard motion centric benchmarks for video action recognition, such as Something Something V1 V2, Diving48, and FineGym.


Improving Novelty Detection using the Reconstructions of Nearest Neighbours. We show that using nearest neighbours in the latent space of autoencoders (AE) significantly improves performance of semi supervised novelty detection in both single and multi class contexts. Autoencoding methods detect novelty by learning to differentiate between the non novel training class(es) and all other unseen classes. Our method harnesses a combination of the reconstructions of the nearest neighbours and the latent neighbour distances of a given input's latent representation. We demonstrate that our nearest latent neighbours (NLN) algorithm is memory and time efficient, does not require significant data augmentation, nor is reliant on pre trained networks. Furthermore, we show that the NLN algorithm is easily applicable to multiple datasets without modification. Additionally, the proposed algorithm is agnostic to autoencoder architecture and reconstruction error method. We validate our method across several standard datasets for a variety of different autoencoding architectures such as vanilla, adversarial and variational autoencoders using either reconstruction, residual or feature consistent losses. The results show that the NLN algorithm grants up to a 17 increase in Area Under the Receiver Operating Characteristics (AUROC) curve performance for the multi class case and 8 for single class novelty detection.


Spatial Dependency Networks Neural Layers for Improved Generative Image Modeling. How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our spatial dependency networks (SDNs), feature maps at each level of a deep neural net are computed in a spatially coherent way, using a sequential gating based mechanism that distributes contextual information across 2 D space. We show that augmenting the decoder of a hierarchical VAE by spatial dependency layers considerably improves density estimation over baseline convolutional architectures and the state of the art among the models within the same class. Furthermore, we demonstrate that SDN can be applied to large images by synthesizing samples of high quality and coherence. In a vanilla VAE setting, we find that a powerful SDN decoder also improves learning disentangled representations, indicating that neural architectures play an important role in this task. Our results suggest favoring spatial dependency over convolutional layers in various VAE settings. The accompanying source code is given at https github.com djordjemila sdn.


Universal Payment Channels An Interoperability Platform for Digital Currencies. With the innovation of distributed ledger technology (DLT), often known as blockchain technology, there has been significant growth of digital tokens in the form of cryptocurrencies, stablecoins, and central bank digital currencies. As the number of DLT networks increases, each with varying design characteristics, the likelihood that transacting parties are on the same network decreases. Thus, it is crucial to facilitate payments that are universal across networks, scalable to massive loads, and highly available. We envision a future payment network that may be built on top of DLT networks without being subject to their limitations on interoperability, scalability, and availability faced by DLT payment solutions today. Specifically, we propose a hub and spoke payment route, referred to here as Universal Payment Channels (UPC), that can be used to support digital token transfers of funds across different networks through payment channels. We further discuss the potential use cases of the UPC technology to support, and not complicate, an already robust digital payment ecosystem. Finally, through the paper, we share some future directions of the UPC technology.


Colorization Transformer. We present the Colorization Transformer, a novel approach for diverse high fidelity image colorization based on self attention. Given a grayscale image, the colorization proceeds in three steps. We first use a conditional autoregressive transformer to produce a low resolution coarse coloring of the grayscale image. Our architecture adopts conditional transformer layers to effectively condition grayscale input. Two subsequent fully parallel networks upsample the coarse colored low resolution image into a finely colored high resolution image. Sampling from the Colorization Transformer produces diverse colorings whose fidelity outperforms the previous state of the art on colorising ImageNet based on FID results and based on a human evaluation in a Mechanical Turk test. Remarkably, in more than 60 of cases human evaluators prefer the highest rated among three generated colorings over the ground truth. The code and pre trained checkpoints for Colorization Transformer are publicly available at https github.com google research google research tree master coltran


Data Driven Characterization and Detection of COVID 19 Themed Malicious Websites. COVID 19 has hit hard on the global community, and organizations are working diligently to cope with the new norm of "work from home". However, the volume of remote work is unprecedented and creates opportunities for cyber attackers to penetrate home computers. Attackers have been leveraging websites with COVID 19 related names, dubbed COVID 19 themed malicious websites. These websites mostly contain false information, fake forms, fraudulent payments, scams, or malicious payloads to steal sensitive information or infect victims' computers. In this paper, we present a data driven study on characterizing and detecting COVID 19 themed malicious websites. Our characterization study shows that attackers are agile and are deceptively crafty in designing geolocation targeted websites, often leveraging popular domain registrars and top level domains. Our detection study shows that the Random Forest classifier can detect COVID 19 themed malicious websites based on the lexical and WHOIS features defined in this paper, achieving a 98 accuracy and 2.7 false positive rate.


Conducting lines drawable conductors as a source of active learning activities. Drawable electronics attract the attention of both educators and innovative circuit engineers due to their affordability and simplicity. This paper focuses on active learning activities related to conducting lines and presents extensible laboratory projects suitable for students of all levels from late primary school pupils to early undergraduate students. We build on ideas of Pouillet's law classroom demonstrations with pencil drawings on paper and continue with a line, circle and grid drawings and appropriate resistance measurements. These are used as methodological examples of drawable circuits suitable for learning about resistors in series, parallel and mixed combinations. Particularly, grid drawings, e.g. mixed circuits, offer a variety of exercises that can connect analytical and experimental approaches and instigate discussions about assessments of uncertainty. Along the way, we propose ideas for extracurricular projects students can undertake to further their experimental knowledge and practise the scientific method.


Maximizing spreading in complex networks with risk in node activation. It is widely acknowledged that the initial spreaders play an important role for the wide spreading of information in complex networks. Thus, a variety of centrality based methods have been proposed to identify the most influential spreaders. However, most of the existing studies have overlooked the fact that in real social networks it is more costly and difficult to convince influential individuals to act as initial spreaders, resulting in a high risk in maximizing the spreading. In this paper, we address this problem on the basis of the assumption that large degree nodes are activated with a higher risk than small degree nodes. We aim to identify the effective initial spreaders to maximize spreading when considering both the activation risk and the outbreak size of initial spreaders. On random networks, the analytical analysis reveals that the degree of optimal initial spreaders does not correspond to the largest degree of nodes in the network but rather be determined by infection probability and difference of activation risk among nodes with different degree. Here, we propose a risk aware metric to identify the effective spreaders on real networks. The numerical simulation shows that the risk aware metric outperforms the existing benchmark centralities in maximizing the effective spreading.


ZHED is NP complete. We prove that the 2017 puzzle game ZHED is NP complete, even with just 1 tiles. Such a puzzle is defined by a set of unit square 1 tiles in a square grid, and a target square of the grid. A move consists of selecting an unselected 1 tile and then filling the next unfilled square in a chosen direction from that tile (similar to Tipover and Cross Purposes). We prove NP completeness of deciding whether the target square can be filled, by a reduction from rectilinear planar monotone 3SAT.


Cases for Explainable Software Systems Characteristics and Examples. The need for systems to explain behavior to users has become more evident with the rise of complex technology like machine learning or self adaptation. In general, the need for an explanation arises when the behavior of a system does not match the user's expectations. However, there may be several reasons for a mismatch including errors, goal conflicts, or multi agent interference. Given the various situations, we need precise and agreed descriptions of explanation needs as well as benchmarks to align research on explainable systems. In this paper, we present a taxonomy that structures needs for an explanation according to different reasons. We focus on explanations to improve the user interaction with the system. For each leaf node in the taxonomy, we provide a scenario that describes a concrete situation in which a software system should provide an explanation. These scenarios, called explanation cases, illustrate the different demands for explanations. Our taxonomy can guide the requirements elicitation for explanation capabilities of interactive intelligent systems and our explanation cases build the basis for a common benchmark. We are convinced that both, the taxonomy and the explanation cases, help the community to align future research on explainable systems.


Semi Supervised Learning with Taxonomic Labels. We propose techniques to incorporate coarse taxonomic labels to train image classifiers in fine grained domains. Such labels can often be obtained with a smaller effort for fine grained domains such as the natural world where categories are organized according to a biological taxonomy. On the Semi iNat dataset consisting of 810 species across three Kingdoms, incorporating Phylum labels improves the Species level classification accuracy by 6 in a transfer learning setting using ImageNet pre trained models. Incorporating the hierarchical label structure with a state of the art semi supervised learning algorithm called FixMatch improves the performance further by 1.3 . The relative gains are larger when detailed labels such as Class or Order are provided, or when models are trained from scratch. However, we find that most methods are not robust to the presence of out of domain data from novel classes. We propose a technique to select relevant data from a large collection of unlabeled images guided by the hierarchy which improves the robustness. Overall, our experiments show that semi supervised learning with coarse taxonomic labels are practical for training classifiers in fine grained domains.


Efficient Maximum Likelihood Decoding of Polar Codes Over the Binary Erasure Channel. A new algorithm for efficient exact maximum likelihood decoding of polar codes (which may be CRC augmented), transmitted over the binary erasure channel, is presented. The algorithm applies a matrix triangulation process on a sparse polar code parity check matrix, followed by solving a small size linear system over GF(2). To implement the matrix triangulation, we apply belief propagation decoding type operations. We also indicate how this decoder can be implemented in parallel for low latency decoding. Numerical simulations are used to evaluate the performance and computational complexity of the new algorithm.


GEDIT Geographic Enhanced and Dependency Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps. Providing timely accessibility reminders of a point of interest (POI) plays a vital role in improving user satisfaction of finding places and making visiting decisions. However, it is difficult to keep the POI database in sync with the real world counterparts due to the dynamic nature of business changes. To alleviate this problem, we formulate and present a practical solution that jointly extracts POI mentions and identifies their coupled accessibility labels from unstructured text. We approach this task as a sequence tagging problem, where the goal is to produce POI name, accessibility label pairs from unstructured text. This task is challenging because of two main issues (1) POI names are often newly coined words so as to successfully register new entities or brands and (2) there may exist multiple pairs in the text, which necessitates dealing with one to many or many to one mapping to make each POI coupled with its accessibility label. To this end, we propose a Geographic Enhanced and Dependency guIded sequence Tagging (GEDIT) model to concurrently address the two challenges. First, to alleviate challenge 1, we develop a geographic enhanced pre trained model to learn the text representations. Second, to mitigate challenge 2, we apply a relational graph convolutional network to learn the tree node representations from the parsed dependency tree. Finally, we construct a neural sequence tagging model by integrating and feeding the previously pre learned representations into a CRF layer. Extensive experiments conducted on a real world dataset demonstrate the superiority and effectiveness of GEDIT. In addition, it has already been deployed in production at Baidu Maps. Statistics show that the proposed solution can save significant human effort and labor costs to deal with the same amount of documents, which confirms that it is a practical way for POI accessibility maintenance.


Why Propagate Alone? Parallel Use of Labels and Features on Graphs. Graph neural networks (GNNs) and label propagation represent two interrelated modeling strategies designed to exploit graph structure in tasks such as node property prediction. The former is typically based on stacked message passing layers that share neighborhood information to transform node features into predictive embeddings. In contrast, the latter involves spreading label information to unlabeled nodes via a parameter free diffusion process, but operates independently of the node features. Given then that the material difference is merely whether features or labels are smoothed across the graph, it is natural to consider combinations of the two for improving performance. In this regard, it has recently been proposed to use a randomly selected portion of the training labels as GNN inputs, concatenated with the original node features for making predictions on the remaining labels. This so called label trick accommodates the parallel use of features and labels, and is foundational to many of the top ranking submissions on the Open Graph Benchmark (OGB) leaderboard. And yet despite its wide spread adoption, thus far there has been little attempt to carefully unpack exactly what statistical properties the label trick introduces into the training pipeline, intended or otherwise. To this end, we prove that under certain simplifying assumptions, the stochastic label trick can be reduced to an interpretable, deterministic training objective composed of two factors. The first is a data fitting term that naturally resolves potential label leakage issues, while the second serves as a regularization factor conditioned on graph structure that adapts to graph size and connectivity. Later, we leverage this perspective to motivate a broader range of label trick use cases, and provide experiments to verify the efficacy of these extensions.


Dynamic Knowledge Distillation for Pre trained Language Models. Knowledge distillation (KD) has been proved effective for compressing large scale pre trained language models. However, existing methods conduct KD statically, e.g., the student model aligns its output distribution to that of a selected teacher model on the pre defined training dataset. In this paper, we explore whether a dynamic knowledge distillation that empowers the student to adjust the learning procedure according to its competency, regarding the student performance and learning efficiency. We explore the dynamical adjustments on three aspects teacher model adoption, data selection, and KD objective adaptation. Experimental results show that (1) proper selection of teacher model can boost the performance of student model (2) conducting KD with 10 informative instances achieves comparable performance while greatly accelerates the training (3) the student performance can be boosted by adjusting the supervision contribution of different alignment objective. We find dynamic knowledge distillation is promising and provide discussions on potential future directions towards more efficient KD methods. Our code is available at https github.com lancopku DynamicKD.


The Diagonal Dimension of Curves. We prove Conjecture 4.16 of the paper EL21 of Elagin and Lunts namely, that a smooth projective curve of genus at least 1 over a field has diagonal dimension 2.


Infinite Dimensional Sums of Squares for Optimal Control. We introduce an approximation method to solve an optimal control problem via the Lagrange dual of its weak formulation. It is based on a sum of squares representation of the Hamiltonian, and extends a previous method from polynomial optimization to the generic case of smooth problems. Such a representation is infinite dimensional and relies on a particular space of functions a reproducing kernel Hilbert space chosen to fit the structure of the control problem. After subsampling, it leads to a practical method that amounts to solving a semi definite program. We illustrate our approach by a numerical application on a simple low dimensional control problem.


On the codescent of 'etale wild kernels in p adic Lie extensions. Let F be a number field and p an odd prime. We estimate the kernels and cokernels of the codescent maps of the 'etale wild kernels over various p adic Lie extensions. For this, we propose a novel approach of viewing the 'etale wild kernel as an appropriate fine Selmer group in the sense of Coates Sujatha. This viewpoint reduces the problem to a control theorem of the said fine Selmer groups, which in turn allows us to employ the strategies developed by Mazur and Greenberg. As applications of our estimates on the kernels and cokernels of the codescent maps, we establish asymptotic growth formulas for the 'etale wild kernels in the various said p adic Lie extensions. We then relate these growth formulas to the Greenberg's conjecture (and its noncommutative analogue). Finally, we shall give some examples to illustrate our results.


A Flexible Proof Format for SAT Solver Elaborator Communication. We introduce FRAT, a new proof format for unsatisfiable SAT problems, and its associated toolchain. Compared to DRAT, the FRAT format allows solvers to include more information in proofs to reduce the computational cost of subsequent elaboration to LRAT. The format is easy to parse forward and backward, and it is extensible to future proof methods. The provision of optional proof steps allows SAT solver developers to balance implementation effort against elaboration time, with little to no overhead on solver time. We benchmark our FRAT toolchain against a comparable DRAT toolchain and confirm 84 median reduction in elaboration time and 94 median decrease in peak memory usage.


Synwalk Community Detection via Random Walk Modelling. Complex systems, abstractly represented as networks, are ubiquitous in everyday life. Analyzing and understanding these systems requires, among others, tools for community detection. As no single best community detection algorithm can exist, robustness across a wide variety of problem settings is desirable. In this work, we present Synwalk, a random walk based community detection method. Synwalk builds upon a solid theoretical basis and detects communities by synthesizing the random walk induced by the given network from a class of candidate random walks. We thoroughly validate the effectiveness of our approach on synthetic and empirical networks, respectively, and compare Synwalk's performance with the performance of Infomap and Walktrap. Our results indicate that Synwalk performs robustly on networks with varying mixing parameters and degree distributions. We outperform Infomap on networks with high mixing parameter, and Infomap and Walktrap on networks with many small communities and low average degree. Our work has a potential to inspire further development of community detection via synthesis of random walks and we provide concrete ideas for future research.


Toward a Human Level Video Understanding Intelligence. We aim to develop an AI agent that can watch video clips and have a conversation with human about the video story. Developing video understanding intelligence is a significantly challenging task, and evaluation methods for adequately measuring and analyzing the progress of AI agent are lacking as well. In this paper, we propose the Video Turing Test to provide effective and practical assessments of video understanding intelligence as well as human likeness evaluation of AI agents. We define a general format and procedure of the Video Turing Test and present a case study to confirm the effectiveness and usefulness of the proposed test.


Relation Leakage in Elicited Natural Language Inference Datasets. Natural language inference (NLI) is an important task for producing useful models of human language. Unfortunately large scale NLI dataset production relies on crowdworkers who are prone to introduce biases in the sentences they write, enabling models to predict sentence pair relations from a single sentence in the pair, better than chance. This elicited sentence relation leakage property is undesirable as it enables models to cheat rather than learn the desired reasoning capabilities, and hasn't gone away since its 2018 discovery. We analyze this problem in 8 modern NLI datasets, using a combination of previously established and novel model based techniques, so as to enable ameliorating this leakage in future NLI datasets.


Objective hearing threshold identification from auditory brainstem response measurements using supervised and self supervised approaches. Hearing loss is a major health problem and psychological burden in humans. Mouse models offer a possibility to elucidate genes involved in the underlying developmental and pathophysiological mechanisms of hearing impairment. To this end, large scale mouse phenotyping programs include auditory phenotyping of single gene knockout mouse lines. Using the auditory brainstem response (ABR) procedure, the German Mouse Clinic and similar facilities worldwide have produced large, uniform data sets of averaged ABR raw data of mutant and wildtype mice. In the course of standard ABR analysis, hearing thresholds are assessed visually by trained staff from series of signal curves of increasing sound pressure level. This is time consuming and prone to be biased by the reader as well as the graphical display quality and scale. In an attempt to reduce workload and improve quality and reproducibility, we developed and compared two methods for automated hearing threshold identification from averaged ABR raw data a supervised approach involving two combined neural networks trained on human generated labels and a self supervised approach, which exploits the signal power spectrum and combines random forest sound level estimation with a piece wise curve fitting algorithm for threshold finding. We show that both models work well, outperform human threshold detection, and are suitable for fast, reliable, and unbiased hearing threshold detection and quality control. In a high throughput mouse phenotyping environment, both methods perform well as part of an automated end to end screening pipeline to detect candidate genes for hearing involvement. Code for both models as well as data used for this work are freely available.


Continuous Offline Handwriting Recognition using Deep Learning Models. Handwritten text recognition is an open problem of great interest in the area of automatic document image analysis. The transcription of handwritten content present in digitized documents is significant in analyzing historical archives or digitizing information from handwritten documents, forms, and communications. In the last years, great advances have been made in this area due to applying deep learning techniques to its resolution. This Thesis addresses the offline continuous handwritten text recognition (HTR) problem, consisting of developing algorithms and models capable of transcribing the text present in an image without the need for the text to be segmented into characters. For this purpose, we have proposed a new recognition model based on integrating two types of deep learning architectures convolutional neural networks (CNN) and sequence to sequence (seq2seq) models, respectively. The convolutional component of the model is oriented to identify relevant features present in characters, and the seq2seq component builds the transcription of the text by modeling the sequential nature of the text. For the design of this new model, an extensive analysis of the capabilities of different convolutional architectures in the simplified problem of isolated character recognition has been carried out in order to identify the most suitable ones to be integrated into the continuous model. Additionally, extensive experimentation of the proposed model for the continuous problem has been carried out to determine its robustness to changes in parameterization. The generalization capacity of the model has also been validated by evaluating it on three handwritten text databases using different languages IAM in English, RIMES in French, and Osborne in Spanish, respectively. The new proposed model provides competitive results with those obtained with other well established methodologies.


Zero pronoun Data Augmentation for Japanese to English Translation. For Japanese to English translation, zero pronouns in Japanese pose a challenge, since the model needs to infer and produce the corresponding pronoun in the target side of the English sentence. However, although fully resolving zero pronouns often needs discourse context, in some cases, the local context within a sentence gives clues to the inference of the zero pronoun. In this study, we propose a data augmentation method that provides additional training signals for the translation model to learn correlations between local context and zero pronouns. We show that the proposed method significantly improves the accuracy of zero pronoun translation with machine translation experiments in the conversational domain.


gl(2) foams and the Khovanov homotopy type. The Blanchet link homology theory is an oriented model of Khovanov homology, functorial over the integers with respect to link cobordisms. We formulate a stable homotopy refinement of the Blanchet theory, based on a comparison of the Blanchet and Khovanov chain complexes associated to link diagrams. The construction of the stable homotopy type relies on the signed Burnside category approach of Sarkar Scaduto Stoffregen.


UAV Based Search and Rescue in Avalanches using ARVA An Extremum Seeking Approach. This work deals with the problem of localizing a victim buried by an avalanche by means of a drone equipped with an ARVA (Appareil de Recherche de Victimes d'Avalanche) sensor. The proposed control solution is based on a "model free" extremum seeking strategy which is shown to succeed in steering the drone in a neighborhood of the victim position. The effectiveness and robustness of the proposed algorithm is tested in Gazebo simulation environment, where a new flight mode and a new controller module have been implemented as an extension of the well known PX4 open source flight stack. Finally, to test usability, we present hardware in the loop simulations on a Pixhawk 2 Cube board.


Neural networks with trainable matrix activation functions. The training process of neural networks usually optimize weights and bias parameters of linear transformations, while nonlinear activation functions are pre specified and fixed. This work develops a systematic approach to constructing matrix activation functions whose entries are generalized from ReLU. The activation is based on matrix vector multiplications using only scalar multiplications and comparisons. The proposed activation functions depend on parameters that are trained along with the weights and bias vectors. Neural networks based on this approach are simple and efficient and are shown to be robust in numerical experiments.


Calibrated Feature Decomposition for Generalizable Person Re Identification. Existing disentangled based methods for generalizable person re identification aim at directly disentangling person representations into domain relevant interference and identity relevant feature. However, they ignore that some crucial characteristics are stubbornly entwined in both the domain relevant interference and identity relevant feature, which are intractable to decompose in an unsupervised manner. In this paper, we propose a simple yet effective Calibrated Feature Decomposition (CFD) module that focuses on improving the generalization capacity for person re identification through a more judicious feature decomposition and reinforcement strategy. Specifically, a calibrated and standardized Batch normalization (CSBN) is designed to learn calibrated person representation by jointly exploring intra domain calibration and inter domain standardization of multi source domain features. CSBN restricts instance level inconsistency of feature distribution for each domain and captures intrinsic domain level specific statistics. The calibrated person representation is subtly decomposed into the identity relevant feature, domain feature, and the remaining entangled one. For enhancing the generalization ability and ensuring high discrimination of the identity relevant feature, a calibrated instance normalization (CIN) is introduced to enforce discriminative id relevant information, and filter out id irrelevant information, and meanwhile the rich complementary clues from the remaining entangled feature are further employed to strengthen it. Extensive experiments demonstrate the strong generalization capability of our framework. Our models empowered by CFD modules significantly outperform the state of the art domain generalization approaches on multiple widely used benchmarks. Code will be made public https github.com zkcys001 CFD.


Residually finite lattices in widetilde mathrm PU (2,1) and fundamental groups of smooth projective surfaces. This paper studies residual finiteness of lattices in the universal cover of mathrm PU (2,1) and applications to the existence of smooth projective varieties with fundamental group a cocompact lattice in mathrm PU (2,1) or a finite covering of it. First, we prove that certain lattices in the universal cover of mathrm PU (2,1) are residually finite. To our knowledge, these are the first such examples. We then use residually finite central extensions of torsion free lattices in mathrm PU (2,1) to construct smooth projective surfaces that are not birationally equivalent to a smooth compact ball quotient but whose fundamental group is a torsion free cocompact lattice in mathrm PU (2,1) .


HyperSec Visual Analytics for blockchain security monitoring. Today, permissioned blockchains are being adopted by large organizations for business critical operations. Consequently, they are subject to attacks by malicious actors. Researchers have discovered and enumerated a number of attacks that could threaten availability, integrity and confidentiality of blockchain data. However, currently it remains difficult to detect these attacks. We argue that security experts need appropriate visualizations to assist them in detecting attacks on blockchain networks. To achieve this, we develop HyperSec, a visual analytics monitoring tool that provides relevant information at a glance to detect ongoing attacks on Hyperledger Fabric. For evaluation, we connect the HyperSec prototype to a Hyperledger Fabric test network. The results show that common attacks on Fabric can be detected by a security expert using HyperSec's visualizations.


A Combined Deep Learning based End to End Video Coding Architecture for YUV Color Space. Most of the existing deep learning based end to end video coding (DLEC) architectures are designed specifically for RGB color format, yet the video coding standards, including H.264 AVC, H.265 HEVC and H.266 VVC developed over past few decades, have been designed primarily for YUV 4 2 0 format, where the chrominance (U and V) components are subsampled to achieve superior compression performances considering the human visual system. While a broad number of papers on DLEC compare these two distinct coding schemes in RGB domain, it is ideal to have a common evaluation framework in YUV 4 2 0 domain for a more fair comparison. This paper introduces a new DLEC architecture for video coding to effectively support YUV 4 2 0 and compares its performance against the HEVC standard under a common evaluation framework. The experimental results on YUV 4 2 0 video sequences show that the proposed architecture can outperform HEVC in intra frame coding, however inter frame coding is not as efficient on contrary to the RGB coding results reported in recent papers.


GAM Changer Editing Generalized Additive Models with Interactive Visualization. Recent strides in interpretable machine learning (ML) research reveal that models exploit undesirable patterns in the data to make predictions, which potentially causes harms in deployment. However, it is unclear how we can fix these models. We present our ongoing work, GAM Changer, an open source interactive system to help data scientists and domain experts easily and responsibly edit their Generalized Additive Models (GAMs). With novel visualization techniques, our tool puts interpretability into action empowering human users to analyze, validate, and align model behaviors with their knowledge and values. Built using modern web technologies, our tool runs locally in users' computational notebooks or web browsers without requiring extra compute resources, lowering the barrier to creating more responsible ML models. GAM Changer is available at https interpret.ml gam changer.


On the modular McKay graph of SL n(p) with respect to its standard representation. Let F be an algebraically closed field of prime characteristic p . The modular McKay graph of G SL n(p) with respect to its standard FG module W is the connected, directed graph whose vertices are the irreducible FG modules and for which there is an edge from a vertex V 1 to V 2 if V 2 occurs as a composition factor of the tensor product V 1 otimes W . We show that the diameter of this modular McKay graph is frac 1 2 (p 1)(n 2 n) .


Mean field BDSDEs and associated nonlocal semi linear backward stochastic partial differential equations. In this paper we investigate mean field backward doubly stochastic differential equations (BDSDEs), i.e., BDSDEs whose driving coefficients also depend on the joint law of the solution process as well as the solution of an associated mean field forward SDE. Unlike the pioneering paper on BDSDEs by Pardoux Peng (1994), we handle a driving coefficient in the backward integral of the BDSDE for which the Lipschitz assumption w.r.t. the law of the solution is sufficient, without assuming that this Lipschitz constant is small enough. On the other hand, as the parameters (x,P xi) and (x,P xi,y) run an infinite dimensional space, unlike Pardoux and Peng, we cannot apply Kolmogorov's continuity criterion to the value function V(t,x,P xi ) Y t t,x,P xi , while in the classical case studied in Pardoux Peng the value function V(t,x) Y t t,x can be shown to be of class C 1,2 ( 0,T times mathbb R d) , we have for our value function V(t,x,P xi ) and its derivative partial mu V(t,x,P xi ,y) only the L 2 differentiability with respect to x and y , respectively. Using a new method we prove the characterization of V (V(t,x,P xi )) as the unique solution of the associated mean field backward stochastic PDE.


On tensors that are determined by their singular tuples. In this paper we study the locus of singular tuples of a complex valued multisymmetric tensor. The main problem that we focus on is given the set of singular tuples of some general tensor, which are all the tensors that admit those same singular tuples. Assume that the triangular inequality holds, that is exactly the condition such that the dual variety to the Segre Veronese variety is an hypersurface, or equivalently, the hyperdeterminant exists. We show in such case that, when at least one component has degree odd, this tensor is projectively unique. On the other hand, if all the degrees are even, the fiber is an 1 dimensional space.


Reaction extent or advancement of the reaction A new general definition. Following the classical works by De Donder, Aris, and Croce we extend the general investigation of the concept of reaction extent to the case of an arbitrary number of species and (reversible or irreversible) reaction steps, not restricted to mass action type kinetics. In typical cases, the reaction extent tends to infinity. However, we have defined quantities tending to 1, as it is assumed many times. We have calculated the reaction extent also for exotic (oscillatory and chaotic) reactions in order to see their meaning. Our approach tries to adhere to the customs of the chemists and to be mathematically correct and avoids some generally followed bad practice mainly in the educational literature.


The tropicalisation of a ( 2,0) flop. As a standard example in toric geometry, the Atiyah flop of a ( 1, 1) curve in a smooth 3 fold can be described combinatorially in terms of the two possible triangulations of a square cone. The flop of ( 2,0) curve cannot be realised in terms of toric geometry. Nevertheless, we explain how to construct a cone sigma in an integral affine manifold with singularities associated to the singularity (P in Y) at the base of a ( 2,0) flop. The two sides of the flop can then be described combinatorially in terms of two different subdivisions of sigma . As an interesting byproduct of our construction, we can build a singularity (P star in Y star) which is mirror to (P in Y) .


Computational analysis of flow structures in turbulent ventricular blood flow associated with mitral valve intervention. Cardiac disease and clinical intervention may both lead to an increased risk for thrombosis events due to modified blood flow in the heart, and thereby a change in the mechanical stimuli of blood cells passing through the chambers of the heart. Specifically, the degree of platelet activation is influenced by the level and type of mechanical stresses in the blood flow. Here we analyze the blood flow in the left ventricle of the heart through a computational model constructed from patient specific data. The blood flow in the ventricle is modeled by the Navier Stokes equations, and the flow through the mitral valve by a parameterized model which represents the projected opening of the valve. A finite element method is used to solve the equations, from which a simulation of the velocity and pressure of the blood flow is constructed. A triple decomposition of the velocity gradient tensor is then used to distinguish between rigid body rotational flow, irrotational straining flow, and shear flow. The triple decomposition enables the separation of three fundamentally different flow structures, each generating a distinct type of mechanical stimulus on the blood cells in the flow. We compare the results to simulations where a mitral valve clip intervention is modelled, which leads to a significant modification of the ventricular flow. It was found that the shear in the simulation cases treated with clips increased more compared to the untreated case than the rotation and strain did. A decrease in valve opening area of 64 in one of the cases led to a 90 increase in rotation and strain, but a 150 increase in shear. The computational analysis suggests a process for patient specific simulation of clinical interventions in the heart with a detailed analysis of the resulting blood flow, which could support clinical risk assessment with respect to platelet activation and thrombosis events.


Generation of quasi monoenergetic proton beams via quantum radiative compression. Dense high energy monoenergetic proton beams are vital for wide applications, thus modern laser plasma based ion acceleration methods are aiming to obtain high energy proton beams with energy spread as low as possible. In this work, we put forward a quantum radiative compression method to post compress a highly accelerated proton beam and convert it to a dense quasi monoenergetic one. We find that when the relativistic plasma produced by radiation pressure acceleration collides head on with an ultraintense laser beam, large amplitude plasma oscillations are excited due to quantum radiation reaction and the ponderomotive force, which induce compression of the phase space of protons located in its acceleration phase with negative gradient. Our three dimensional spin resolved QED particle in cell simulations show that hollow structure proton beams with a peak energy sim GeV, relative energy spread of few percents and number N p sim10 10 (or N p sim 10 9 with a 1 energy spread) can be produced in near future laser facilities, which may fulfill the requirements of important applications, such as, for radiography of ultra thick dense materials, or as injectors of hadron colliders.


Analyzing the effectiveness of image augmentations for face recognition from limited data. This work presents an analysis of the efficiency of image augmentations for the face recognition problem from limited data. We considered basic manipulations, generative methods, and their combinations for augmentations. Our results show that augmentations, in general, can considerably improve the quality of face recognition systems and the combination of generative and basic approaches performs better than the other tested techniques.


Deep Neural Network as an alternative to Boosted Decision Trees for PID. In this paper we recreate, and improve, the binary classification method for particles proposed in Roe et al. (2005) paper "Boosted decision trees as an alternative to artificial neural networks for particle identification". Such particles are tau neutrinos, which we will refer to as background, and electronic neutrinos the signal we are interested in. In the original paper the preferred algorithm is a Boosted decision tree. This is due to its low effort tuning and good overall performance at the time. Our choice for implementation is a deep neural network, faster and more promising in performance. We will show how, using modern techniques, we are able to improve on the original result, both in accuracy and in training time.


Probabilistic Trajectory Prediction with Structural Constraints. This work addresses the problem of predicting the motion trajectories of dynamic objects in the environment. Recent advances in predicting motion patterns often rely on machine learning techniques to extrapolate motion patterns from observed trajectories, with no mechanism to directly incorporate known rules. We propose a novel framework, which combines probabilistic learning and constrained trajectory optimisation. The learning component of our framework provides a distribution over future motion trajectories conditioned on observed past coordinates. This distribution is then used as a prior to a constrained optimisation problem which enforces chance constraints on the trajectory distribution. This results in constraint compliant trajectory distributions which closely resemble the prior. In particular, we focus our investigation on collision constraints, such that extrapolated future trajectory distributions conform to the environment structure. We empirically demonstrate on real world and simulated datasets the ability of our framework to learn complex probabilistic motion trajectories for motion data, while directly enforcing constraints to improve generalisability, producing more robust and higher quality trajectory distributions.


Most Probable Transitions from Metastable to Oscillatory Regimes in a Carbon Cycle System. Global climate changes are related to the ocean's store of carbon. We study a carbonate system of the upper ocean, which has metastable and oscillatory regimes, under small random fluctuations. We calculate the most probable transition path via a geometric minimum action method in the context of the large deviations theory. By examining the most probable transition paths from metastable to oscillatory regimes for various external carbon input rates, we find two different transition patterns, which gives us an early warning sign for the dramatic change in the carbonate state of the ocean.


Ethics lines and Machine learning a design and simulation of an Association Rules Algorithm for exploiting the data. Data mining techniques offer great opportunities for developing ethics lines, tools for communication, participation and innovation whose main aim is to ensure improvements and compliance with the values, conduct and commitments making up the code of ethics. The aim of this study is to suggest a process for exploiting the data generated by the data generated and collected from an ethics line by extracting rules of association and applying the Apriori algorithm. This makes it possible to identify anomalies and behaviour patterns requiring action to review, correct, promote or expand them, as appropriate. Finally, I offer a simulated application of the Apriori algorithm, supplying it with synthetic data to find out its potential, strengths and limitations.


Shape from Polarization for Complex Scenes in the Wild. We present a new data driven approach with physics based priors to scene level normal estimation from a single polarization image. Existing shape from polarization (SfP) works mainly focus on estimating the normal of a single object rather than complex scenes in the wild. A key barrier to high quality scene level SfP is the lack of real world SfP data in complex scenes. Hence, we contribute the first real world scene level SfP dataset with paired input polarization images and ground truth normal maps. Then we propose a learning based framework with a multi head self attention module and viewing encoding, which is designed to handle increasing polarization ambiguities caused by complex materials and non orthographic projection in scene level SfP. Our trained model can be generalized to far field outdoor scenes as the relationship between polarized light and surface normals is not affected by distance. Experimental results demonstrate that our approach significantly outperforms existing SfP models on two datasets. Our dataset and source code will be publicly available at https github.com ChenyangLEI sfp wild


Some approximation results for mild solutions of stochastic fractional order evolution equations driven by Gaussian noise. We investigate the quality of space approximation of a class of stochastic integral equations of convolution type with Gaussian noise. Such equations arise, for example, when considering mild solutions of stochastic fractional order partial differential equations but also when considering mild solutions of classical stochastic partial differential equations. The key requirement for the equations is a smoothing property of the deterministic evolution operator which is typical in parabolic type problems. We show that if one has access to nonsmooth data estimates for the deterministic error operator together with its derivative of a space discretization procedure, then one obtains error estimates in pathwise H "older norms with rates that can be read off the deterministic error rates. We illustrate the main result by considering a class of stochastic fractional order partial differential equations and space approximations performed by spectral Galerkin methods and finite elements. We also improve an existing result on the stochastic heat equation.


KKT Conditions, First Order and Second Order Optimization, and Distributed Optimization Tutorial and Survey. This is a tutorial and survey paper on Karush Kuhn Tucker (KKT) conditions, first order and second order numerical optimization, and distributed optimization. After a brief review of history of optimization, we start with some preliminaries on properties of sets, norms, functions, and concepts of optimization. Then, we introduce the optimization problem, standard optimization problems (including linear programming, quadratic programming, and semidefinite programming), and convex problems. We also introduce some techniques such as eliminating inequality, equality, and set constraints, adding slack variables, and epigraph form. We introduce Lagrangian function, dual variables, KKT conditions (including primal feasibility, dual feasibility, weak and strong duality, complementary slackness, and stationarity condition), and solving optimization by method of Lagrange multipliers. Then, we cover first order optimization including gradient descent, line search, convergence of gradient methods, momentum, steepest descent, and backpropagation. Other first order methods are explained, such as accelerated gradient method, stochastic gradient descent, mini batch gradient descent, stochastic average gradient, stochastic variance reduced gradient, AdaGrad, RMSProp, and Adam optimizer, proximal methods (including proximal mapping, proximal point algorithm, and proximal gradient method), and constrained gradient methods (including projected gradient method, projection onto convex sets, and Frank Wolfe method). We also cover non smooth and ell 1 optimization methods including lasso regularization, convex conjugate, Huber function, soft thresholding, coordinate descent, and subgradient methods. Then, we explain second order methods including Newton's method for unconstrained, equality constrained, and inequality constrained problems....


ell infty cohomology, bounded differential forms and isoperimetric inequalities. We revisit Gersten's ell infty cohomology of groups and spaces, removing the finiteness assumptions required by the original definition while retaining its geometric nature. Mirroring the corresponding results in bounded cohomology, we provide a characterization of amenable groups using ell infty cohomology, and generalize Mineyev's characterization of hyperbolic groups via ell infty cohomology to the relative setting. We describe how ell infty cohomology is related to isoperimetric inequalities. We prove an adaptation of the de Rham's theorem in the context of ell infty cohomology. Lastly, we consider some algorithmic problems concerning ell infty cohomology and show that they are undecidable.


Black Box and Modular Meta Learning for Power Control via Random Edge Graph Neural Networks. In this paper, we consider the problem of power control for a wireless network with an arbitrarily time varying topology, including the possible addition or removal of nodes. A data driven design methodology that leverages graph neural networks (GNNs) is adopted in order to efficiently parametrize the power control policy mapping the channel state information (CSI) to transmit powers. The specific GNN architecture, known as random edge GNN (REGNN), defines a non linear graph convolutional filter whose spatial weights are tied to the channel coefficients. While prior work assumed a joint training approach whereby the REGNN based policy is shared across all topologies, this paper targets adaptation of the power control policy based on limited CSI data regarding the current topology. To this end, we propose both black box and modular meta learning techniques. Black box meta learning optimizes a general purpose adaptation procedure via (stochastic) gradient descent, while modular meta learning finds a set of reusable modules that can form components of a solution for any new network topology. Numerical results validate the benefits of meta learning for power control problems over joint training schemes, and demonstrate the advantages of modular meta learning when data availability is extremely limited.


Tutorial review of Reverse Osmosis and Electrodialysis. Reverse osmosis (RO) and electrodialysis (ED) are the two most important membrane technologies for water desalination and treatment. Their desalination and transport mechanisms are very different, but on closer look also have many similarities. In this tutorial review we describe state of the art theory for both processes focusing on simple examples that are helpful for the non specialist and for classroom teaching. We describe relevant theory for ion and water transport and the coupling with theory for chemical and mechanical equilibrium on membrane solution interfaces. For RO of neutral solutes, we explain the solution friction (SF) model which is closely related to the classical sieving or pore flow model. The SF model includes advection, diffusion, and solute partitioning, and leads to simple relationships for the coupled fluxes of water and solutes (and thus for solute retention as well), also when a diffusion boundary layer is included in the model. Subsequently this theory is extended to describe RO for symmetric salt solutions with charged membranes. For the desalination of salt solutions, both for RO and ED we present two dimensional module scale calculations which lead to a characteristic curve that determines optimum operational conditions based on a simple cost calculation that offsets energy and material costs. We discuss the two fluid model (TFM) that comprehensively describes ion and water flow both in RO and ED, and we explain how this theory also accurately describes osmosis experiments where water and ions run in opposite directions through a membrane. Finally, we present results of optimization studies of the combination of multiple modules for RO and ED, and we evaluate the relevance of concentration polarization by using a 3D model for cross current flow in an ED module.


HTLM Hyper Text Pre Training and Prompting of Language Models. We introduce HTLM, a hyper text language model trained on a large scale web crawl. Modeling hyper text has a number of advantages (1) it is easily gathered at scale, (2) it provides rich document level and end task adjacent supervision (e.g. class and id attributes often encode document category information), and (3) it allows for new structured prompting that follows the established semantics of HTML (e.g. to do zero shot summarization by infilling title tags for a webpage that contains the input text). We show that pretraining with a BART style denoising loss directly on simplified HTML provides highly effective transfer for a wide range of end tasks and supervision levels. HTLM matches or exceeds the performance of comparably sized text only LMs for zero shot prompting and fine tuning for classification benchmarks, while also setting new state of the art performance levels for zero shot summarization. We also find that hyper text prompts provide more value to HTLM, in terms of data efficiency, than plain text prompts do for existing LMs, and that HTLM is highly effective at auto prompting itself, by simply generating the most likely hyper text formatting for any available training data. We will release all code and models to support future HTLM research.


Prime ideals and Noetherian properties in vector lattices. In this paper we study the set of prime ideals in vector lattices and how the properties of the prime ideals structure the vector lattice in question. The different properties that will be considered are firstly, that all or none of the prime ideals are order dense, secondly, that there are only finitely many prime ideals, thirdly, that every prime ideal is principal, and lastly, that every ascending chain of prime ideals is stationary (a property that we refer to as prime Noetherian). We also completely characterize the prime ideals in vector lattices of piecewise polynomials, which turns out to be an interesting class of vector lattices for studying principal prime ideals and ascending chains of prime ideals.


Adjustable Robust Two Stage Polynomial Optimization with Application to AC Optimal Power Flow. In this work, we consider two stage polynomial optimization problems under uncertainty. In the first stage, one needs to decide upon the values of a subset of optimization variables (control variables). In the second stage, the uncertainty is revealed and the rest of optimization variables (state variables) are set up as a solution to a known system of possibly non linear equations. This type of problem occurs, for instance, in optimization for dynamical systems, such as electric power systems. We combine tools from polynomial and robust optimization to provide a framework for general adjustable robust polynomial optimization problems. In particular, we propose an iterative algorithm to build a sequence of (approximately) robustly feasible solutions with an improving objective value and verify robust feasibility or infeasibility of the resulting solution under a semialgebraic uncertainty set. At each iteration, the algorithm optimizes over a subset of the feasible set and uses affine approximations of the second stage equations while preserving the non linearity of other constraints. The algorithm allows for additional simplifications in case of possibly non convex quadratic problems under ellipsoidal uncertainty. We implement our approach for AC Optimal Power Flow and demonstrate the performance of our proposed method on Matpower instances.


A quantitative rigidity result for a two dimensional Frenkel Kontorova model. We consider a Frenkel Kontorova system of harmonic oscillators in a two dimensional Euclidean lattice and we obtain a quantitative estimate on the angular function of the equilibria. The proof relies on a PDE method related to a classical conjecture by E. De Giorgi, also in view of an elegant technique based on complex variables that was introduced by A. Farina. In the discrete setting, a careful analysis of the reminders is needed to exploit this type of methodologies inspired by continuum models.


Computing the original eBWT faster, simpler, and with less memory. Mantaci et al. TCS 2007 defined the eBWT to extend the definition of the BWT to a collection of strings, however, since this introduction, it has been used more generally to describe any BWT of a collection of strings and the fundamental property of the original definition (i.e., the independence from the input order) is frequently disregarded. In this paper, we propose a simple linear time algorithm for the construction of the original eBWT, which does not require the preprocessing of Bannai et al. CPM 2021 . As a byproduct, we obtain the first linear time algorithm for computing the BWT of a single string that uses neither an end of string symbol nor Lyndon rotations. We combine our new eBWT construction with a variation of prefix free parsing to allow for scalable construction of the eBWT. We evaluate our algorithm (pfpebwt) on sets of human chromosomes 19, Salmonella, and SARS CoV2 genomes, and demonstrate that it is the fastest method for all collections, with a maximum speedup of 7.6x on the second best method. The peak memory is at most 2x larger than the second best method. Comparing with methods that are also, as our algorithm, able to report suffix array samples, we obtain a 57.1x improvement in peak memory. The source code is publicly available at https github.com davidecenzato PFP eBWT.


Mean exit time in irregularly shaped annular and composite disc domains. Calculating the mean exit time (MET) for models of diffusion is a classical problem in statistical physics, with various applications in biophysics, economics and heat and mass transfer. While many exact results for MET are known for diffusion in simple geometries involving homogeneous materials, calculating MET for diffusion in realistic geometries involving heterogeneous materials is typically limited to repeated stochastic simulations or numerical solutions of the associated boundary value problem (BVP). In this work we derive exact solutions for the MET in irregular annular domains, including some applications where diffusion occurs in heterogenous media. These solutions are obtained by taking the exact results for MET in an annulus, and then constructing various perturbation solutions to account for the irregular geometries involved. These solutions, with a range of boundary conditions, are implemented symbolically and compare very well with averaged data from repeated stochastic simulations and with numerical solutions of the associated BVP. Software to implement the exact solutions is available at https github.com ProfMJSimpson Exit time.


LS3 Latent Space Safe Sets for Long Horizon Visuomotor Control of Sparse Reward Iterative Tasks. Reinforcement learning (RL) has shown impressive success in exploring high dimensional environments to learn complex tasks, but can often exhibit unsafe behaviors and require extensive environment interaction when exploration is unconstrained. A promising strategy for learning in dynamically uncertain environments is requiring that the agent can robustly return to learned safe sets, where task success (and therefore safety) can be guaranteed. While this approach has been successful in low dimensions, enforcing this constraint in environments with visual observations is exceedingly challenging. We present a novel continuous representation for safe sets by framing it as a binary classification problem in a learned latent space, which flexibly scales to image observations. We then present a new algorithm, Latent Space Safe Sets (LS3), which uses this representation for long horizon tasks with sparse rewards. We evaluate LS3 on 4 domains, including a challenging sequential pushing task in simulation and a physical cable routing task. We find that LS3 can use prior task successes to restrict exploration and learn more efficiently than prior algorithms while satisfying constraints. See https tinyurl.com latent ss for code and supplementary material.


Automatically Select Emotion for Response via Personality affected Emotion Transition. To provide consistent emotional interaction with users, dialog systems should be capable to automatically select appropriate emotions for responses like humans. However, most existing works focus on rendering specified emotions in responses or empathetically respond to the emotion of users, yet the individual difference in emotion expression is overlooked. This may lead to inconsistent emotional expressions and disinterest users. To tackle this issue, we propose to equip the dialog system with personality and enable it to automatically select emotions in responses by simulating the emotion transition of humans in conversation. In detail, the emotion of the dialog system is transitioned from its preceding emotion in context. The transition is triggered by the preceding dialog context and affected by the specified personality trait. To achieve this, we first model the emotion transition in the dialog system as the variation between the preceding emotion and the response emotion in the Valence Arousal Dominance (VAD) emotion space. Then, we design neural networks to encode the preceding dialog context and the specified personality traits to compose the variation. Finally, the emotion for response is selected from the sum of the preceding emotion and the variation. We construct a dialog dataset with emotion and personality labels and conduct emotion prediction tasks for evaluation. Experimental results validate the effectiveness of the personality affected emotion transition.


Optical pump terahertz probe spectroscopy of the topological crystalline insulator Pb1 xSnxSe through the topological phase transition. Topological crystalline insulators topological insulators whose properties are guaranteed by crystalline symmetry can potentially provide a promising platform for terahertz optoelectronic devices, as their properties can be tuned on demand when layered in heterostructures. We perform the first optical pump terahertz probe spectroscopy of topological crystalline insulators, using them to study the dynamics of Pb1 xSnxSe as a function of temperature. At low temperatures, excitation of Dirac fermions leads to an increase in terahertz transmission from this negative photoconductivity, the intrasubband relaxation rate of 6 ps is extracted. At high temperatures where only massive fermions exist, the free carrier losses induced by the pump reduce the terahertz transmission for the duration of the 27 ps interband lifetime. Both effects are present at temperatures near the topological to trivial transition. Our experimental observations provide critical details for potential applications of Pb1 xSnxSe and provide a direct measurement of the topological character of Pb1 xSnxSe heterostructures.


Removable sets for Newtonian Sobolev spaces and a characterization of p path almost open sets. We study removable sets for Newtonian Sobolev functions in metric measure spaces satisfying the usual (local) assumptions of a doubling measure and a Poincar 'e inequality. In particular, when restricted to Euclidean spaces, a closed set E subset mathbf R n with zero Lebesgue measure is shown to be removable for W 1,p ( mathbf R n setminus E) if and only if mathbf R n setminus E supports a p Poincar 'e inequality as a metric space. When p 1 , this recovers Koskela's result (Ark. Mat. 37 (1999), 291 304), but for p 1 , as well as for metric spaces, it seems to be new. We also obtain the corresponding characterization for the Dirichlet spaces L 1,p . To be able to include p 1 , we first study extensions of Newtonian Sobolev functions in the case p 1 from a noncomplete space X to its completion widehat X . In these results, p path almost open sets play an important role, and we provide a characterization of them by means of p path open, p quasiopen and p finely open sets. We also show that there are nonmeasurable p path almost open subsets of mathbf R n , n geq 2 , provided that the continuum hypothesis is assumed to be true. Furthermore, we extend earlier results about measurability of functions with L p integrable upper gradients, about p quasiopen, p path and p finely open sets, and about Lebesgue points for N 1,1 functions, to spaces that only satisfy local assumptions.


Iso Edge Domains. Iso edge domains are a variant of the iso Delaunay decomposition introduced by Voronoi. They were introduced by Baranovskii Ryshkov in order to solve the covering problem in dimension 5 . In this work we revisit this decomposition and prove the following new results bullet We review the existing theory and give a general mass formula for the iso edge domains. bullet We prove that the associated toroidal compactification of the moduli space of principally polarized abelian varieties is projective. bullet We prove the Conway Sloane conjecture in dimension 5 . bullet We prove that the quadratic forms for which the conorms are non negative are exactly the matroidal ones in dimension 5 .


HHP Net A light Heteroscedastic neural network for Head Pose estimation with uncertainty. In this paper we introduce a novel method to estimate the head pose of people in single images starting from a small set of head keypoints. To this purpose, we propose a regression model that exploits keypoints computed automatically by 2D pose estimation algorithms and outputs the head pose represented by yaw, pitch, and roll. Our model is simple to implement and more efficient with respect to the state of the art faster in inference and smaller in terms of memory occupancy with comparable accuracy. Our method also provides a measure of the heteroscedastic uncertainties associated with the three angles, through an appropriately designed loss function we show there is a correlation between error and uncertainty values, thus this extra source of information may be used in subsequent computational steps. As an example application, we address social interaction analysis in images we propose an algorithm for a quantitative estimation of the level of interaction between people, starting from their head poses and reasoning on their mutual positions. The code is available at https github.com cantarinigiorgio HHP Net.


Laser Driven Fluorescence Emission in a Nitrogen Gas Jet at 100 MHz Repetition Rate. We report the fluorescence emission which is driven by femtosecond laser pulses with a repetition rate of 100 MHz and a center wavelength of 1040 nm in a nitrogen gas jet. The experiment is performed in a femtosecond enhancement cavity coupled with high repetition rate laser for the first time to the best of our knowledge. In contrast to previous observation at low repetition rate with a nitrogen gas jet, where the 391 nm radiation was observed but the 337 nm emission was missing, the 337 nm emission is 3 times stronger than the 391 nm emission in our experiment. By examining the dependence of the radiation intensity on the flow rate of the nitrogen gas and the polarization of the pump pulse, the formation mechanism of the N2(C3 Pi u) triplet excited state, i.e., the upper state of the 337 nm emission, is investigated. We attribute the main excitation process to the inelastic collision excitation process, and exclude the possibility of the dissociative recombination as the dominate pathway. The role of the steady state plasma that is generated under our experimental conditions is also discussed.