Exploring the Semi supervised Video Object Segmentation Problem from a Cyclic Perspective. Modern video object segmentation (VOS) algorithms have achieved remarkably high performance in a sequential processing order, while most of currently prevailing pipelines still show some obvious inadequacy like accumulative error, unknown robustness or lack of proper interpretation tools. In this paper, we place the semi supervised video object segmentation problem into a cyclic workflow and find the defects above can be collectively addressed via the inherent cyclic property of semi supervised VOS systems. Firstly, a cyclic mechanism incorporated to the standard sequential flow can produce more consistent representations for pixel wise correspondance. Relying on the accurate reference mask in the starting frame, we show that the error propagation problem can be mitigated. Next, a simple gradient correction module, which naturally extends the offline cyclic pipeline to an online manner, can highlight the high frequent and detailed part of results to further improve the segmentation quality while keeping feasible computation cost. Meanwhile such correction can protect the network from severe performance degration resulted from interference signals. Finally we develop cycle effective receptive field (cycle ERF) based on gradient correction process to provide a new perspective into analyzing object specific regions of interests. We conduct comprehensive comparison and detailed analysis on challenging benchmarks of DAVIS16, DAVIS17 and Youtube VOS, demonstrating that the cyclic mechanism is helpful to enhance segmentation quality, improve the robustness of VOS systems, and further provide qualitative comparison and interpretation on how different VOS algorithms work. The code of this project can be found at https github.com lyxok1 STM Training


Circumcentric directions of cones. Generalized circumcenters have been recently introduced and employed to speed up classical projection type methods for solving feasibility problems. In this note, circumcenters are enforced in a new setting they are proven to provide inward directions to sets given by convex inequalities. In particular, we show that circumcentric directions of finitely generated cones belong to the interior of their polars. We also derive a measure of interiorness of the circumcentric direction, which then provides a special cone of search directions, all being feasible to the convex region under consideration.


A simulation based optimization approach for the calibration of a discrete event simulation model of an emergency department. Accurate modeling of the patient flow within an Emergency Department (ED) is required by all studies dealing with the increasing and well known problem of overcrowding. Since Discrete Event Simulation (DES) models are often adopted with the aim of assessing solutions for reducing the impact of this worldwide phenomenon, an accurate estimation of the service time of the ED processes is necessary to guarantee the reliability of the results. However, simulation models concerning EDs are frequently affected by data quality problems, thus requiring a proper estimation of the missing parameters. In this paper, a simulation based optimization approach is used to estimate the incomplete data in the patient flow within an ED by adopting a model calibration procedure. The objective function of the resulting minimization problem represents the deviation between simulation output and real data, while the constraints ensure that the response of the simulation is sufficiently accurate according to the precision required. Data from a real case study related to a big ED in Italy is used to test the effectiveness of the proposed approach. The experimental results show that the model calibration allows recovering the missing parameters, thus leading to an accurate DES model.


High fidelity glass micro axicons fabricated by laser assisted wet etching. We report on the fabrication of micro axicons made of glass by laser assisted wet etching (LAE) and laser polishing. The employed technique, relying on an efficient direct writing process by femtosecond laser, allows revealing high fidelity profiles while etched in a heated potassium hydroxide (KOH) solution. The remaining surface roughness is then smoothened by carbon dioxide (CO2) laser polishing. Such polishing is limited to the skin of the component so that the tip is only slightly rounded, with a radius of curvature of nearly 200 mu m. It is then shown with 500 mu m diameter axicons that the quasi Bessel beam is generated closely after the tip, and features a 5.3 mu m diameter maintained over a propagation distance of almost 3.5 mm.


Classifying sufficiently connected PSC manifolds in 4 and 5 dimensions. We show that if N is a closed manifold of dimension n 4 (resp. n 5 ) with pi 2(N) 0 (resp. pi 2(N) pi 3(N) 0 ) that admits a metric of positive scalar curvature, then a finite cover hat N of N is homotopy equivalent to S n or connected sums of S n 1 times S 1 . Our approach combines recent advances in the study of positive scalar curvature with a novel argument of Alpert Balitskiy Guth. Additionally, we prove a more general mapping version of this result. In particular, this implies that if N is a closed manifold of dimensions 4 or 5 , and N admits a map of nonzero degree to a closed aspherical manifold, then N does not admit any Riemannian metric with positive scalar curvature.


DP Coloring Cartesian Products of Graphs. DP coloring (also called correspondence coloring) is a generalization of list coloring introduced by Dvo v r ' a k and Postle in 2015. Motivated by results related to list coloring Cartesian products of graphs, we initiate the study of the DP chromatic number, chi DP , of the same. We show that chi DP (G square H) leq text min chi DP (G) text col (H), chi DP (H) text col (G) 1 where text col (H) is the coloring number of the graph H . We focus on building tools for lower bound arguments for chi DP (G square H) and use them to show the sharpness of the bound above and its various forms. Our results illustrate that the DP color function of G , the DP analogue of the chromatic polynomial, is essential in the study of the DP chromatic number of the Cartesian product of graphs, including the following question that extends the sharpness problem above and the classical result on gap between list chromatic number and chromatic number given any graph G and k in mathbb N , what is the smallest t for which chi DP (G square K k,t ) chi DP (G) k ?


Unsupervised domain adaptation via double classifiers based on high confidence pseudo label. Unsupervised domain adaptation (UDA) aims to solve the problem of knowledge transfer from labeled source domain to unlabeled target domain. Recently, many domain adaptation (DA) methods use centroid to align the local distribution of different domains, that is, to align different classes. This improves the effect of domain adaptation, but domain differences exist not only between classes, but also between samples. This work rethinks what is the alignment between different domains, and studies how to achieve the real alignment between different domains. Previous DA methods only considered one distribution feature of aligned samples, such as full distribution or local distribution. In addition to aligning the global distribution, the real domain adaptation should also align the meso distribution and the micro distribution. Therefore, this study propose a double classifier method based on high confidence label (DCP). By aligning the centroid and the distribution between centroid and sample of different classifiers, the meso and micro distribution alignment of different domains is realized. In addition, in order to reduce the chain error caused by error marking, This study propose a high confidence marking method to reduce the marking error. To verify its versatility, this study evaluates DCP on digital recognition and target recognition data sets. The results show that our method achieves state of the art results on most of the current domain adaptation benchmark datasets.


On Enhancing Ground Surface Detection from Sparse Lidar Point Cloud. Ground surface detection in point cloud is widely used as a key module in autonomous driving systems. Different from previous approaches which are mostly developed for lidars with high beam resolution, e.g. Velodyne HDL 64, this paper proposes ground detection techniques applicable to much sparser point cloud captured by lidars with low beam resolution, e.g. Velodyne VLP 16. The approach is based on the RANSAC scheme of plane fitting. Inlier verification for plane hypotheses is enhanced by exploiting the point wise tangent, which is a local feature available to compute regardless of the density of lidar beams. Ground surface which is not perfectly planar is fitted by multiple (specifically 4 in our implementation) disjoint plane regions. By assuming these plane regions to be rectanglar and exploiting the integral image technique, our approach approximately finds the optimal region partition and plane hypotheses under the RANSAC scheme with real time computational complexity.


Declarative Demand Driven Reverse Engineering. Binary reverse engineering is a challenging task because it often necessitates reasoning using both domain specific knowledge (e.g., understanding entrypoint idioms common to an ABI) and logical inference (e.g., reconstructing interprocedural control flow). To help perform these tasks, reverse engineers often use toolkits (such as IDA Pro or Ghidra) that allow them to interactively explicate properties of binaries. We argue that deductive databases serve as a natural abstraction for interfacing between visualization based binary analysis tools and high performance logical inference engines that compute facts about binaries. In this paper, we present a vision for the future in which reverse engineers use a visualization based tool to understand binaries while simultaneously querying a logical inference engine to perform arbitrarily complex deductive inference tasks. We call our vision declarative demand driven reverse engineering (D 3RE for short), and sketch a formal semantics whose goal is to mediate interaction between a logical inference engine (such Souffle) and a reverse engineering tool. We describe aprototype tool, d3re, which are using to explore the D 3RE vision. While still a prototype, we have used d3re to reimplement several common querying tasks on binaries. Our evaluation demonstrates that d3re enables both better performance and more succinct implementation of these common RE tasks.


Queuing model of axonal transport. The motor driven intracellular transport of vesicles to synaptic targets in the axons and dendrites of neurons plays a crucial role in normal cell function. Moreover, stimulus dependent regulation of active transport is an important component of long term synaptic plasticity, whereas the disruption of vesicular transport can lead to the onset of various neurodegenerative diseases. In this paper we investigate how the discrete and stochastic nature of vesicular transport in axons contributes to fluctuations in the accumulation of resources within synaptic targets. We begin by solving the first passage time problem of a single motor cargo complex (particle) searching for synaptic targets distributed along a one dimensional axonal cable. We then use queuing theory to analyze the accumulation of synaptic resources under the combined effects of multiple search and capture events and degradation. In particular, we determine the steady state mean and variance of the distribution of synaptic resources along the axon in response to the periodic insertion of particles. The mean distribution recovers the spatially decaying distribution of resources familiar from deterministic population models. However, the discrete nature of vesicular transport can lead to Fano factors that are greater than unity (non Poissonian) across the array of synapses, resulting in significant fluctuation bursts. We also find that each synaptic Fano factor is independent of the rate of particle insertion but increases monotonically with the amount of protein cargo in each vesicle. This implies that fluctuations can be reduced by increasing the injection rate while decreasing the cargo load of each vesicle.


Continual Learning with Knowledge Transfer for Sentiment Classification. This paper studies continual learning (CL) for sentiment classification (SC). In this setting, the CL system learns a sequence of SC tasks incrementally in a neural network, where each task builds a classifier to classify the sentiment of reviews of a particular product category or domain. Two natural questions are Can the system transfer the knowledge learned in the past from the previous tasks to the new task to help it learn a better model for the new task? And, can old models for previous tasks be improved in the process as well? This paper proposes a novel technique called KAN to achieve these objectives. KAN can markedly improve the SC accuracy of both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of KAN is demonstrated through extensive experiments.


Modulational instability of dust ion acoustic waves in pair ion plasma having non thermal non extensive electrons. The modulational instability (MI) criteria of dust ion acoustic (DIA) waves (DIAWs) have been investigated in a four component pair ion plasma having inertial pair ions, inertialess non thermal non extensive electrons, and immobile negatively charged massive dust grains. A nonlinear Schr " o dinger equation (NLSE) is derived by using reductive perturbation method. The nonlinear and dispersive coefficients of the NLSE can predict the modulationally stable and unstable parametric regimes of DIAWs and associated first and second order DIA rogue waves (DIARWs). The MI growth rate and the configuration of the DIARWs are examined, and it is found that the MI growth rate increases (decreases) with increasing the number density of the negatively charged dust grains in the presence (absence) of the negative ions. It is also observed that the amplitude and width of the DIARWs increase (decrease) with the negative (positive) ion mass. The implications of the results to laboratory and space plasmas are briefly discussed.


Complex network modelling of EEG band coupling in dyslexia an exploratory analysis of auditory processing and diagnosis. Complex network analysis has an increasing relevance in the study of neurological disorders, enhancing the knowledge of brain's structural and functional organization. Network structure and efficiency reveal different brain states along with different ways of processing the information. This work is structured around the exploratory analysis of the brain processes involved in low level auditory processing. A complex network analysis was performed on the basis of brain coupling obtained from Electroencephalography (EEG) data, while different auditory stimuli were presented to the subjects. This coupling is inferred from the Phase Amplitude coupling (PAC) from different EEG electrodes to explore differences between controls and dyslexic subjects. Coupling data allows the construction of a graph, and then, graph theory is used to study the characteristics of the complex networks throughout time for controls and dyslexics. This results in a set of metrics including clustering coefficient, path length and small worldness. From this, different characteristics linked to the temporal evolution of networks and coupling are pointed out for dyslexics. Our study revealed patterns related to Dyslexia as losing the small world topology. Finally, these graph based features are used to classify between controls and dyslexic subjects by means of a Support Vector Machine (SVM).


Human In The Loop Document Layout Analysis. Document layout analysis (DLA) aims to divide a document image into different types of regions. DLA plays an important role in the document content understanding and information extraction systems. Exploring a method that can use less data for effective training contributes to the development of DLA. We consider a Human in the loop (HITL) collaborative intelligence in the DLA. Our approach was inspired by the fact that the HITL push the model to learn from the unknown problems by adding a small amount of data based on knowledge. The HITL select key samples by using confidence. However, using confidence to find key samples is not suitable for DLA tasks. We propose the Key Samples Selection (KSS) method to find key samples in high level tasks (semantic segmentation) more accurately through agent collaboration, effectively reducing costs. Once selected, these key samples are passed to human beings for active labeling, then the model will be updated with the labeled samples. Hence, we revisited the learning system from reinforcement learning and designed a sample based agent update strategy, which effectively improves the agent's ability to accept new samples. It achieves significant improvement results in two benchmarks (DSSE 200 (from 77.1 to 86.3 ) and CS 150 (from 88.0 to 95.6 )) by using 10 of labeled data.


Understanding health and behavioral trends of successful students through machine learning models. This study analyzes patterns of physical, mental, lifestyle, and personality factors in college students in different periods over the course of a semester and models their relationships with students' academic performance. The data analyzed was collected through smartphones and Fitbit. The use of machine learning models derived from the gathered data was employed to observe the extent of students' behavior associated with their GPA, lifestyle, physical health, mental health, and personality attributes. A mutual agreement method was used in which rather than looking at the accuracy of results, the model parameters and weights of features were used to find common behavioral trends. From the results of the model creation, it was determined that the most significant indicator of academic success defined as a higher GPA, was the places a student spent their time. Lifestyle and personality factors were deemed more significant than mental and physical factors. This study will provide insight into the impact of different factors and the timing of those factors on students' academic performance.


Properties of Higher Order Prime Number Sequences. In this paper, we analyze properties of prime number sequences produced by the alternating sum of higher order subsequences of the primes. We also introduce a new sieve which will generate these prime number sequences via the systematic selection and elimination of prime number indexes on the real number line.


News Consumption in Time of Conflict 2021 Palestinian Israel War as an Example. This paper examines news consumption in response to a major polarizing event, and we use the May 2021 Israeli Palestinian conflict as an example. We conduct a detailed analysis of the news consumption of more than eight thousand Twitter users who are either pro Palestinian or pro Israeli and authored more than 29 million tweets between January 1 and August 17, 2021. We identified the stance of users using unsupervised stance detection. We observe that users may consume more topically related content from foreign and less popular sources, because, unlike popular sources, they may reaffirm their views, offer more extreme, hyper partisan, or sensational content, or provide more in depth coverage of the event. The sudden popularity of such sources may not translate to longer term or general popularity on other topics.


Model Complexity of Deep Learning A Survey. Model complexity is a fundamental problem in deep learning. In this paper we conduct a systematic overview of the latest studies on model complexity in deep learning. Model complexity of deep learning can be categorized into expressive capacity and effective model complexity. We review the existing studies on those two categories along four important factors, including model framework, model size, optimization process and data complexity. We also discuss the applications of deep learning model complexity including understanding model generalization, model optimization, and model selection and design. We conclude by proposing several interesting future directions.


Simplify Your Law Using Information Theory to Deduplicate Legal Documents. Textual redundancy is one of the main challenges to ensuring that legal texts remain comprehensible and maintainable. Drawing inspiration from the refactoring literature in software engineering, which has developed methods to expose and eliminate duplicated code, we introduce the duplicated phrase detection problem for legal texts and propose the Dupex algorithm to solve it. Leveraging the Minimum Description Length principle from information theory, Dupex identifies a set of duplicated phrases, called patterns, that together best compress a given input text. Through an extensive set of experiments on the Titles of the United States Code, we confirm that our algorithm works well in practice Dupex will help you simplify your law.


Learning First Order Representations for Planning from Black Box States New Results. Recently Bonet and Geffner have shown that first order representations for planning domains can be learned from the structure of the state space without any prior knowledge about the action schemas or domain predicates. For this, the learning problem is formulated as the search for a simplest first order domain description D that along with information about instances I i (number of objects and initial state) determine state space graphs G(P i) that match the observed state graphs G i where P i (D, I i). The search is cast and solved approximately by means of a SAT solver that is called over a large family of propositional theories that differ just in the parameters encoding the possible number of action schemas and domain predicates, their arities, and the number of objects. In this work, we push the limits of these learners by moving to an answer set programming (ASP) encoding using the CLINGO system. The new encodings are more transparent and concise, extending the range of possible models while facilitating their exploration. We show that the domains introduced by Bonet and Geffner can be solved more efficiently in the new approach, often optimally, and furthermore, that the approach can be easily extended to handle partial information about the state graphs as well as noise that prevents some states from being distinguished.


The Three and Fourfold Translative Tiles in Three Dimensional Space. This paper proves the following statement If a convex body can form a three or fourfold translative tiling in the three dimensional space, it must be a parallelohedron. In other words, it must be a parallelotope, a hexagonal prism, a rhombic dodecahedron, an elongated dodecahedron, or a truncated octahedron.


Combinatorial model categories are equivalent to presentable quasicategories. We establish a Dwyer Kan equivalence of relative categories of combinatorial model categories, presentable quasicategories, and other models for locally presentable (infinity,1) categories. This implies that the underlying quasicategories of these relative categories are also equivalent.


Sensitivity Analysis for Periodic Orbits and Quasiperiodic Invariant Tori Using the Adjoint Method. This paper presents a rigorous framework for the continuation of solutions to nonlinear constraints and the simultaneous analysis of the sensitivities of test functions to constraint violations at each solution point using an adjoint based approach. By the linearity of a problem Lagrangian in the associated Lagrange multipliers, the formalism is shown to be directly amenable to analysis using the COCO software package, specifically its paradigm for staged problem construction. The general theory is illustrated in the context of algebraic equations and boundary value problems, with emphasis on periodic orbits in smooth and hybrid dynamical systems, and quasiperiodic invariant tori of flows. In the latter case, normal hyperbolicity is used to prove the existence of continuous solutions to the adjoint conditions associated with the sensitivities of the orbital periods to parameter perturbations and constraint violations, even though the linearization of the governing boundary value problem lacks a bounded inverse, as required by the general theory. An assumption of transversal stability then implies that these solutions predict the asymptotic phases of trajectories based at initial conditions perturbed away from the torus. Example COCO code is used to illustrate the minimal additional investment in setup costs required to append sensitivity analysis to regular parameter continuation.


Graph Based Network with Contextualized Representations of Turns in Dialogue. Dialogue based relation extraction (RE) aims to extract relation(s) between two arguments that appear in a dialogue. Because dialogues have the characteristics of high personal pronoun occurrences and low information density, and since most relational facts in dialogues are not supported by any single sentence, dialogue based relation extraction requires a comprehensive understanding of dialogue. In this paper, we propose the TUrn COntext awaRE Graph Convolutional Network (TUCORE GCN) modeled by paying attention to the way people understand dialogues. In addition, we propose a novel approach which treats the task of emotion recognition in conversations (ERC) as a dialogue based RE. Experiments on a dialogue based RE dataset and three ERC datasets demonstrate that our model is very effective in various dialogue based natural language understanding tasks. In these experiments, TUCORE GCN outperforms the state of the art models on most of the benchmark datasets. Our code is available at https github.com BlackNoodle TUCORE GCN.


A Region based Collaborative Management Scheme for Dynamic Clustering in Green VANET. Green Vehicular Ad hoc Network (VANET) is a newly emerged research area which focuses on reducing harmful impacts of vehicular communication equipments on the natural environment. Recent studies have shown that grouping vehicles into clusters for green communications in VANETs can significantly improve networking efficiency and reduce infrastructure costs. As a dynamic network system, maintaining the network connectivity and reducing the communication overlap are two critical challenges for green VANET clustering. However, most existing work studies connectivity and overlap separately, lacking a deep understanding of the relationship between them. To address this issue, we present a comprehensive analysis that jointly considers the two critical factors in one model. Specifically, we first design a state resemblance prediction (SRP) model based on the historical trajectory feature relevance between vehicles Combined with the SRP model, we propose the region based collaborative management scheme (RCMS) to establish the dynamic clustering Lastly, we take extensive experiments to verify the region based collaborative management scheme for dynamic clustering. The results demonstrate that the proposed clustering algorithm can achieve high networking efficiency and better communication stability.


Entropy of monomial algebras and derived categories. Let A be a finitely presented associative monomial algebra. We study the category qgr(A) which is a quotient of the category of graded finitely presented A modules by the finite dimensional ones. As this category plays a role of the category of coherent sheaves on the corresponding noncommutative variety, we consider its bounded derived category. We calculate the categorical entropy of the Serre twist functor this derived category and show that it is equal to logarithm of the entropy of the algebra A itself. Moreover, we relate these two kinds of entropy with the topological entropy of the Ufnarovski graph of A and the entropy of the path algebra of the graph. If A is a path algebra of some quiver, the categorical entropy is equal to the logarithm of the spectral radius of the quiver's adjacency matrix.


New Bounds for the Flock of Birds Problem. In this paper, we continue a line of work on obtaining succinct population protocols for Presburger definable predicates. More specifically, we focus on threshold predicates. These are predicates of the form n ge d , where n is a free variable and d is a constant. For every d , we establish a 1 aware population protocol for this predicate with log 2 d min e, z O(1) states, where e (resp., z ) is the number of 1 's (resp., 0 's) in the binary representation of d (resp., d 1 ). This improves upon an upper bound 4 log 2 d O(1) due to Blondin et al. We also show that any 1 aware protocol for our problem must have at least log 2(d) states. This improves upon a lower bound log 3 d due to Blondin et al.


Connectivity of the Gromov Boundary of the Free Factor Complex. We show that in large enough rank, the Gromov boundary of the free factor complex is path connected and locally path connected.


Goodwillie Calculus and Geometric Stacks. We show Goodwillie's calculus of functors and n geometric D stacks share similar features by starting to focus on the convergence of Taylor towers for homotopy functors and the fact that mathbb R F(A) cong text holim mathbb R F(A leq n ) for geometric stacks, where A leq n provides a Postnikov tower of some given A in s text k Alg . From there we show parallel results, such as similar homotopy fibers of connecting maps in towers, as well as polynomial approximations, pointwise approximations and reconstruction theorems for towers.


GMA A Pareto Optimal Distributed Resource Allocation Algorithm. To address the rising demand for strong packet delivery guarantees in networking, we study a novel way to perform graph resource allocation. We first introduce allocation graphs, in which nodes can independently set local resource limits based on physical constraints or policy decisions. In this scenario we formalize the distributed path allocation (PAdist) problem, which consists in allocating resources to paths considering only local on path information importantly, not knowing which other paths could have an allocation while at the same time achieving the global property of never exceeding available resources. Our core contribution, the global myopic allocation (GMA) algorithm, is a solution to this problem. We prove that GMA can compute unconditional allocations for all paths on a graph, while never over allocating resources. Further, we prove that GMA is Pareto optimal with respect to the allocation size, and it has linear complexity in the input size. Finally, we show with simulations that this theoretical result could be indeed applied to practical scenarios, as the resulting path allocations are large enough to fit the requirements of practically relevant applications.


Ethereum Name Service the Good, the Bad, and the Ugly. DNS has always been criticized for its inherent design flaws, making the system vulnerable to kinds of attacks. Besides, DNS domain names are not fully controlled by the users, which can be easily taken down by the authorities and registrars. Since blockchain has its unique properties like immutability and decentralization, it seems to be promising to build a decentralized name service on blockchain. Ethereum Name Service (ENS), as a novel name service built atop Etheruem, has received great attention from the community. Yet, no existing work has systematically studied this emerging system, especially the security issues and misbehaviors in ENS. To fill the void, we present the first large scale study of ENS by collecting and analyzing millions of event logs related to ENS. We characterize the ENS system from a number of perspectives. Our findings suggest that ENS is showing gradually popularity during its four years' evolution, mainly due to its distributed and open nature that ENS domain names can be set to any kinds of records, even censored and malicious contents. We have identified several security issues and misbehaviors including traditional DNS security issues and new issues introduced by ENS smart contracts. Attackers are abusing the system with thousands of squatting ENS names, a number of scam blockchain addresses and malicious websites, etc. Our exploration suggests that our community should invest more effort into the detection and mitigation of issues in Blockchain based Name Services towards building an open and trustworthy name service.


People, Places, and Ties Landscape of social places and their social network structures. Due to their essential role as places for socialization, "third places" social places where people casually visit and communicate with friends and neighbors have been studied by a wide range of fields including network science, sociology, geography, urban planning, and regional studies. However, the lack of a large scale census on third places kept researchers from systematic investigations. Here we provide a systematic nationwide investigation of third places and their social networks, by using Facebook pages. Our analysis reveals a large degree of geographic heterogeneity in the distribution of the types of third places, which is highly correlated with baseline demographics and county characteristics. Certain types of pages like "Places of Worship" demonstrate a large degree of clustering suggesting community preference or potential complementarities to concentration. We also found that the social networks of different types of social place differ in important ways The social networks of 'Restaurants' and 'Indoor Recreation' pages are more likely to be tight knit communities of pre existing friendships whereas 'Places of Worship' and 'Community Amenities' page categories are more likely to bridge new friendship ties. We believe that this study can serve as an important milestone for future studies on the systematic comparative study of social spaces and their social relationships.


Pseudo labeling for Scalable 3D Object Detection. To safely deploy autonomous vehicles, onboard perception systems must work reliably at high accuracy across a diverse set of environments and geographies. One of the most common techniques to improve the efficacy of such systems in new domains involves collecting large labeled datasets, but such datasets can be extremely costly to obtain, especially if each new deployment geography requires additional data with expensive 3D bounding box annotations. We demonstrate that pseudo labeling for 3D object detection is an effective way to exploit less expensive and more widely available unlabeled data, and can lead to performance gains across various architectures, data augmentation strategies, and sizes of the labeled dataset. Overall, we show that better teacher models lead to better student models, and that we can distill expensive teachers into efficient, simple students. Specifically, we demonstrate that pseudo label trained student models can outperform supervised models trained on 3 10 times the amount of labeled examples. Using PointPillars 24 , a two year old architecture, as our student model, we are able to achieve state of the art accuracy simply by leveraging large quantities of pseudo labeled data. Lastly, we show that these student models generalize better than supervised models to a new domain in which we only have unlabeled data, making pseudo label training an effective form of unsupervised domain adaptation.


Roaming leads to amino acid photodamage A deep learning study of tyrosine. Although the amino acid tyrosine is among the main building blocks of life, its photochemistry is not fully understood. Traditional theoretical simulations are neither accurate enough, nor computationally efficient to provide the missing puzzle pieces to the experimentally observed signatures obtained via time resolved pump probe spectroscopy or mass spectroscopy. In this work, we go beyond the realms of possibility with conventional quantum chemical methods and develop as well as apply a new technique to shed light on the photochemistry of tyrosine. By doing so, we discover roaming atoms in tyrosine, which is the first time such a reaction is discovered in biology. Our findings suggest that roaming atoms are radicals that could play a fundamental role in the photochemistry of peptides and proteins, offering a new perspective. Our novel method is based on deep learning, leverages the physics underlying the data, and combines different levels of theory. This combination of methods to obtain an accurate picture of excited molecules could shape how we study photochemical systems in the future and how we can overcome the current limitations that we face when applying quantum chemical methods.


Multivariate tempered stable additive subordination for financial models. We study a class of multivariate tempered stable distributions and introduce the associated class of tempered stable Sato subordinators. These Sato subordinators are used to build additive inhomogeneous processes by subordination of a multiparameter Brownian motion. The resulting process is additive and time inhomogeneous. Furthermore, these processes are associated with the distribution at unit time of a class of L 'evy process with good fit properties on fifinancial data. The main feature of the Sato subordinated Brownian motion is that it has time dependent correlation, whereas the L 'evy counterpart does not. We provide a numerical illustration of the correlation dynamics.


Newell Littlewood numbers III eigencones and GIT semigroups. The Newell Littlewood numbers are tensor product multiplicities of Weyl modules for the classical groups in the stable range. Littlewood Richardson coefficients form a special case. Klyachko connected eigenvalues of sums of Hermitian matrices to the saturated LR cone and established defining linear inequalities. We prove analogues for the saturated NL cone an eigenvalue interpretation a minimal list of defining linear inequalities a description by Extended Horn inequalities, as conjectured in part II of this series and a factorization of NL numbers, on the boundary.


Volume and Monge Amp ere energy on polarized affine varieties. Let (X, xi) be a polarized affine variety, i.e. an affine variety X with a (possibly irrational) Reeb vector field xi . We define the volume of a filtration of the coordinate ring of X in terms of the asymptotics of the average of jumping numbers. When the filtration is finitely generated, it induces a Fubini Study function varphi on the Berkovich analytification of X . In this case, we define the Monge Amp ere energy for varphi using the theory of forms and currents on Berkovich spaces developed by Chambert Loir and Ducros, and show that it agrees with the volume of the filtration. In the special case when the filtration comes from a test configuration, we recover the functional defined by Collins Sz 'ekelyhidi and Li Xu.


A practical analysis of ROP attacks. Control Flow Hijacking attacks have posed a serious threat to the security of applications for a long time where an attacker can damage the control Flow Integrity of the program and execute arbitrary code. These attacks can be performed by injecting code in the program's memory or reusing already existing code in the program (also known as Code Reuse Attacks). Code Reuse Attacks in the form of Return into libc Attacks or Return Oriented Programming Attacks are said to be Turing Complete, providing a guarantee that there will always exist code segments (also called ROP gadgets) within a binary allowing an attacker to perform any kind of function by building a suitable ROP chain (chain of ROP gadgets). Our goal is to study different techniques of performing ROP Attacks and find the difficulties encountered to perform such attacks. For this purpose, we have designed an automated tool which works on 64 bit systems and generates a ROP chain from ROP gadgets to execute arbitrary system calls.


From Strings to Data Science a Practical Framework for Automated String Handling. Many machine learning libraries require that string features be converted to a numerical representation for the models to work as intended. Categorical string features can represent a wide variety of data (e.g., zip codes, names, marital status), and are notoriously difficult to preprocess automatically. In this paper, we propose a framework to do so based on best practices, domain knowledge, and novel techniques. It automatically identifies different types of string features, processes them accordingly, and encodes them into numerical representations. We also provide an open source Python implementation to automatically preprocess categorical string data in tabular datasets and demonstrate promising results on a wide range of datasets.


Effective medium theory for embedded obstacles in elasticity with applications to inverse problems. We consider the time harmonic elastic wave scattering from a general (possibly anisotropic) inhomogeneous medium with an embedded impenetrable obstacle. We show that the impenetrable obstacle can be effectively approximated by an isotropic elastic medium with a particular choice of material parameters. We derive sharp estimates to rigorously verify such an effective approximation. Our study is strongly motivated by the related studies of two challenging inverse elastic problems including the inverse boundary problem with partial data and the inverse scattering problem of recovering mediums with buried obstacles. The proposed effective medium theory readily yields some interesting applications of practical significance to these inverse problems.


Analyzing Behavioral Changes of Twitter Users After Exposure to Misinformation. Social media platforms have been exploited to disseminate misinformation in recent years. The widespread online misinformation has been shown to affect users' beliefs and is connected to social impact such as polarization. In this work, we focus on misinformation's impact on specific user behavior and aim to understand whether general Twitter users changed their behavior after being exposed to misinformation. We compare the before and after behavior of exposed users to determine whether the frequency of the tweets they posted, or the sentiment of their tweets underwent any significant change. Our results indicate that users overall exhibited statistically significant changes in behavior across some of these metrics. Through language distance analysis, we show that exposed users were already different from baseline users before the exposure. We also study the characteristics of two specific user groups, multi exposure and extreme change groups, which were potentially highly impacted. Finally, we study if the changes in the behavior of the users after exposure to misinformation tweets vary based on the number of their followers or the number of followers of the tweet authors, and find that their behavioral changes are all similar.


Measure data problems for a class of elliptic equations with mixed absorption reaction. We study the existence of nonnegative solutions to the Dirichlet problem CL M p,q u Delta u u p M nabla u q mu in a domain Omega subset BBR N where mu is a nonnegative Radon measure, when p 1 , q 1 and M geq 0 . We also give conditions under which nonnegative solutions of CL M p,q u 0 in Omega setminus K where K is a compact subset of Omega can be extended as a solution of the same equation in Omega


Does constituency analysis enhance domain specific pre trained BERT models for relation extraction?. Recently many studies have been conducted on the topic of relation extraction. The DrugProt track at BioCreative VII provides a manually annotated corpus for the purpose of the development and evaluation of relation extraction systems, in which interactions between chemicals and genes are studied. We describe the ensemble system that we used for our submission, which combines predictions of fine tuned bioBERT, sciBERT and const bioBERT models by majority voting. We specifically tested the contribution of syntactic information to relation extraction with BERT. We observed that adding constituentbased syntactic information to BERT improved precision, but decreased recall, since relations rarely seen in the train set were less likely to be predicted by BERT models in which the syntactic information is infused. Our code is available online https github.com Maple177 drugprot relation extraction .


A non hyperelliptic curve with torsion Ceresa class. We exhibit a non hyperelliptic curve C of genus 3 such that the class of the Ceresa cycle C C in the intermediate Jacobian of JC is torsion.


JointLK Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering. Existing KG augmented models for commonsense question answering primarily focus on designing elaborate Graph Neural Networks (GNNs) to model knowledge graphs (KGs). However, they ignore (i) the effectively fusing and reasoning over question context representations and the KG representations, and (ii) automatically selecting relevant nodes from the noisy KGs during reasoning. In this paper, we propose a novel model, JointLK, which solves the above limitations through the joint reasoning of LM and GNN and the dynamic KGs pruning mechanism. Specifically, JointLK performs joint reasoning between LM and GNN through a novel dense bidirectional attention module, in which each question token attends on KG nodes and each KG node attends on question tokens, and the two modal representations fuse and update mutually by multi step interactions. Then, the dynamic pruning module uses the attention weights generated by joint reasoning to prune irrelevant KG nodes recursively. We evaluate JointLK on the CommonsenseQA and OpenBookQA datasets, and demonstrate its improvements to the existing LM and LM KG models, as well as its capability to perform interpretable reasoning.


Class Incremental Few Shot Object Detection. Conventional detection networks usually need abundant labeled training samples, while humans can learn new concepts incrementally with just a few examples. This paper focuses on a more challenging but realistic class incremental few shot object detection problem (iFSD). It aims to incrementally transfer the model for novel objects from only a few annotated samples without catastrophically forgetting the previously learned ones. To tackle this problem, we propose a novel method LEAST, which can transfer with Less forgetting, fEwer training resources, And Stronger Transfer capability. Specifically, we first present the transfer strategy to reduce unnecessary weight adaptation and improve the transfer capability for iFSD. On this basis, we then integrate the knowledge distillation technique using a less resource consuming approach to alleviate forgetting and propose a novel clustering based exemplar selection process to preserve more discriminative features previously learned. Being a generic and effective method, LEAST can largely improve the iFSD performance on various benchmarks.


Towards Automatic Recognition of Pure Mixed Stones using Intraoperative Endoscopic Digital Images. Objective To assess automatic computer aided in situ recognition of morphological features of pure and mixed urinary stones using intraoperative digital endoscopic images acquired in a clinical setting. Materials and methods In this single centre study, an experienced urologist intraoperatively and prospectively examined the surface and section of all kidney stones encountered. Calcium oxalate monohydrate (COM Ia), dihydrate (COD IIb) and uric acid (UA IIIb) morphological criteria were collected and classified to generate annotated datasets. A deep convolutional neural network (CNN) was trained to predict the composition of both pure and mixed stones. To explain the predictions of the deep neural network model, coarse localisation heat maps were plotted to pinpoint key areas identified by the network. Results This study included 347 and 236 observations of stone surface and stone section, respectively. A highest sensitivity of 98 was obtained for the type "pure IIIb UA" using surface images. The most frequently encountered morphology was that of the type "pure Ia COM" it was correctly predicted in 91 and 94 of cases using surface and section images, respectively. Of the mixed type "Ia COM IIb COD", Ia COM was predicted in 84 of cases using surface images, IIb COD in 70 of cases, and both in 65 of cases. Concerning mixed Ia COM IIIb UA stones, Ia COM was predicted in 91 of cases using section images, IIIb UA in 69 of cases, and both in 74 of cases. Conclusions This preliminary study demonstrates that deep convolutional neural networks are promising to identify kidney stone composition from endoscopic images acquired intraoperatively. Both pure and mixed stone composition could be discriminated. Collected in a clinical setting, surface and section images analysed by deep CNN provide valuable information about stone morphology for computer aided diagnosis.


Hod up to AD mathbb R Theta is measurable. Suppose M is a transitive class size model of AD mathbb R Theta is regular". M is a minimal model of AD mathbb R Theta is measurable" if (i) mathbb R , Ord subseteq M (ii) there is mu in M such that M models mu is a normal mathbb R complete measure on Theta " and (iii) for any transitive class size N subsetneq M such that mathbb R subseteq N , N models there is no mathbb R complete measure on Theta ". Continuing Trang's work in 8 , we compute HOD of a minimal model of AD mathbb R Theta is measurable".


Implementing WordNet Measures of Lexical Semantic Similarity in a Fuzzy Logic Programming System. This paper introduces techniques to integrate WordNet into a Fuzzy Logic Programming system. Since WordNet relates words but does not give graded information on the relation between them, we have implemented standard similarity measures and new directives allowing the proximity equations linking two words to be generated with an approximation degree. Proximity equations are the key syntactic structures which, in addition to a weak unification algorithm, make a flexible query answering process possible in this kind of programming language. This addition widens the scope of Fuzzy Logic Programming, allowing certain forms of lexical reasoning, and reinforcing Natural Language Processing applications. Under consideration in Theory and Practice of Logic Programming (TPLP)


Prediction of mandibular ORN incidence from 3D radiation dose distribution maps using deep learning. Absorbed radiation dose to the mandible is an important risk factor in the development of mandibular osteoradionecrosis (ORN) in patients with head and neck cancer (HNC) treated with radiotherapy (RT). The management of ORN is often complex and may result in costly clinical interventions. The prediction of mandibular ORN prior to the start of RT is therefore of high clinical interest. Dosimetric parameters typically included in ORN risk prediction studies are based on the clinical dose volume histogram (DVH) obtained from the planned radiation dose distribution map. A 3D radiation dose distribution map is reduced to a 2D DVH with the resulting loss of spatial localisation and dose gradient and direction information. However, spatial dosimetric information is of great interest in the investigation of radiation damage to the mandible. We propose the use of a binary classification 3D DenseNet to extract the relevant dosimetric information from mandibular 3D radiation dose distribution maps and predict the incidence of ORN. We compare the results to a Random Forest ensemble with DVH based parameters. Finally, we investigate the benefit of combining both types of data (dose distribution maps and DVH parameters) in a 3D convolutional neural network (CNN). The prediction of mandibular ORN before the start of RT may not only guide the RT treatment planning optimisation process but also identify which patients would benefit from a closer follow up post RT for an early diagnosis and intervention of ORN.


Stability of Contraction Driven Cell Motion. We consider motility of keratocyte cells driven by myosin contraction and introduce a 2D free boundary model for such motion. This model generalizes a 1D model from 12 by combining a 2D Keller Segel model and a Hele Shaw type boundary condition with the Young Laplace law resulting in a boundary curvature term which provides a regularizing effect. We show that this model has a family of traveling solutions with constant shape and velocity which bifurcates from a family of radially symmetric stationary states. Our goal is to establish observable steady motion of the cell with constant velocity. Mathematically, this amounts to establishing stability of the traveling solutions. Our key result is an explicit asymptotic formula for the stability determining eigenvalue of the linearized problem. This formula greatly simplifies the task of numerically computing the sign of this eigenvalue and reveals the physical mechanisms of stability. The derivation of this formula is based on a special ansatz for the corresponding eigenvector which exhibits an interesting singular behavior such that it asymptotically (in the small velocity limit) becomes parallel to another eigenvector. This reflects the non self adjoint nature of the linearized problem, a signature of living systems. Finally, our results describe the onset of motion via a transition from unstable radial stationary solutions to stable asymmetric traveling solutions.


Covariance Generalized Matching Component Analysis for Data Fusion and Transfer Learning. In order to allow for the encoding of additional statistical information in data fusion and transfer learning applications, we introduce a generalized covariance constraint for the matching component analysis (MCA) transfer learning technique. After proving a semi orthogonally constrained trace maximization lemma, we develop a closed form solution to the resulting covariance generalized optimization problem and provide an algorithm for its computation. We call this technique applicable to both data fusion and transfer learning covariance generalized MCA (CGMCA).


Managing ML Pipelines Feature Stores and the Coming Wave of Embedding Ecosystems. The industrial machine learning pipeline requires iterating on model features, training and deploying models, and monitoring deployed models at scale. Feature stores were developed to manage and standardize the engineer's workflow in this end to end pipeline, focusing on traditional tabular feature data. In recent years, however, model development has shifted towards using self supervised pretrained embeddings as model features. Managing these embeddings and the downstream systems that use them introduces new challenges with respect to managing embedding training data, measuring embedding quality, and monitoring downstream models that use embeddings. These challenges are largely unaddressed in standard feature stores. Our goal in this tutorial is to introduce the feature store system and discuss the challenges and current solutions to managing these new embedding centric pipelines.


Continued Fraction approach to Gauss Reduction Theory. Jordan Normal Forms serve as excellent representatives of conjugacy classes of matrices over closed fields. Once we knows normal forms, we can compute functions of matrices, their main invariant, etc. The situation is much more complicated if we search for normal forms for conjugacy classes over fields that are not closed and especially for rings. In this paper we study PGL(2,Z) conjugacy classes of GL(2,Z) matrices. For the ring of integers Jordan approach has various limitations and in fact it is not effective. The normal forms of conjugacy classes of GL(2,Z) matrices are provided by alternative theory, which is known as Gauss Reduction Theory. We introduce a new techniques to compute reduced forms In Gauss Reduction Theory in terms of the elements of certain continued fractions. Current approach is based on recent progress in geometry of numbers. The proposed technique provides an explicit computation of periods of continued fractions for the slopes of eigenvectors.


Maximal and minimal dynamic Petri net slicing. Context Petri net slicing is a technique to reduce the size of a Petri net so that it can ease the analysis or understanding of the original Petri net. Objective Presenting two new Petri net slicing algorithms to isolate those places and transitions of a Petri net (the slice) that may contribute tokens to one or more places given (the slicing criterion). Method The two algorithms proposed are formalized. The completeness of the first algorithm and the minimality of the second algorithm are formally proven. Both algorithms together with other three state of the art algorithms have been implemented and integrated into a single tool so that we have been able to carry out a fair empirical evaluation. Results Besides the two new Petri net slicing algorithms, a public, free, and open source implementation of five algorithms is reported. The results of an empirical evaluation of the new algorithms and the slices that they produce are also presented. Conclusions The first algorithm collects all places and transitions that may influence (in any computation) the slicing criterion, while the second algorithm collects a minimum set of places and transitions that may influence (in some computation) the slicing criterion. Therefore, the net computed by the first algorithm can reproduce any computation that contributes tokens to any place of interest. In contrast, the second algorithm loses this possibility but it often produces a much more reduced subnet (which still can reproduce some computations that contribute tokens to some places of interest). The first algorithm is proven complete, and the second one is proven minimal.


Weak transport equation on a bounded domain stability theory apr 'es DiPerna Lions. The article studies the transport equation that governes the motion of a fluid in a bounded domain, under the hypothesis of zero velocity at the boundary and supposing the incompressible nature of the fluid. Together with existence and uniqueness results, we study the DiPerna Lions stability problem, in the case of a bounded domain.


The Hidden Costs of Requiring Accounts Quasi Experimental Evidence From Peer Production. Online communities, like Wikipedia, produce valuable public information goods. Whereas some of these communities require would be contributors to create accounts, many do not. Does this requirement catalyze cooperation or inhibit participation? Prior research provides divergent predictions but little causal evidence. We conduct an empirical test using longitudinal data from 136 natural experiments where would be contributors to wikis were suddenly required to log in to contribute. Requiring accounts leads to a small increase in account creation, but reduces both high and low quality contributions from registered and unregistered participants. Although the change deters a large portion of low quality participation, the vast majority of deterred contributions are of higher quality. We conclude that requiring accounts introduces an undertheorized tradeoff for public goods production in interactive communication systems.


Case study of SARS CoV 2 transmission risk assessment in indoor environments using cloud computing resources. Complex flow simulations are conventionally performed on HPC clusters. However, the limited availability of HPC resources and steep learning curve of executing on traditional supercomputer infrastructure has drawn attention towards deploying flow simulation software on the cloud. We showcase how a complex computational framework that can evaluate COVID 19 transmission risk in various indoor classroom scenarios can be abstracted and deployed on cloud services. The availability of such cloud based personalized planning tools can enable educational institutions, medical institutions, public sector workers (courthouses, police stations, airports, etc.), and other entities to comprehensively evaluate various in person interaction scenarios for transmission risk. We deploy the simulation framework on the Azure cloud framework, utilizing the Dendro kT mesh generation tool and PETSc solvers. The cloud abstraction is provided by RocketML cloud infrastructure. We compare the performance of the cloud machines with state of the art HPC machine TACC Frontera. Our results suggest that cloud based HPC resources are a viable strategy for a diverse array of end users to rapidly and efficiently deploy simulation software.


MissFormer (In )attention based handling of missing observations for trajectory filtering and prediction. In applications such as object tracking, time series data inevitably carry missing observations. Following the success of deep learning based models for various sequence learning tasks, these models increasingly replace classic approaches in object tracking applications for inferring the objects' motion states. While traditional tracking approaches can deal with missing observations, most of their deep counterparts are, by default, not suited for this. Towards this end, this paper introduces a transformer based approach for handling missing observations in variable input length trajectory data. The model is formed indirectly by successively increasing the complexity of the demanded inference tasks. Starting from reproducing noise free trajectories, the model then learns to infer trajectories from noisy inputs. By providing missing tokens, binary encoded missing events, the model learns to in attend to missing data and infers a complete trajectory conditioned on the remaining inputs. In the case of a sequence of successive missing events, the model then acts as a pure prediction model. The abilities of the approach are demonstrated on synthetic data and real world data reflecting prototypical object tracking scenarios.


Domain Adaptive Learning Based on Sample Dependent and Learnable Kernels. Reproducing Kernel Hilbert Space (RKHS) is the common mathematical platform for various kernel methods in machine learning. The purpose of kernel learning is to learn an appropriate RKHS according to different machine learning scenarios and training samples. Because RKHS is uniquely generated by the kernel function, kernel learning can be regarded as kernel function learning. This paper proposes a Domain Adaptive Learning method based on Sample Dependent and Learnable Kernels (SDLK DAL). The first contribution of our work is to propose a sample dependent and learnable Positive Definite Quadratic Kernel function (PDQK) framework. Unlike learning the exponential parameter of Gaussian kernel function or the coefficient of kernel combinations, the proposed PDQK is a positive definite quadratic function, in which the symmetric positive semi definite matrix is the learnable part in machine learning applications. The second contribution lies on that we apply PDQK to Domain Adaptive Learning (DAL). Our approach learns the PDQK through minimizing the mean discrepancy between the data of source domain and target domain and then transforms the data into an optimized RKHS generated by PDQK. We conduct a series of experiments that the RKHS determined by PDQK replaces those in several state of the art DAL algorithms, and our approach achieves better performance.


Commutative monoid duality. We introduce two partially overlapping classes of pathwise dualities between interacting particle systems that are based on commutative monoids (semigroups with a neutral element) and semirings, respectively. For interacting particle systems whose local state space has two elements, this approach yields a unified treatment of the well known additive and cancellative dualities. For local state spaces with three or more elements, we discover several new dualities.


SLA Driven Load Scheduling in Multi Tier Cloud Computing Financial Impact Considerations. A cloud service provider strives to provide a high Quality of Service (QoS) to client jobs. Such jobs vary in computational and Service Level Agreement (SLA) obligations, as well as differ with respect to tolerating delays and SLA violations. The job scheduling plays a critical role in servicing cloud demands by allocating appropriate resources to execute client jobs. The response to such jobs is optimized by the cloud provider on a multi tier cloud computing environment. Typically, the complex and dynamic nature of multi tier environments incurs difficulties in meeting such demands, because tiers are dependent on each other which in turn makes bottlenecks of a tier shift to escalate in subsequent tiers. However, the optimization process of existing approaches produces single tier driven schedules that do not employ the differential impact of SLA violations in executing client jobs. Furthermore, the impact of schedules optimized at the tier level on the performance of schedules formulated in subsequent tiers tends to be ignored, resulting in a less than optimal performance when measured at the multi tier level. Thus, failing in committing job obligations incurs SLA penalties that often take the form of either financial compensations, or losing future interests and motivations of unsatisfied clients in the service provided. In this paper, a scheduling and allocation approach is proposed to formulate schedules that account for differential impacts of SLA violation penalties and, thus, produce schedules that are optimal in financial performance. A queue virtualization scheme is designed to facilitate the formulation of optimal schedules at the tier and multi tier levels of the cloud environment. Because the scheduling problem is NP hard, a biologically inspired approach is proposed to mitigate the complexity of finding optimal schedules.


Scaling Laws for the Few Shot Adaptation of Pre trained Image Classifiers. Empirical science of neural scaling laws is a rapidly growing area of significant importance to the future of machine learning, particularly in the light of recent breakthroughs achieved by large scale pre trained models such as GPT 3, CLIP and DALL e. Accurately predicting the neural network performance with increasing resources such as data, compute and model size provides a more comprehensive evaluation of different approaches across multiple scales, as opposed to traditional point wise comparisons of fixed size models on fixed size benchmarks, and, most importantly, allows for focus on the best scaling, and thus most promising in the future, approaches. In this work, we consider a challenging problem of few shot learning in image classification, especially when the target data distribution in the few shot phase is different from the source, training, data distribution, in a sense that it includes new image classes not encountered during training. Our current main goal is to investigate how the amount of pre training data affects the few shot generalization performance of standard image classifiers. Our key observations are that (1) such performance improvements are well approximated by power laws (linear log log plots) as the training set size increases, (2) this applies to both cases of target data coming from either the same or from a different domain (i.e., new classes) as the training data, and (3) few shot performance on new classes converges at a faster rate than the standard classification performance on previously seen classes. Our findings shed new light on the relationship between scale and generalization.


Does Pretraining for Summarization Require Knowledge Transfer?. Pretraining techniques leveraging enormous datasets have driven recent advances in text summarization. While folk explanations suggest that knowledge transfer accounts for pretraining's benefits, little is known about why it works or what makes a pretraining task or dataset suitable. In this paper, we challenge the knowledge transfer story, showing that pretraining on documents consisting of character n grams selected at random, we can nearly match the performance of models pretrained on real corpora. This work holds the promise of eliminating upstream corpora, which may alleviate some concerns over offensive language, bias, and copyright issues. To see whether the small residual benefit of using real data could be accounted for by the structure of the pretraining task, we design several tasks motivated by a qualitative study of summarization corpora. However, these tasks confer no appreciable benefit, leaving open the possibility of a small role for knowledge transfer.


Representation theory and the diagonal coinvariant ring of the type B Weyl group. We explain how to use representation theory to give a lower bound on the dimension of the quotient ring by type B n diagonal invariants that improves upon the current known lower bound (2n 1) n by a quadratic polynomial in n .


Comments on Arithmetic Teichmuller Spaces. I provide some comments on Arithmetic Teichmuller Spaces constructed in my paper arXiv 2106.11452.


A Wiener criterion for the fractional Laplacian. We characterize regular boundary points for the fractional Laplace equation ( Delta) su 0 , 0 s 1 , in terms of a Wiener type criterion involving a Besov capacity. The Kellogg property and a decay estimate for the solutions near a regular boundary point are also obtained.


Conceptual Temporal Modeling Applied to Databases. We present a different approach to developing a concept of time for specifying temporality in the conceptual modeling of software and database systems. In the database field, various proposals and products address temporal data. The difficulty with most of the current approaches to modeling temporality is that they represent and record time as just another type of data (e.g., values of a bank balance or amounts of money), instead of appreciating that time and its values are unique, in comparison to typical data attributes. Time is an engulfing phenomenon that lifts a system s entire model from staticity to dynamism and beyond. In this paper, we propose a conceptualization of temporality involving the construction of a multilevel modeling method that progresses from static representation to system compositions that form regions of dynamism. Then, a chronology of events is used to define the system s behavior. Lastly, the events are viewed as data sources with which to build a temporal model. A case study model of a temporal banking management system database that extends UML and the object constraint language is re modeled using thinging machine (TM) modeling. The resultant TM diagrammatic specification delivers a new approach to temporality that can be extended to be a holistic monitoring system for historic data and events.


Accumulative Iterative Codes Based on Feedback. The Accumulative Iterative Code (AIC) proposed in this work is a new error correcting code for channels with feedback. AIC sends the information message to the receiver in a number of transmissions, where the initial transmission contains the uncoded message and each subsequent transmission informs the receiver about the locations of the errors that corrupted the previous transmission. Error locations are determined based on the forward channel output, which is made available to the transmitter through the feedback channel. AIC achieves arbitrarily low error rates, thereby being suitablefor applications demanding extremely high reliability. In the same time, AIC achieves spectral efficiencies very close to the channel capacity in a wide range of signal to noise ratios even for transmission of short information messages.


Cost effective End to end Information Extraction for Semi structured Document Images. A real world information extraction (IE) system for semi structured document images often involves a long pipeline of multiple modules, whose complexity dramatically increases its development and maintenance cost. One can instead consider an end to end model that directly maps the input to the target output and simplify the entire process. However, such generation approach is known to lead to unstable performance if not designed carefully. Here we present our recent effort on transitioning from our existing pipeline based IE system to an end to end system focusing on practical challenges that are associated with replacing and deploying the system in real, large scale production. By carefully formulating document IE as a sequence generation task, we show that a single end to end IE system can be built and still achieve competent performance.


Statistical discrimination in learning agents. Undesired bias afflicts both human and algorithmic decision making, and may be especially prevalent when information processing trade offs incentivize the use of heuristics. One primary example is textit statistical discrimination selecting social partners based not on their underlying attributes, but on readily perceptible characteristics that covary with their suitability for the task at hand. We present a theoretical model to examine how information processing influences statistical discrimination and test its predictions using multi agent reinforcement learning with various agent architectures in a partner choice based social dilemma. As predicted, statistical discrimination emerges in agent policies as a function of both the bias in the training population and of agent architecture. All agents showed substantial statistical discrimination, defaulting to using the readily available correlates instead of the outcome relevant features. We show that less discrimination emerges with agents that use recurrent neural networks, and when their training environment has less bias. However, all agent algorithms we tried still exhibited substantial bias after learning in biased training populations.


MaIL A Unified Mask Image Language Trimodal Network for Referring Image Segmentation. Referring image segmentation is a typical multi modal task, which aims at generating a binary mask for referent described in given language expressions. Prior arts adopt a bimodal solution, taking images and languages as two modalities within an encoder fusion decoder pipeline. However, this pipeline is sub optimal for the target task for two reasons. First, they only fuse high level features produced by uni modal encoders separately, which hinders sufficient cross modal learning. Second, the uni modal encoders are pre trained independently, which brings inconsistency between pre trained uni modal tasks and the target multi modal task. Besides, this pipeline often ignores or makes little use of intuitively beneficial instance level features. To relieve these problems, we propose MaIL, which is a more concise encoder decoder pipeline with a Mask Image Language trimodal encoder. Specifically, MaIL unifies uni modal feature extractors and their fusion model into a deep modality interaction encoder, facilitating sufficient feature interaction across different modalities. Meanwhile, MaIL directly avoids the second limitation since no uni modal encoders are needed anymore. Moreover, for the first time, we propose to introduce instance masks as an additional modality, which explicitly intensifies instance level features and promotes finer segmentation results. The proposed MaIL set a new state of the art on all frequently used referring image segmentation datasets, including RefCOCO, RefCOCO , and G Ref, with significant gains, 3 10 against previous best methods. Code will be released soon.


I. Asynchronous Optimization over weakly Coupled Renewal Systems. A renewal system divides the slotted timeline into back to back time periods called renewal frames. At the beginning of each frame, it chooses a policy from a set of options for that frame. The policy determines the duration of the frame, the penalty incurred during the frame (such as energy expenditure), and a vector of performance metrics (such as instantaneous number of jobs served). The starting points of this line of research are Chapter 7 of the book Nee10a , the seminal work Nee13a , and Chapter 5 of the PhD thesis of Chih ping Li Li11 . These works consider stochastic optimization over a single renewal system. By way of contrast, this thesis considers optimization over multiple parallel renewal systems, which is computationally more challenging and yields much more applications. The goal is to minimize the time average overall penalty subject to time average overall constraints on the corresponding performance metrics. The main difficulty, which is not present in earlier works, is that these systems act asynchronously due to the fact that the renewal frames of different renewal systems are not aligned. The goal of the thesis is to resolve this difficulty head on via a new asynchronous algorithm and a novel supermartingale stopping time analysis which shows our algorithms not only converge to the optimal solution but also enjoy fast convergence rates. Based on this general theory, we further develop novel algorithms for data center server provision problems with performance guarantees as well as new heuristics for the multi user file downloading problems.


Implicit Premise Generation with Discourse aware Commonsense Knowledge Models. Enthymemes are defined as arguments where a premise or conclusion is left implicit. We tackle the task of generating the implicit premise in an enthymeme, which requires not only an understanding of the stated conclusion and premise but also additional inferences that could depend on commonsense knowledge. The largest available dataset for enthymemes (Habernal et al., 2018) consists of 1.7k samples, which is not large enough to train a neural text generation model. To address this issue, we take advantage of a similar task and dataset Abductive reasoning in narrative text (Bhagavatula et al., 2020). However, we show that simply using a state of the art seq2seq model fine tuned on this data might not generate meaningful implicit premises associated with the given enthymemes. We demonstrate that encoding discourse aware commonsense during fine tuning improves the quality of the generated implicit premises and outperforms all other baselines both in automatic and human evaluations on three different datasets.


Quantifying the impact of vibrational nonequilibrium in plasma catalysis Insights from a molecular dynamics model of dissociative chemisorption. The rate, selectivity and efficiency of plasma based conversion processes is strongly affected by nonequilibrium phenomena. High concentrations of vibrationally excited molecules are such a plasma induced effect. It is frequently assumed that vibrationally excited molecules are important in plasma catalysis because their presence lowers the apparent activation energy of dissociative chemisorption reactions and thus increases the conversion rate. A detailed atomic level understanding of vibrationally stimulated catalytic reactions in the context of plasma catalysis is however lacking. Here, we couple a recently developed statistical model of a plasma induced vibrational nonequilibrium to molecular dynamics simulations, enhanced sampling methods, and machine learning techniques. We quantify the impact of a vibrational nonequilibrium on the dissociative chemisorption barrier of H2 and CH4 on nickel catalysts over a wide range of vibrational temperatures. We investigate the effect of surface structure and compare the role of different vibrational modes of methane in the dissociation process. For low vibrational temperatures, very high vibrational efficacies are found, and energy in bend vibrations appears to dominate the dissociation of methane. The relative impact of vibrational nonequilibrium is much higher on terrace sites than on surface steps. We then show how our simulations can help to interpret recent experimental results, and suggest new paths to a better understanding of plasma catalysis.


DenDrift A Drift Aware Algorithm for Host Profiling. Detecting and reacting to unauthorized actions is an essential task in security monitoring. What make this task challenging are the large number and various categories of hosts and processes to monitor. To these we should add the lack of an exact definition of normal behavior for each category. Host profiling using stream clustering algorithms is an effective means of analyzing hosts' behaviors, categorizing them, and identifying atypical ones. However, unforeseen changes in behavioral data (i.e. concept drift) make the obtained profiles unreliable. DenStream is a well known stream clustering algorithm, which can be effectively used for host profiling. This algorithm is an incremental extension of DBSCAN which is a non parametric algorithm widely used in real world clustering applications. Recent experimental studies indicate that DenStream is not robust against concept drift. In this paper, we present DenDrift as a drift aware host profiling algorithm based on DenStream. DenDrift relies on non negative matrix factorization for dimensionality reduction and Page Hinckley test for drift detection. We have done experiments on both synthetic and industrial datasets and the results affirm the robustness of DenDrift against abrupt, gradual and incremental drifts.


Covariance of Error Terms Related to the Dirichlet Eigenvalue Problem. We explore the covariance of error terms coming from Weyl's conjecture regarding the number of Dirichlet eigenvalues up to size X . We also consider this problem in short intervals, i.e. the error term of the number of eigenvalues in the window X, X S for some S(X) . We look at these error terms for planar domains where the Dirichlet eigenvalues can be explicitly calculated. In these cases, the error term is closely related to the error term from the classical lattice points counting problem of expanding planar domains. We give a formula for the covariance of such error terms, for general planar domains. We also give a formula for the covariance of error terms in short intervals, for sufficiently large intervals. Going back to the Dirichlet eigenvalue problem, we give results regarding the covariance of the error terms in short intervals of 'generic' rectangles. We also explore a specific example, namely we compute the covariance between the error terms of an equilateral triangle and various rectangles.


HTF Homogeneous Tree Framework for Differentially Private Release of Location Data. Mobile apps that use location data are pervasive, spanning domains such as transportation, urban planning and healthcare. Important use cases for location data rely on statistical queries, e.g., identifying hotspots where users work and travel. Such queries can be answered efficiently by building histograms. However, precise histograms can expose sensitive details about individual users. Differential privacy (DP) is a mature and widely adopted protection model, but most approaches for DP compliant histograms work in a data independent fashion, leading to poor accuracy. The few proposed data dependent techniques attempt to adjust histogram partitions based on dataset characteristics, but they do not perform well due to the addition of noise required to achieve DP. We identify density homogeneity as a main factor driving the accuracy of DP compliant histograms, and we build a data structure that splits the space such that data density is homogeneous within each resulting partition. We show through extensive experiments on large scale real world data that the proposed approach achieves superior accuracy compared to existing approaches.


A Design and an Implementation of an Inverse Kinematics Computation in Robotics Using Real Quantifier Elimination based on Comprehensive Gr "obner Systems. The solution and implementation of the inverse kinematics computation of a three degree of freedom (DOF) robot manipulator using an algorithm for real quantifier elimination with Comprehensive Gr "obner Systems (CGS) are presented. The method enables us to verify if the given parameters are feasible before solving the inverse kinematics problem. Furthermore, pre computation of CGS and substituting parameters in the CGS with the given values avoids the repetitive computation of Gr "obner basis. Experimental results compared with our previous implementation are shown.


Combination of institutional incentives for cooperative governance of risky commons. Finding appropriate incentives to enforce collaborative efforts for governing the commons in risky situations is a long lasting challenge. Previous works have demonstrated that both punishing free riders and rewarding cooperators could be potential tools to reach this goal. Despite weak theoretical foundations, policy makers frequently impose a punishment reward combination. Here, we consider the emergence of positive and negative incentives and analyze their simultaneous impact on sustaining risky commons. Importantly, we consider institutions with fixed and flexible incentives. We find that a local sanctioning scheme with pure reward is the optimal incentive strategy. It can drive the entire population towards a highly cooperative state in a broad range of parameters, independently of the type of institutions. We show that our finding is also valid for flexible incentives in the global sanctioning scheme, although the local arrangement works more effectively.


Understanding Architecture Erosion The Practitioners' Perceptive. As software systems evolve, their architecture is meant to adapt accordingly by following the changes in requirements, the environment, and the implementation. However, in practice, the evolving system often deviates from the architecture, causing severe consequences to system maintenance and evolution. This phenomenon of architecture erosion has been studied extensively in research, but not yet been examined from the point of view of developers. In this exploratory study, we look into how developers perceive the notion of architecture erosion, its causes and consequences, as well as tools and practices to identify and control architecture erosion. To this end, we searched through several popular online developer communities for collecting data of discussions related to architecture erosion. Besides, we identified developers involved in these discussions and conducted a survey with 10 participants and held interviews with 4 participants. Our findings show that (1) developers either focus on the structural manifestation of architecture erosion or on its effect on run time qualities, maintenance and evolution (2) alongside technical factors, architecture erosion is caused to a large extent by non technical factors (3) despite the lack of dedicated tools for detecting architecture erosion, developers usually identify erosion through a number of symptoms and (4) there are effective measures that can help to alleviate the impact of architecture erosion.


Assessing the impact of social activity permissiveness on the COVID 19 infection curve of several countries. This document aims to estimate and describe the effects of the social distancing measures implemented in several countries with the expectancy of controlling the spread of COVID 19. The procedure relies on the classic Susceptible Infected Removed (SIR) model, which is modified to incorporate a permissiveness index, representing the isolation achieved by the social distancing and the future development of vaccination campaigns and allowing the math model to reproduce more than one infection wave. The adjusted SIR models are used to study the compromise between the economy's reactivation and the resulting infection spreading increase. The document presents a graphical abacus that describes the convenience of progressively relax social distancing measures while a feasible vaccination campaign develops


Motor imagery classification model for brain computer interface a sparse group filter bank representation model. Background Common spatial pattern (CSP) has been widely used for feature extraction in the case of motor imagery (MI) electroencephalogram (EEG) recordings and in MI classification of brain computer interface (BCI) applications. BCI usually requires relatively long EEG data for reliable classifier training. More specifically, before using general spatial patterns for feature extraction, a training dictionary from two different classes is used to construct a compound dictionary matrix, and the representation of the test samples in the filter band is estimated as a linear combination of the columns in the dictionary matrix. New method To alleviate the problem of sparse small sample (SS) between frequency bands. We propose a novel sparse group filter bank model (SGFB) for motor imagery in BCI system. Results We perform a task by representing residuals based on the categories corresponding to the non zero correlation coefficients. Besides, we also perform joint sparse optimization with constrained filter bands in three different time windows to extract robust CSP features in a multi task learning framework. To verify the effectiveness of our model, we conduct an experiment on the public EEG dataset of BCI competition to compare it with other competitive methods. Comparison with existing methods Decent classification performance for different subbands confirms that our algorithm is a promising candidate for improving MI based BCI performance.


Learning to Solve Hard Minimal Problems. We present an approach to solving hard geometric optimization problems in the RANSAC framework. The hard minimal problems arise from relaxing the original geometric optimization problem into a minimal problem with many spurious solutions. Our approach avoids computing large numbers of spurious solutions. We design a learning strategy for selecting a starting problem solution pair that can be numerically continued to the problem and the solution of interest. We demonstrate our approach by developing a RANSAC solver for the problem of computing the relative pose of three calibrated cameras, via a minimal relaxation using four points in each view. On average, we can solve a single problem in under 70 mu s. We also benchmark and study our engineering choices on the very familiar problem of computing the relative pose of two calibrated cameras, via the minimal case of five points in two views.


Finding Nash Equilibria of Two Player Games. This paper is an exposition of algorithms for finding one or all equilibria of a bimatrix game (a two player game in strategic form) in the style of a chapter in a graduate textbook. Using labeled "best response polytopes", we present the Lemke Howson algorithm that finds one equilibrium. We show that the path followed by this algorithm has a direction, and that the endpoints of the path have opposite index, in a canonical way using determinants. For reference, we prove that a number of notions of nondegeneracy of a bimatrix game are equivalent. The computation of all equilibria of a general bimatrix game, via a description of the maximal Nash subsets of the game, is canonically described using "complementary pairs" of faces of the best response polytopes.


Geometrically reduced modelling of pulsatile flow in perivascular networks. Flow of cerebrospinal fluid in perivascular spaces is a key mechanism underlying brain transport and clearance. In this paper, we present a mathematical and numerical formalism for reduced models of pulsatile viscous fluid flow in networks of generalized annular cylinders. We apply this framework to study cerebrospinal fluid flow in perivascular spaces induced by pressure differences, cardiac pulse wave induced vascular wall motion and vasomotion. The reduced models provide approximations of the cross section average pressure and cross section flux, both defined over the topologically one dimensional centerlines of the network geometry. Comparing the full and reduced model predictions, we find that the reduced models capture pulsatile flow characteristics and provide accurate pressure and flux predictions across the range of idealized and image based scenarios investigated at a fraction of the computational cost of the corresponding full models. The framework presented thus provides a robust and effective computational approach for large scale in silico studies of pulsatile perivascular fluid flow and transport.


Combining Machine Learning Classifiers for Stock Trading with Effective Feature Extraction. The unpredictability and volatility of the stock market render it challenging to make a substantial profit using any generalized scheme. This paper intends to discuss our machine learning model, which can make a significant amount of profit in the US stock market by performing live trading in the Quantopian platform while using resources free of cost. Our top approach was to use ensemble learning with four classifiers Gaussian Naive Bayes, Decision Tree, Logistic Regression with L1 regularization and Stochastic Gradient Descent, to decide whether to go long or short on a particular stock. Our best model performed daily trade between July 2011 and January 2019, generating 54.35 profit. Finally, our work showcased that mixtures of weighted classifiers perform better than any individual predictor about making trading decisions in the stock market.


A setup for studies of photoelectron circular dichroism from chiral molecules in aqueous solution. We present a unique experimental design that enables the measurement of photoelectron circular dichroism (PECD) from chiral molecules in aqueous solution. The effect is revealed from the intensity difference of photoelectron emission into a backward scattering angle relative to the photon propagation direction when ionizing with circularly polarized light of different helicity. This leads to asymmetries (normalized intensity differences) that depend on the handedness of the chiral sample and exceed the ones in conventional dichroic mechanisms by orders of magnitude. The asymmetry is largest for photon energies within several electron volts above the ionization threshold. A primary aim is to explore the effect of hydration on PECD. The modular and flexible design of our experimental setup EASI (Electronic structure from Aqueous Solutions and Interfaces) also allows for detection of more common photoelectron angular distributions (PADs), requiring distinctively different detection geometries, and typically using linearly polarized light. A microjet is used for liquid sample delivery. We describe EASI's technical features and present two selected experimental results, one based on synchrotron light measurements and the other performed in the laboratory, using monochromatized He II alpha radiation. The former demonstrates the principal effectiveness of PECD detection, illustrated for prototypic gas phase fenchone. We also discuss the first data from liquid fenchone. In the second example we present valence photoelectron spectra from liquid water and NaI aqueous solution, here obtained from a planar surface microjet (flatjet). This new development features a more favorable symmetry for angle dependent photoelectron measurements.


Policy gradient methods for distortion risk measures. We propose policy gradient algorithms for solving the problem of control in a risk sensitive reinforcement learning context. The objective of our algorithms is to maximize the distortion risk measure (DRM) of the cumulative reward in an episodic Markov decision process. We derive a variant of the policy gradient theorem that caters to the DRM objective. Using this theorem in conjunction with a likelihood ratio based gradient estimation scheme, we propose policy gradient algorithms for optimizing DRM in both on policy and off policy RL settings. We derive non asymptotic bounds that establish the convergence of our algorithms to an approximate stationary point of the DRM objective.


Gromov hyperbolic John is quasihyperbolic John I. In this paper, we introduce a concept of quasihyperbolic John spaces and provide a necessary and sufficient condition for a space to be quasihyperbolic John. Using this criteria, we exhibit a simple proof to show that a John space with a Gromov hyperbolic quasihyperbolization is quasihyperbolic John, quantitatively. This answers affirmatively to an open question proposed by Heinonen (Rev. Math. Iber, 1989), which was studied by Gehring et al. (Math. Scand, 1989). As a tool, we study its connection between several geometric conditions.


BEV MODNet Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving. Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the image plane to top view BEV plane. Such a projection is prone to errors due to lack of depth information and noisy mapping in far away areas. CNNs can leverage the global context in the scene to project better. In this work, we explore end to end Moving Object Detection (MOD) on the BEV map directly using monocular images as input. To the best of our knowledge, such a dataset does not exist and we create an extended KITTI raw dataset consisting of 12.9k images with annotations of moving object masks in BEV space for five classes. The dataset is intended to be used for class agnostic motion cue based object detection and classes are provided as meta data for better tuning. We design and implement a two stream RGB and optical flow fusion architecture which outputs motion segmentation directly in BEV space. We compare it with inverse perspective mapping of state of the art motion segmentation predictions on the image plane. We observe a significant improvement of 13 in mIoU using the simple baseline implementation. This demonstrates the ability to directly learn motion segmentation output in BEV space. Qualitative results of our baseline and the dataset annotations can be found in https sites.google.com view bev modnet.


On the Evaluation of Vision and Language Navigation Instructions. Vision and Language Navigation wayfinding agents can be enhanced by exploiting automatically generated navigation instructions. However, existing instruction generators have not been comprehensively evaluated, and the automatic evaluation metrics used to develop them have not been validated. Using human wayfinders, we show that these generators perform on par with or only slightly better than a template based generator and far worse than human instructors. Furthermore, we discover that BLEU, ROUGE, METEOR and CIDEr are ineffective for evaluating grounded navigation instructions. To improve instruction evaluation, we propose an instruction trajectory compatibility model that operates without reference instructions. Our model shows the highest correlation with human wayfinding outcomes when scoring individual instructions. For ranking instruction generation systems, if reference instructions are available we recommend using SPICE.