The Brinkman viscosity for porous media exposed to a free flow. The Brinkman equation has found great popularity in modelling the interfacial flow between free fluid and a porous medium. However, it is still unclear how to determine an appropriate effective Brinkman viscosity without resolving the flow at the pore scale. Here, we propose to determine the Brinkman viscosity for rough porous media from the interface slip length and the interior permeability. Both slip and permeability can be determined from unit cell analysis, thus enabling an a priori estimate of the effective viscosity. By comparing the velocity distribution in the porous material predicted from the Brinkman equation with that obtained from pore scale resolved simulations, we show that modelling errors are sim 10 and not larger than 40 . We highlight the physical origins of the obtained errors and demonstrate that the Brinkman model can be much more accurate for irregular porous structures.


On Euler number of symplectic hyperbolic manifold. In this article, we introduce a class of closed almost K " a hler manifold X 2n which called the special symplectic hyperbolic manifold. Those manifolds include K " a hler hyperbolic manifolds. We show that the Euler number of a special symplectic manifold satisfies the inequality ( 1) n chi(X) 0 .


Simple Flagellated Soft Robot for Locomotion near Air Fluid Interface. A wide range of microorganisms, e.g. bacteria, propel themselves by rotation of soft helical tails, also known as flagella. Due to the small size of these organisms, viscous forces overwhelm inertial effects and the flow is at low Reynolds number. In this fluid structure problem, a competition between elastic forces and hydrodynamic (viscous) forces leads to a net propulsive force forward. A thorough understanding of this highly coupled fluid structure interaction problem can not only help us better understand biological propulsion but also help us design bio inspired functional robots with applications in oil spill cleanup, water quality monitoring, and infrastructure inspection. Here, we introduce arguably the simplest soft robot with a single binary control signal, which is capable of moving along an arbitrary 2D trajectory near air fluid interface and at the interface between two fluids. The robot exploits the variation in viscosity to move along the prescribed trajectory. Our analysis of this newly introduced soft robot consists of three main components. First, we fabricate this simple robot and use it as an experimental testbed. Second, a discrete differential geometry based modeling framework is used for simulation of the robot. Upon validation of the simulation tool, the third part of this study employs the simulations to develop a control scheme with a single binary input to make the robot follow any prescribed path.


Strong unique continuation and local asymptotics at the boundary for fractional elliptic equations. We study local asymptotics of solutions to fractional elliptic equations at boundary points, under some outer homogeneous Dirichlet boundary condition. Our analysis is based on a blow up procedure which involves some Almgren type monotonicity formulae and provides a classification of all possible homogeneity degrees of limiting entire profiles. As a consequence, we establish a strong unique continuation principle from boundary points.


CoPE Conditional image generation using Polynomial Expansions. Generative modeling has evolved to a notable field of machine learning. Deep polynomial neural networks (PNNs) have demonstrated impressive results in unsupervised image generation, where the task is to map an input vector (i.e., noise) to a synthesized image. However, the success of PNNs has not been replicated in conditional generation tasks, such as super resolution. Existing PNNs focus on single variable polynomial expansions which do not fare well to two variable inputs, i.e., the noise variable and the conditional variable. In this work, we introduce a general framework, called CoPE, that enables a polynomial expansion of two input variables and captures their auto and cross correlations. We exhibit how CoPE can be trivially augmented to accept an arbitrary number of input variables. CoPE is evaluated in five tasks (class conditional generation, inverse problems, edges to image translation, image to image translation, attribute guided generation) involving eight datasets. The thorough evaluation suggests that CoPE can be useful for tackling diverse conditional generation tasks. The source code of CoPE is available at url https github.com grigorisg9gr polynomial nets for conditional generation .


Low Emittance Positron Beam Generation A Comparison Between Photo production and Electro Production. Positron beams, both polarized and non polarized, low and high energy have a wide range of applications and many methods can be used to produce them. In this paper we analyse the two main methods used to produce positrons for accelerator applications, the "traditional" electro production and the more recent "photo production". After having determined the best target material, the positron production yield is determined for various target thickness and primary beam energy. Production efficiency up to about 7.6 and 200 are achievable for photo production and electro production respectively. Then the quality, i.e. the emittance and the normalized emittance of the produced beam is evaluated the proposed "Gruber" correction for calculating the normalized emittance is considered too. The brightness of the obtained beams is calculated, relating it to the intrinsic temporal lengthening of the positron beam. The time structure of the primary beam is preserved for long bunches down to the ps scale. A very preliminary evaluation of the energy deposition in the target and its effect is done. The polarization is not take, so far, into account.


Mapping the impact of papers on various status groups A new excellence mapping tool based on citation and reader scores. In over five years, Bornmann, Stefaner, de Moya Anegon, and Mutz (2014) and Bornmann, Stefaner, de Moya Anegon, and Mutz (2014, 2015) have published several releases of the www.excellencemapping.net tool revealing (clusters of) excellent institutions worldwide based on citation data. With the new release, a completely revised tool has been published. It is not only based on citation data (bibliometrics), but also Mendeley data (altmetrics). Thus, the institutional impact measurement of the tool has been expanded by focusing on additional status groups besides researchers such as students and librarians. Furthermore, the visualization of the data has been completely updated by improving the operability for the user and including new features such as institutional profile pages. In this paper, we describe the datasets for the current excellencemapping.net tool and the indicators applied. Furthermore, the underlying statistics for the tool and the use of the web application are explained.


Graph based Heuristic Solution for Placing Distributed Video Processing Applications on Moving Vehicle Clusters. Vehicular fog computing (VFC) is envisioned as an extension of cloud and mobile edge computing to utilize the rich sensing and processing resources available in vehicles. We focus on slow moving cars that spend a significant time in urban traffic congestion as a potential pool of on board sensors, video cameras, and processing capacity. For leveraging the dynamic network and processing resources, we utilize a stochastic mobility model to select nodes with similar mobility patterns. We then design two distributed applications that are scaled in real time and placed as multiple instances on selected vehicular fog nodes. We handle the unstable vehicular environment by a), Using real vehicle density data to build a realistic mobility model that helps in selecting nodes for service deployment b), Using community detection algorithms for selecting a robust vehicular cluster using the predicted mobility behavior of vehicles. The stability of the chosen cluster is validated using a graph centrality measure, and c), Graph based placement heuristics are developed to find the optimal placement of service graphs based on a multi objective constrained optimization problem with the objective of efficient resource utilization. The heuristic solves an important problem of processing data generated from distributed devices by balancing the trade off between increasing the number of service instances to have enough redundancy of processing instances to increase resilience in the service in case of node or link failure, versus reducing their number to minimise resource usage. We compare our heuristic to an integer linear program solution and a first fit heuristic. Our approach performs better than these comparable schemes in terms of resource utilization and or has a lesser service latency, which is a crucial requirement for safety related applications.


On the approximation exponents for subspaces of mathbb R n . This paper follows the generalisation of the classical theory of Diophantine approximation to subspaces of mathbb R n established by W. M. Schmidt in 1967. Let A and B be two subspaces of mathbb R n of respective dimensions d and e with d e leqslant n . The proximity between A and B is measured by t min(d,e) canonical angles 0 leqslant theta 1 leqslant cdots leqslant theta t leqslant pi 2 we set psi j(A,B) sin theta j . If B is a rational subspace, his complexity is measured by its height H(B) mathrm covol (B cap mathbb Z n) . We denote by mu n(A vert e) j the exponent of approximation defined as the upper bound (possibly equal to infty ) of the set of beta 0 such that the inequality psi j(A,B) leqslant H(B) beta holds for infinitely many rational subspaces B of dimension e . We are interested in the minimal value mathring mu n(d vert e) j taken by mu n(A vert e) j when A ranges through the set of subspaces of dimension d of mathbb R n such that for all rational subspaces B of dimension e one has dim (A cap B) j . We show that mathring mu 4(2 vert 2) 1 3 , mathring mu 5(3 vert 2) 1 le 6 and mathring mu 2d (d vert ell) 1 leqslant 2d 2 (2d ell) . We also prove a lower bound in the general case, which implies that mathring mu n(d vert d) d xrightarrow n to infty 1 d .


Uncertainty principles for the windowed Opdam Cherednik transform. In this paper, we study a few versions of the uncertainty principle for the windowed Opdam Cherednik transform. In particular, we establish the uncertainty principle for orthonormal sequences, Donoho Stark's uncertainty principle, Benedicks type uncertainty principle, Heisenberg type uncertainty principle and local uncertainty inequality for this transform. We also obtain the Heisenberg type uncertainty inequality using the k entropy of the windowed Opdam Cherednik transform.


Two sided boundary points of Sobolev extension domains on Euclidean spaces. We prove an estimate on the Hausdorff dimension of the set of two sided boundary points of general Sobolev extension domains on Euclidean spaces. We also present examples showing lower bounds on possible dimension estimates of this type.


On duoidal infty categories. A duoidal category is a category equipped with two monoidal structures in which one is (op)lax monoidal with respect to the other. In this paper we introduce duoidal infty categories which are counterparts of duoidal categories in the setting of infty categories. There are three kinds of functors between duoidal infty categories, which are called bilax, double lax, and double oplax monoidal functors. We make three formulations of infty categories of duoidal infty categories according to which functors we take. Furthermore, corresponding to the three kinds of functors, we define bimonoids, double monoids, and double comonoids in duoidal infty categories.


On the geometric fixed points of real topological cyclic homology. We give a formula for the geometric fixed points spectrum of the real topological cyclic homology of a bounded below ring spectrum, as an equaliser of two maps between tensor products of modules over the norm. We then use this formula to carry out computations in the fundamental examples of spherical group rings, perfect mathbb F p algebras, and 2 torsion free rings with perfect modulo 2 reduction. Our calculations agree with the normal L theory spectrum in the cases where the latter is known, as conjectured by Nikolaus.


The Connection between Process Complexity of Event Sequences and Models discovered by Process Mining. Process mining is a research area focusing on the design of algorithms that can automatically provide insights into business processes. Among the most popular algorithms are those for automated process discovery, which have the ultimate goal to generate a process model that summarizes the behavior recorded in an event log. Past research had the aim to improve process discovery algorithms irrespective of the characteristics of the input log. In this paper, we take a step back and investigate the connection between measures capturing characteristics of the input event log and the quality of the discovered process models. To this end, we review the state of the art process complexity measures, propose a new process complexity measure based on graph entropy, and analyze this set of complexity measures on an extensive collection of event logs and corresponding automatically discovered process models. Our analysis shows that many process complexity measures correlate with the quality of the discovered process models, demonstrating the potential of using complexity measures as predictors of process model quality. This finding is important for process mining research, as it highlights that not only algorithms, but also connections between input data and output quality should be studied.


Residuation for Soft Constraints Lexicographic Orders and Approximation Techniques. Residuation theory concerns the study of partially ordered algebraic structures, most often monoids, equipped with a weak inverse for the monoidal operator. One of its area of application has been constraint programming, whose key requirement is the presence of an aggregator operator for combining preferences. Given a residuated monoid of preferences, the paper first shows how to build a new residuated monoid of (possibly infinite) tuples, which is based on the lexicographic order. Second, it introduces a variant of an approximation technique (known as Mini bucket) that exploits the presence of the weak inverse.


EM WaveHoltz A flexible frequency domain method built from time domain solvers. A novel approach to computing time harmonic solutions of Maxwell's equations by time domain simulations is presented. The method, EM WaveHoltz, results in a positive definite system of equations which makes it amenable to iterative solution with the conjugate gradient method or with GMRES. Theoretical results guaranteeing the convergence of the method away from resonances is presented. Numerical examples illustrating the properties of EM WaveHoltz are given.


Multi modal Graph Learning for Disease Prediction. Benefiting from the powerful expressive capability of graphs, graph based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually based on meta features, and then obtain the node embeddings for downstream tasks by Graph Representation Learning (GRL). However, it is not easy for these approaches to generalize to unseen samples. Meanwhile, the complex correlation between modalities is also ignored. As a result, these factors inevitably yield the inadequacy of providing valid information about the patient's condition for a reliable diagnosis. In this paper, we propose an end to end Multimodal Graph Learning framework (MMGL) for disease prediction. To effectively exploit the rich information across multi modality associated with diseases, amodal attentional multi modal fusion is proposed to integrate the features of each modality by leveraging the correlation and complementarity between the modalities. Furthermore, instead of defining the adjacency matrix manually as existing methods, the latent graph structure can be captured through a novel way of adaptive graph learning. It could be jointly optimized with the prediction model, thus revealing the intrinsic connections among samples. Unlike the previous transductive methods, our model is also applicable to the scenario of inductive learning for those unseen data. An extensive group of experiments on two disease prediction problems is then carefully designed and presented, demonstrating that MMGL obtains more favorable performances. In addition, we also visualize and analyze the learned graph structure to provide more reliable decision support for doctors in real medical applications and inspiration for disease research.


Learning Relation Alignment for Calibrated Cross modal Retrieval. Despite the achievements of large scale multimodal pre training approaches, cross modal retrieval, e.g., image text retrieval, remains a challenging task. To bridge the semantic gap between the two modalities, previous studies mainly focus on word region alignment at the object level, lacking the matching between the linguistic relation among the words and the visual relation among the regions. The neglect of such relation consistency impairs the contextualized representation of image text pairs and hinders the model performance and the interpretability. In this paper, we first propose a novel metric, Intra modal Self attention Distance (ISD), to quantify the relation consistency by measuring the semantic distance between linguistic and visual relations. In response, we present Inter modal Alignment on Intra modal Self attentions (IAIS), a regularized training method to optimize the ISD and calibrate intra modal self attentions from the two modalities mutually via inter modal alignment. The IAIS regularizer boosts the performance of prevailing models on Flickr30k and MS COCO datasets by a considerable margin, which demonstrates the superiority of our approach.


SS BERT Mitigating Identity Terms Bias in Toxic Comment Classification by Utilising the Notion of "Subjectivity" and "Identity Terms". Toxic comment classification models are often found biased toward identity terms which are terms characterizing a specific group of people such as "Muslim" and "black". Such bias is commonly reflected in false positive predictions, i.e. non toxic comments with identity terms. In this work, we propose a novel approach to tackle such bias in toxic comment classification, leveraging the notion of subjectivity level of a comment and the presence of identity terms. We hypothesize that when a comment is made about a group of people that is characterized by an identity term, the likelihood of that comment being toxic is associated with the subjectivity level of the comment, i.e. the extent to which the comment conveys personal feelings and opinions. Building upon the BERT model, we propose a new structure that is able to leverage these features, and thoroughly evaluate our model on 4 datasets of varying sizes and representing different social media platforms. The results show that our model can consistently outperform BERT and a SOTA model devised to address identity term bias in a different way, with a maximum improvement in F1 of 2.43 and 1.91 respectively.


The theoretical and practical foundations of strong earthquake predictability. This paper provides theoretical and practical arguments regarding the possibility of predicting strong and major earthquakes worldwide. Many strong and major earthquakes can be predicted at least two to five months in advance, based on identifying stressed areas that begin to behave abnormally before strong events, with the size of these areas corresponding to Dobrovolsky formula. We make predictions by combining knowledge from many different disciplines physics, geophysics, seismology, geology, and earth science, among others. An integrated approach is used to identify anomalies and make predictions, including satellite remote sensing techniques and data from ground based instruments. Terabytes of information are currently processed every day with many different multi parametric prediction systems applied thereto. Alerts are issued if anomalies are confirmed by a few different systems. It has been found that geophysical patterns of earthquake preparation and stress accumulation are similar for all key seismic regions. The same earthquake prediction methodologies and systems have been successfully applied in global practice since 2013, with the technology successfully used to retrospectively test against more than 700 strong and major earthquakes since 1970.


Using Deep Learning to Identify Patients with Cognitive Impairment in Electronic Health Records. Dementia is a neurodegenerative disorder that causes cognitive decline and affects more than 50 million people worldwide. Dementia is under diagnosed by healthcare professionals only one in four people who suffer from dementia are diagnosed. Even when a diagnosis is made, it may not be entered as a structured International Classification of Diseases (ICD) diagnosis code in a patient's charts. Information relevant to cognitive impairment (CI) is often found within electronic health records (EHR), but manual review of clinician notes by experts is both time consuming and often prone to errors. Automated mining of these notes presents an opportunity to label patients with cognitive impairment in EHR data. We developed natural language processing (NLP) tools to identify patients with cognitive impairment and demonstrate that linguistic context enhances performance for the cognitive impairment classification task. We fine tuned our attention based deep learning model, which can learn from complex language structures, and substantially improved accuracy (0.93) relative to a baseline NLP model (0.84). Further, we show that deep learning NLP can successfully identify dementia patients without dementia related ICD codes or medications.


Irreversibility of Structure Tensors of Modules. Determining the matrix multiplication exponent omega is one of the greatest open problems in theoretical computer science. We show that it is impossible to prove omega 2 by starting with structure tensors of modules of fixed degree and using arbitrary restrictions. It implies that the same is impossible by starting with 1 A generic non diagonal tensors of fixed size with minimal border rank. This generalizes the work of Bl "aser and Lysikov 3 . Our methods come from both commutative algebra and complexity theory.


FNetAR Mixing Tokens with Autoregressive Fourier Transforms. In this note we examine the autoregressive generalization of the FNet algorithm, in which self attention layers from the standard Transformer architecture are substituted with a trivial sparse uniformsampling procedure based on Fourier transforms. Using the Wikitext 103 benchmark, we demonstratethat FNetAR retains state of the art performance (25.8 ppl) on the task of causal language modelingcompared to a Transformer XL baseline (24.2 ppl) with only half the number self attention layers,thus providing further evidence for the superfluity of deep neural networks with heavily compoundedattention mechanisms. The autoregressive Fourier transform could likely be used for parameterreduction on most Transformer based time series prediction models.


The Log Moment formula for implied volatility. We revisit the foundational Moment Formula proved by Roger Lee fifteen years ago. We show that when the underlying stock price martingale admits finite log moments E log(S) q for some positive q, the arbitrage free growth in the left wing of the implied volatility smile is less constrained than Lee's bound. The result is rationalised by a market trading discretely monitored variance swaps wherein the payoff is a function of squared log returns, and requires no assumption for the underlying martingale to admit any negative moment. In this respect, the result can derived from a model independent setup. As a byproduct, we relax the moment assumptions on the stock price to provide a new proof of the notorious Gatheral Fukasawa formula expressing variance swaps in terms of the implied volatility.


MLIM Vision and Language Model Pre training with Masked Language and Image Modeling. Vision and Language Pre training (VLP) improves model performance for downstream tasks that require image and text inputs. Current VLP approaches differ on (i) model architecture (especially image embedders), (ii) loss functions, and (iii) masking policies. Image embedders are either deep models like ResNet or linear projections that directly feed image pixels into the transformer. Typically, in addition to the Masked Language Modeling (MLM) loss, alignment based objectives are used for cross modality interaction, and RoI feature regression and classification tasks for Masked Image Region Modeling (MIRM). Both alignment and MIRM objectives mostly do not have ground truth. Alignment based objectives require pairings of image and text and heuristic objective functions. MIRM relies on object detectors. Masking policies either do not take advantage of multi modality or are strictly coupled with alignments generated by other models. In this paper, we present Masked Language and Image Modeling (MLIM) for VLP. MLIM uses two loss functions Masked Language Modeling (MLM) loss and image reconstruction (RECON) loss. We propose Modality Aware Masking (MAM) to boost cross modality interaction and take advantage of MLM and RECON losses that separately capture text and image reconstruction quality. Using MLM RECON tasks coupled with MAM, we present a simplified VLP methodology and show that it has better downstream task performance on a proprietary e commerce multi modal dataset.


CINS Comprehensive Instruction for Few shot Learning in Task oriented Dialog Systems. As labeling cost for different modules in task oriented dialog (ToD) systems is high, a major challenge in practice is to learn different tasks with the least amount of labeled data. Recently, prompting methods over pre trained language models (PLMs) have shown promising results for few shot learning in ToD. To better utilize the power of PLMs, this paper proposes Comprehensive Instruction (CINS) that exploits PLMs with extra task specific instructions. We design a schema (definition, constraint, prompt) of instructions and their customized realizations for three important downstream tasks in ToD, i.e. intent classification, dialog state tracking, and natural language generation. A sequence to sequence model (T5) is adopted to solve these three tasks in a unified framework. Extensive experiments are conducted on these ToD tasks in realistic few shot learning scenarios with small validation data. Empirical results demonstrate that the proposed CINS approach consistently improves techniques that finetune PLMs with raw input or short prompts.


FGOT Graph Distances based on Filters and Optimal Transport. Graph comparison deals with identifying similarities and dissimilarities between graphs. A major obstacle is the unknown alignment of graphs, as well as the lack of accurate and inexpensive comparison metrics. In this work we introduce the filter graph distance. It is an optimal transport based distance which drives graph comparison through the probability distribution of filtered graph signals. This creates a highly flexible distance, capable of prioritising different spectral information in observed graphs, offering a wide range of choices for a comparison metric. We tackle the problem of graph alignment by computing graph permutations that minimise our new filter distances, which implicitly solves the graph comparison problem. We then propose a new approximate cost function that circumvents many computational difficulties inherent to graph comparison and permits the exploitation of fast algorithms such as mirror gradient descent, without grossly sacrificing the performance. We finally propose a novel algorithm derived from a stochastic version of mirror gradient descent, which accommodates the non convexity of the alignment problem, offering a good trade off between performance accuracy and speed. The experiments on graph alignment and classification show that the flexibility gained through filter graph distances can have a significant impact on performance, while the difference in speed offered by the approximation cost makes the framework applicable in practical settings.


Encoding multitype Galton Watson forests and a multitype Ray Knight theorem. We provide a simple forest model to encode the genealogical structure of a multitype Galton Watson process with immigration. We provide two encodings of these forests by stochastic processes. We show, under appropriate conditions, the depth first encodings of each particular type converge to a solution to a system of stochastic integral equations involving height processes perturbed by functionals of their local times. The forest picture allows us to extend the Ray Knight theorem and show that local time of the solution to the system of equations form a multitype continuous state branching process with immigration. These assumptions underlying our weak convergence arguments are easily seen to be met in the Brownian setting, and more generally an alpha stable setting for any alpha in(1,2 .


Spectral flow inside essential spectrum IV F F is a regular direction. Let H 0 and V be self adjoint operators such that V admits a factorisation V F JF with bounded self adjoint J and H 0 1 2 compact F. Flow of singular spectrum of the path of self adjoint operators H 0 rV, r in mathbb R, also called spectral flow, through a point lambda outside the essential spectrum of H 0 is well studied, and appears in such diverse areas as differential geometry and condensed matter physics. Inside the essential spectrum the spectral flow through lambda for such a path is well defined if the norm limit lim y to 0 F (H 0 r V lambda iy) 1 F exists for at least one value of the coupling variable r in mathbb R . This raises the question given a self adjoint operator H 0 and H 0 1 2 compact operator F, for which real numbers lambda there exists a bounded self adjoint operator J such that the limit above exists? Real numbers lambda for which this statement is true we call semi regular and the operator V F JF we call a regular direction for H 0 at lambda. In this paper we prove that lambda is semi regular for H 0 if and only if the direction F F is regular.


Singularities Almost Always Scatter Regularity Results for Non scattering Inhomogeneities. In this paper we examine necessary conditions for an inhomogeneity to be non scattering, or equivalently, by negation, sufficient conditions for it to be scattering. These conditions are formulated in terms of the regularity of the boundary of the inhomogeneity. We examine broad classes of incident waves in both two and three dimensions. Our analysis is greatly influenced by the analysis carried out by Williams 28 in order to establish that a domain, which does not possess the Pompeiu Property, has a real analytic boundary. That analysis, as well as ours, relies crucially on classical free boundary regularity results due to Kinderlehrer and Nirenberg 18 , and Caffarelli 6 .


Macroscopic turbulent flow via hard sphere potential. In recent works, we proposed a hypothesis that the turbulence in gases could be produced by particles interacting via a potential, and examined the proposed mechanics of turbulence formation in a simple model of two particles for a variety of different potentials. In this work, we use the same hypothesis to develop new fluid mechanics equations which model turbulent gas flow on a macroscopic scale. The main difference between our approach and the conventional formalism is that we avoid replacing the potential interaction between particles with the Boltzmann collision integral. Due to this difference, the velocity moment closure, which we implement for the shear stress and heat flux, relies upon the high Reynolds number condition, rather than the Newton law of viscosity and the Fourier law of heat conduction. The resulting system of equations of fluid mechanics differs considerably from the standard Euler and Navier Stokes equations. A numerical simulation of our system shows that a laminar Bernoulli jet of an argon like hard sphere gas in a straight pipe rapidly becomes a turbulent flow. The time averaged Fourier spectra of the kinetic energy of this flow exhibit Kolmogorov's negative five thirds power decay rate.


COMPRA A COMPact Reactive Autonomy framework for subterranean MAV based search and rescue operations. This work establishes COMPRA, a compact and reactive autonomy framework for fast deployment of Micro Aerial Vehicles (MAVs) in subterranean Search and Rescue (SAR) missions. A COMPRA enabled MAV is able to autonomously explore previously unknown areas while specific mission criteria are considered e.g. an object of interest is identified and localized, the remaining useful battery life, the overall desired exploration mission duration. The proposed architecture follows a low complexity algorithmic design to facilitate fully on board computations, including nonlinear control, state estimation, navigation, exploration behavior and object localization capabilities. The framework is mainly structured around a reactive local avoidance planner, based on enhanced Potential Field concepts and using instantaneous 3D pointclouds, as well as a computationally efficient heading regulation technique, based on depth images from an instantaneous camera stream. Those techniques decouple the collision free path generation from the dependency of a global map and are capable of handling imprecise localization occasions. Field experimental verification of the overall architecture is performed in relevant unknown Global Positioning System (GPS) denied environments.


Real time Human Response Prediction Using a Non intrusive Data driven Model Reduction Scheme. Recent research in non intrusive data driven model order reduction (MOR) enabled accurate and efficient approximation of parameterized ordinary differential equations (ODEs). However, previous studies have focused on constant parameters, whereas time dependent parameters have been neglected. The purpose of this paper is to introduce a novel two step MOR scheme to tackle this issue. In a first step, classic MOR approaches are applied to calculate a low dimensional representation of high dimensional ODE solutions, i.e. to extract the most important features of simulation data. Based on this representation, a long short term memory (LSTM) is trained to predict the reduced dynamics iteratively in a second step. This enables the parameters to be taken into account during the respective time step. The potential of this approach is demonstrated on an occupant model within a car driving scenario. The reduced model's response to time varying accelerations matches the reference data with high accuracy for a limited amount of time. Furthermore, real time capability is achieved. Accordingly, it is concluded that the presented method is well suited to approximate parameterized ODEs and can handle time dependent parameters in contrast to common methods.


Task Offloading and Resource Allocation with Multiple CAPs and Selfish Users. In this work, we consider a multi user mobile edge computing system with multiple computing access points (CAPs). Each mobile user has multiple dependent tasks that must be processed in a round by round schedule. In every round, a user may process their individual task locally, or choose to offload their task to one of the M CAPs or the remote cloud server, in order to possibly reduce their processing cost. We aim to jointly optimize the offloading decisions of the users and the resource allocation decisions for each CAP over a global objective function, defined as a weighted sum of total energy consumption and the round time. We first present a centralized heuristic solution, termed MCAP, where the original problem is relaxed to a semi definite program (SDP) to probabilistically generate the offloading decision. Then, recognizing that the users often exhibit selfish behavior to reduce their individual cost, we propose a game theoretical approach, termed MCAP NE, which allows us to compute a Nash Equilibrium (NE) through a finite improvement method starting from the previous SDP solution. This approach leads to a solution from which the users have no incentive to deviate, with substantially reduced NE computation time. In simulation, we compare the system cost of the NE solution with those of MCAP, MCAP NE, a random mapping, and the optimal solution, showing that our NE solution attains near optimal performance under a wide set of parameter settings, as well as demonstrating the advantages of using MCAP to produce the initial point for MCAP NE.


Adversarial for Good? How the Adversarial ML Community's Values Impede Socially Beneficial Uses of Attacks. Attacks from adversarial machine learning (ML) have the potential to be used "for good" they can be used to run counter to the existing power structures within ML, creating breathing space for those who would otherwise be the targets of surveillance and control. But most research on adversarial ML has not engaged in developing tools for resistance against ML systems. Why? In this paper, we review the broader impact statements that adversarial ML researchers wrote as part of their NeurIPS 2020 papers and assess the assumptions that authors have about the goals of their work. We also collect information about how authors view their work's impact more generally. We find that most adversarial ML researchers at NeurIPS hold two fundamental assumptions that will make it difficult for them to consider socially beneficial uses of attacks (1) it is desirable to make systems robust, independent of context, and (2) attackers of systems are normatively bad and defenders of systems are normatively good. That is, despite their expressed and supposed neutrality, most adversarial ML researchers believe that the goal of their work is to secure systems, making it difficult to conceptualize and build tools for disrupting the status quo.


Fourier transforms of some special functions in terms of orthogonal polynomials on the simplex and continuous Hahn polynomials. In this paper Fourier transform of multivariate orthogonal polynomials on the simplex is presented. A new family of multivariate orthogonal functions is obtained by using the Parseval's identity and several recurrence relations are derived.


Semi Supervised Segmentation of Concrete Aggregate Using Consensus Regularisation and Prior Guidance. In order to leverage and profit from unlabelled data, semi supervised frameworks for semantic segmentation based on consistency training have been proven to be powerful tools to significantly improve the performance of purely supervised segmentation learning. However, the consensus principle behind consistency training has at least one drawback, which we identify in this paper imbalanced label distributions within the data. To overcome the limitations of standard consistency training, we propose a novel semi supervised framework for semantic segmentation, introducing additional losses based on prior knowledge. Specifically, we propose a light weight architecture consisting of a shared encoder and a main decoder, which is trained in a supervised manner. An auxiliary decoder is added as additional branch in order to make use of unlabelled data based on consensus training, and we add additional constraints derived from prior information on the class distribution and on auto encoder regularisation. Experiments performed on our "concrete aggregate dataset" presented in this paper demonstrate the effectiveness of the proposed approach, outperforming the segmentation results achieved by purely supervised segmentation and standard consistency training.


Examples of non K "ahler Calabi Yau manifolds with arbitrarily large b 2 . We construct non K "ahler Calabi Yau manifolds of dimension ge 4 with arbitrarily large 2nd Betti numbers by smoothing normal crossing varieties. The examples have K3 fibrations over smooth projective varieties and their algebraic dimensions are of codimension 2.


Performance Analysis and Optimization Opportunities for NVIDIA Automotive GPUs. Advanced Driver Assistance Systems (ADAS) and Autonomous Driving (AD) bring unprecedented performance requirements for automotive systems. Graphic Processing Unit (GPU) based platforms have been deployed with the aim of meeting these requirements, being NVIDIA Jetson TX2 and its high performance successor, NVIDIA AGX Xavier, relevant representatives. However, to what extent high performance GPU configurations are appropriate for ADAS and AD workloads remains as an open question. This paper analyzes this concern and provides valuable insights on this question by modeling two recent automotive NVIDIA GPU based platforms, namely TX2 and AGX Xavier. In particular, our work assesses their microarchitectural parameters against relevant benchmarks, identifying GPU setups delivering increased performance within a similar cost envelope, or decreasing hardware costs while preserving original performance levels. Overall, our analysis identifies opportunities for the optimization of automotive GPUs to further increase system efficiency.


A Review of SHACL From Data Validation to Schema Reasoning for RDF Graphs. We present an introduction and a review of the Shapes Constraint Language (SHACL), the W3C recommendation language for validating RDF data. A SHACL document describes a set of constraints on RDF nodes, and a graph is valid with respect to the document if its nodes satisfy these constraints. We revisit the basic concepts of the language, its constructs and components and their interaction. We review the different formal frameworks used to study this language and the different semantics proposed. We examine a number of related problems, from containment and satisfiability to the interaction of SHACL with inference rules, and exhibit how different modellings of the language are useful for different problems. We also cover practical aspects of SHACL, discussing its implementations and state of adoption, to present a holistic review useful to practitioners and theoreticians alike.


The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware. The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large scale integrated (VLSI) circuits capable of fast, low power information processing. However, it has been argued that most modern machine learning algorithms are not neurophysiologically plausible. In particular, the workhorse of modern deep learning, the backpropagation algorithm, has proven difficult to translate to neuromorphic hardware. In this study, we present a neuromorphic, spiking backpropagation algorithm based on synfire gated dynamical information coordination and processing, implemented on Intel's Loihi neuromorphic research processor. We demonstrate a proof of principle three layer circuit that learns to classify digits from the MNIST dataset. To our knowledge, this is the first work to show a Spiking Neural Network (SNN) implementation of the backpropagation algorithm that is fully on chip, without a computer in the loop. It is competitive in accuracy with off chip trained SNNs and achieves an energy delay product suitable for edge computing. This implementation shows a path for using in memory, massively parallel neuromorphic processors for low power, low latency implementation of modern deep learning applications.


Fractionally Log Concave and Sector Stable Polynomials Counting Planar Matchings and More. We show fully polynomial time randomized approximation schemes (FPRAS) for counting matchings of a given size, or more generally sampling counting monomer dimer systems in planar, not necessarily bipartite, graphs. While perfect matchings on planar graphs can be counted exactly in polynomial time, counting non perfect matchings was shown by Jer87 to be P hard, who also raised the question of whether efficient approximate counting is possible. We answer this affirmatively by showing that the multi site Glauber dynamics on the set of monomers in a monomer dimer system always mixes rapidly, and that this dynamics can be implemented efficiently on downward closed families of graphs where counting perfect matchings is tractable. As further applications of our results, we show how to sample efficiently using multi site Glauber dynamics from partition constrained strongly Rayleigh distributions, and nonsymmetric determinantal point processes. In order to analyze mixing properties of the multi site Glauber dynamics, we establish two notions for generating polynomials of discrete set valued distributions sector stability and fractional log concavity. These notions generalize well studied properties like real stability and log concavity, but unlike them robustly degrade under useful transformations applied to the distribution. We relate these notions to pairwise correlations in the underlying distribution and the notion of spectral independence introduced by ALO20 , providing a new tool for establishing spectral independence based on geometry of polynomials. As a byproduct of our techniques, we show that polynomials avoiding roots in a sector of the complex plane must satisfy what we call fractional log concavity this extends a classic result established by Gar59 who showed homogeneous polynomials that have no roots in a half plane must be log concave over the positive orthant.


Heat kernel estimates for subordinate Markov processes and their applications. In this paper, we establish sharp two sided estimates for transition densities of a large class of subordinate Markov processes. As applications, we show that the parabolic Harnack inequality and H "older regularity hold for parabolic functions of such processes, and derive sharp two sided Green function estimates.


Two phase gravity currents in layered porous media. We examine the effects of horizontally layered heterogeneities on the spreading of two phase gravity currents in a porous medium, with application to numerous environmental flows, most notably geological carbon sequestration. Geological heterogeneities, which are omnipresent within all reservoirs, affect the large scale propagation of such flows through the action of small scale capillary forces, yet the relationship between these small and large scales is poorly understood. Here, we derive a simple upscaled model for a gravity current under an impermeable cap rock, which we use to investigate the effect of a wide range of heterogeneities on the macroscopic flow. By parameterising in terms of different types of archetypal layering, we assess the sensitivity of the gravity current to the distribution and magnitude of these heterogeneities. Furthermore, since field measurements of heterogeneities are often sparse or incomplete, we quantify how uncertainty in such measurements is manifest as uncertainty in the macroscale flow predictions. Finally we apply our model to the Sleipner case study in the North Sea, positing how heterogeneities may have played a role in the observed migration of CO2.


Codegrees of primitive characters of solvable groups. We obtain the codegree of a certain primitive character for a finite solvable group, and thereby give a negative answer to a question proposed by Moret 'o in cite Moreto .


Coronary Plaque Analysis for CT Angiography Clinical Research. The analysis of plaque deposits in the coronary vasculature is an important topic in current clinical research. From a technical side mostly new algorithms for different sub tasks e.g. centerline extraction or vessel plaque segmentation are proposed. However, to enable clinical research with the help of these algorithms, a software solution, which enables manual correction, comprehensive visual feedback and tissue analysis capabilities, is needed. Therefore, we want to present such an integrated software solution. It is able to perform robust automatic centerline extraction and inner and outer vessel wall segmentation, while providing easy to use manual correction tools. Also, it allows for annotation of lesions along the centerlines, which can be further analyzed regarding their tissue composition. Furthermore, it enables research in upcoming technologies and research directions it does support dual energy CT scans with dedicated plaque analysis and the quantification of the fatty tissue surrounding the vasculature, also in automated set ups.


Osmotic transport at the aqueous graphene and hBN interfaces scaling laws from a unified, first principles description. Osmotic transport in nanoconfined aqueous electrolytes provides new venues for water desalination and "blue energy" harvesting the osmotic response of nanofluidic systems is controlled by the interfacial structure of water and electrolyte solutions in the so called electrical double layer (EDL), but a molecular level picture of the EDL is to a large extent still lacking. Particularly, the role of the electronic structure has not been considered in the description of electrolyte surface interactions. Here, we report enhanced sampling simulations based on ab initio molecular dynamics, aiming at unravelling the free energy of prototypical ions adsorbed at the aqueous graphene and hBN interfaces, and its consequences on nanofluidic osmotic transport. Specifically, we predicted the zeta potential, the diffusio osmotic mobility and the diffusio osmotic conductivity for a wide range of salt concentrations from the ab initio water and ion spatial distributions through an analytical framework based on Stokes equation and a modified Poisson Boltzmann equation. We observed concentration dependent scaling laws, together with dramatic differences in osmotic transport between the two interfaces, including diffusio osmotic flow and current reversal on hBN, but not on graphene. We could rationalize the results for the three osmotic responses with a simple model based on characteristic length scales for ion and water adsorption at the surface, which are quite different on graphene and on hBN. Our work provides first principles insights into the structure and osmotic transport of aqueous electrolytes on two dimensional materials and explores new pathways for efficient water desalination and osmotic energy conversion.


Learning Instance and Task Aware Dynamic Kernels for Few Shot Learning. Learning and generalizing to novel concepts with few samples (Few Shot Learning) is still an essential challenge to real world applications. A principle way of achieving few shot learning is to realize a model that can rapidly adapt to the context of a given task. Dynamic networks have been shown capable of learning content adaptive parameters efficiently, making them suitable for few shot learning. In this paper, we propose to learn the dynamic kernels of a convolution network as a function of the task at hand, enabling faster generalization. To this end, we obtain our dynamic kernels based on the entire task and each sample and develop a mechanism further conditioning on each individual channel and position independently. This results in dynamic kernels that simultaneously attend to the global information whilst also considering minuscule details available. We empirically show that our model improves performance on few shot classification and detection tasks, achieving a tangible improvement over several baseline models. This includes state of the art results on 4 few shot classification benchmarks mini ImageNet, tiered ImageNet, CUB and FC100 and competitive results on a few shot detection dataset MS COCO PASCAL VOC.


Low power threshold gas discharge by enhanced local electric field in electromagnetically induced transparencylike metamolecules. To realize efficient nonlinear metamaterials, we investigate a method for enhancing the local electric field in a metamolecule composed of two radiatively coupled cut wire resonators where resonance of the cut wire resonators and low group velocity propagation of an incident electromagnetic wave simultaneously occur. Numerical analysis shows that the local electric field in the metamolecule can be enhanced by decreasing the electrode size and the gap of the capacitor structure of the cut wire resonators while keeping the equivalent electrical circuit parameters of the metamolecule constant. We measure and compare the threshold incident power for a gas discharge in the metamolecule fabricated in our previous study and that in the metamolecule with shrunken capacitor structures. The experiment reveals that shrinking the capacitor structure while keeping the resonance frequency of the metamolecule decreases the threshold incident power for a gas discharge and may increase the gas pressure where the threshold incident power is minimum. Further development of this work will enable us to realize efficient nonlinear metamaterials that have atmospheric pressure gas as a nonlinear element.


SZ3 A Modular Framework for Composing Prediction Based Error Bounded Lossy Compressors. Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I O bandwidth and storage space. Error bounded lossy compressor has been considered one of the most effective solutions to the above problem. In practice, however, the best fit compression method often needs to be customized optimized in particular because of diverse characteristics in different datasets and various user requirements on the compression quality and performance. In this paper, we develop a novel modular, composable compression framework (namely SZ3), which involves three significant contributions. (1) SZ3 features a modular abstraction for the prediction based compression framework such that the new compression modules can be plugged in easily. (2) SZ3 supports multialgorithm predictors and can automatically select the best fit predictor for each data block based on the designed error estimation criterion. (3) SZ3 allows users to easily compose different compression pipelines on demand, such that both compression quality and performance can be significantly improved for their specific datasets and requirements. (4) In addition, we evaluate several lossy compressors composed from SZ3 using the real world datasets. Specifically, we leverage SZ3 to improve the compression quality and performance for different use cases, including GAMESS quantum chemistry dataset and Advanced Photon Source (APS) instrument dataset. Experiments show that our customized compression pipelines lead to up to 20 improvement in compression ratios under the same data distortion compared with the state of the art approaches.


Complex Multiplication and Noether Lefschetz Loci of the Twistor Space of a K3 Surface. For an algebraic K3 surface with complex multiplication (CM), algebraic fibres of the associated twistor space away from the equator are again of CM type. In this paper, we show that algebraic fibres corresponding to points at the same altitude of the twistor base S 2 simeq mathbb P 1 mathbb C share the same CM endomorphism field. Moreover, we determine all the admissible Picard numbers of the twistor fibres.


Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detection. Self driving cars must detect other vehicles and pedestrians in 3D to plan safe routes and avoid collisions. State of the art 3D object detectors, based on deep learning, have shown promising accuracy but are prone to over fit to domain idiosyncrasies, making them fail in new environments a serious problem if autonomous vehicles are meant to operate freely. In this paper, we propose a novel learning approach that drastically reduces this gap by fine tuning the detector on pseudo labels in the target domain, which our method generates while the vehicle is parked, based on replays of previously recorded driving sequences. In these replays, objects are tracked over time, and detections are interpolated and extrapolated crucially, leveraging future information to catch hard cases. We show, on five autonomous driving datasets, that fine tuning the object detector on these pseudo labels substantially reduces the domain gap to new driving environments, yielding drastic improvements in accuracy and detection reliability.


Few Shot Upsampling for Protest Size Detection. We propose a new task and dataset for a common problem in social science research "upsampling" coarse document labels to fine grained labels or spans. We pose the problem in a question answering format, with the answers providing the fine grained labels. We provide a benchmark dataset and baselines on a socially impactful task identifying the exact crowd size at protests and demonstrations in the United States given only order of magnitude information about protest attendance, a very small sample of fine grained examples, and English language news text. We evaluate several baseline models, including zero shot results from rule based and question answering models, few shot models fine tuned on a small set of documents, and weakly supervised models using a larger set of coarsely labeled documents. We find that our rule based model initially outperforms a zero shot pre trained transformer language model but that further fine tuning on a very small subset of 25 examples substantially improves out of sample performance. We also demonstrate a method for fine tuning the transformer span on only the coarse labels that performs similarly to our rule based approach. This work will contribute to social scientists' ability to generate data to understand the causes and successes of collective action.


Autonomous Cooperative Transportation System involving Multi Aerial Robots with Variable Attachment Mechanism. Cooperative transportation by multi aerial robots has the potential to support various payloads and improve failsafe against dropping. Furthermore, changing the attachment positions of robots according payload characteristics increases the stability of transportation. However, there are almost no transportation systems capable of scaling to the payload weight and size and changing the optimal attachment positions. To address this issue, we propose a cooperative transportation system comprising autonomously executable software and suitable hardware, covering the entire process, from pre takeoff setting to controlled flight. The proposed system decides the formation of the attachment positions by prioritizing controllability based on the center of gravity obtained from Bayesian estimations with robot pairs. We investigated the cooperative transportation of an unknown payload larger than that of whole carrier robots through numerical simulations. Furthermore, we performed cooperative transportation of an unknown payload (with a weight of about 3.2 kg and maximum length of 1.76 m) using eight robots. The proposed system was found to be versatile with regard to handling unknown payloads with different shapes and center of gravity positions.


On the combination of graph data for assessing thin file borrowers' creditworthiness. The thin file borrowers are customers for whom a creditworthiness assessment is uncertain due to their lack of credit history many researchers have used borrowers' relationships and interactions networks in the form of graphs as an alternative data source to address this. Incorporating network data is traditionally made by hand crafted feature engineering, and lately, the graph neural network has emerged as an alternative, but it still does not improve over the traditional method's performance. Here we introduce a framework to improve credit scoring models by blending several Graph Representation Learning methods feature engineering, graph embeddings, and graph neural networks. We stacked their outputs to produce a single score in this approach. We validated this framework using a unique multi source dataset that characterizes the relationships and credit history for the entire population of a Latin American country, applying it to credit risk models, application, and behavior, targeting both individuals and companies. Our results show that the graph representation learning methods should be used as complements, and these should not be seen as self sufficient methods as is currently done. In terms of AUC and KS, we enhance the statistical performance, outperforming traditional methods. In Corporate lending, where the gain is much higher, it confirms that evaluating an unbanked company cannot solely consider its features. The business ecosystem where these firms interact with their owners, suppliers, customers, and other companies provides novel knowledge that enables financial institutions to enhance their creditworthiness assessment. Our results let us know when and which group to use graph data and what effects on performance to expect. They also show the enormous value of graph data on the unbanked credit scoring problem, principally to help companies' banking.


On the Curved Patterns Seen in the Graph of PPTs. Dr. Ron Knott constructed a graph of all Primitive Pythagorean Triples (PPTs) with legs up to length 10,000, using Mathematica. The patterns are very interesting, suggesting conic sections. We show that they indeed are parabolic curves which follow in a natural way from the mathematics of the subject matter.


Improving the interaction of Older Adults with Socially Assistive Robots for Table setting. This study provides user studies aimed at exploring factors influencing the interaction between older adults and a robotic table setting assistant. The in fluence of the level of automation (LOA) and level of transparency (LOT) on the quality of the interaction was considered. Results revealed that the interaction effect of LOA and LOT significantly influenced the interaction. A lower LOA which required the user to control some of the actions of the robot influenced the older adults to participate more in the interaction when the LOT was low com pared to situations with higher LOT (more information) and higher LOA (more robot autonomy). Even though the higher LOA influenced more fluency in the interaction, the lower LOA encouraged a more collaborative form of interaction which is a priority in the design of robotic aids for older adult users. The results provide some insights into shared control designs which accommodates the preferences of the older adult users as they interact with robotic aids such as the table setting robot used in this study.


Gradient Free Neural Network Training via Synaptic Level Reinforcement Learning. An ongoing challenge in neural information processing is how do neurons adjust their connectivity to improve task performance over time (i.e., actualize learning)? It is widely believed that there is a consistent, synaptic level learning mechanism in specific brain regions that actualizes learning. However, the exact nature of this mechanism remains unclear. Here we propose an algorithm based on reinforcement learning (RL) to generate and apply a simple synaptic level learning policy for multi layer perceptron (MLP) models. In this algorithm, the action space for each MLP synapse consists of a small increase, decrease, or null action on the synapse weight, and the state for each synapse consists of the last two actions and reward signals. A binary reward signal indicates improvement or deterioration in task performance. The static policy produces superior training relative to the adaptive policy and is agnostic to activation function, network shape, and task. Trained MLPs yield character recognition performance comparable to identically shaped networks trained with gradient descent. 0 hidden unit character recognition tests yielded an average validation accuracy of 88.28 , 1.86 pm 0.47 higher than the same MLP trained with gradient descent. 32 hidden unit character recognition tests yielded an average validation accuracy of 88.45 , 1.11 pm 0.79 lower than the same MLP trained with gradient descent. The robustness and lack of reliance on gradient computations opens the door for new techniques for training difficult to differentiate artificial neural networks such as spiking neural networks (SNNs) and recurrent neural networks (RNNs). Further, the method's simplicity provides a unique opportunity for further development of local rule driven multi agent connectionist models for machine intelligence analogous to cellular automata.


VBR Version Based Reclamation. Safe lock free memory reclamation is a difficult problem. Existing solutions follow three basic methods (or their combinations) epoch based reclamation, hazard pointers, and optimistic reclamation. Epoch based methods are fast, but do not guarantee lock freedom. Hazard pointer solutions are lock free but typically do not provide high performance. Optimistic methods are lock free and fast, but previous optimistic methods did not go all the way. While reads were executed optimistically, writes were protected by hazard pointers. In this work we present a new reclamation scheme called version based reclamation (VBR), which provides a full optimistic solution to lock free memory reclamation, obtaining lock freedom and high efficiency. Speculative execution is known as a fundamental tool for improving performance in various areas of computer science, and indeed evaluation with a lock free linked list, hash table and skip list shows that VBR outperforms state of the art existing solutions.


Metric Learning for Session based Recommendations. Session based recommenders, used for making predictions out of users' uninterrupted sequences of actions, are attractive for many applications. Here, for this task we propose using metric learning, where a common embedding space for sessions and items is created, and distance measures dissimilarity between the provided sequence of users' events and the next action. We discuss and compare metric learning approaches to commonly used learning to rank methods, where some synergies exist. We propose a simple architecture for problem analysis and demonstrate that neither extensively big nor deep architectures are necessary in order to outperform existing methods. The experimental results against strong baselines on four datasets are provided with an ablation study.


Lefschetz fibrations on cotangent bundles and some plumbings. We introduce an idea of constructing Lefschetz fibrations of Weinstein manifolds from Weinstein handle decompositions on them. We prove theorems that formulate the idea for the cases of cotangent bundles and some plumbings. As a corollary, we give diffeomorphic families of plumbing spaces. Those diffeomorphic families contain some plumbing spaces with names. For example, Milnor fibers of A 4k 3 and D 4k 3 singularities are diffeomorphic if their complex dimension is odd.


e PoS Making Proof of Stake Decentralized and Fair. Blockchain applications that rely on the Proof of Work (PoW) have increasingly become energy inefficient with a staggering carbon footprint. In contrast, energy efficient alternative consensus protocols such as Proof of Stake (PoS) may cause centralization and unfairness in the blockchain system. To address these challenges, we propose a modular version of PoS based blockchain systems called epos that resists the centralization of network resources by extending mining opportunities to a wider set of stakeholders. Moreover, epos leverages the in built system operations to promote fair mining practices by penalizing malicious entities. We validate epos's achievable objectives through theoretical analysis and simulations. Our results show that epos ensures fairness and decentralization, and can be applied to existing blockchain applications.


Maintaining Common Ground in Dynamic Environments. Common grounding is the process of creating and maintaining mutual understandings, which is a critical aspect of sophisticated human communication. While various task settings have been proposed in existing literature, they mostly focus on creating common ground under static context and ignore the aspect of maintaining them overtime under dynamic context. In this work, we propose a novel task setting to study the ability of both creating and maintaining common ground in dynamic environments. Based on our minimal task formulation, we collected a large scale dataset of 5,617 dialogues to enable fine grained evaluation and analysis of various dialogue systems. Through our dataset analyses, we highlight novel challenges introduced in our setting, such as the usage of complex spatio temporal expressions to create and maintain common ground. Finally, we conduct extensive experiments to assess the capabilities of our baseline dialogue system and discuss future prospects of our research.


CP MDP A CANDECOMP PARAFAC Decomposition Approach to Solve a Markov Decision Process Multidimensional Problem. Markov Decision Process (MDP) is the underlying model for optimal planning for decision theoretic agents in stochastic environments. Although much research focuses on solving MDP problems both in tabular form or using factored representations, none focused on tensor decomposition methods. Solving MDPs using tensor algebra offers the prospect of leveraging advances in tensor based computations to further increase solver efficiency. In this paper, we develop an MDP solver for a multidimensional problem using a tensor decomposition method to compress the transition models and optimize the value iteration and policy iteration algorithms. We empirically evaluate our approach against tabular methods and show our approach can compute much larger problems using substantially less memory, opening up new possibilities for tensor based approaches in stochastic planning


Analyzing Thermal Buckling in Curvilinearly Stiffened Composite Plates with Arbitrary Shaped Cutouts Using Isogeometric Level Set Method. In this paper we develop a new simple and effective isogeometric analysis for modeling thermal buckling of stiffened laminated composite plates with cutouts using level sets. We employ a first order shear deformation theory to approximate the displacement field of the stiffeners and the plate. Numerical modeling with a treatment of trimmed objects, such as internal cutouts in terms of NURBS based isogeometric analysis presents several challenges, primarily due to need for using the tensor product of the NURBS basis functions. Due to this feature, the refinement operations can only be performed globally on the domain and not locally around the cutout. The new approach can overcome the drawbacks in modeling complex geometries with multiple patches as the level sets are used to describe the internal cutouts while the numerical integration is used only inside the physical domain. Results of parametric studies are presented which show the influence of ply orientation, size and orientation of the cutout and the position and profile of the curvilinear stiffeners. The numerical examples show high reliability and efficiency of the present method compared with other published solutions and ABAQUS.


Workshop on Autonomous Driving at CVPR 2021 Technical Report for Streaming Perception Challenge. In this report, we introduce our real time 2D object detection system for the realistic autonomous driving scenario. Our detector is built on a newly designed YOLO model, called YOLOX. On the Argoverse HD dataset, our system achieves 41.0 streaming AP, which surpassed second place by 7.8 6.1 on detection only track fully track, respectively. Moreover, equipped with TensorRT, our model achieves the 30FPS inference speed with a high resolution input size (e.g., 1440 2304). Code and models will be available at https github.com Megvii BaseDetection YOLOX


ClustRank a Visual Quality Measure Trained on Perceptual Data for Sorting Scatterplots by Cluster Patterns. Visual quality measures (VQMs) are designed to support analysts by automatically detecting and quantifying patterns in visualizations. We propose a new data driven technique called ClustRank that allows to rank scatterplots according to visible grouping patterns. Our model first encodes scatterplots in the parametric space of a Gaussian Mixture Model, and then uses a classifier trained on human judgment data to estimate the perceptual complexity of grouping patterns. The numbers of initial mixture components and final combined groups determine the rank of the scatterplot. ClustRank improves on existing VQM techniques by mimicking human judgments on two Gaussian cluster patterns and gives more accuracy when ranking general cluster patterns in scatterplots. We demonstrate its benefit by analyzing kinship data for genome wide association studies, a domain in which experts rely on the visual analysis of large sets of scatterplots. We make the three benchmark datasets and the ClustRank VQM available for practical use and further improvements.


An Equational Logical Framework for Type Theories. A wide range of intuitionistic type theories may be presented as equational theories within a logical framework. This method was formulated by Per Martin L " o f in the mid 1980's and further developed by Uemura, who used it to prove an initiality result for a class of models. Herein is presented a logical framework for type theories that includes an extensional equality type so that a type theory may be given by a signature of constants. The framework is illustrated by a number of examples of type theoretic concepts, including identity and equality types, and a hierarchy of universes.


Singular perturbation problem of mean field game of acceleration. This paper is devoted to the singular perturbation problem for mean field game systems with control on the acceleration. This correspond to a model in which the acceleration cost vanishes. So, we are interested in analyzing the behavior of solutions to the mean field game systems arising from such a problem as the acceleration cost goes to zero. In this case the Hamiltonian fails to be strictly convex and superlinear w.r.t. the momentum variable and this creates new issues in the analysis of the problem. We obtain that the limit problem is the classical mean field game system.


Abelian varieties as automorphism groups of smooth projective varieties in arbitrary characteristics. Let A be an abelian variety over an algebraically closed field. We show that A is the automorphism group scheme of some smooth projective variety if and only if A has only finitely many automorphisms as an algebraic group. This generalizes a result of Lombardo and Maffei for complex abelian varieties.


Drop the GAN In Defense of Patches Nearest Neighbors as Single Image Generative Models. Single image generative models perform synthesis and manipulation tasks by capturing the distribution of patches within a single image. The classical (pre Deep Learning) prevailing approaches for these tasks are based on an optimization process that maximizes patch similarity between the input and generated output. Recently, however, Single Image GANs were introduced both as a superior solution for such manipulation tasks, but also for remarkable novel generative tasks. Despite their impressiveness, single image GANs require long training time (usually hours) for each image and each task. They often suffer from artifacts and are prone to optimization issues such as mode collapse. In this paper, we show that all of these tasks can be performed without any training, within several seconds, in a unified, surprisingly simple framework. We revisit and cast the "good old" patch based methods into a novel optimization free framework. We start with an initial coarse guess, and then simply refine the details coarse to fine using patch nearest neighbor search. This allows generating random novel images better and much faster than GANs. We further demonstrate a wide range of applications, such as image editing and reshuffling, retargeting to different sizes, structural analogies, image collage and a newly introduced task of conditional inpainting. Not only is our method faster ( times 10 3 times 10 4 than a GAN), it produces superior results (confirmed by quantitative and qualitative evaluation), less artifacts and more realistic global structure than any of the previous approaches (whether GAN based or classical patch based).


Learning Purified Feature Representations from Task irrelevant Labels. Learning an empirically effective model with generalization using limited data is a challenging task for deep neural networks. In this paper, we propose a novel learning framework called PurifiedLearning to exploit task irrelevant features extracted from task irrelevant labels when training models on small scale datasets. Particularly, we purify feature representations by using the expression of task irrelevant information, thus facilitating the learning process of classification. Our work is built on solid theoretical analysis and extensive experiments, which demonstrate the effectiveness of PurifiedLearning. According to the theory we proved, PurifiedLearning is model agnostic and doesn't have any restrictions on the model needed, so it can be combined with any existing deep neural networks with ease to achieve better performance. The source code of this paper will be available in the future for reproducibility.


An Empirical Study of Topic Transition in Dialogue. Transitioning between topics is a natural component of human human dialog. Although topic transition has been studied in dialogue for decades, only a handful of corpora based studies have been performed to investigate the subtleties of topic transitions. Thus, this study annotates 215 conversations from the switchboard corpus and investigates how variables such as length, number of topic transitions, topic transitions share by participants and turns topic are related. This work presents an empirical study on topic transition in switchboard corpus followed by modelling topic transition with a precision of 83 for in domain(id) test set and 82 on 10 out of domain (ood) test set. It is envisioned that this work will help in emulating human human like topic transition in open domain dialog systems.


Entropy and complexity unveil the landscape of memes evolution. On the Internet, information circulates fast and widely, and the form of content adapts to comply with users' cognitive abilities. Memes are an emerging aspect of the internet system of signification, and their visual schemes evolve by adapting to a heterogeneous context. A fundamental question is whether they present culturally and temporally transcendent characteristics in their organizing principles. In this work, we study the evolution of 2 million visual memes from Reddit over ten years, from 2011 to 2020, in terms of their statistical complexity and entropy. We find support for the hypothesis that memes are part of an emerging form of internet metalanguage on one side, we observe an exponential growth with a doubling time of approximately 6 months on the other side, the complexity of memes contents increases, allowing and adapting to represent social trends and attitudes.


From Paraphrasing to Semantic Parsing Unsupervised Semantic Parsing via Synchronous Semantic Decoding. Semantic parsing is challenging due to the structure gap and the semantic gap between utterances and logical forms. In this paper, we propose an unsupervised semantic parsing method Synchronous Semantic Decoding (SSD), which can simultaneously resolve the semantic gap and the structure gap by jointly leveraging paraphrasing and grammar constrained decoding. Specifically, we reformulate semantic parsing as a constrained paraphrasing problem given an utterance, our model synchronously generates its canonical utterance and meaning representation. During synchronous decoding the utterance paraphrasing is constrained by the structure of the logical form, therefore the canonical utterance can be paraphrased controlledly the semantic decoding is guided by the semantics of the canonical utterance, therefore its logical form can be generated unsupervisedly. Experimental results show that SSD is a promising approach and can achieve competitive unsupervised semantic parsing performance on multiple datasets.


Domination numbers and noncover complexes of hypergraphs. Let mathcal H be a hypergraph on a finite set V . A em cover of mathcal H is a set of vertices that meets all edges of mathcal H . If W is not a cover of mathcal H , then W is said to be a em noncover of mathcal H . The em noncover complex of mathcal H is the abstract simplicial complex whose faces are the noncovers of mathcal H . In this paper, we study homological properties of noncover complexes of hypergraphs. In particular, we obtain an upper bound on their Leray numbers. The bound is in terms of hypergraph domination numbers. Also, our proof idea is applied to compute the homotopy type of the noncover complexes of certain uniform hypergraphs, called em tight paths and em tight cycles . This extends to hypergraphs known results on graphs.


All fiber photonic lantern multimode optical receiver with coherent adaptive optics beam combining. A multimode optical receiver for free space optical communications (FSOC) based on a photonic lantern and adaptive optics coherent beam combining (CBC) of the lantern's single mode outputs is proposed and demonstrated for the first time. The use of optical coherent combining in fiber serves to increase the signal to noise ratio compared to similar receivers based on electrically combined signals, and represents an all fiber approach to low order adaptive optics. This optical receiver is demonstrated using a photonic lantern with three outputs, fibre couplers and active phase locking, and further investigated under atmospheric conditions with and without turbulence.


Cell Detection in Domain Shift Problem Using Pseudo Cell Position Heatmap. The domain shift problem is an important issue in automatic cell detection. A detection network trained with training data under a specific condition (source domain) may not work well in data under other conditions (target domain). We propose an unsupervised domain adaptation method for cell detection using the pseudo cell position heatmap, where a cell centroid becomes a peak with a Gaussian distribution in the map. In the prediction result for the target domain, even if a peak location is correct, the signal distribution around the peak often has anon Gaussian shape. The pseudo cell position heatmap is re generated using the peak positions in the predicted heatmap to have a clear Gaussian shape. Our method selects confident pseudo cell position heatmaps using a Bayesian network and adds them to the training data in the next iteration. The method can incrementally extend the domain from the source domain to the target domain in a semi supervised manner. In the experiments using 8 combinations of domains, the proposed method outperformed the existing domain adaptation methods.


FReTAL Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning. As GAN based video and image manipulation technologies become more sophisticated and easily accessible, there is an urgent need for effective deepfake detection technologies. Moreover, various deepfake generation techniques have emerged over the past few years. While many deepfake detection methods have been proposed, their performance suffers from new types of deepfake methods on which they are not sufficiently trained. To detect new types of deepfakes, the model should learn from additional data without losing its prior knowledge about deepfakes (catastrophic forgetting), especially when new deepfakes are significantly different. In this work, we employ the Representation Learning (ReL) and Knowledge Distillation (KD) paradigms to introduce a transfer learning based Feature Representation Transfer Adaptation Learning (FReTAL) method. We use FReTAL to perform domain adaptation tasks on new deepfake datasets while minimizing catastrophic forgetting. Our student model can quickly adapt to new types of deepfake by distilling knowledge from a pre trained teacher model and applying transfer learning without using source domain data during domain adaptation. Through experiments on FaceForensics datasets, we demonstrate that FReTAL outperforms all baselines on the domain adaptation task with up to 86.97 accuracy on low quality deepfakes.


Towards Out Of Distribution Generalization A Survey. Classic machine learning methods are built on the i.i.d. assumption that training and testing data are independent and identically distributed. However, in real scenarios, the i.i.d. assumption can hardly be satisfied, rendering the sharp drop of classic machine learning algorithms' performances under distributional shifts, which indicates the significance of investigating the Out of Distribution generalization problem. Out of Distribution (OOD) generalization problem addresses the challenging setting where the testing distribution is unknown and different from the training. This paper serves as the first effort to systematically and comprehensively discuss the OOD generalization problem, from the definition, methodology, evaluation to the implications and future directions. Firstly, we provide the formal definition of the OOD generalization problem. Secondly, existing methods are categorized into three parts based on their positions in the whole learning pipeline, namely unsupervised representation learning, supervised model learning and optimization, and typical methods for each category are discussed in detail. We then demonstrate the theoretical connections of different categories, and introduce the commonly used datasets and evaluation metrics. Finally, we summarize the whole literature and raise some future directions for OOD generalization problem. The summary of OOD generalization methods reviewed in this survey can be found at http out of distribution generalization.com.


CPP Net Context aware Polygon Proposal Network for Nucleus Segmentation. Nucleus segmentation is a challenging task due to the crowded distribution and blurry boundaries of nuclei. Recent approaches represent nuclei by means of polygons to differentiate between touching and overlapping nuclei and have accordingly achieved promising performance. Each polygon is represented by a set of centroid to boundary distances, which are in turn predicted by features of the centroid pixel for a single nucleus. However, using the centroid pixel alone does not provide sufficient contextual information for robust prediction. To handle this problem, we propose a Context aware Polygon Proposal Network (CPP Net) for nucleus segmentation. First, we sample a point set rather than one single pixel within each cell for distance prediction. This strategy substantially enhances contextual information and thereby improves the robustness of the prediction. Second, we propose a Confidence based Weighting Module, which adaptively fuses the predictions from the sampled point set. Third, we introduce a novel Shape Aware Perceptual (SAP) loss that constrains the shape of the predicted polygons. Here, the SAP loss is based on an additional network that is pre trained by means of mapping the centroid probability map and the pixel to boundary distance maps to a different nucleus representation. Extensive experiments justify the effectiveness of each component in the proposed CPP Net. Finally, CPP Net is found to achieve state of the art performance on three publicly available databases, namely DSB2018, BBBC06, and PanNuke. Code of this paper will be released.


Fairness and Communication Based Semantics for Session Typed Languages. We give communication based semantics and reasoning techniques for Polarized SILL, a rich session typed programming language with general recursion. Its features include channel and code transmission, synchronous and asynchronous communication, and functional programming. Our contributions are distinguished by their faithfulness to the process abstraction, i.e., to the premise that communication is the only observable phenomenon of processes. We give the first observed communication semantics that supports general recursion and code transmission. Observed communication semantics define the meaning of processes in terms of their observed communications. We use this observational semantics to define experiments on processes, and we give a communication based testing equivalences framework for defining observational simulations and equivalences on processes. This framework captures several natural equivalences, and we show that one of these coincides with barbed congruence, the canonical notion of process equivalence. Polarized SILL is defined using a substructural operational semantics based on multiset rewriting. To ensure that our contributions are well defined in the presence of non termination, we introduce fairness for multiset rewriting systems. We construct a fair scheduler, we give sufficient conditions for traces to be fair, and we study the effects of permutation on fair traces.


Rational Pavelka logic the best among three worlds?. This comparative survey explores three formal approaches to reasoning with partly true statements and degrees of truth, within the family of L ukasiewicz logic. These approaches are represented by infinite valued L ukasiewicz logic ( L ), Rational Pavelka logic (RPL) and a logic with graded formulas that we refer to as Graded Rational Pavelka logic (GRPL). Truth constants for all rationals between 0 and 1 are used as a technical means to calibrate degrees of truth. L ukasiewicz logic ostensibly features no truth constants except 0 and 1 Rational Pavelka logic includes constants in the basic language, with suitable axioms Graded Rational Pavelka logic works with graded formulas and proofs, following the original intent of Pavelka, inspired by Goguen's work. Historically, Pavelka's papers precede the definition of GRPL, which in turn precedes RPL retrieving these steps, we discuss how these formal systems naturally evolve from each other, and we also recall how this process has been a somewhat contentious issue in the realm of L ukasiewicz logic. This work can also be read as a case study in logics, their fragments, and the relationship of the fragments to a logic.


R4Dyn Exploring Radar for Self Supervised Monocular Depth Estimation of Dynamic Scenes. While self supervised monocular depth estimation in driving scenarios has achieved comparable performance to supervised approaches, violations of the static world assumption can still lead to erroneous depth predictions of traffic participants, posing a potential safety issue. In this paper, we present R4Dyn, a novel set of techniques to use cost efficient radar data on top of a self supervised depth estimation framework. In particular, we show how radar can be used during training as weak supervision signal, as well as an extra input to enhance the estimation robustness at inference time. Since automotive radars are readily available, this allows to collect training data from a variety of existing vehicles. Moreover, by filtering and expanding the signal to make it compatible with learning based approaches, we address radar inherent issues, such as noise and sparsity. With R4Dyn we are able to overcome a major limitation of self supervised depth estimation, i.e. the prediction of traffic participants. We substantially improve the estimation on dynamic objects, such as cars by 37 on the challenging nuScenes dataset, hence demonstrating that radar is a valuable additional sensor for monocular depth estimation in autonomous vehicles.


A Privacy preserving Distributed Training Framework for Cooperative Multi agent Deep Reinforcement Learning. Deep Reinforcement Learning (DRL) sometimes needs a large amount of data to converge in the training procedure and in some cases, each action of the agent may produce regret. This barrier naturally motivates different data sets or environment owners to cooperate to share their knowledge and train their agents more efficiently. However, it raises privacy concerns if we directly merge the raw data from different owners. To solve this problem, we proposed a new Deep Neural Network (DNN) architecture with both global NN and local NN, and a distributed training framework. We allow the global weights to be updated by all the collaborator agents while the local weights are only updated by the agent they belong to. In this way, we hope the global weighs can share the common knowledge among these collaborators while the local NN can keep the specialized properties and ensure the agent to be compatible with its specific environment. Experiments show that the framework can efficiently help agents in the same or similar environments to collaborate in their training process and gain a higher convergence rate and better performance.


Cell in cell structures are involved in the competition between cells in breast cancer. Breast cancer is the most common cancer in women worldwide, and discovering the biomarkers of this disease became so vital nowadays and Cell in Cell structure could be one of them, and it may be used as an available proxy for tumor malignancy. (CICs) are unusual in that keep morphologically healthy cells within another cell. They are found in various human cancers and result from active cell cell interaction, and it has different kinds. In this study, we analyzed the microarray data from GEO (GSE103865) to genetically evaluate CICs' incidence in samples obtained from breast cancer patients to understand the relationship between the rate of CIC and the prognosis of breast cancer. The preprocessing was performed using R software. The DAVID website was used to analyze gene ontology (GO) and Gene and Genome (KEGG) pathways. The protein protein interactions (PPIs) of the obtained DEGs were assessed using the STRING website, and hub modules in Cytoscape and cytoHubba were screened. According to the results from analyzing the 20 hub genes, we understood that overexpression of our Top genes is effective in focal adhesion, ECM receptor interaction, platelet activation and PI3K Akt signaling pathway, which shows that changes in these pathways could be the reason the overexpression of CICs in breast cancer. These data and research by many others have uncovered various genes involved in CIC formation and have started to give us an idea of why they are formed and how they could contribute to breast cancer


JEM Improved Techniques for Training JEM. Joint Energy based Model (JEM) is a recently proposed hybrid model that retains strong discriminative power of modern CNN classifiers, while generating samples rivaling the quality of GAN based approaches. In this paper, we propose a variety of new training procedures and architecture features to improve JEM's accuracy, training stability, and speed altogether. 1) We propose a proximal SGLD to generate samples in the proximity of samples from the previous step, which improves the stability. 2) We further treat the approximate maximum likelihood learning of EBM as a multi step differential game, and extend the YOPO framework to cut out redundant calculations during backpropagation, which accelerates the training substantially. 3) Rather than initializing SGLD chain from random noise, we introduce a new informative initialization that samples from a distribution estimated from training data. 4) This informative initialization allows us to enable batch normalization in JEM, which further releases the power of modern CNN architectures for hybrid modeling. Code https github.com sndnyang JEMPP


Soccer Player Tracking in Low Quality Video. In this paper we propose a system capable of tracking multiple soccer players in different types of video quality. The main goal, in contrast to most state of art soccer player tracking systems, is the ability of execute effectively tracking in videos of low quality. We adapted a state of art Multiple Object Tracking to the task. In order to do that adaptation, we created a Detection and a Tracking Dataset for 3 different qualities of video. The results of our system are conclusive of its high performance.


Cross Region Domain Adaptation for Class level Alignment. Semantic segmentation requires a lot of training data, which necessitates costly annotation. There have been many studies on unsupervised domain adaptation (UDA) from one domain to another, e.g., from computer graphics to real images. However, there is still a gap in accuracy between UDA and supervised training on native domain data. It is arguably attributable to class level misalignment between the source and target domain data. To cope with this, we propose a method that applies adversarial training to align two feature distributions in the target domain. It uses a self training framework to split the image into two regions (i.e., trusted and untrusted), which form two distributions to align in the feature space. We term this approach cross region adaptation (CRA) to distinguish from the previous methods of aligning different domain distributions, which we call cross domain adaptation (CDA). CRA can be applied after any CDA method. Experimental results show that this always improves the accuracy of the combined CDA method, having updated the state of the art.


Degenerate Fubini type polynomials associated with degenerate Apostol Bernoulli and Apostol Euler polynomials of order alpha . In this paper, by introducing the degenerate Fubini type polynomials, we give several relations with the help of the Fa a di Bruno formula and some properties of Bell polynomials, and generating function methods. Also, we derive some new explicit formulas and recurrence relations for Fubini type polynomials and numbers. Associating the degenerate Fubini type polynomials newly defined here with degenerate Apostol Bernoulli polynomials and degenerate Apostol Euler polynomials of order alpha enables us to present additional relations for some degenerate special polynomials and numbers.