Continuity, Uniqueness and Long Term Behavior of Nash Flows Over Time. We consider a dynamic model of traffic that has received a lot of attention in the past few years. Users control infinitesimal flow particles aiming to travel from a source to destination as quickly as possible. Flow patterns vary over time, and congestion effects are modeled via queues, which form whenever the inflow into a link exceeds its capacity. Despite lots of interest, some very basic questions remain open in this model. We resolve a number of them We show uniqueness of journey times in equilibria. We show continuity of equilibria small perturbations to the instance or to the traffic situation at some moment cannot lead to wildly different equilibrium evolutions. We demonstrate that, assuming constant inflow into the network at the source, equilibria always settle down into a "steady state" in which the behavior extends forever in a linear fashion. One of our main conceptual contributions is to show that the answer to the first two questions, on uniqueness and continuity, are intimately connected to the third. Our result also shows very clearly that resolving uniqueness and continuity, despite initial appearances, cannot be resolved by analytic techniques, but are related to very combinatorial aspects of the model. To resolve the third question, we substantially extend the approach of Cominetti et al., who show a steady state result in the regime where the input flow rate is smaller than the network capacity.


Multi dataset Pretraining A Unified Model for Semantic Segmentation. Collecting annotated data for semantic segmentation is time consuming and hard to scale up. In this paper, we for the first time propose a unified framework, termed as Multi Dataset Pretraining, to take full advantage of the fragmented annotations of different datasets. The highlight is that the annotations from different domains can be efficiently reused and consistently boost performance for each specific domain. This is achieved by first pretraining the network via the proposed pixel to prototype contrastive loss over multiple datasets regardless of their taxonomy labels, and followed by fine tuning the pretrained model over specific dataset as usual. In order to better model the relationship among images and classes from different datasets, we extend the pixel level embeddings via cross dataset mixing and propose a pixel to class sparse coding strategy that explicitly models the pixel class similarity over the manifold embedding space. In this way, we are able to increase intra class compactness and inter class separability, as well as considering inter class similarity across different datasets for better transferability. Experiments conducted on several benchmarks demonstrate its superior performance. Notably, MDP consistently outperforms the pretrained models over ImageNet by a considerable margin, while only using less than 10 samples for pretraining.


Dynamical analysis of a generalized hepatitis B epidemic model and its dynamically consistent discrete model. The aim of this work is to study qualitative dynamical properties of a generalized hepatitis B epidemic model and its dynamically consistent discrete model.


Inductive Program Synthesis over Noisy Datasets using Abstraction Refinement Based Optimization. We present a new synthesis algorithm to solve program synthesis over noisy datasets, i.e., data that may contain incorrect corrupted input output examples. Our algorithm uses an abstraction refinement based optimization process to synthesize programs which optimize the tradeoff between the loss over the noisy dataset and the complexity of the synthesized program. The algorithm uses abstractions to divide the search space of programs into subspaces by computing an abstract value that represents outputs for all programs in a subspace. The abstract value allows our algorithm to compute, for each subspace, a sound approximate lower bound of the loss over all programs in the subspace. It iteratively refines these abstractions to further subdivide the space into smaller subspaces, prune subspaces that do not contain an optimal program, and eventually synthesize an optimal program. We implemented this algorithm in a tool called Rose. We compare Rose to a current state of the art noisy program synthesis system using the SyGuS 2018 benchmark suite. Our evaluation demonstrates that Rose significantly outperforms this previous system on two noisy benchmark program synthesis problems sets drawn from the SyGus 2018 benchmark suite, Rose delivers speedups of up to 1587 and 81.7, with median speedups of 20.5 and 81.7. Rose also terminates on 20 (out of 54) and 4 (out of 11) more benchmark problems than the previous system. Both Rose and the previous system synthesize programs that are optimal over the provided noisy data sets. For the majority of the problems in the benchmark sets ( 272 out of 286 ), the synthesized programs also produce correct outputs for all inputs in the original (unseen) noise free data set. These results highlight the benefits that Rose can deliver for effective noisy program synthesis.


Fast and Robust Characterization of Dielectric Slabs Using Rectangular Waveguides. Waveguide characterization of dielectric materials is a convenient and broadband approach for measuring dielectric constant. In conventional microwave measurements, material samples are usually mechanically shaped to fit the waveguide opening and measured in closed waveguides. This method is not practical for millimeter wave and sub millimeter wave measurements where the waveguide openings become tiny, and it is rather difficult to shape the sample to exactly the same dimensions as the waveguide cross section. In this paper, we present a method that allows one to measure arbitrarily shaped dielectric slabs that extend outside waveguides. In this method, the measured sample is placed between two waveguide flanges, creating a discontinuity. The measurement system is characterized as an equivalent Pi circuit, and the circuit elements of the Pi circuit are extracted from the scattering parameters. We have found that the equivalent shunt impedance of the measured sample is only determined by the material permittivity and is rather insensitive to the sample shape, position, sizes, and other structural details of the discontinuity. This feature can be leveraged for accurate measurements of permittivity. The proposed method is very useful for measuring the permittivity of medium loss and high loss dielectrics from microwave to sub terahertz frequencies.


From "Analogue" Science to AI powered Digital Science. Phase transition from the human limited, "analogue" way of research enquiry to the silicon based, artificial intelligence (AI) powered digital science is forthcoming. To facilitate this transition, I propose three project ideas 1) CryptoScience platform, aimed to provide tools for endemic digitalization open access of the research data, with attribution of the work credit of all involved individuals and parties using blockchain technology 2) Computational Publication Standard, designed for publishing research findings in an AI friendly format of knowledge graphs 3) data modelling from publications, meant to extract key pieces of knowledge (entities and their relationships) contained in manuscript publications using natural language processing and image recognition, to enable their incorporation into the digital knowledge databases. These three ideas could be implemented separately by different research groups and institutions, however, they will strongly benefit from each other's synergistic effect.


A new pseudo spectral methodology without numerical diffusion for conducting dye simulations and particle residence time calculations. Dye experimentation is a widely used method in experimental fluid mechanics for flow analysis or for the study of the transport of particles within a fluid. This technique is particularly useful in biomedical diagnostic applications ranging from hemodynamic analysis of cardiovascular systems to ocular circulation. However, simulating dyes governed by convection diffusion partial differential equations (PDEs) can also be a useful post processing analysis approach for computational fluid dynamics (CFD) applications. Such simulations can be used to identify the relative significance of different spatial subregions in particular time intervals of interest in an unsteady flow field. Additionally, dye evolution is closely related to non discrete particle residence time (PRT) calculations that are governed by similar PDEs. PRT is a widely used metric for various fluid dynamics applications (e.g., environmental fluids, biological flows) and is a well accepted biomarker for cardiovascular diseases since it is linked to thrombus formation. This contribution introduces a pseudo spectral method based on Fourier continuation (FC) for conducting dye simulations and non discrete particle residence time calculations without numerical diffusion errors. Convergence and error analyses are performed with both manufactured and analytical solutions. The methodology is applied to three distinct physical physiological cases 1) flow over a two dimensional (2D) cavity 2) pulsatile flow in a simplified partially grafted aortic dissection model and 3) non Newtonian blood flow in a Fontan graft. Although velocity data is provided in this work by numerical simulation, the proposed approach can also be applied to velocity data collected through experimental techniques such as from particle image velocimetry.


BLEU, METEOR, BERTScore Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment oriented Text. Social media companies as well as authorities make extensive use of artificial intelligence (AI) tools to monitor postings of hate speech, celebrations of violence or profanity. Since AI software requires massive volumes of data to train computers, Machine Translation (MT) of the online content is commonly used to process posts written in several languages and hence augment the data needed for training. However, MT mistakes are a regular occurrence when translating sentiment oriented user generated content (UGC), especially when a low resource language is involved. The adequacy of the whole process relies on the assumption that the evaluation metrics used give a reliable indication of the quality of the translation. In this paper, we assess the ability of automatic quality metrics to detect critical machine translation errors which can cause serious misunderstanding of the affect message. We compare the performance of three canonical metrics on meaningless translations where the semantic content is seriously impaired as compared to meaningful translations with a critical error which exclusively distorts the sentiment of the source text. We conclude that there is a need for fine tuning of automatic metrics to make them more robust in detecting sentiment critical errors.


Implementation of Ethically Aligned Design with Ethical User stories in SMART terminal Digitalization project Use case Passenger Flow. Digitalization and Smart systems are part of our everyday lives today. So far the development has been rapid and all the implications that comes after the deployment has not been able to foresee or even assess during the development, especially when ethics or trustworthiness is concerned. Artificial Intelligence (AI) and Autonomous Systems (AS) are the direction that software systems are taking today. It is witnessed in banks, stores, internet and it is proceeding to transportation as well as on traveling. Autonomous maritime industry has also taking this direction when taking under development in digitalization on fairway and port terminals. AI ethics has advanced profoundly since the machine learning develop during the last decade and is now being implemented in AI development and workflow of software engineers. It is not an easy task and tools are needed to make the ethical assessment easier. This paper will review a research in an industrial setting, where Ethically Aligned Design practice, Ethical User Stories are used to transfer ethical requirements to ethical user stories to form practical solutions for project use. This project is in the field of maritime industry and concentrates on digitalization of port terminals and this particular paper focuses on the passenger flow. Results are positive towards the practice of Ethical User Stories, drawn from a large empirical data set.


Linear and nonlinear optimal growth mechanisms for generating turbulent bands. Linear and nonlinear energy optimizations in a tilted domain are used to unveil the main mechanisms allowing the creation of a turbulent band in a channel flow. Linear optimization predicts an optimal growth for streamwse and spanwise wavenumbers k x 1.2 , k z 1.75 , corresponding to the peak values of the premultiplied energy spectra of direct numerical simulations. At target time, the linear optimal perturbation is composed by oblique streaks, which, for a sufficiently large initial energy, induce turbulence in the whole domain, due to the lack of spatial localization. When localization is achieved by adding nonlinear effects to the optimization, or by artificially confining the linear optimal to a localized region in the spanwise direction, a large scale flow is created, which leads to the generation of a localised turbulent band. These results suggest that inducing transition towards turbulent bands in a tilted domain, two main elements are needed a linear energy growth mechanism such as the lift up for generating large amplitude flow structures which produce inflection points large scale vortices ensuring spatial localisation. Remarkably, these two elements alone are able to generate an isolated turbulent band also in a large, non tilted domain.


Analog MIMO Communication for One shot Distributed Principal Component Analysis. A fundamental algorithm for data analytics at the edge of wireless networks is distributed principal component analysis (DPCA), which finds the most important information embedded in a distributed high dimensional dataset by distributed computation of a reduced dimension data subspace, called principal components (PCs). In this paper, to support one shot DPCA in wireless systems, we propose a framework of analog MIMO transmission featuring the uncoded analog transmission of local PCs for estimating the global PCs. To cope with channel distortion and noise, two maximum likelihood (global) PC estimators are presented corresponding to the cases with and without receive channel state information (CSI). The first design, termed coherent PC estimator, is derived by solving a Procrustes problem and reveals the form of regularized channel inversion where the regulation attempts to alleviate the effects of both channel noise and data noise. The second one, termed blind PC estimator, is designed based on the subspace channel rotation invariance property and computes a centroid of received local PCs on a Grassmann manifold. Using the manifold perturbation theory, tight bounds on the mean square subspace distance (MSSD) of both estimators are derived for performance evaluation. The results reveal simple scaling laws of MSSD concerning device population, data and channel signal to noise ratios (SNRs), and array sizes. More importantly, both estimators are found to have identical scaling laws, suggesting the dispensability of CSI to accelerate DPCA. Simulation results validate the derived results and demonstrate the promising latency performance of the proposed analog MIMO.


The zonoid algebra, generalized mixed volumes, and random determinants. We show that every multilinear map between Euclidean spaces induces a unique, continuous, Minkowski multilinear map of the corresponding real cones of zonoids. Applied to the wedge product of the exterior algebra of a Euclidean space, this yields a multiplication of zonoids, defining the structure of a commutative, associative, and partially ordered ring, which we call the zonoid algebra. This framework gives a new perspective on classical objects in convex geometry, and it allows to introduce new functionals on zonoids, in particular generalizing the notion of mixed volume. We also analyze a similar construction based on the complex wedge product, which leads to the new notion of mixed J volume. These ideas connect to the theory of random determinants.


q-bio.QM physics.bio-ph physics.flu-dyn q-bio.PE

Quantifying the COVID19 infection risk due to droplet aerosol inhalation. The dose response model has been widely used for quantifying the risk of infection of airborne diseases like COVID 19. The model has been used in the room average analysis of infection risk and analysis using passive scalars as a proxy for aerosol transport. However, it has not been employed for risk estimation in numerical simulations of droplet dispersion. In this work, we develop a framework for the evaluation of the probability of infection in droplet dispersion simulations using the dose response model. We introduce a version of the model that can incorporate the higher transmissibility of variant strains of SARS CoV2 and the effect of vaccination in evaluating the probability of infection. Numerical simulations of droplet dispersion during speech are carried out to investigate the infection risk over space and time using the model. The advantage of droplet dispersion simulations for risk evaluation is demonstrated through the analysis of the effect of humidity on infection risk.


Strategic Behavior is Bliss Iterative Voting Improves Social Welfare. Recent work in iterative voting has defined the difference in social welfare between the truthful winner and worst case equilibrium winner, due to repeated strategic manipulations, known as the additive dynamic price of anarchy (ADPoA). While all iterative plurality winners have been shown to differ from truth by at most one initial vote, it is less understood how agents' welfare changes in equilibrium. To this end, we differentiate agents' utility from their iteration mechanism and determine iterative plurality's ADPoA in the worst and average case. We first negatively demonstrate that the worst case ADPoA is linear in the number of agents. In expectation, rather, equilibrium winners have a constant order welfare advantage over the truthful winner. Our positive results illustrate the prospect for social welfare to increase due to strategic manipulation.


First Order Hyperbolic Boundary Value Problems With a Large Oscillatory Zero Order Term. We study the weakly stable hyperbolic boundary value problem with a large zero order oscillatory coefficient. This problem is related to linearized problems in the study of Mach stem and vortex sheets. We wish to establish a uniform energy estimate with respect to epsilon , which is needed in mentioned applications and justification of geometric optics solutions, but the zero order oscillatory term gives rise to great obstacles. In this paper we obtain positive results in the small medium frequency region by adapting the approach of Williams to a more general situation than the one treated there. We also show that it is possible to construct high order approximate solutions by the method of geometric optics for those systems without any restriction on frequencies.


Non autonomous vector fields on S 3 simple dynamics and wild separatrices embedding. We construct new substantive examples of non autonomous vector fields on 3 dimensional sphere having a simple dynamics but non trivial topology. The construction is based on two ideas the theory of diffeomorpisms with wild separatrix embedding (Pixton, Bonatti Grines, etc.) and the construction of a non autonomous suspension over a diffeomorpism (Lerman Vainshtein). As a result, we get periodic, almost periodic or even nonrecurrent vector fields which have a finite number of special integral curves possessing exponential dichotomy on R such that among them there is one saddle integral curve (with an exponential dichotomy of the type (3,2)) having wildly embedded two dimensional unstable separatrix and wildly embedded three dimensional stable manifold. All other integral curves tend, as t to pm infty, to these special integral curves. Also we construct another vector fields having k ge 2 special saddle integral curves with tamely embedded two dimensional unstable separatrices forming mildly wild frames in the sense of Debrunner Fox. In the case of periodic vector fields, corresponding specific integral curves are periodic with the period of the vector field, and they are almost periodic for the case of almost periodic vector fields.


Boundary concentration phenomena for an anisotropic Neumann problem in mathbb R 2 . Given a smooth bounded domain Omega in mathbb R 2 , we study the following anisotropic Neumann problem begin cases nabla(a(x) nabla u) a(x)u lambda a(x) u p 1 e u p , , , , , u 0 , , , , , textrm in , , , , , Omega, 2mm frac partial u partial nu 0 , , qquad quad qquad qquad qquad qquad qquad , qquad quad , textrm on , , , partial Omega, end cases where lambda 0 is a small parameter, 0 p 2 , a(x) is a positive smooth function over overline Omega and nu denotes the outer unit normal vector to partial Omega . Under suitable assumptions on anisotropic coefficient a(x) , we construct solutions of this problem with arbitrarily many mixed interior and boundary bubbles which concentrate at totally different strict local maximum or minimal boundary points of a(x) restricted to partial Omega , or accumulate to the same strict local maximum boundary point of a(x) over overline Omega as lambda rightarrow0 .


A Benchmark for Spray from Nearby Cutting Vehicles. Current driver assistance systems and autonomous driving stacks are limited to well defined environment conditions and geo fenced areas. To increase driving safety in adverse weather conditions, broadening the application spectrum of autonomous driving and driver assistance systems is necessary. In order to enable this development, reproducible benchmarking methods are required to quantify the expected distortions. In this publication, a testing methodology for disturbances from spray is presented. It introduces a novel lightweight and configurable spray setup alongside an evaluation scheme to assess the disturbances caused by spray. The analysis covers an automotive RGB camera and two different LiDAR systems, as well as downstream detection algorithms based on YOLOv3 and PV RCNN. In a common scenario of a closely cutting vehicle, it is visible that the distortions are severely affecting the perception stack up to four seconds showing the necessity of benchmarking the influences of spray.


The Product of Gaussian Matrices is Close to Gaussian. We study the distribution of the it matrix product G 1 G 2 cdots G r of r independent Gaussian matrices of various sizes, where G i is d i 1 times d i , and we denote p d 0 , q d r , and require d 1 d r 1 . Here the entries in each G i are standard normal random variables with mean 0 and variance 1 . Such products arise in the study of wireless communication, dynamical systems, and quantum transport, among other places. We show that, provided each d i , i 1, ldots, r , satisfies d i geq C p cdot q , where C geq C 0 for a constant C 0 0 depending on r , then the matrix product G 1 G 2 cdots G r has variation distance at most delta to a p times q matrix G of i.i.d. standard normal random variables with mean 0 and variance prod i 1 r 1 d i . Here delta rightarrow 0 as C rightarrow infty . Moreover, we show a converse for constant r that if d i C' max p,q 1 2 min p,q 3 2 for some i , then this total variation distance is at least delta' , for an absolute constant delta' 0 depending on C' and r . This converse is best possible when p Theta(q) .


A Critical Assessment of Online Vs Traditional Review Characteristics. With the expansion of internet based platforms, social media and sharing economy, most individuals are tempted to review products or services that they consume.


A Compound Logic for Modification Problems Big Kingdoms Fall from Within. We introduce a novel model theoretic framework inspired from graph modification and based on the interplay between model theory and algorithmic graph minors. We propose a new compound logic operating with two types of sentences, expressing graph modification the modulator sentence, defining some property of the modified part of the graph, and the target sentence, defining some property of the resulting graph. In our framework, modulator sentences are in monadic second order logic and have models of bounded treewidth, while target sentences express first order logic properties along with minor exclusion. Our logic captures problems that are not definable in first order logic and, moreover, may have instances of unbounded treewidth. Also, it permits the modelling of wide families of problems involving vertex edge removals, alternative modulator measures (such as elimination distance or G treewidth), multistage modifications, and various cut problems. Our main result is that, for this compound logic, model checking can be done in quadratic time. This algorithmic meta theorem encompasses, unifies, and extends all known meta algorithmic results on minor closed graph classes. Moreover, all derived algorithms are constructive and this, as a byproduct, extends the constructibility horizon of the algorithmic applications of the Graph Minors theorem of Robertson and Seymour. The proposed logic can be seen as a general framework to capitalize on the potential of the irrelevant vertex technique.


Intermittent Deployment for Large Scale Multi Robot Forage Perception Data Synthesis, Prediction, and Planning. Monitoring the health and vigor of grasslands is vital for informing management decisions to optimize rotational grazing in agriculture applications. To take advantage of forage resources and improve land productivity, we require knowledge of pastureland growth patterns that is simply unavailable at state of the art. In this paper, we propose to deploy a team of robots to monitor the evolution of an unknown pastureland environment to fulfill the above goal. To monitor such an environment, which usually evolves slowly, we need to design a strategy for rapid assessment of the environment over large areas at a low cost. Thus, we propose an integrated pipeline comprising of data synthesis, deep neural network training and prediction along with a multi robot deployment algorithm that monitors pasturelands intermittently. Specifically, using expert informed agricultural data coupled with novel data synthesis in ROS Gazebo, we first propose a new neural network architecture to learn the spatiotemporal dynamics of the environment. Such predictions help us to understand pastureland growth patterns on large scales and make appropriate monitoring decisions for the future. Based on our predictions, we then design an intermittent multi robot deployment policy for low cost monitoring. Finally, we compare the proposed pipeline with other methods, from data synthesis to prediction and planning, to corroborate our pipeline's performance.


Multinational Address Parsing A Zero Shot Evaluation. Address parsing consists of identifying the segments that make up an address, such as a street name or a postal code. Because of its importance for tasks like record linkage, address parsing has been approached with many techniques, the latest relying on neural networks. While these models yield notable results, previous work on neural networks has only focused on parsing addresses from a single source country. This paper explores the possibility of transferring the address parsing knowledge acquired by training deep learning models on some countries' addresses to others with no further training in a zero shot transfer learning setting. We also experiment using an attention mechanism and a domain adversarial training algorithm in the same zero shot transfer setting to improve performance. Both methods yield state of the art performance for most of the tested countries while giving good results to the remaining countries. We also explore the effect of incomplete addresses on our best model, and we evaluate the impact of using incomplete addresses during training. In addition, we propose an open source Python implementation of some of our trained models.


Bitcoin Address Clustering Method Based on Multiple Heuristic Conditions. We analyzed the associations between Bitcoin transactions and addresses to cluster address and further find groups of addresses controlled by the same entity. It revealed the vulnerabilities of Bitcoin anonymity mechanism, which could be used by the law enforcement agencies to track and crack down illegal transactions. However, single heuristic method and incomplete heuristic conditions were difficult to cluster a large number of addresses comprehensively and accurately. Therefore, this paper reviewed a variety of heuristics, and used multiple heuristics comprehensively to cluster addresses to improve the degree of address aggregation and address recall rate, which laid a foundation for further inferring of entity identity.


Accelerated derivative free nonlinear least squares applied to the estimation of Manning coefficients. A general framework for solving nonlinear least squares problems without the employment of derivatives is proposed in the present paper together with a new general global convergence theory. With the aim to cope with the case in which the number of variables is big (for the standards of derivative free optimization), two dimension reduction procedures are introduced. One of them is based on iterative subspace minimization and the other one is based on spline interpolation with variable nodes. Each iteration based on those procedures is followed by an acceleration step inspired in the Sequential Secant Method. The practical motivation for this work is the estimation of parameters in Hydraulic models applied to dam breaking problems. Numerical examples of the application of the new method to those problems are given.


AKER A Design and Verification Framework for Safe andSecure SoC Access Control. Modern systems on a chip (SoCs) utilize heterogeneous architectures where multiple IP cores have concurrent access to on chip shared resources. In security critical applications, IP cores have different privilege levels for accessing shared resources, which must be regulated by an access control system. AKER is a design and verification framework for SoC access control. AKER builds upon the Access Control Wrapper (ACW) a high performance and easy to integrate hardware module that dynamically manages access to shared resources. To build an SoC access control system, AKER distributes the ACWs throughout the SoC, wrapping controller IP cores, and configuring the ACWs to perform local access control. To ensure the access control system is functioning correctly and securely, AKER provides a property driven security verification using MITRE common weakness enumerations. AKER verifies the SoC access control at the IP level to ensure the absence of bugs in the functionalities of the ACW module, at the firmware level to confirm the secure operation of the ACW when integrated with a hardware root of trust (HRoT), and at the system level to evaluate security threats due to the interactions among shared resources. The performance, resource usage, and security of access control systems implemented through AKER is experimentally evaluated on a Xilinx UltraScale programmable SoC, it is integrated with the OpenTitan hardware root of trust, and it is used to design an access control system for the OpenPULP multicore architecture.


The Twist Subgroup is generated by two elements. We show that the twist subgroup mathcal T g of a nonorientable surface of genus g can be generated by two elements for every odd g geq27 and even g geq42 . Using these generators, we can also show that mathcal T g can be generated by two or three commutators depending on g modulo 4 . Moreover, we show that mathcal T g can be generated by three elements if g geq 8 . For this general case, the number of commutator generators is either three or four depending on g modulo 4 again.


Ensemble Based Well Log Interpretation and Uncertainty Quantification for Geosteering. The costs for drilling offshore wells are high and hydrocarbons are often located in complex reservoir formations. To effectively produce from such reservoirs and reduce costs, optimized well placement in real time (geosteering) is crucial. Geosteering is usually assisted by an updated formation evaluation obtained by well log interpretation while drilling. A reliable, computationally efficient, and robust workflow to interpret well logs and capture uncertainties in real time is necessary for this application. An iterative ensemble based method, namely the approximate Levenberg Marquardt form of the Ensemble Randomized Maximum Likelihood (LM EnRML) is integrated in our formation evaluation workflow. We estimate model parameters, resistivity and density in addition to boundary locations, and related uncertainties by reducing the statistical misfit between the measurements from the well logging tools and the theoretical measurements from the forward tool simulators. The results of analyzing several synthetic cases with several types of logs verified that the proposed method can give good estimate of model parameters. By comparing the CPU time, we conclude that the proposed method has at least about 10 125 times lower computational time compare to a common statistical method, such as Metropolis Hastings Monte Carlo. In addition, the ensemble based method can run in parallel on multiple CPUs. Testing the method on a case inspired from a real field also yielded accurate formation evaluation. Thus, the proposed ensemble based method has been proven robust and computationally efficient to estimate petrophysical formation properties, layer boundaries and their uncertainties, indicating that it is suitable for geosteering.


On Typical Hesitant Fuzzy Languages and Automata. The idea of nondeterministic typical hesitant fuzzy automata is a generalization of the fuzzy automata presented by Costa and Bedregal. This paper, presents the sufficient and necessary conditions for a typical hesitant fuzzy language to be computed by nondeterministic typical hesitant fuzzy automata. Besides, the paper introduces a new class of Typical Hesitant Fuzzy Automata with crisp transitions, and we will show that this new class is equivalent to the original class introduced by Costa and Bedregal


MaxRay A Raytracing based Integrated Sensing and Communication Framework. Integrated Sensing And Communication (ISAC)forms a symbiosis between the human need for communication and the need for increasing productivity, by extracting environmental information leveraging the communication network. As multiple sensory already create a perception of the environment, an investigation into the advantages of ISAC compare to such modalities is required. Therefore, we introduce MaxRay, an ISAC framework allowing to simulate communication, sensing, and additional sensory jointly. Emphasizing the challenges for creating such sensing networks, we introduce the required propagation properties for sensing and how they are leveraged. To compare the performance of the different sensing techniques, we analyze four commonly used metrics used in different fields and evaluate their advantages and disadvantages for sensing. We depict that a metric based on prominence is suitable to cover most algorithms. Further we highlight the requirement of clutter removal algorithms, using two standard clutter removal techniques to detect a target in a typical industrial scenario. In general a versatile framework, allowing to create automatically labeled datasets to investigate a large variety of tasks is demonstrated.


Learning Implicit Glyph Shape Representation. In this paper, we present a novel implicit glyph shape representation, which models glyphs as shape primitives enclosed by quadratic curves, and naturally enables generating glyph images at arbitrary high resolutions. Experiments on font reconstruction and interpolation tasks verified that this structured implicit representation is suitable for describing both structure and style features of glyphs. Furthermore, based on the proposed representation, we design a simple yet effective disentangled network for the challenging one shot font style transfer problem, and achieve the best results comparing to state of the art alternatives in both quantitative and qualitative comparisons. Benefit from this representation, our generated glyphs have the potential to be converted to vector fonts through post processing, reducing the gap between rasterized images and vector graphics. We hope this work can provide a powerful tool for 2D shape analysis and synthesis, and inspire further exploitation in implicit representations for 2D shape modeling.


The ell p Gaussian Grothendieck problem with vector spins. We study the vector spin generalization of the ell p Gaussian Grothendieck problem. In other words, given integer kappa geq 1 , we investigate the asymptotic behaviour of the ground state energy associated with the Sherrington Kirkpatrick Hamiltonian indexed by vector spin configurations in the unit ell p ball. The ranges 1 leq p leq 2 and 2 p infty exhibit significantly different behaviours. When 1 leq p leq 2 , the vector spin generalization of the ell p Gaussian Grothendieck problem agrees with its scalar counterpart. In particular, its re scaled limit is proportional to some norm of a standard Gaussian random variable. On the other hand, for 2 p infty the re scaled limit of the ell p Gaussian Grothendieck problem with vector spins is given by a Parisi type variational formula.


Chemotactic Reaction Enhancement in One Dimension. Chemotaxis, the directional locomotion of cells towards a source of a chemical gradient, is an integral part of many biological processes for example, bacteria motion, single cell or multicellular organisms development, immune response, etc. Chemotaxis directs bacteria's movement to find food (e.g., glucose) by swimming toward the highest concentration of food molecules. In multicellular organisms, chemotaxis is critical to early development (e.g., movement of sperm towards the egg during fertilization). Chemotaxis also helps mobilize phagocytic and immune cells at sites of infection, tissue injury, and thus facilitates immune reactions. In this paper, we study a PDE system that describes such biological processes in one dimension, which may correspond to a thin channel, the setting relevant in many applications for example, spermatozoa progression to the ovum inside a Fallopian tube or immune response in a blood vessel.


Cascade RCNN for MIDOG Challenge. Mitotic counts are one of the key indicators of breast cancer prognosis. However, accurate mitotic cell counting is still a difficult problem and is labourious. Automated methods have been proposed for this task, but are usually dependent on the training images and show poor performance on unseen domains. In this work, we present a multi stage mitosis detection method based on a Cascade RCNN developed to be sequentially more selective against false positives. On the preliminary test set, the algorithm scores an F1 score of 0.7492.


Relating CNNs with brain Challenges and findings. Conventional neural network models (CNN), loosely inspired by the primate visual system, have been shown to predict neural responses in the visual cortex. However, the relationship between CNNs and the visual system is incomplete due to many reasons. On one hand state of the art CNN architecture is very complex, yet can be fooled by imperceptibly small, explicitly crafted perturbations which makes it hard difficult to map layers of the network with the visual system and to understand what they are doing. On the other hand, we don't know the exact mapping between feature space of the CNNs and the space domain of the visual cortex, which makes it hard to accurately predict neural responses. In this paper we review the challenges and the methods that have been used to predict neural responses in the visual cortex and whole brain as part of The Algonauts Project 2021 Challenge "How the Human Brain Makes Sense of a World in Motion".


Linear Additives. We introduce LAM, a subsystem of IMALL2 with restricted additive rules able to manage duplication linearly, called linear additive rules. LAM is presented as the type assignment system for a calculus endowed with copy constructors, which deal with substitution in a linear fashion. As opposed to the standard additive rules, the linear additive rules do not affect the complexity of term reduction typable terms of LAM enjoy linear strong normalization. Moreover, a mildly weakened version of cut elimination for this system is proven which takes a cubic number of steps. Finally, we define a sound translation from proofs of LAM into linear lambda terms of IMLL2, and we study its complexity.


Ritz type projectors with boundary interpolation properties and explicit spline error estimates. In this paper we construct Ritz type projectors with boundary interpolation properties in finite dimensional subspaces of the usual Sobolev space and we provide a priori error estimates for them. The abstract analysis is exemplified by considering spline spaces and we equip the corresponding error estimates with explicit constants. This complements our results recently obtained for explicit spline error estimates based on the classical Ritz projectors in Numer. Math. 144(4) 889 929, 2020 .


Multi Object Tracking with Hallucinated and Unlabeled Videos. In this paper, we explore learning end to end deep neural trackers without tracking annotations. This is important as large scale training data is essential for training deep neural trackers while tracking annotations are expensive to acquire. In place of tracking annotations, we first hallucinate videos from images with bounding box annotations using zoom in out motion transformations to obtain free tracking labels. We add video simulation augmentations to create a diverse tracking dataset, albeit with simple motion. Next, to tackle harder tracking cases, we mine hard examples across an unlabeled pool of real videos with a tracker trained on our hallucinated video data. For hard example mining, we propose an optimization based connecting process to first identify and then rectify hard examples from the pool of unlabeled videos. Finally, we train our tracker jointly on hallucinated data and mined hard video examples. Our weakly supervised tracker achieves state of the art performance on the MOT17 and TAO person datasets. On MOT17, we further demonstrate that the combination of our self generated data and the existing manually annotated data leads to additional improvements.


AdaptCL Efficient Collaborative Learning with Dynamic and Adaptive Pruning. In multi party collaborative learning, the parameter server sends a global model to each data holder for local training and then aggregates committed models globally to achieve privacy protection. However, both the dragger issue of synchronous collaborative learning and the staleness issue of asynchronous collaborative learning make collaborative learning inefficient in real world heterogeneous environments. We propose a novel and efficient collaborative learning framework named AdaptCL, which generates an adaptive sub model dynamically from the global base model for each data holder, without any prior information about worker capability. All workers (data holders) achieve approximately identical update time as the fastest worker by equipping them with capability adapted pruned models. Thus the training process can be dramatically accelerated. Besides, we tailor the efficient pruned rate learning algorithm and pruning approach for AdaptCL. Meanwhile, AdaptCL provides a mechanism for handling the trade off between accuracy and time overhead and can be combined with other techniques to accelerate training further. Empirical results show that AdaptCL introduces little computing and communication overhead. AdaptCL achieves time savings of more than 41 on average and improves accuracy in a low heterogeneous environment. In a highly heterogeneous environment, AdaptCL achieves a training speedup of 6.2x with a slight loss of accuracy.


A Framework to Enhance Generalization of Deep Metric Learning methods using General Discriminative Feature Learning and Class Adversarial Neural Networks. Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear projection. In contrast, Deep Metric Learning (DML) methods are proposed that automatically extract features from data and learn a non linear transformation from input space to a semantically embedding space. Recently, many DML methods are proposed focused to enhance the discrimination power of the learned metric by providing novel sampling strategies or loss functions. This approach is very helpful when both the training and test examples are coming from the same set of categories. However, it is less effective in many applications of DML such as image retrieval and person reidentification. Here, the DML should learn general semantic concepts from observed classes and employ them to rank or identify objects from unseen categories. Neglecting the generalization ability of the learned representation and just emphasizing to learn a more discriminative embedding on the observed classes may lead to the overfitting problem. To address this limitation, we propose a framework to enhance the generalization power of existing DML methods in a Zero Shot Learning (ZSL) setting by general yet discriminative representation learning and employing a class adversarial neural network. To learn a more general representation, we propose to employ feature maps of intermediate layers in a deep neural network and enhance their discrimination power through an attention mechanism. Besides, a class adversarial network is utilized to enforce the deep model to seek class invariant features for the DML task. We evaluate our work on widely used machine vision datasets in a ZSL setting.


Private Power and Public Interests An Ethnographic Examination of the Power Outages in Texas in February 2021. In 21st century America, to many observers, the idea that 10's of millions of Americans could lose power and heat for multiple days in the middle of a record cold snap, was unthinkable. It came as an even greater surprise that it would be Texas arguably one of the world's energy capitals that failed to provide sufficient power to its residents. This paper explores the events that led to the outage, the experiences of those who lived through it, and the situation in Texas one to two months after the event. We have taken an ethnographic approach to capture both the empirical aspects of the situation, and the more interpretive descriptions of the accounts and thoughts of the participants. We believe this ethnography of events in Texas can serve as foundational evidence and therefore can be generalized to a wide variety of situations and methodologies.


Resource Bisimilarity in Petri Nets is Decidable. Petri nets are a popular formalism for modeling and analyzing distributed systems. Tokens in Petri net models can represent the control flow state or resources produced consumed by transition firings. We define a resource as a part (a submultiset) of Petri net markings and call two resources equivalent when replacing one of them with another in any marking does not change the observable Petri net behavior. We consider resource similarity and resource bisimilarity, two congruent restrictions of bisimulation equivalence on Petri net markings. Previously it was proved that resource similarity (the largest congruence included in bisimulation equivalence) is undecidable. Here we present an algorithm for checking resource bisimilarity, thereby proving that this relation (the largest congruence included in bisimulation equivalence that is a bisimulation) is decidable. We also give an example of two resources in a Petri net that are similar but not bisimilar.


Opposite product system for the multiparameter CAR flows. We consider the multiparameter CAR flows and describe its opposite. We also characterize the symmeticity of CAR flows in terms of associated isometric representations.


Cellcounter a deep learning framework for high fidelity spatial localization of neurons. Many neuroscientific applications require robust and accurate localization of neurons. It is still an unsolved problem because of the enormous variation in intensity, texture, spatial overlap, morphology and background artifacts. In addition, curation of a large dataset containing complete manual annotation of neurons from high resolution images to train a classifier requires significant time and effort. We present Cellcounter, a deep learning based model trained on images containing incompletely annotated neurons with highly varied morphology and control images containing artifacts and background structures. Leveraging the striking self learning ability, Cellcounter gradually labels neurons, obviating the need for time intensive complete annotation. Cellcounter shows its efficacy over the state of the arts in the accurate localization of neurons while significantly reducing false positive detection in several protocols.


Classification of pivotal tensor categories with fusion rules related to SO(4) . In this paper we classify all semisimple tensor categories with the same fusion rules as operatorname Rep (SO(4)) , or one of the associated truncations. We show that such categories are explicitly classified by two non zero complex numbers. Furthermore we show these tensor categories are always braided, and there exist exactly 8 braidings.


RoadAtlas Intelligent Platform for Automated Road Defect Detection and Asset Management. With the rapid development of intelligent detection algorithms based on deep learning, much progress has been made in automatic road defect recognition and road marking parsing. This can effectively address the issue of an expensive and time consuming process for professional inspectors to review the street manually. Towards this goal, we present RoadAtlas, a novel end to end integrated system that can support 1) road defect detection, 2) road marking parsing, 3) a web based dashboard for presenting and inputting data by users, and 4) a backend containing a well structured database and developed APIs.


A proof of the IK K conjecture using spherical harmonic expansions. We use spherical harmonic expansions to prove that any star body equal to its intersection body is a ball about the origin.


Bayesian Optimization and Deep Learning forsteering wheel angle prediction. Automated driving systems (ADS) have undergone a significant improvement in the last years. ADS and more precisely self driving cars technologies will change the way we perceive and know the world of transportation systems in terms of user experience, mode choices and business models. The emerging field of Deep Learning (DL) has been successfully applied for the development of innovative ADS solutions. However, the attempt to single out the best deep neural network architecture and tuning its hyperparameters are all expensive processes, both in terms of time and computational resources. In this work, Bayesian Optimization (BO) is used to optimize the hyperparameters of a Spatiotemporal Long Short Term Memory (ST LSTM) network with the aim to obtain an accurate model for the prediction of the steering angle in a ADS. BO was able to identify, within a limited number of trials, a model namely BOST LSTM which resulted, on a public dataset, the most accurate when compared to classical end to end driving models.


Room temperature silicon platform for GHz frequency nano electro opto mechanical systems. Nano electro opto mechanical systems enable the synergistic coexistence of electrical, mechanical, and optical signals on a chip to realize new functions. Most of the technology platforms proposed for the fabrication of these systems so far are not fully compatible with the mainstream CMOS technology, thus hindering mass scale utilization. We have developed a CMOS technology platform for nano electro opto mechanical systems that includes piezoelectric interdigitated transducers for electronic driving of mechanical signals and nanocrystalline silicon nanobeams for enhanced optomechanical interaction. Room temperature operation of devices at 2 GHz and with peak sensitivity down to 2.6 cavity phonons is demonstrated. Our proof of principle technology platform can be integrated and interfaced with silicon photonics, electronics, and MEMS devices and may enable multiple functions for coherent signal processing in the classical and quantum domains.


Robust Backdoor Attacks against Deep Neural Networks in Real Physical World. Deep neural networks (DNN) have been widely deployed in various applications. However, many researches indicated that DNN is vulnerable to backdoor attacks. The attacker can create a hidden backdoor in target DNN model, and trigger the malicious behaviors by submitting specific backdoor instance. However, almost all the existing backdoor works focused on the digital domain, while few studies investigate the backdoor attacks in real physical world. Restricted to a variety of physical constraints, the performance of backdoor attacks in the real physical world will be severely degraded. In this paper, we propose a robust physical backdoor attack method, PTB (physical transformations for backdoors), to implement the backdoor attacks against deep learning models in the real physical world. Specifically, in the training phase, we perform a series of physical transformations on these injected backdoor instances at each round of model training, so as to simulate various transformations that a backdoor may experience in real world, thus improves its physical robustness. Experimental results on the state of the art face recognition model show that, compared with the backdoor methods that without PTB, the proposed attack method can significantly improve the performance of backdoor attacks in real physical world. Under various complex physical conditions, by injecting only a very small ratio (0.5 ) of backdoor instances, the attack success rate of physical backdoor attacks with the PTB method on VGGFace is 82 , while the attack success rate of backdoor attacks without the proposed PTB method is lower than 11 . Meanwhile, the normal performance of the target DNN model has not been affected.


Fast Graph Neural Tangent Kernel via Kronecker Sketching. Many deep learning tasks have to deal with graphs (e.g., protein structures, social networks, source code abstract syntax trees). Due to the importance of these tasks, people turned to Graph Neural Networks (GNNs) as the de facto method for learning on graphs. GNNs have become widely applied due to their convincing performance. Unfortunately, one major barrier to using GNNs is that GNNs require substantial time and resources to train. Recently, a new method for learning on graph data is Graph Neural Tangent Kernel (GNTK) Du, Hou, Salakhutdinov, Poczos, Wang and Xu 19 . GNTK is an application of Neural Tangent Kernel (NTK) Jacot, Gabriel and Hongler 18 (a kernel method) on graph data, and solving NTK regression is equivalent to using gradient descent to train an infinite wide neural network. The key benefit of using GNTK is that, similar to any kernel method, GNTK's parameters can be solved directly in a single step. This can avoid time consuming gradient descent. Meanwhile, sketching has become increasingly used in speeding up various optimization problems, including solving kernel regression. Given a kernel matrix of n graphs, using sketching in solving kernel regression can reduce the running time to o(n 3) . But unfortunately such methods usually require extensive knowledge about the kernel matrix beforehand, while in the case of GNTK we find that the construction of the kernel matrix is already O(n 2N 4) , assuming each graph has N nodes. The kernel matrix construction time can be a major performance bottleneck when the size of graphs N increases. A natural question to ask is thus whether we can speed up the kernel matrix construction to improve GNTK regression's end to end running time. This paper provides the first algorithm to construct the kernel matrix in o(n 2N 3) running time.


Towards the Verification of Strategic Properties in Multi Agent Systems with Imperfect Information. In logics for the strategic reasoning the main challenge is represented by their verification in contexts of imperfect information and perfect recall. In this work, we show a technique to approximate the verification of Alternating time Temporal Logic (ATL ) under imperfect information and perfect recall, which is known to be undecidable. Given a model M and a formula varphi , we propose a verification procedure that generates sub models of M in which each sub model M' satisfies a sub formula varphi' of varphi and the verification of varphi' in M' is decidable. Then, we use CTL model checking to provide a verification result of varphi on M. We prove that our procedure is in the same class of complexity of ATL model checking under perfect information and perfect recall, we present a tool that implements our procedure, and provide experimental results.


Artificial Intelligence Technology analysis using Artificial Intelligence patent through Deep Learning model and vector space model. Thanks to rapid development of artificial intelligence technology in recent years, the current artificial intelligence technology is contributing to many part of society. Education, environment, medical care, military, tourism, economy, politics, etc. are having a very large impact on society as a whole. For example, in the field of education, there is an artificial intelligence tutoring system that automatically assigns tutors based on student's level. In the field of economics, there are quantitative investment methods that automatically analyze large amounts of data to find investment laws to create investment models or predict changes in financial markets. As such, artificial intelligence technology is being used in various fields. So, it is very important to know exactly what factors have an important influence on each field of artificial intelligence technology and how the relationship between each field is connected. Therefore, it is necessary to analyze artificial intelligence technology in each field. In this paper, we analyze patent documents related to artificial intelligence technology. We propose a method for keyword analysis within factors using artificial intelligence patent data sets for artificial intelligence technology analysis. This is a model that relies on feature engineering based on deep learning model named KeyBERT, and using vector space model. A case study of collecting and analyzing artificial intelligence patent data was conducted to show how the proposed model can be applied to real world problems.


Morava K theory and Filtrations by Powers. We prove the convergence of the Adams spectral sequence based on Morava K theory and relate it to the filtration by powers of the maximal ideal in the Lubin Tate ring through a Miller square. We use the filtration by powers to construct a spectral sequence relating the homology of the K local sphere to derived functors of completion and express the latter as cohomology of the Morava stabilizer group. As an application, we compute the zeroth limit at all primes and heights.


Modal Reasoning Metric Reasoning, via Lawvere. Graded modal types systems and coeffects are becoming a standard formalism to deal with context dependent computations where code usage plays a central role. The theory of program equivalence for modal and coeffectful languages, however, is considerably underdeveloped if compared to the denotational and operational semantics of such languages. This raises the question of how much of the theory of ordinary program equivalence can be given in a modal scenario. In this work, we show that coinductive equivalences can be extended to a modal setting, and we do so by generalising Abramsky's applicative bisimilarity to coeffectful behaviours. To achieve this goal, we develop a general theory of ternary program relations based on the novel notion of a comonadic lax extension, on top of which we define a modal extension of Abramsky's applicative bisimilarity (which we dub modal applicative bisimilarity). We prove such a relation to be a congruence, this way obtaining a compositional technique for reasoning about modal and coeffectful behaviours. But this is not the end of the story we also establish a correspondence between modal program relations and program distances. This correspondence shows that modal applicative bisimilarity and (a properly extended) applicative bisimilarity distance coincide, this way revealing that modal program equivalences and program distances are just two sides of the same coin.


Agile Formation Control of Drone Flocking Enhanced with Active Vision based Relative Localization. The vision based relative localization can provide effective feedback for the cooperation of aerial swarm and has been widely investigated in previous works. However, the limited field of view (FOV) inherently restricts its performance. To cope with this issue, this letter proposes a novel distributed active vision based relative localization framework and apply it to formation control in aerial swarms. Inspired by bird flocks in nature, we devise graph based attention planning (GAP) to improve the observation quality of the active vision in the swarm. Then active detection results are fused with onboard measurements from Ultra WideBand (UWB) and visual inertial odometry (VIO) to obtain real time relative positions, which further improve the formation control performance of the swarm. Simulations and experiments demonstrate that the proposed active vision system outperforms the fixed vision system in terms of estimation and formation accuracy.


A Novel Framework Integrating AI Model and Enzymological Experiments Promotes Identification of SARS CoV 2 3CL Protease Inhibitors and Activity based Probe. The identification of protein ligand interaction plays a key role in biochemical research and drug discovery. Although deep learning has recently shown great promise in discovering new drugs, there remains a gap between deep learning based and experimental approaches. Here we propose a novel framework, named AIMEE, integrating AI Model and Enzymology Experiments, to identify inhibitors against 3CL protease of SARS CoV 2, which has taken a significant toll on people across the globe. From a bioactive chemical library, we have conducted two rounds of experiments and identified six novel inhibitors with a hit rate of 29.41 , and four of them showed an IC50 value less than 3 mu M. Moreover, we explored the interpretability of the central model in AIMEE, mapping the deep learning extracted features to domain knowledge of chemical properties. Based on this knowledge, a commercially available compound was selected and proven to be an activity based probe of 3CLpro. This work highlights the great potential of combining deep learning models and biochemical experiments for intelligent iteration and expanding the boundaries of drug discovery.


Left invariant Riemann solitons of three dimensional Lorentzian Lie groups. In this note, we completely classify left invariant Riemann solitons on three dimensional Lorentzian Lie groups.


Preference Communication in Multi Objective Normal Form Games. We study the problem of multiple agents learning concurrently in a multi objective environment. Specifically, we consider two agents that repeatedly play a multi objective normal form game. In such games, the payoffs resulting from joint actions are vector valued. Taking a utility based approach, we assume a utility function exists that maps vectors to scalar utilities and consider agents that aim to maximise the utility of expected payoff vectors. As agents do not necessarily know their opponent's utility function or strategy, they must learn optimal policies to interact with each other. To aid agents in arriving at adequate solutions, we introduce four novel preference communication protocols for both cooperative as well as self interested communication. Each approach describes a specific protocol for one agent communicating preferences over their actions and how another agent responds. These protocols are subsequently evaluated on a set of five benchmark games against baseline agents that do not communicate. We find that preference communication can drastically alter the learning process and lead to the emergence of cyclic Nash equilibria which had not been previously observed in this setting. Additionally, we introduce a communication scheme where agents must learn when to communicate. For agents in games with Nash equilibria, we find that communication can be beneficial but difficult to learn when agents have different preferred equilibria. When this is not the case, agents become indifferent to communication. In games without Nash equilibria, our results show differences across learning rates. When using faster learners, we observe that explicit communication becomes more prevalent at around 50 of the time, as it helps them in learning a compromise joint policy. Slower learners retain this pattern to a lesser degree, but show increased indifference.


Coherent presentations of super plactic monoids of type A by insertions. In this paper, we study by rewriting methods the presentations of the super plactic monoid of type A which is related to the representations of the general linear Lie superalgebra. We construct a convergent presentation of this monoid whose generators are super columns and whose rules are defined by insertions on super tableaux over a signed alphabet. We extend this presentation into a coherent one whose syzygies are defined as relations among insertion algorithms. Finally, we reduce this coherent presentation to a Tietze equivalent one over the initial signed alphabet. Such coherent presentations are used for representations of super plactic monoids by describing their actions on categories.


Revisiting derived crystalline cohomology. We prove that the infty category of surjections of animated rings is projectively generated, introduce and study the notion of animated PD pairs surjections of animated rings with a "derived" PD structure. This allows us to generalize classical results to non flat and non finitely generated situations. Using animated PD pairs, we develop several approaches to derived crystalline cohomology and establish comparison theorems. As an application, we generalize the comparison between derived and classical crystalline cohomology from syntomic (affine) schemes (due to Bhatt) to quasisyntomic schemes. We also develop a non completed animated analogue of prisms and prismatic envelopes. We prove a variant of the Hodge Tate comparison for animated prismatic envelopes from which we deduce a result about flat cover of the final object for quasisyntomic schemes, which generalizes several known results under smoothness and finiteness conditions.


A Closer Look at How Fine tuning Changes BERT. Given the prevalence of pre trained contextualized representations in today's NLP, there have been many efforts to understand what information they contain, and why they seem to be universally successful. The most common approach to use these representations involves fine tuning them for an end task. Yet, how fine tuning changes the underlying embedding space is less studied. In this work, we study the English BERT family and use two probing techniques to analyze how fine tuning changes the space. We hypothesize that fine tuning affects classification performance by increasing the distances between examples associated with different labels. We confirm this hypothesis with carefully designed experiments on five different NLP tasks. Via these experiments, we also discover an exception to the prevailing wisdom that "fine tuning always improves performance". Finally, by comparing the representations before and after fine tuning, we discover that fine tuning does not introduce arbitrary changes to representations instead, it adjusts the representations to downstream tasks while largely preserving the original spatial structure of the data points.


Discriminative Attribution from Counterfactuals. We present a method for neural network interpretability by combining feature attribution with counterfactual explanations to generate attribution maps that highlight the most discriminative features between pairs of classes. We show that this method can be used to quantitatively evaluate the performance of feature attribution methods in an objective manner, thus preventing potential observer bias. We evaluate the proposed method on three diverse datasets, including a challenging artificial dataset and real world biological data. We show quantitatively and qualitatively that the highlighted features are substantially more discriminative than those extracted using conventional attribution methods and argue that this type of explanation is better suited for understanding fine grained class differences as learned by a deep neural network.


Inapproximability of counting hypergraph colourings. Recent developments in approximate counting have made startling progress in developing fast algorithmic methods for approximating the number of solutions to constraint satisfaction problems (CSPs) with large arities, using connections to the Lovasz Local Lemma. Nevertheless, the boundaries of these methods for CSPs with non Boolean domain are not well understood. Our goal in this paper is to fill in this gap and obtain strong inapproximability results by studying the prototypical problem in this class of CSPs, hypergraph colourings. More precisely, we focus on the problem of approximately counting q colourings on K uniform hypergraphs with bounded degree Delta . An efficient algorithm exists if Delta lesssim frac q K 3 1 4 KK 2 (Jain, Pham, and Voung, 2021 He, Sun, and Wu, 2021). Somewhat surprisingly however, a hardness bound is not known even for the easier problem of finding colourings. For the counting problem, the situation is even less clear and there is no evidence of the right constant controlling the growth of the exponent in terms of K . To this end, we first establish that for general q computational hardness for finding a colouring on simple linear hypergraphs occurs at Delta gtrsim Kq K , almost matching the algorithm from the Lovasz Local Lemma. Our second and main contribution is to obtain a far more refined bound for the counting problem that goes well beyond the hardness of finding a colouring and which we conjecture that is asymptotically tight (up to constant factors). We show in particular that for all even q geq 4 it is NP hard to approximate the number of colourings when Delta gtrsim q K 2 .


DaLAJ a dataset for linguistic acceptability judgments for Swedish Format, baseline, sharing. We present DaLAJ 1.0, a Dataset for Linguistic Acceptability Judgments for Swedish, comprising 9 596 sentences in its first version and the initial experiment using it for the binary classification task. DaLAJ is based on the SweLL second language learner data, consisting of essays at different levels of proficiency. To make sure the dataset can be freely available despite the GDPR regulations, we have sentence scrambled learner essays and removed part of the metadata about learners, keeping for each sentence only information about the mother tongue and the level of the course where the essay has been written. We use the normalized version of learner language as the basis for the DaLAJ sentences, and keep only one error per sentence. We repeat the same sentence for each individual correction tag used in the sentence. For DaLAJ 1.0 we have used four error categories (out of 35 available in SweLL), all connected to lexical or word building choices. Our baseline results for the binary classification show an accuracy of 58 for DaLAJ 1.0 using BERT embeddings. The dataset is included in the SwedishGlue (Swe. SuperLim) benchmark. Below, we describe the format of the dataset, first experiments, our insights and the motivation for the chosen approach to data sharing.


Fredholm transformation on Laplacian and rapid stabilization for the heat equation. We study the rapid stabilization of the heat equation on the 1 dimensional torus using the backstepping method with a Fredholm transformation. We prove that, under some assumption on the control operator, two scalar controls are necessary and sufficient to get controllability and rapid stabilization. This classical framework allows us to present the backstepping method with Fredholm transformations on Laplace operators in a sharp functional setting, which is the main objective of this work. Finally, we prove that the same Fredholm transformation also leads to the local rapid stability of the viscous Burgers equation.


Gone Fishing Neural Active Learning with Fisher Embeddings. There is an increasing need for effective active learning algorithms that are compatible with deep neural networks. This paper motivates and revisits a classic, Fisher based active selection objective, and proposes BAIT, a practical, tractable, and high performing algorithm that makes it viable for use with neural models. BAIT draws inspiration from the theoretical analysis of maximum likelihood estimators (MLE) for parametric models. It selects batches of samples by optimizing a bound on the MLE error in terms of the Fisher information, which we show can be implemented efficiently at scale by exploiting linear algebraic structure especially amenable to execution on modern hardware. Our experiments demonstrate that BAIT outperforms the previous state of the art on both classification and regression problems, and is flexible enough to be used with a variety of model architectures.


Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation. Recent studies imply that deep neural networks are vulnerable to adversarial examples inputs with a slight but intentional perturbation are incorrectly classified by the network. Such vulnerability makes it risky for some security related applications (e.g., semantic segmentation in autonomous cars) and triggers tremendous concerns on the model reliability. For the first time, we comprehensively evaluate the robustness of existing UDA methods and propose a robust UDA approach. It is rooted in two observations (i) the robustness of UDA methods in semantic segmentation remains unexplored, which pose a security concern in this field and (ii) although commonly used self supervision (e.g., rotation and jigsaw) benefits image tasks such as classification and recognition, they fail to provide the critical supervision signals that could learn discriminative representation for segmentation tasks. These observations motivate us to propose adversarial self supervision UDA (or ASSUDA) that maximizes the agreement between clean images and their adversarial examples by a contrastive loss in the output space. Extensive empirical studies on commonly used benchmarks demonstrate that ASSUDA is resistant to adversarial attacks.


White Box Performance Influence Models A Profiling and Learning Approach. Many modern software systems are highly configurable, allowing the user to tune them for performance and more. Current performance modeling approaches aim at finding performance optimal configurations by building performance models in a black box manner. While these models provide accurate estimates, they cannot pinpoint causes of observed performance behavior to specific code regions. This does not only hinder system understanding, but it also complicates tracing the influence of configuration options to individual methods. We propose a white box approach that models configuration dependent performance behavior at the method level. This allows us to predict the influence of configuration decisions on individual methods, supporting system understanding and performance debugging. The approach consists of two steps First, we use a coarse grained profiler and learn performance influence models for all methods, potentially identifying some methods that are highly configuration and performance sensitive, causing inaccurate predictions. Second, we re measure these methods with a fine grained profiler and learn more accurate models, at higher cost, though. By means of 9 real world Java software systems, we demonstrate that our approach can efficiently identify configuration relevant methods and learn accurate performance influence models.


Crosslingual Embeddings are Essential in UNMT for Distant Languages An English to IndoAryan Case Study. Recent advances in Unsupervised Neural Machine Translation (UNMT) have minimized the gap between supervised and unsupervised machine translation performance for closely related language pairs. However, the situation is very different for distant language pairs. Lack of lexical overlap and low syntactic similarities such as between English and Indo Aryan languages leads to poor translation quality in existing UNMT systems. In this paper, we show that initializing the embedding layer of UNMT models with cross lingual embeddings shows significant improvements in BLEU score over existing approaches with embeddings randomly initialized. Further, static embeddings (freezing the embedding layer weights) lead to better gains compared to updating the embedding layer weights during training (non static). We experimented using Masked Sequence to Sequence (MASS) and Denoising Autoencoder (DAE) UNMT approaches for three distant language pairs. The proposed cross lingual embedding initialization yields BLEU score improvement of as much as ten times over the baseline for English Hindi, English Bengali, and English Gujarati. Our analysis shows the importance of cross lingual embedding, comparisons between approaches, and the scope of improvements in these systems.


Relativistic effects for the superheavy reaction Og 2Ts 2 Og(Ts) 4 Dramatic relativistic effects for the atomization energy of Oganesson tetratennesside Og(Ts) 4 and the prediction of the existence of tetrahedral Og(Ts) 4 . Our all electron fully relativistic Dirac Fock (DF) and nonrelativistic (NR) Hartree Fock (HF) SCF molecular calculations for the superheavy tetrahedral (T d ) oganesson tetratennesside OgT 4 predict atomization energy (Ae) of 7.45 and 11.21 eV, respectively. Our DF and NR calculations, however for the square planar (D 4h )OsTs 4 predict atomization energy (Ae) o 6.34 and 8.56 ev, respectively. There are dramatic relativistic effects for the atomization energy of T d and D 4h OgT 4 of 18.65 eV and 14.90 eV, respectively. Whereas our DF calculations predict the T d OgT 4 to be more stable than the D 4h OgT 4 by 1.10 eV, our NR calculations predict the D 4h OgT 4 to be more stable than the T d OgT 4 by 2.65eV. Our NR calculations predict both the T d and D 4h OgTs 4 to be unbound by 11.21 and 8.56 eV, respectively. However our relativistic DF calculations predict both the T d and D 4h OgT 4 to be bound by 7.45 and 6.34 eV respectively and so the relativistic treatment is mandatory for bonding and binding in the pentatomic superheavy system with 586 electrons involving the two heaviest SHE Ts and Og.


Sharp estimates of noncommutative Bochner Riesz means on two dimensional quantum tori. In this paper, we establish the full L p boundedness of noncommutative Bochner Riesz means on two dimensional quantum tori, which completely resolves an open problem raised in cite CXY13 in the sense of the L p convergence for two dimensions. The main ingredients are sharp estimates of noncommutative Kakeya maximal functions and geometric estimates in the plane. We make the most of noncommutative theories of maximal square functions, together with microlocal decompositions in both proofs of sharper estimates of Kakeya maximal functions and Bochner Riesz means.


GeoCLR Georeference Contrastive Learning for Efficient Seafloor Image Interpretation. This paper describes Georeference Contrastive Learning of visual Representation (GeoCLR) for efficient training of deep learning Convolutional Neural Networks (CNNs). The method leverages georeference information by generating a similar image pair using images taken of nearby locations, and contrasting these with an image pair that is far apart. The underlying assumption is that images gathered within a close distance are more likely to have similar visual appearance, where this can be reasonably satisfied in seafloor robotic imaging applications where image footprints are limited to edge lengths of a few metres and are taken so that they overlap along a vehicle's trajectory, whereas seafloor substrates and habitats have patch sizes that are far larger. A key advantage of this method is that it is self supervised and does not require any human input for CNN training. The method is computationally efficient, where results can be generated between dives during multi day AUV missions using computational resources that would be accessible during most oceanic field trials. We apply GeoCLR to habitat classification on a dataset that consists of 86k images gathered using an Autonomous Underwater Vehicle (AUV). We demonstrate how the latent representations generated by GeoCLR can be used to efficiently guide human annotation efforts, where the semi supervised framework improves classification accuracy by an average of 11.8 compared to state of the art transfer learning using the same CNN and equivalent number of human annotations for training.


An upperbound for the number of critical points of the systole function on the surface moduli space. We obtain an upper bound for the number of critical points of the systole function on mathcal M g . Besides, we obtain an upper bound for the number of those critical points whose systole is smaller than a constant.


A generalized fractional Pohozaev identity and applications. We prove a fractional Pohozaev type identity in a generalized framework and discuss its applications. Specifically, we shall consider applications to nonexistence of solutions in the case of supercritical semilinear Dirichlet problems and regarding a Hadamard formula for the derivative of Dirichlet eigenvalues of the fractional Laplacian with respect to domain deformations. We also derive the simplicity of radial eigenvalues in the case of radial bounded domains and apply the Hadamard formula to this case.


Weave Realizability for D type. We study exact Lagrangian fillings of Legendrian links of D n type in the standard contact 3 sphere. The main result is the existence of a Lagrangian filling, represented by a weave, such that any algebraic quiver mutation of the associated intersection quiver can be realized as a geometric weave mutation. The method of proof is via Legendrian weave calculus and a construction of appropriate 1 cycles whose geometric intersections realize the required algebraic intersection numbers. In particular, we show that in D type, each cluster chart of the moduli of microlocal rank 1 sheaves is induced by at least one embedded exact Lagrangian filling. Hence, the Legendrian links of D n type have at least as many Hamiltonian isotopy classes of Lagrangian fillings as cluster seeds in the D n type cluster algebra, and their geometric exchange graph for Lagrangian disk surgeries contains the cluster exchange graph of D n type.


On r dynamic coloring on lexicographic product of star graphs. In this research, the exact results on r dynamic coloring of lexicographic product of path with star graph, path with double star graph, path with triple star graph and finally complete graph with path are obtained.


Towards Equal Gender Representation in the Annotations of Toxic Language Detection. Classifiers tend to propagate biases present in the data on which they are trained. Hence, it is important to understand how the demographic identities of the annotators of comments affect the fairness of the resulting model. In this paper, we focus on the differences in the ways men and women annotate comments for toxicity, investigating how these differences result in models that amplify the opinions of male annotators. We find that the BERT model as sociates toxic comments containing offensive words with male annotators, causing the model to predict 67.7 of toxic comments as having been annotated by men. We show that this disparity between gender predictions can be mitigated by removing offensive words and highly toxic comments from the training data. We then apply the learned associations between gender and language to toxic language classifiers, finding that models trained exclusively on female annotated data perform 1.8 better than those trained solely on male annotated data and that training models on data after removing all offensive words reduces bias in the model by 55.5 while increasing the sensitivity by 0.4 .


Comparison and Analysis of Image to Image Generative Adversarial Networks A Survey. Generative Adversarial Networks (GANs) have recently introduced effective methods of performing Image to Image translations. These models can be applied and generalized to a variety of domains in Image to Image translation without changing any parameters. In this paper, we survey and analyze eight Image to Image Generative Adversarial Networks Pix2Px, CycleGAN, CoGAN, StarGAN, MUNIT, StarGAN2, DA GAN, and Self Attention GAN. Each of these models presented state of the art results and introduced new techniques to build Image to Image GANs. In addition to a survey of the models, we also survey the 18 datasets they were trained on and the 9 metrics they were evaluated on. Finally, we present results of a controlled experiment for 6 of these models on a common set of metrics and datasets. The results were mixed and showed that on certain datasets, tasks, and metrics some models outperformed others. The last section of this paper discusses those results and establishes areas of future research. As researchers continue to innovate new Image to Image GANs, it is important that they gain a good understanding of the existing methods, datasets, and metrics. This paper provides a comprehensive overview and discussion to help build this foundation.


Real Lie Groups of Finite Dimension. This survey is about the fundamentals of the theory of finite dimensional Lie groups over the field of real numbers. The notion of the tangent space of a manifold at a point is considered to be defined via the well known chart and vector formalism, here, a formalism equivalent to other commonly used ones (namely, the curve and derivation methods). The proofs of all assertions about Lie groups are in alignment with this formalism, here. Dealing with the basic facts of Lie groups rigorously with regard to this formulation of tangent space seems to be scarce in the literature.


A single camera synthetic Schlieren method for the measurement of free liquid surfaces. A single camera synthetic Schlieren method is introduced to measure the height of a dynamic free liquid surface in a container with a flat bottom. Markers placed on the bottom, seen through the free surface, are virtually displaced due to light refraction at the surface. According to Snell's law, the marker displacements depend on the refractive indices of the transparent liquid and the air, and on the surface height and its spatial gradients. We solve the resulting governing nonlinear equation with the Newton Raphson method to obtain the surface height. Our method does not require a reference surface height, which allows the measurement of surfaces topography in situations where the liquid depth is unknown. We demonstrate the accuracy of the method by performing experiments of surface ripples and dam break flows and discuss the measurement uncertainty, errors and limitations.


Beyond Question Based Biases Assessing Multimodal Shortcut Learning in Visual Question Answering. We introduce an evaluation methodology for visual question answering (VQA) to better diagnose cases of shortcut learning. These cases happen when a model exploits spurious statistical regularities to produce correct answers but does not actually deploy the desired behavior. There is a need to identify possible shortcuts in a dataset and assess their use before deploying a model in the real world. The research community in VQA has focused exclusively on question based shortcuts, where a model might, for example, answer "What is the color of the sky" with "blue" by relying mostly on the question conditional training prior and give little weight to visual evidence. We go a step further and consider multimodal shortcuts that involve both questions and images. We first identify potential shortcuts in the popular VQA v2 training set by mining trivial predictive rules such as co occurrences of words and visual elements. We then introduce VQA CounterExamples (VQA CE), an evaluation protocol based on our subset of CounterExamples i.e. image question answer triplets where our rules lead to incorrect answers. We use this new evaluation in a large scale study of existing approaches for VQA. We demonstrate that even state of the art models perform poorly and that existing techniques to reduce biases are largely ineffective in this context. Our findings suggest that past work on question based biases in VQA has only addressed one facet of a complex issue. The code for our method is available at https github.com cdancette detect shortcuts.


Meta evaluation of Conversational Search Evaluation Metrics. Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any natural language responses could be generated, and users commonly interact for multiple semantically coherent rounds to accomplish a search task. Although prior studies proposed many evaluation metrics, the extent of how those measures effectively capture user preference remains to be investigated. In this paper, we systematically meta evaluate a variety of conversational search metrics. We specifically study three perspectives on those metrics (1) reliability the ability to detect "actual" performance differences as opposed to those observed by chance (2) fidelity the ability to agree with ultimate user preference and (3) intuitiveness the ability to capture any property deemed important adequacy, informativeness, and fluency in the context of conversational search. By conducting experiments on two test collections, we find that the performance of different metrics varies significantly across different scenarios whereas consistent with prior studies, existing metrics only achieve a weak correlation with ultimate user preference and satisfaction. METEOR is, comparatively speaking, the best existing single turn metric considering all three perspectives. We also demonstrate that adapted session based evaluation metrics can be used to measure multi turn conversational search, achieving moderate concordance with user satisfaction. To our knowledge, our work establishes the most comprehensive meta evaluation for conversational search to date.


PySDM v1 particle based cloud modelling package for warm rain microphysics and aqueous chemistry. PySDM is an open source Python package for simulating the dynamics of particles undergoing condensational and collisional growth, interacting with a fluid flow and subject to chemical composition changes. It is intended to serve as a building block for process level as well as computational fluid dynamics simulation systems involving representation of a continuous phase (air) and a dispersed phase (aerosol), with PySDM being responsible for representation of the dispersed phase. The PySDM package core is a Pythonic high performance implementation of the Super Droplet Method (SDM) Monte Carlo algorithm for representing collisional growth, hence the name. PySDM has two alternative parallel number crunching backends available multi threaded CPU backend based on Numba and GPU resident backend built on top of ThrustRTC. The usage examples are built on top of four simple atmospheric cloud modelling frameworks box, adiabatic parcel, single column and 2D prescribed flow kinematic models. In addition, the package ships with tutorial code depicting how PySDM can be used from Julia and Matlab.


Adjoint Matching Neural Network Surrogates for Fast 4D Var Data Assimilation. The data assimilation procedures used in many operational numerical weather forecasting systems are based around variants of the 4D Var algorithm. The cost of solving the 4D Var problem is dominated by the cost of forward and adjoint evaluations of the physical model. This motivates their substitution by fast, approximate surrogate models. Neural networks offer a promising approach for the data driven creation of surrogate models. The accuracy of the surrogate 4D Var problem's solution has been shown to depend explicitly on accurate modeling of the forward and adjoint for other surrogate modeling approaches and in the general nonlinear setting. We formulate and analyze several approaches to incorporating derivative information into the construction of neural network surrogates. The resulting networks are tested on out of training set data and in a sequential data assimilation setting on the Lorenz 63 system. Two methods demonstrate superior performance when compared with a surrogate network trained without adjoint information, showing the benefit of incorporating adjoint information into the training process.


Stochastic Bandits for Multi platform Budget Optimization in Online Advertising. We study the problem of an online advertising system that wants to optimally spend an advertiser's given budget for a campaign across multiple platforms, without knowing the value for showing an ad to the users on those platforms. We model this challenging practical application as a Stochastic Bandits with Knapsacks problem over T rounds of bidding with the set of arms given by the set of distinct bidding m tuples, where m is the number of platforms. We modify the algorithm proposed in Badanidiyuru emph et al., to extend it to the case of multiple platforms to obtain an algorithm for both the discrete and continuous bid spaces. Namely, for discrete bid spaces we give an algorithm with regret O left(OPT sqrt frac mn B sqrt mn OPT right) , where OPT is the performance of the optimal algorithm that knows the distributions. For continuous bid spaces the regret of our algorithm is tilde O left(m 1 3 cdot min left B 2 3 , (m T) 2 3 right right) . When restricted to this special case, this bound improves over Sankararaman and Slivkins in the regime OPT ll T , as is the case in the particular application at hand. Second, we show an Omega left ( sqrt m OPT right) lower bound for the discrete case and an Omega left( m 1 3 B 2 3 right) lower bound for the continuous setting, almost matching the upper bounds. Finally, we use a real world data set from a large internet online advertising company with multiple ad platforms and show that our algorithms outperform common benchmarks and satisfy the required properties warranted in the real world application.


A large octupole magnetic trap for research with atomic hydrogen. We describe the design and performance of a large magnetic trap for storing and cooling of atomic hydrogen (H). The trap operates in the vacuum space of a dilution refrigerator at a temperature of 1.5 K. Aiming at a large volume of the trap we implemented the octupole configuration of linear currents (Ioffe bars) for the radial confinement, combined with two axial pinch coils and a 3 T solenoid for the cryogenic H dissociator. The octupole magnet consists of eight race track segments which are compressed towards each other with magnetic forces. This provides a mechanically stable and robust construction with a possibility of replacement or repair of each segment. A maximum trap depth of 0.54 K (0.8 T) was reached, corresponding to an effective volume of 0.5 liters for hydrogen gas at 50 mK. This is an order of magnitude larger than ever used for trapping atoms.


MCTSteg A Monte Carlo Tree Search based Reinforcement Learning Framework for Universal Non additive Steganography. Recent research has shown that non additive image steganographic frameworks effectively improve security performance through adjusting distortion distribution. However, as far as we know, all of the existing non additive proposals are based on handcrafted policies, and can only be applied to a specific image domain, which heavily prevent non additive steganography from releasing its full potentiality. In this paper, we propose an automatic non additive steganographic distortion learning framework called MCTSteg to remove the above restrictions. Guided by the reinforcement learning paradigm, we combine Monte Carlo Tree Search (MCTS) and steganalyzer based environmental model to build MCTSteg. MCTS makes sequential decisions to adjust distortion distribution without human intervention. Our proposed environmental model is used to obtain feedbacks from each decision. Due to its self learning characteristic and domain independent reward function, MCTSteg has become the first reported universal non additive steganographic framework which can work in both spatial and JPEG domains. Extensive experimental results show that MCTSteg can effectively withstand the detection of both hand crafted feature based and deep learning based steganalyzers. In both spatial and JPEG domains, the security performance of MCTSteg steadily outperforms the state of the art by a clear margin under different scenarios.