A Triangular Fuzzy based Multicriteria Decision Making Approach for Assessing Security Risks in 5G Networks. The emerging 5G network is a new global wireless standard after 1G, 2G, 3G, and 4G networks. In comparison to 4G, it has lower latency, larger capacity, and more bandwidth. These network upgrades will have a profound impact on how people throughout the world live and work. The current research investigates mechanisms to protect the 5G networks to meet resilience requirements and to minimize the damage from attacks that do occur. The main contribution of this paper includes (1) Improving the current 5G security testbed by orchestrating the security services using the OSM and Open stack, Integrating the FlexRan with the testbed components to control and manage the eNodeB, and implementing some real time security experiments to test and validate the testbed. (2) Develop an intelligent fuzzy method to improve the accuracy of the current Vulnerability Assessment Approach (VAA) using a new approach that integrates the Triangular Fuzzy Numbers (TFNs) and a multi criteria decision making technique to find the attack graph paths where the attack most probably will propagate in the 5G network.


Learning To Count Everything. Existing works on visual counting primarily focus on one specific category at a time, such as people, animals, and cells. In this paper, we are interested in counting everything, that is to count objects from any category given only a few annotated instances from that category. To this end, we pose counting as a few shot regression task. To tackle this task, we present a novel method that takes a query image together with a few exemplar objects from the query image and predicts a density map for the presence of all objects of interest in the query image. We also present a novel adaptation strategy to adapt our network to any novel visual category at test time, using only a few exemplar objects from the novel category. We also introduce a dataset of 147 object categories containing over 6000 images that are suitable for the few shot counting task. The images are annotated with two types of annotation, dots and bounding boxes, and they can be used for developing few shot counting models. Experiments on this dataset shows that our method outperforms several state of the art object detectors and few shot counting approaches. Our code and dataset can be found at https github.com cvlab stonybrook LearningToCountEverything.


CosmoAmautas Astrophysics in the high school classroom. We present the book CosmoAmautas Astrophysics in the classroom' which is a text and activity book on selected topics in astrophysics. The content is written in Spanish and intended as the introductory literature and material for high school teachers who want to integrate astronomy to their science and math classes. The book includes an introduction to topics such as planetary science, stellar evolution, exoplanets, galaxies, black holes, and cosmology. In addition to the astronomy content, the book includes didactic notes on general physics of gravity and light, unit conversion, history of science, and tools for the digital classroom (ICT tools), which are compatible with the requirements of the Peruvian high school curriculum. This book is constructed based on the astrophysics curriculum and education model introduced in the online teacher training workshop CosmoAmautas, which took place in May and June 2021. CosmoAmautas (amauta teacher in the Quechua language) is an astronomy education project in Peru, funded by the IAU Office of Astronomy for Development. For more information, please visit www.cosmoamautas.org.


Massive Uncoordinated Access With Random User Activity. We extend the seminal work by Polyanskiy (2017) on massive uncoordinated access to the case where the number of active users is random and unknown a priori. We define a random access code accounting for both misdetection (MD) and false alarm (FA), and derive a random coding achievability bound for the Gaussian multiple access channel. Our bound captures the fundamental trade off between MD and FA probabilities. The derived bound suggests that, for the scenario considered in Polyanskiy (2017), lack of knowledge of the number of active users entails a small penalty in terms of power efficiency. For example, our bound shows that 0.5 0.7 dB extra power is required to achieve both MD and FA probabilities below 0.1 compared to the case in which the number of active users is known a priori. Taking both MD and FA into account, we show that some of the recently proposed massive random access schemes are highly suboptimal with respect to our bound.


Decoupled Reinforcement Learning to Stabilise Intrinsically Motivated Exploration. Intrinsic rewards can improve exploration in reinforcement learning, but the exploration process may suffer from instability caused by non stationary reward shaping and strong dependency on hyperparameters. In this work, we introduce Decoupled RL (DeRL) as a general framework which trains separate policies for intrinsically motivated exploration and exploitation. Such decoupling allows DeRL to leverage the benefits of intrinsic rewards for exploration while demonstrating improved robustness and sample efficiency. We evaluate DeRL algorithms in two sparse reward environments with multiple types of intrinsic rewards. Our results show that DeRL is more robust to varying scale and rate of decay of intrinsic rewards and converges to the same evaluation returns than intrinsically motivated baselines in fewer interactions. Lastly, we discuss the challenge of distribution shift and show that divergence constraint regularisers can successfully minimise instability caused by divergence of exploration and exploitation policies.


Bounds on the Norms of Maximal Operators on Weyl Sums. We obtain new estimates on the maximal operator applied to the Weyl sums. We also consider the quadratic case (that is, Gauss sums) in more details. In wide ranges of parameters our estimates are optimal and match lower bounds. Our approach is based on a combination of ideas of Baker (2021) and Chen and Shparlinski (2020).


QuantifyML How Good is my Machine Learning Model?. The efficacy of machine learning models is typically determined by computing their accuracy on test data sets. However, this may often be misleading, since the test data may not be representative of the problem that is being studied. With QuantifyML we aim to precisely quantify the extent to which machine learning models have learned and generalized from the given data. Given a trained model, QuantifyML translates it into a C program and feeds it to the CBMC model checker to produce a formula in Conjunctive Normal Form (CNF). The formula is analyzed with off the shelf model counters to obtain precise counts with respect to different model behavior. QuantifyML enables i) evaluating learnability by comparing the counts for the outputs to ground truth, expressed as logical predicates, ii) comparing the performance of models built with different machine learning algorithms (decision trees vs. neural networks), and iii) quantifying the safety and robustness of models.


GraphPrompt Biomedical Entity Normalization Using Graph based Prompt Templates. Biomedical entity normalization unifies the language across biomedical experiments and studies, and further enables us to obtain a holistic view of life sciences. Current approaches mainly study the normalization of more standardized entities such as diseases and drugs, while disregarding the more ambiguous but crucial entities such as pathways, functions and cell types, hindering their real world applications. To achieve biomedical entity normalization on these under explored entities, we first introduce an expert curated dataset OBO syn encompassing 70 different types of entities and 2 million curated entity synonym pairs. To utilize the unique graph structure in this dataset, we propose GraphPrompt, a prompt based learning approach that creates prompt templates according to the graphs. GraphPrompt obtained 41.0 and 29.9 improvement on zero shot and few shot settings respectively, indicating the effectiveness of these graph based prompt templates. We envision that our method GraphPrompt and OBO syn dataset can be broadly applied to graph based NLP tasks, and serve as the basis for analyzing diverse and accumulating biomedical data.


SURENA IV Towards A Cost effective Full size Humanoid Robot for Real world Scenarios. This paper describes the hardware, software framework, and experimental testing of SURENA IV humanoid robotics platform. SURENA IV has 43 degrees of freedom (DoFs), including seven DoFs for each arm, six DoFs for each hand, and six DoFs for each leg, with a height of 170 cm and a mass of 68 kg and morphological and mass properties similar to an average adult human. SURENA IV aims to realize a cost effective and anthropomorphic humanoid robot for real world scenarios. In this way, we demonstrate a locomotion framework based on a novel and inexpensive predictive foot sensor that enables walking with 7cm foot position error because of accumulative error of links and connections' deflection(that has been manufactured by the tools which are available in the Universities). Thanks to this sensor, the robot can walk on unknown obstacles without any force feedback, by online adaptation of foot height and orientation. Moreover, the arm and hand of the robot have been designed to grasp the objects with different stiffness and geometries that enable the robot to do drilling, visual servoing of a moving object, and writing his name on the white board.


A Computational Study of the Reaction Cyanoacetylene and Cyano Radical leading to 2 Butynedinitrile and Hydrogen Radical. The present work focuses on the characterization of the reaction between cyanoacetylene and cyano radical by electronic structure calculations of the stationary points along the minimum energy path. One channel, leading to C4N2 (2 Butynedinitrile) H, was selected due to the importance of its products. Using different ab initio methods, a number of stationary points of the potential energy surface were characterized. The energy values of these minima were compared in order to weight the computational costs in relation to chemical accuracy. The results of this works suggests that B2PLYP (and B2PLYPD3) gave a better description of the saddle point geometry, while B3LYP works better for minima.


Preprocessing to Reduce the Search Space Antler Structures for Feedback Vertex Set. The goal of this paper is to open up a new research direction aimed at understanding the power of preprocessing in speeding up algorithms that solve NP hard problems exactly. We explore this direction for the classic Feedback Vertex Set problem on undirected graphs, leading to a new type of graph structure called antler decomposition, which identifies vertices that belong to an optimal solution. It is an analogue of the celebrated crown decomposition which has been used for Vertex Cover. We develop the graph structure theory around such decompositions and develop fixed parameter tractable algorithms to find them, parameterized by the number of vertices for which they witness presence in an optimal solution. This reduces the search space of fixed parameter tractable algorithms parameterized by the solution size that solve Feedback Vertex Set.


Relaxations for Non Separable Cardinality Rank Penalties. Rank and cardinality penalties are hard to handle in optimization frameworks due to non convexity and discontinuity. Strong approximations have been a subject of intense study and numerous formulations have been proposed. Most of these can be described as separable, meaning that they apply a penalty to each element (or singular value) based on size, without considering the joint distribution. In this paper we present a class of non separable penalties and give a recipe for computing strong relaxations suitable for optimization. In our analysis of this formulation we first give conditions that ensure that the globally optimal solution of the relaxation is the same as that of the original (unrelaxed) objective. We then show how a stationary point can be guaranteed to be unique under the RIP assumption (despite non convexity of the framework).


Recolouring weakly chordal graphs and the complement of triangle free graphs. For a graph G , the k recolouring graph mathcal R k(G) is the graph whose vertices are the k colourings of G and two colourings are joined by an edge if they differ in colour on exactly one vertex. We prove that for all n ge 1 , there exists a k colourable weakly chordal graph G where mathcal R k n (G) is disconnected, answering an open question of Feghali and Fiala. We also show that for every k colourable 3K 1 free graph G , mathcal R k 1 (G) is connected with diameter at most 4 V(G) .


Microlocal analysis of singular measures. The purpose of this article is to investigate the structure of singular measures from a microlocal perspective. We introduce a notion of L 1 regularity wave front set for scalar and vector distributions. Our main result is a proper microlocal characterisation of the support of the singular part of tempered Radon measures and of their polar functions at these points. We deduce a sharp L 1 elliptic regularity result which appears to be new even for scalar measures and which enlightens the interest of the techniques from geometric measure theory to the study of harmonic analysis questions. We also deduce several consequences including extensions of the results in 10 giving constraints on the polar function at singular points for measures constrained by a PDE. Finally, we also illustrate the interest of this microlocal approach with a result of propagation of singularities for constrained measures.


New constructions of q Ary 2 D Z Complementary Array Pairs. This paper is devoted to sequences and focuses on designing new two dimensional (2 D) Z complementary array pairs (ZCAPs) by exploring two promising approaches. A ZCAP is a pair of 2 D arrays, whose 2 D autocorrelation sum gives zero value at all time shifts in a zone around the (0,0) time shift, except the (0,0) time shift. The first approach investigated in this paper uses a one dimensional (1 D) Z complementary pair (ZCP), which is an extension of the 1 D Golay complementary pair (GCP) where the autocorrelations of constituent sequences are complementary within a zero correlation zone (ZCZ). The second approach involves directly generalized Boolean functions (which are important components with many applications, particularly in (symmetric) cryptography). Along with this paper, new construction of 2 D ZCAPs is proposed based on 1 D ZCP, and direct construction of 2 D ZCAPs is also offered directly by 2 D generalized Boolean functions. Compared to existing constructions based on generalized Boolean functions, our proposed construction covers all of them. ZCZ sequences are a class of spreading sequences having ideal auto correlation and cross correlation in a zone around the origin. In recent years, they have been extensively studied due to their crucial applications, particularly in quasi synchronous code division multiple access systems. Our proposed 2 D ZCAPs based on 2 D generalized Boolean functions have larger 2 D mathrm ZCZ mathrm ratio frac 6 7 . Compared to the construction based on ZCPs, our proposed 2 D ZCAPs also have the largest 2 D mathrm ZCZ mathrm ratio .


About an efficiency functional implementing the principle of least effort. A probabilistic functional of efficiency has been proposed recently in order to implement the principle of least effort and to derive Zipf Pareto laws with a calculus of variation. This work is a further investigation of this efficiency measure from mathematical point of view. We address some key mathematical properties of this functional such as its unicity, its robustness against small variation of probability distribution and its relationship with inequality as well as probabilistic uncertainty. In passing, a method for calculating non negative continuous (differential) entropy is proposed based upon a generalized definition of informational entropy called varentropy.


Verification of asymptotic homogenization method developed for periodic architected materials in strain gradient continuum. Strain gradient theory is an accurate model for capturing the size effect and localization phenomena. However, the challenge in identification of corresponding constitutive parameters limits the practical application of the theory. We present and utilize asymptotic homogenization herein. All parameters in rank four, five, and six tensors are determined with the demonstrated computational approach. Examples for epoxy carbon fiber composite, metal matrix composite, and aluminum foam illustrate the effectiveness and versatility of the proposed method. The influences of volume fraction of matrix, the stack of RVEs, and the varying unit cell lengths on the identified parameters are investigated. The homogenization computational tool is applicable to a wide class materials and makes use of open source codes in FEniCS. We make all of the codes publicly available in order to encourage a transparent scientific exchange.


Variations in the pickup ion density structure in response to the growth of the Kelvin Helmholtz instability along the heliopause. Features of the response of pickup ions (PUIs) to the Kelvin Helmholtz instability (KHI) on the heliopause (HP) are examined by means of two dimensional hybrid simulations. We assume the supersonic neutral solar wind as the source of PUIs gyrating about the magnetic field in the outer heliosheath. These PUIs become energetic neutral atoms (ENAs) via charge exchange with interstellar hydrogen, and a portion of these ENAs are detected by spacecraft such as the Interstellar Boundary Explorer (IBEX . To evaluate the possibility of identifying the KHI on HP from ENA observations, we assume that an imprint of the KHI may be displayed in spatial and temporal variations in the observed ENA profile. As an alternative to ENA, the column density of PUIs integrated across the HP is calculated. The KH inducing vortex forces not only background protons but also PUIs to roll up deep in the inner heliosheath. The KH vortex also results in the emission of magnetosonic pulses that sweep PUIs in the outer heliosheath and lead to their local confinement. These effects elongate the PUIs spatial distribution in the direction normal to the HP. The appearance of the local confined structure in the PUIs column density is consequently confirmed, and this feature can be confirmed as the KHI evolution. Although the simulation cannot be quantitatively compared with the observations currently available because its resolution is too small, we expect that the derived properties will be useful for diagnosing the nature of HP fluctuation in future missions.


TransGAN Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up. The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainly study the discriminative models, we explore transformers on some more notoriously difficult vision tasks, e.g., generative adversarial networks (GANs). Our goal is to conduct the first pilot study in building a GAN completely free of convolutions, using only pure transformer based architectures. Our vanilla GAN architecture, dubbed TransGAN, consists of a memory friendly transformer based generator that progressively increases feature resolution, and correspondingly a multi scale discriminator to capture simultaneously semantic contexts and low level textures. On top of them, we introduce the new module of grid self attention for alleviating the memory bottleneck further, in order to scale up TransGAN to high resolution generation. We also develop a unique training recipe including a series of techniques that can mitigate the training instability issues of TransGAN, such as data augmentation, modified normalization, and relative position encoding. Our best architecture achieves highly competitive performance compared to current state of the art GANs using convolutional backbones. Specifically, TransGAN sets new state of the art inception score of 10.43 and FID of 18.28 on STL 10, outperforming StyleGAN V2. When it comes to higher resolution (e.g. 256 x 256) generation tasks, such as on CelebA HQ and LSUN Church, TransGAN continues to produce diverse visual examples with high fidelity and impressive texture details. In addition, we dive deep into the transformer based generation models to understand how their behaviors differ from convolutional ones, by visualizing training dynamics. The code is available at https github.com VITA Group TransGAN.


Improving Few shot Learning with Weakly supervised Object Localization. Few shot learning often involves metric learning based classifiers, which predict the image label by comparing the distance between the extracted feature vector and class representations. However, applying global pooling in the backend of the feature extractor may not produce an embedding that correctly focuses on the class object. In this work, we propose a novel framework that generates class representations by extracting features from class relevant regions of the images. Given only a few exemplary images with image level labels, our framework first localizes the class objects by spatially decomposing the similarity between the images and their class prototypes. Then, enhanced class representations are achieved from the localization results. We also propose a loss function to enhance distinctions of the refined features. Our method outperforms the baseline few shot model in miniImageNet and tieredImageNet benchmarks.


Consecutive real quadratic fields with large class numbers. For a given positive integer k , we prove that there are at least x 1 2 o(1) integers d leq x such that the real quadratic fields mathbb Q( sqrt d 1 ), dots, mathbb Q( sqrt d k ) have class numbers essentially as large as possible.


Timing Covert Channel Analysis of the VxWorks MILS Embedded Hypervisor under the Common Criteria Security Certification. Virtualization technology is nowadays adopted in security critical embedded systems to achieve higher performance and more design flexibility. However, it also comes with new security threats, where attackers leverage timing covert channels to exfiltrate sensitive information from a partition using a trojan. This paper presents a novel approach for the experimental assessment of timing covert channels in embedded hypervisors, with a case study on security assessment of a commercial hypervisor product (Wind River VxWorks MILS), in cooperation with a licensed laboratory for the Common Criteria security certification. Our experimental analysis shows that it is indeed possible to establish a timing covert channel, and that the approach is useful for system designers for assessing that their configuration is robust against this kind of information leakage.


Two kinds of real lines on real del Pezzo surfaces of degree 1. We show how the real lines on a real del Pezzo surface of degree 1 can be split into two species, elliptic and hyperbolic, via a certain distinguished, intrinsically defined, Pin structure on the real locus of the surface. We prove that this splitting is invariant under real automorphisms and real deformations of the surface, and that the difference between the total numbers of hyperbolic and elliptic lines is always equal to 16.


A heat flow for the mean field equation on a finite graph. Inspired by works of Cast 'eras (Pacific J. Math., 2015), Li Zhu (Calc. Var., 2019) and Sun Zhu (Calc. Var., 2020), we propose a heat flow for the mean field equation on a connected finite graph G (V,E) . Namely left begin array lll partial t phi(u) Delta u Q rho frac e u int Ve ud mu 1.5ex u( cdot,0) u 0, end array right. where Delta is the standard graph Laplacian, rho is a real number, Q V rightarrow mathbb R is a function satisfying int VQd mu rho , and phi mathbb R rightarrow mathbb R is one of certain smooth functions including phi(s) e s . We prove that for any initial data u 0 and any rho in mathbb R , there exists a unique solution u V times 0, infty) rightarrow mathbb R of the above heat flow moreover, u(x,t) converges to some function u infty V rightarrow mathbb R uniformly in x in V as t rightarrow infty , and u infty is a solution of the mean field equation Delta u infty Q rho frac e u infty int Ve u infty d mu 0. Though G is a finite graph, this result is still unexpected, even in the special case Q equiv 0 . Our approach reads as follows the short time existence of the heat flow follows from the ODE theory various integral estimates give its long time existence moreover we establish a Lojasiewicz Simon type inequality and use it to conclude the convergence of the heat flow.


pyBKT An Accessible Python Library of Bayesian Knowledge Tracing Models. Bayesian Knowledge Tracing, a model used for cognitive mastery estimation, has been a hallmark of adaptive learning research and an integral component of deployed intelligent tutoring systems (ITS). In this paper, we provide a brief history of knowledge tracing model research and introduce pyBKT, an accessible and computationally efficient library of model extensions from the literature. The library provides data generation, fitting, prediction, and cross validation routines, as well as a simple to use data helper interface to ingest typical tutor log dataset formats. We evaluate the runtime with various dataset sizes and compare to past implementations. Additionally, we conduct sanity checks of the model using experiments with simulated data to evaluate the accuracy of its EM parameter learning and use real world data to validate its predictions, comparing pyBKT's supported model variants with results from the papers in which they were originally introduced. The library is open source and open license for the purpose of making knowledge tracing more accessible to communities of research and practice and to facilitate progress in the field through easier replication of past approaches.


Super Tickets in Pre Trained Language Models From Model Compression to Improving Generalization. The Lottery Ticket Hypothesis suggests that an over parametrized network consists of lottery tickets'', and training a certain collection of them (i.e., a subnetwork) can match the performance of the full model. In this paper, we study such a collection of tickets, which is referred to as winning tickets'', in extremely over parametrized models, e.g., pre trained language models. We observe that at certain compression ratios, the generalization performance of the winning tickets can not only match but also exceed that of the full model. In particular, we observe a phase transition phenomenon As the compression ratio increases, generalization performance of the winning tickets first improves then deteriorates after a certain threshold. We refer to the tickets on the threshold as super tickets''. We further show that the phase transition is task and model dependent as the model size becomes larger and the training data set becomes smaller, the transition becomes more pronounced. Our experiments on the GLUE benchmark show that the super tickets improve single task fine tuning by 0.9 points on BERT base and 1.0 points on BERT large, in terms of task average score. We also demonstrate that adaptively sharing the super tickets across tasks benefits multi task learning.


Two Sides of the Same Coin Heterophily and Oversmoothing in Graph Convolutional Neural Networks. In node classification tasks, heterophily and oversmoothing are two problems that can hurt the performance of graph convolutional neural networks (GCNs). The heterophily problem refers to the model's inability to handle heterophilous graphs where neighboring nodes belong to different classes the oversmoothing problem refers to the model's degenerated performance with increasing number of layers. These two seemingly unrelated problems have been studied mostly independently, but there is recent empirical evidence that solving one problem may benefit the other. In this work, beyond empirical observations, we aim to (1) analyze the heterophily and oversmoothing problems from a unified theoretical perspective, (2) identify the common causes of the two problems, and (3) propose simple yet effective strategies to address the common causes. In our theoretical analysis, we show that the common causes of the heterophily and oversmoothing problems namely, the relative degree of a node and its heterophily level trigger the node representations in consecutive layers to "move" closer to the original decision boundary, which increases the misclassification rate of node labels under certain constraints. We theoretically show that (1) Nodes with high heterophily have a higher misclassification rate. (2) Even with low heterophily, degree disparity in a node's neighborhood can influence the movements of node representations and result in a "pseudo heterophily" situation, which helps to explain oversmoothing. (3) Allowing not only positive but also negative messages during message passing can help counteract the common causes of the two problems. Based on our theoretical insights, we propose simple modifications to the GCN architecture (i.e., learned degree corrections and signed messages), and we show that they alleviate the heteorophily and oversmoothing problems with experiments on 9 networks.


Reasoning in circles. Circular proofs, introduced by Daniyar Shamkanov, are proofs in which assumptions are allowed that are not axioms but do appear at least twice along a branch. Shamkanov has shown that a formula belongs to the provability logic GL exactly if it has a circular proof in the modal logic K4. Shamkanov uses Tait style proof systems and infinitary proofs. In this paper we prove the same result but then for sequent calculi and without the detour via infinitary systems. We also obtain a mild generalisation of the result, implying that its intuitionistic analogue holds as well.


Limiting distribution of the sample canonical correlation coefficients of high dimensional random vectors. Consider two high dimensional random vectors widetilde mathbf x in mathbb R p and widetilde mathbf y in mathbb R q with finite rank correlations. More precisely, suppose that widetilde mathbf x mathbf x A mathbf z and widetilde mathbf y mathbf y B mathbf z , for independent random vectors mathbf x in mathbb R p , mathbf y in mathbb R q and mathbf z in mathbb R r with iid entries of mean 0 and variance 1, and two deterministic matrices A in mathbb R p times r and B in mathbb R q times r . With n iid observations of ( widetilde mathbf x , widetilde mathbf y ) , we study the sample canonical correlations between them. In this paper, we focus on the high dimensional setting with a rank r correlation. Let t 1 ge cdots ge t r be the squares of the population canonical correlation coefficients (CCC) between widetilde mathbf x and widetilde mathbf y , and widetilde lambda 1 ge cdots ge widetilde lambda r be the squares of the largest r sample CCC. Under certain moment assumptions on the entries of mathbf x , mathbf y and mathbf z , we show that there exists a threshold t c in(0, 1) such that if t i t c , then sqrt n ( widetilde lambda i theta i) converges in law to a centered normal distribution, where theta i lambda is a fixed outlier location determined by t i . Our results extend the ones in 4 for Gaussian vectors. Moreover, we find that the variance of the limiting distribution of sqrt n ( widetilde lambda i theta i) also depends on the fourth cumulants of the entries of mathbf x , mathbf y and mathbf z , a phenomenon that cannot be observed in the Gaussian case.


Observation of Silicon Nitride Nanomechanical Resonator Actuation Using Capacitive Substrate Excitation. We observe the actuation of silicon nitride (SiN) nanomechanical resonators by electrical excitation of metal dielectric semiconductor (MDS) capacitors on their supporting silicon substrate. We develop first principle models explaining this actuation mechanism by acoustic waves resulting from voltage dependent electrostatic forces in the MDS capacitors. Models are developed for actuation in the charge accumulation (Ni pSi) and charge depletion (Al pSi) regimes. Experimental observations confirm our prediction that charge accumulation (Ni pSi) is more efficient at actuation than charge depletion. For a 2 V actuation signal, Ni pSi capacitors achieve 10 nm actuation amplitude in square (1.7 times 1.7 mm) low stress ( 100 MPa) SiN membrane resonators. In this case, electrical power dissipation in the chip is on the order of 0.1 mu W, and spurious heating is less than 1 mK. Both these values could be further reduced by doping the substrate to minimize resistive dissipation. The actuation method is remarkably simple and only requires attachment of wires to the chip with vacuum compatible nickel paste, with no extra photolithography step. All the chips presented in this work are fabricated in house, and a detailed fabrication procedure is provided.


Temporally Consistent Online Depth Estimation in Dynamic Scenes. Temporally consistent depth estimation is crucial for real time applications. While stereo depth estimation has received substantial attention, there is relatively little work focused on maintaining temporal stability. Indeed, based on our analysis, current techniques still suffer from poor temporal consistency. Stabilizing depth temporally in dynamic scenes is challenging due to concurrent object and camera motion. In an online setting, this process is further aggravated because only past frames are available. We present an approach to produce temporally consistent depth estimates in dynamic scenes in an online setting. Our network augments per frame stereo networks with novel motion and fusion networks. The motion network accounts for object and camera motion by predicting a per pixel SE3 transformation. The fusion network improves temporal consistency in predictions by aggregating the current and previous estimates. We conduct extensive experiments across varied datasets. We demonstrate that our proposed approach outperforms competing methods in terms of temporal consistency and per frame accuracy, both quantitatively and qualitatively. Our code will be available.


Evolutionary Multitask Optimization a Methodological Overview, Challenges and Future Research Directions. In this work we consider multitasking in the context of solving multiple optimization problems simultaneously by conducting a single search process. The principal goal when dealing with this scenario is to dynamically exploit the existing complementarities among the problems (tasks) being optimized, helping each other through the exchange of valuable knowledge. Additionally, the emerging paradigm of Evolutionary Multitasking tackles multitask optimization scenarios by using as inspiration concepts drawn from Evolutionary Computation. The main purpose of this survey is to collect, organize and critically examine the abundant literature published so far in Evolutionary Multitasking, with an emphasis on the methodological patterns followed when designing new algorithmic proposals in this area (namely, multifactorial optimization and multipopulation based multitasking). We complement our critical analysis with an identification of challenges that remain open to date, along with promising research directions that can stimulate future efforts in this topic. Our discussions held throughout this manuscript are offered to the audience as a reference of the general trajectory followed by the community working in this field in recent times, as well as a self contained entry point for newcomers and researchers interested to join this exciting research avenue.


An improved bound on the burning number of graphs. The burning number conjecture states that the burning number of a connected graph is at most lceil sqrt n rceil. While the conjecture is unresolved, Land and Lu proved that the burning number of a connected graph is at most sqrt (3 2)n O(1). Using an algorithmic approach, we provide an improved upper bound for the burning number of a connected graph bigg lceil frac sqrt 12n 64 8 3 bigg rceil sqrt (4 3)n O(1) .


The Minimum Edit Arborescence Problem and Its Use in Compressing Graph Collections Extended Version . The inference of minimum spanning arborescences within a set of objects is a general problem which translates into numerous application specific unsupervised learning tasks. We introduce a unified and generic structure called edit arborescence that relies on edit paths between data in a collection, as well as the Min Edit Arborescence Problem, which asks for an edit arborescence that minimizes the sum of costs of its inner edit paths. Through the use of suitable cost functions, this generic framework allows to model a variety of problems. In particular, we show that by introducing encoding size preserving edit costs, it can be used as an efficient method for compressing collections of labeled graphs. Experiments on various graph datasets, with comparisons to standard compression tools, show the potential of our method.


Fairness in TabNet Model by Disentangled Representation for the Prediction of Hospital No Show. Patient no shows is a major burden for health centers leading to loss of revenue, increased waiting time and deteriorated health outcome. Developing machine learning (ML) models for the prediction of no shows could help addressing this important issue. It is crucial to consider fair ML models for no show prediction in order to ensure equality of opportunity in accessing healthcare services. In this wo rk, we are interested in developing deep learning models for no show prediction based on tabular data while ensuring fairness properties. Our baseline model, TabNet, uses on attentive feature transforme rs and has shown promising results for tabular data. We propose Fair TabNet based on representation learning that disentangles predictive from sensitive components. The model is trained to jointly min imize loss functions on no shows and sensitive variables while ensuring that the sensitive and prediction representations are orthogonal. In the experimental analysis, we used a hospital dataset of 210, 000 appointments collected in 2019. Our preliminary results show that the proposed Fair TabNet improves the predictive, fairness performance and convergence speed over TabNet for the task of appointment no show prediction. The comparison with the state of the art models for tabular data shows promising results and could be further improved by a better tuning of hyper parameters.


MFNet Multi class Few shot Segmentation Network with Pixel wise Metric Learning. In visual recognition tasks, few shot learning requires the ability to learn object categories with few support examples. Its re popularity in light of the deep learning development is mainly in image classification. This work focuses on few shot semantic segmentation, which is still a largely unexplored field. A few recent advances are often restricted to single class few shot segmentation. In this paper, we first present a novel multi way (class) encoding and decoding architecture which effectively fuses multi scale query information and multi class support information into one query support embedding. Multi class segmentation is directly decoded upon this embedding. For better feature fusion, a multi level attention mechanism is proposed within the architecture, which includes the attention for support feature modulation and attention for multi scale combination. Last, to enhance the embedding space learning, an additional pixel wise metric learning module is introduced with triplet loss formulated on the pixel level embedding of the input image. Extensive experiments on standard benchmarks PASCAL 5i and COCO 20i show clear benefits of our method over the state of the art in few shot segmentation


Attentive Neural Processes and Batch Bayesian Optimization for Scalable Calibration of Physics Informed Digital Twins. Physics informed dynamical system models form critical components of digital twins of the built environment. These digital twins enable the design of energy efficient infrastructure, but must be properly calibrated to accurately reflect system behavior for downstream prediction and analysis. Dynamical system models of modern buildings are typically described by a large number of parameters and incur significant computational expenditure during simulations. To handle large scale calibration of digital twins without exorbitant simulations, we propose ANP BBO a scalable and parallelizable batch wise Bayesian optimization (BBO) methodology that leverages attentive neural processes (ANPs).


Computational Homogenization of Concrete in the Cyber Size Resolution Discretization (SRD) Parameter Space. Micro and mesostructures of multiphase materials obtained from tomography and image acquisition are an ever more important database for simulation analyses. Huge data sets for reconstructed 3d volumes typically as voxel grids call for criteria and measures to find an affordable balance of accuracy and efficiency. The present work shows for a 3d mesostructure of concrete in the elastic deformation range, how the computational complexity in analyses of numerical homogenization can be reduced at controlled errors. Reduction is systematically applied to specimen size S, resolution R, and discretization D, which span the newly introduced SRD parameter space. Key indicators for accuracy are (i) the phase fractions, (ii) the homogenized elasticity tensor, (iii) its invariance with respect to the applied boundary conditions and (iv) the total error as well as spatial error distributions, which are computed and estimated. Pre analyses in the 2d SRD parameter sub space explore the transferability to the 3d case. Beyond the concrete specimen undergoing elastic deformations in the present work, the proposed concept enables accuracy efficiency balances for various classes of heterogeneous materials in different deformation regimes and thus contributes to build comprehensive digital twins of materials with validated attributes.


Homogenization of Schrodinger equations. Extended Effective Mass Theorems for non crystalline matter. This paper concerns the homogenization of Schrodinger equations for non crystalline matter, that is to say the coefficients are given by the composition of stationary functions with stochastic deformations. Two rigorous results of so called effective mass theorems in solid state physics are obtained a general abstract result (beyond the classical stationary ergodic setting), and one for quasi perfect materials (i.e. the disorder in the non crystalline matter is limited). The former relies on the double scale limits and the wave function is spanned on the Bloch basis. Therefore, we have extended the Bloch Theory which was restrict until now to crystals (periodic setting). The second result relies on the Perturbation Theory and a special case of stochastic deformations, namely stochastic perturbation of the identity.


Spontaneous symmetry breaking in a coherently driven nanophotonic Bose Hubbard dimer. We report on the first experimental observation of spontaneous mirror symmetry breaking (SSB) in coherently driven dissipative coupled optical cavities. SSB is observed as the breaking of the spatial or mirror Z2 symmetry between two symmetrically pumped and evanescently coupled photonic crystal nanocavities, and manifests itself as random intensity localization in one of the two cavities. We show that, in a system featuring repulsive boson interactions (U 0), the observation of a pure pitchfork bifurcation requires negative photon hopping energies (J 0), which we have realized in our photonic crystal molecule. SSB is observed over a wide range of the two dimensional parameter space of driving intensity and detuning, where we also find a region that exhibits bistable symmetric behavior. Our results pave the way for the experimental study of limit cycles and deterministic chaos arising from SSB, as well as the study of nonclassical photon correlations close to SSB transitions.


Multileaf Collimator for Real Time Beam Shaping using Emittance Exchange. Emittance exchange beamlines employ transverse masks to create drive and witness beams of variable longitudinal profile and bunch spacing. Recently, this approach has been used to create advanced driver profiles and demonstrate record breaking plasma wakefield transformer ratios Roussel, R., et al., Phys. Rev. Lett. 124, 044802 (2020) , a crucial advancement for efficient witness acceleration. However, since the transverse masks are individually laser cut and installed into the UHV beamline, refinement of the beam profiles is not possible without replacing masks. Instead, this work proposes the use of a UHV compatible multileaf collimator as a beam mask. Such a device permits real time adjustment of the electron distribution, permitting greater refinement in a manner highly synergistic with machine learning. Beam dynamics simulations have shown that a practically realizable multileaf collimator can offer resolution that is functionally equivalent to that offered by laser cut masks.


Clock Skew Compensation Algorithm Immune to Floating Point Precision Loss. We propose a novel clock skew compensation algorithm based on Bresenham's line drawing algorithm. The proposed algorithm can avoid the effect of limited floating point precision (e.g., 32 bit single precision) on clock skew compensation and thereby provide high precision time synchronization even with resource constrained sensor nodes in wireless sensor networks.


TOSCAdata Modelling data pipeline applications in TOSCA. The serverless platform allows a customer to effectively use cloud resources and pay for the exact amount of used resources. A number of dedicated open source and commercial cloud data management tools are available to handle the massive amount of data. Such modern cloud data management tools are not enough matured to integrate the generic cloud application with the serverless platform due to the lack of mature and stable standards. One of the most popular and mature standards, TOSCA (Topology and Orchestration Specification for Cloud Applications), mainly focuses on application and service portability and automated management of the generic cloud application components. This paper proposes the extension of the TOSCA standard, TOSCAdata, that focuses on the modeling of data pipeline based cloud applications. Keeping the requirements of modern data pipeline cloud applications, TOSCAdata provides a number of TOSCA models that are independently deployable, schedulable, scalable, and re usable, while effectively handling the flow and transformation of data in a pipeline manner. We also demonstrate the applicability of proposed TOSCAdata models by taking a web based cloud application in the context of tourism promotion as a use case scenario.


Facilitating Database Tuning with Hyper Parameter Optimization A Comprehensive Experimental Evaluation. Recently, using automatic configuration tuning to improve the performance of modern database management systems (DBMSs) has attracted increasing interest from the database community. This is embodied with a number of systems featuring advanced tuning capabilities being developed. However, it remains a challenge to select the best solution for database configuration tuning, considering the large body of algorithm choices. In addition, beyond the applications on database systems, we could find more potential algorithms designed for configuration tuning. To this end, this paper provides a comprehensive evaluation of configuration tuning techniques from a broader perspective, hoping to better benefit the database community. In particular, we summarize three key modules of database configuration tuning systems and conduct extensive ablation studies using various challenging cases. Our evaluation demonstrates that the hyper parameter optimization algorithms can be borrowed to further enhance the database configuration tuning. Moreover, we identify the best algorithm choices for different modules. Beyond the comprehensive evaluations, we offer an efficient and unified database configuration tuning benchmark via surrogates that reduces the evaluation cost to a minimum, allowing for extensive runs and analysis of new techniques.


Diverse Auto Curriculum is Critical for Successful Real World Multiagent Learning Systems. Multiagent reinforcement learning (MARL) has achieved a remarkable amount of success in solving various types of video games. A cornerstone of this success is the auto curriculum framework, which shapes the learning process by continually creating new challenging tasks for agents to adapt to, thereby facilitating the acquisition of new skills. In order to extend MARL methods to real world domains outside of video games, we envision in this blue sky paper that maintaining a diversity aware auto curriculum is critical for successful MARL applications. Specifically, we argue that emph behavioural diversity is a pivotal, yet under explored, component for real world multiagent learning systems, and that significant work remains in understanding how to design a diversity aware auto curriculum. We list four open challenges for auto curriculum techniques, which we believe deserve more attention from this community. Towards validating our vision, we recommend modelling realistic interactive behaviours in autonomous driving as an important test bed, and recommend the SMARTS ULTRA benchmark.


Towards Global and Limitless Connectivity The Role of Private NGSO Satellite Constellations for Future Space Terrestrial Networks. Satellite networks are expected to support global connectivity and services via future integrated 6G space terrestrial networks (STNs), as well as private non geostationary satellite orbit (NGSO) constellations. In the past few years, many such private constellations have been launched or are in planning, e.g. SpaceX and OneWeb to name a few. In this article we take a closer look at the private constellations and give a comprehensive overview of their features. We then discuss major technical challenges resulting from their design and briefly review the recent literature addressing these challenges. Studying the emerging private constellations gives us useful insights for engineering the future STNs. To this end, we study the satellite mobility and evaluate the impact of two handover strategies on the space to ground link performance of four real private NGSO constellations. We show that the link capacity, delay, and handover rate vary across the constellations, so the optimal handover strategy depends on the constellation design. Consequently, the communications solutions of future STNs should be compliant with the constellation specifics, and the STN standards need to be flexible enough to support satellite operation with the large parameter space observed in the emerging private constellations.


Fourier transform spectroscopy and relativistic electronic structure calculation on the c 3 Sigma state of KCs. The Ti Saphire laser operated within 13800 11800 cm 1 range was used to excite the c 3 Sigma state of KCs molecule directly from the ground X 1 Sigma state. The laser induced fluorescence (LIF) spectra of the c 3 Sigma rightarrow a 3 Sigma transition were recorded with Fourier transform spectrometer within 8000 to 10000 cm 1 range. Overall 673 rovibronic term values belonging to both e f components of the c 3 Sigma ( Omega 1 pm ) state of 39 KCs, covering vibrational levels from v 0 to about 45, and rotational levels J in 11,149 were determined with the accuracy of about 0.01 cm 1 among them 7 values for 41 KCs. The experimental term values with v in 0,22 were involved in a direct point wise potential reconstruction for the c 3 Sigma ( Omega 1 pm ) state, which takes into account the Omega doubling effect caused by the spin rotational interaction with the nearby c 3 Sigma ( Omega 0 ) state. The analysis and interpretation were facilitated by the fully relativistic coupled cluster calculation of the potential energy curves for the B 1 Pi , c 3 Sigma , and b 3 Pi states, as well as of spin forbidden c X and spin allowed c a transition dipole moments radiative lifetimes and vibronic branching ratios were calculated. A comparison of relative intensity distributions measured in vibrational c a LIF progressions with their theoretical counterparts unambiguously confirms the vibrational assignment suggested in emph J. Szczepkovski, et. al. , JQSRT, textbf 204 , 133 137 (2018) .


Categorical semantics of a simple differential programming language. With the increased interest in machine learning, and deep learning in particular, the use of automatic differentiation has become more wide spread in computation. There have been two recent developments to provide the theoretical support for this types of structure. One approach, due to Abadi and Plotkin, provides a simple differential programming language. Another approach is the notion of a reverse differential category. In the present paper we bring these two approaches together. In particular, we show how an extension of reverse derivative categories models Abadi and Plotkin's language, and describe how this categorical model allows one to consider potential improvements to the operational semantics of the language.


Graph Autoencoders for Embedding Learning in Brain Networks and Major Depressive Disorder Identification. Brain functional connectivity (FC) reveals biomarkers for identification of various neuropsychiatric disorders. Recent application of deep neural networks (DNNs) to connectome based classification mostly relies on traditional convolutional neural networks using input connectivity matrices on a regular Euclidean grid. We propose a graph deep learning framework to incorporate the non Euclidean information about graph structure for classifying functional magnetic resonance imaging (fMRI) derived brain networks in major depressive disorder (MDD). We design a novel graph autoencoder (GAE) architecture based on the graph convolutional networks (GCNs) to embed the topological structure and node content of large sized fMRI networks into low dimensional latent representations. In network construction, we employ the Ledoit Wolf (LDW) shrinkage method to estimate the high dimensional FC metrics efficiently from fMRI data. We consider both supervised and unsupervised approaches for the graph embedded learning. The learned embeddings are then used as feature inputs for a deep fully connected neural network (FCNN) to discriminate MDD from healthy controls. Evaluated on a resting state fMRI MDD dataset with 43 subjects, results show that the proposed GAE FCNN model significantly outperforms several state of the art DNN methods for brain connectome classification, achieving accuracy of 72.50 using the LDW FC metrics as node features. The graph embeddings of fMRI FC networks learned by the GAE also reveal apparent group differences between MDD and HC. Our new framework demonstrates feasibility of learning graph embeddings on brain networks to provide discriminative information for diagnosis of brain disorders.


Misleading the Covid 19 vaccination discourse on Twitter An exploratory study of infodemic around the pandemic. In this work, we collect a moderate sized representative corpus of tweets (200,000 approx.) pertaining Covid 19 vaccination spanning over a period of seven months (September 2020 March 2021). Following a Transfer Learning approach, we utilize the pre trained Transformer based XLNet model to classify tweets as Misleading or Non Misleading and validate against a random subset of results manually. We build on this to study and contrast the characteristics of tweets in the corpus that are misleading in nature against non misleading ones. This exploratory analysis enables us to design features (such as sentiments, hashtags, nouns, pronouns, etc) that can, in turn, be exploited for classifying tweets as (Non )Misleading using various ML models in an explainable manner. Specifically, several ML models are employed for prediction, with up to 90 accuracy, and the importance of each feature is explained using SHAP Explainable AI (XAI) tool. While the thrust of this work is principally exploratory analysis in order to obtain insights on the online discourse on Covid 19 vaccination, we conclude the paper by outlining how these insights provide the foundations for a more actionable approach to mitigate misinformation. The curated dataset and code is made available (Github repository) so that the research community at large can reproduce, compare against, or build upon this work.


Oscillations and pattern formation in a slow fast prey predator system. We consider the properties of a slow fast prey predator system in time and space. We first argue that the simplicity of prey predator system is apparent rather than real and there are still many of its hidden properties that have been poorly studied or overlooked altogether. We further focus on the case where, in the slow fast system, the prey growth is affected by a weak Allee effect. We first consider this system in the non spatial case and make its comprehensive study using a variety of mathematical techniques. In particular, we show that the interplay between the Allee effect and the existence of multiple timescales may lead to a regime shift where small amplitude oscillations in the population abundances abruptly change to large amplitude oscillations. We then consider the spatially explicit slow fast prey predator system and reveal the effect of different time scales on the pattern formation. We show that a decrease in the timescale ratio may lead to another regime shift where the spatiotemporal pattern becomes spatially correlated leading to large amplitude oscillations in spatially average population densities and potential species extinction.


A probabilistic model for missing traffic volume reconstruction based on data fusion. Traffic volume information is critical for intelligent transportation systems. It serves as a key input to transportation planning, roadway design, and traffic signal control. However, the traffic volume data collected by fixed location sensors, such as loop detectors, often suffer from the missing data problem and low coverage problem. The missing data problem could be caused by hardware malfunction. The low coverage problem is due to the limited coverage of fixed location sensors in the transportation network, which restrains our understanding of the traffic at the network level. To tackle these problems, we propose a probabilistic model for traffic volume reconstruction by fusing fixed location sensor data and probe vehicle data. We apply the probabilistic principal component analysis (PPCA) to capture the correlations in traffic volume data. An innovative contribution of this work is that we also integrate probe vehicle data into the framework, which allows the model to solve both of the above mentioned two problems. Using a real world traffic volume dataset, we show that the proposed method outperforms state of the art methods for the extensively studied missing data problem. Moreover, for the low coverage problem, which cannot be handled by most existing methods, the proposed model can also achieve high accuracy. The experiments also show that even when the missing ratio reaches 80 , the proposed method can still give an accurate estimate of the unknown traffic volumes with only a 10 probe vehicle penetration rate. The results validate the effectiveness and robustness of the proposed model and demonstrate its potential for practical applications.


Division algebras and MRD codes from skew polynomials. Let D be a division algebra, finite dimensional over its center, and R D t sigma, delta a skew polynomial ring. Using skew polynomials f in R , we construct division algebras and a generalization of maximum rank distance codes consisting of matrices with entries in a noncommutative division algebra or field. These include a class of codes constructed by Sheekey (in particular, generalized Gabidulin codes), as well as Jha Johnson semifields.


KNN BERT Fine Tuning Pre Trained Models with KNN Classifier. Pre trained models are widely used in fine tuning downstream tasks with linear classifiers optimized by the cross entropy loss, which might face robustness and stability problems. These problems can be improved by learning representations that focus on similarities in the same class and contradictions in different classes when making predictions. In this paper, we utilize the K Nearest Neighbors Classifier in pre trained model fine tuning. For this KNN classifier, we introduce a supervised momentum contrastive learning framework to learn the clustered representations of the supervised downstream tasks. Extensive experiments on text classification tasks and robustness tests show that by incorporating KNNs with the traditional fine tuning process, we can obtain significant improvements on the clean accuracy in both rich source and few shot settings and can improve the robustness against adversarial attacks. footnote all codes is available at https github.com LinyangLee KNN BERT


Membership Inference on Word Embedding and Beyond. In the text processing context, most ML models are built on word embeddings. These embeddings are themselves trained on some datasets, potentially containing sensitive data. In some cases this training is done independently, in other cases, it occurs as part of training a larger, task specific model. In either case, it is of interest to consider membership inference attacks based on the embedding layer as a way of understanding sensitive information leakage. But, somewhat surprisingly, membership inference attacks on word embeddings and their effect in other natural language processing (NLP) tasks that use these embeddings, have remained relatively unexplored. In this work, we show that word embeddings are vulnerable to black box membership inference attacks under realistic assumptions. Furthermore, we show that this leakage persists through two other major NLP applications classification and text generation, even when the embedding layer is not exposed to the attacker. We show that our MI attack achieves high attack accuracy against a classifier model and an LSTM based language model. Indeed, our attack is a cheaper membership inference attack on text generative models, which does not require the knowledge of the target model or any expensive training of text generative models as shadow models.


Statistical mechanics and Bayesian Inference addressed to the Osborne Paradox. One of the greatest contributors of the 20th century among all academician in the field of statistical finance, M. F. M. Osborne published in 1956 6 an essential paper and proposed to treat the question of stock market motion through the prism of both the Law of Weber Fechner 1, 4 and the branch of physics developed by James Clerk Maxwell, Ludwig Boltzmann and Josiah Willard Gibbs 3, 5 namely the statistical mechanics. He proposed an improvement of the known research made by his predecessor Louis Jean Baptiste Alphonse Bachelier, by not considering the arithmetic changes of stock prices as means of statistical measurement, but by drawing on the Weber Fechner Law, to treat the changes of prices. Osborne emphasized that as in statistical mechanics, the probability distribution of the steady state of subjective change in prices is determined by the condition of maximum probability, a statement close to the Gibbs distribution conditions. However, Osborne also admitted that the empirical observation of the probability distribution of logarithmic changes of stock prices was emphasizing obvious asymmetries and consequently could not perfectly confirm his prior theory. The purpose of this paper is to propose an explanation to what we could call the Osborne paradox and then address an alternative approach via Bayesian inference regarding the description of the probability distribution of changes in logarithms of prices that was thenceforth under the prism of frequentist inference. We show that the stock market returns are locally described by equilibrium statistical mechanics with conserved statistics variables, whereas globally there is yet other statistics with persistent flowing variables that can be effectively described by a superposition of several statistics on different time scales, namely, a superstatistics.


Diophantine Gaussian excursions and random walks. We investigate the asymptotic variance of Gaussian nodal excursions in the Euclidean space, focusing on the case where the spectral measure has incommensurable atoms. This study requires to establish fine recurrence properties in 0 for the associated irrational random walk on the torus. We show in particular that the recurrence magnitude depends strongly on the diophantine properties of the atoms, and the same goes for the variance asymptotics of nodal excursions. More specifically, if the spectral measures contains atoms which ratios are well approximable by rationals, the variance is likely to have large fluctuations as the observation window grows, whereas the variance is bounded by the (d 1) dimensional measure of the window boundary if these ratio are badly approximable. We also show that, given any reasonable function, there are uncountably many sets of parameters for which the variance is asymptotically equivalent to this function.


Utilizing a Mathematical Model to Estimate Abortion Decline Scenario. Abortion is one of the biggest causes of maternal deaths, accounting for 15 of maternal deaths in Southeast Asia. The increase in and effectiveness of using contraception are still considered to be the effective method to reduce abortion rate. Data pertaining to abortion incidence and effective efforts to reduce abortion rate in Indonesia is limited and difficult to access. Meanwhile such supporting information is necessary to enable the planning and evaluation of abortion control programs. This paper exemplifies the use of a mathematical model to explain an abortion decline scenario. The model employs determinants proposed by Bongaarts, which include average reproductive period, contraceptive prevalence and effectiveness, total fertility rate (TFR), and intended total fertility rate (ITFR), as well as birth and abortion intervals. The data used is from the 1991 2007 Indonesian Demography and Health Survey (Survei Demografi dan Kesehatan Indonesia SDKI), and the unit of analysis is women who had been married and aged 15 49 years old. Based on the current contraceptive prevalence level in Indonesia at 59 61 , the estimated total abortion rate is 1.9 2.2. Based on the plot of this total abortion rate, an abortion decline scenario can be estimated. At the current TFR level of 2.6, the required contraceptive prevalence is 69 (9 increase) for a decrease of one abortion case per woman. With a delay of one year in the age of the first marriage and a birth interval of three years, it is estimated that the abortion rate will decline from 3.05 to 0.69 case per woman throughout her reproductive period. Based on the assumption of contraceptive prevalence growth at 1 1.4 , it can be estimated that abortion rate will reach nearly 0 between 2018 and 2022.


Asymptotic profile and Morse index of the radial solutions of the H 'enon equation. We consider the H 'enon equation begin equation label alphab Delta u x alpha u p 1 u textrm in B N, quad u 0 textrm on partial B N, tag P alpha end equation where B N subset mathbb R N is the open unit ball centered at the origin, N geq 3 , p 1 and alpha 0 is a parameter. We show that, after a suitable rescaling, the two dimensional Lane Emden equation Delta w w p 1 w quad text in B 2, quad w 0 quad text on partial B 2, where B 2 subset mathbb R 2 is the open unit ball, is the limit problem of eqref alphab , as alpha to infty , in the framework of radial solutions. We exploit this fact to prove several qualitative results on the radial solutions of eqref alphab with any fixed number of nodal sets asymptotic estimates on the Morse indices along with their monotonicity with respect to alpha asymptotic convergence of their zeros blow up of the local extrema and on compact sets of B N . All these results are proved for both positive and nodal solutions.


Families of similar simplices inscribed in most smoothly embedded spheres. Let Delta denote a non degenerate k simplex in mathbb R k . The set text Sim ( Delta) of simplices in mathbb R k similar to Delta is diffeomorphic to O(k) times 0, infty) times mathbb R k , where the factor in O(k) is a matrix called the em pose . Among (k 1) spheres smoothly embedded in mathbb R k and isotopic to the identity, there is a dense family of spheres, for which the subset of text Sim ( Delta) of simplices inscribed in each embedded sphere contains a similar simplex of every pose U in O(k) . Further, the intersection of text Sim ( Delta) with the configuration space of k 1 distinct points on an embedded sphere is a manifold whose top homology class maps to the top class in O(k) via the pose map. This gives a high dimensional generalization of classical results on inscribing families of triangles in plane curves. We use techniques established in our previous paper on the square peg problem where we viewed inscribed simplices in spheres as transverse intersections of submanifolds of compactified configuration spaces.


Detecting the birth and death of finite time coherent sets. Finite time coherent sets (FTCSs) are distinguished regions of phase space that resist mixing with the surrounding space for some finite period of time physical manifestations include eddies and vortices in the ocean and atmosphere, respectively. The boundaries of finite time coherent sets are examples of Lagrangian coherent structures (LCSs). The selection of the time duration over which FTCS and LCS computations are made in practice is crucial to their success. If this time is longer than the lifetime of coherence of individual objects then existing methods will fail to detect the shorter lived coherence. It is of clear practical interest to determine the full lifetime of coherent objects, but in complicated practical situations, for example a field of ocean eddies with varying lifetimes, this is impossible with existing approaches. Moreover, determining the timing of emergence and destruction of coherent sets is of significant scientific interest. In this work we introduce new constructions to address these issues. The key components are an inflated dynamic Laplace operator and the concept of semi material FTCSs. We make strong mathematical connections between the inflated dynamic Laplacian and the standard dynamic Laplacian Froyland 2015 , showing that the latter arises as a limit of the former. The spectrum and eigenfunctions of the inflated dynamic Laplacian directly provide information on the number, lifetimes, and evolution of coherent sets.


On the asymptotic optimality of spectral coarse spaces. This paper is concerned with the asymptotic optimality of spectral coarse spaces for two level iterative methods. Spectral coarse spaces, namely coarse spaces obtained as the span of the slowest modes of the used one level smoother, are known to be very efficient and, in some cases, optimal. However, the results of this paper show that spectral coarse spaces do not necessarily minimize the asymptotic contraction factor of a two level iterative method. Moreover, numerical experiments show that there exist coarse spaces that are asymptotically more efficient and lead to preconditioned systems with improved conditioning properties.


Kummer quartic surfaces, strict self duality, and more. In this paper we first show that each Kummer quartic surface (a quartic surface X with 16 singular points) is, in canonical coordinates, equal to its dual surface, and that the Gauss map induces a fixpoint free involution gamma on the minimal resolution S of X . Then we study the corresponding Enriques surfaces S gamma . We also describe in detail the remarkable properties of the most symmetric Kummer quartic, which we call the Cefal 'u quartic. We also investigate the Kummer quartic surfaces whose associated Abelian surface is isogenous to a product of elliptic curves through an isogeny with kernel ( mathbb Z 2) 2 , and show the existence of polarized nodal K3 surfaces X of any degree d 2k with the maximal number of nodes, such that X and its nodes are defined over mathbb R . We take then as parameter space for Kummer quartics an open set in mathbb P 3 , parametrizing nondegenerate (16 6, 16 6) configurations, and compare with other parameter spaces. We also extend to positive characteristic some results which were previously known over mathbb C . We end with a section devoted to remarks on normal cubic surfaces, and providing some other examples of strictly selfdual hypersurfaces.


Centers of Hecke Algebras of Complex Reflection Groups. We provide a variant of the Geck Rouquier Theorem on the center of an Iwahori Hecke algebra, which also covers the complex case and, for some examples of complex reflection groups W , we compute an explicit basis of the center of the Hecke algebra of W .


Neural PathSim for Inductive Similarity Search in Heterogeneous Information Networks. PathSim is a widely used meta path based similarity in heterogeneous information networks. Numerous applications rely on the computation of PathSim, including similarity search and clustering. Computing PathSim scores on large graphs is computationally challenging due to its high time and storage complexity. In this paper, we propose to transform the problem of approximating the ground truth PathSim scores into a learning problem. We design an encoder decoder based framework, NeuPath, where the algorithmic structure of PathSim is considered. Specifically, the encoder module identifies Top T optimized path instances, which can approximate the ground truth PathSim, and maps each path instance to an embedding vector. The decoder transforms each embedding vector into a scalar respectively, which identifies the similarity score. We perform extensive experiments on two real world datasets in different domains, ACM and IMDB. Our results demonstrate that NeuPath performs better than state of the art baselines in the PathSim approximation task and similarity search task.


Unitary group orbits versus groupoid orbits of normal operators. We study the unitary orbit of a normal operator a in mathcal B( mathcal H) , regarded as a homogeneous space for the action of unitary groups associated with symmetrically normed ideals of compact operators. We show with an unified treatment that the orbit is a submanifold of the differing ambient spaces if and only if the spectrum of a is finite, and in that case it is a closed submanifold. For arithmetically mean closed ideals, we show that nevertheless the orbit always has a natural manifold structure, modeled by the kernel of a suitable conditional expectation. When the spectrum of a is not finite, we describe the closure of the orbits of a for the different norm topologies involved. We relate these results to the action of the groupoid of the partial isometries via the moment map given by the range projection of normal operators. We show that all these groupoid orbits also have differentiable structures for which the target map is a smooth submersion. For any normal operator a we also describe the norm closure of its groupoid orbit mathcal O a , which leads to necessary and sufficient spectral conditions on a ensuring that mathcal O a is norm closed and that mathcal O a is a closed embedded submanifold of mathcal B( mathcal H) .


Exponential Convergence of Deep Operator Networks for Elliptic Partial Differential Equations. We construct deep operator networks (ONets) between infinite dimensional spaces that emulate with an exponential rate of convergence the coefficient to solution map of elliptic second order PDEs. In particular, we consider problems set in d dimensional periodic domains, d 1, 2, dots , and with analytic right hand sides and coefficients. Our analysis covers diffusion reaction problems, parametric diffusion equations, and elliptic systems such as linear isotropic elastostatics in heterogeneous materials. We leverage the exponential convergence of spectral collocation methods for boundary value problems whose solutions are analytic. In the present periodic and analytic setting, this follows from classical elliptic regularity. Within the ONet branch and trunk construction of Chen and Chen, 1993 and of Lu et al., 2021 , we show the existence of deep ONets which emulate the coefficient to solution map to accuracy varepsilon 0 in the H 1 norm, uniformly over the coefficient set. We prove that the neural networks in the ONet have size mathcal O ( left log( varepsilon) right kappa) for some kappa 0 depending on the physical space dimension.


Exploring Visual Context for Weakly Supervised Person Search. Person search has recently emerged as a challenging task that jointly addresses pedestrian detection and person re identification. Existing approaches follow a fully supervised setting where both bounding box and identity annotations are available. However, annotating identities is labor intensive, limiting the practicability and scalability of current frameworks. This paper inventively considers weakly supervised person search with only bounding box annotations. We proposed to address this novel task by investigating three levels of context clues (i.e., detection, memory and scene) in unconstrained natural images. The first two are employed to promote local and global discriminative capabilities, while the latter enhances clustering accuracy. Despite its simple design, our CGPS achieves 80.0 in mAP on CUHK SYSU, boosting the baseline model by 8.8 . Surprisingly, it even achieves comparable performance with several supervised person search models. Our code is available at https github.com ljpadam CGPS


Limiting spectral distribution for large sample covariance matrices with graph dependent elements. We obtain the limiting spectral distribution for large sample covariance matrices associated with random vectors having graph dependent entries under the assumption that the interdependence among the entries grows with the sample size n. Our results are tight. In particular, they give necessary and sufficient conditions for the Marchenko Pastur theorem for sample covariance matrices with m dependent orthonormal elements when m o(n).


Molecular modeling with machine learned universal potential functions. Molecular modeling is an important topic in drug discovery. Decades of research have led to the development of high quality scalable molecular force fields. In this paper, we show that neural networks can be used to train a universal approximator for energy potential functions. By incorporating a fully automated training process we have been able to train smooth, differentiable, and predictive potential functions on large scale crystal structures. A variety of tests have also been performed to show the superiority and versatility of the machine learned model.


Approximation by Lexicographically Maximal Solutions in Matching and Matroid Intersection Problems. We study how good a lexicographically maximal solution is in the weighted matching and matroid intersection problems. A solution is lexicographically maximal if it takes as many heaviest elements as possible, and subject to this, it takes as many second heaviest elements as possible, and so on. If the distinct weight values are sufficiently dispersed, e.g., the minimum ratio of two distinct weight values is at least the ground set size, then the lexicographical maximality and the usual weighted optimality are equivalent. We show that the threshold of the ratio for this equivalence to hold is exactly 2 . Furthermore, we prove that if the ratio is less than 2 , say alpha , then a lexicographically maximal solution achieves ( alpha 2) approximation, and this bound is tight.


Cryo shift Reducing domain shift in cryo electron subtomograms with unsupervised domain adaptation and randomization. Cryo Electron Tomography (cryo ET) is a 3D imaging technology that enables the visualization of subcellular structures in situ at near atomic resolution. Cellular cryo ET images help in resolving the structures of macromolecules and determining their spatial relationship in a single cell, which has broad significance in cell and structural biology. Subtomogram classification and recognition constitute a primary step in the systematic recovery of these macromolecular structures. Supervised deep learning methods have been proven to be highly accurate and efficient for subtomogram classification, but suffer from limited applicability due to scarcity of annotated data. While generating simulated data for training supervised models is a potential solution, a sizeable difference in the image intensity distribution in generated data as compared to real experimental data will cause the trained models to perform poorly in predicting classes on real subtomograms. In this work, we present Cryo Shift, a fully unsupervised domain adaptation and randomization framework for deep learning based cross domain subtomogram classification. We use unsupervised multi adversarial domain adaption to reduce the domain shift between features of simulated and experimental data. We develop a network driven domain randomization procedure with warp' modules to alter the simulated data and help the classifier generalize better on experimental data. We do not use any labeled experimental data to train our model, whereas some of the existing alternative approaches require labeled experimental samples for cross domain classification. Nevertheless, Cryo Shift outperforms the existing alternative approaches in cross domain subtomogram classification in extensive evaluation studies demonstrated herein using both simulated and experimental data.


3D Reconstruction Using a Linear Laser Scanner and a Camera. With the rapid development of computer graphics and vision, several three dimensional (3D) reconstruction techniques have been proposed and used to obtain the 3D representation of objects in the form of point cloud models, mesh models, and geometric models. The cost of 3D reconstruction is declining due to the maturing of this technology, however, the inexpensive 3D reconstruction scanners on the market may not be able to generate a clear point cloud model as expected. This study systematically reviews some basic types of 3D reconstruction technology and introduces an easy implementation using a linear laser scanner, a camera, and a turntable. The implementation is based on the monovision with laser and has tested several objects like wiki and mug. The accuracy and resolution of the point cloud result are quite satisfying. It turns out everyone can build such a 3D reconstruction system with appropriate procedures.


Antivax movement and epidemic spreading in the era of social networks Nonmonotonic effects, bistability and network segregation. In this work, we address a multicoupled dynamics on complex networks with tunable structural segregation. Specifically, we work on a networked epidemic spreading under a vaccination campaign with agents in favor and against the vaccine. Our results show that such coupled dynamics exhibits a myriad of phenomena such as nonequilibrium transitions accompanied by bistability. Besides we observe the emergence of an intermediate optimal segregation level where the community structure enhances negative opinions over vaccination but counterintuitively hinders rather than favoring the global disease spreading. Thus, our results hint vaccination campaigns should avoid policies that end up segregating excessively anti vaccine groups so that they effectively work as echo chambers in which individuals look to confirmation without jeopardising the safety of the whole population.


Merton's optimal investment problem with jump signals. This paper presents a new framework for Merton's optimal investment problem which uses the theory of Meyer sigma fields to allow for more flexibility in the information structure by adding a signal that possibly warns the investor about impending jumps. By means of dynamic programming, we solve the problem explicitly. In a case study with Gaussian jumps, we find, for instance, that an investor may prefer to disinvest completely even after a mildly positive signal. Our setting allows us also to address questions such as whether it is better to improve signal quality or quantity and how much extra value can be generated from either choice.


Polygon Placement Revisited (Degree of Freedom 1) SUM Hardness and an Improvement via Offline Dynamic Rectangle Union. We revisit the classical problem of determining the largest copy of a simple polygon P that can be placed into a simple polygon Q . Despite significant effort, known algorithms require high polynomial running times. (Barequet and Har Peled, 2001) give a lower bound of n 2 o(1) under the 3SUM conjecture when P and Q are (convex) polygons with Theta(n) vertices each. This leaves open whether we can establish (1) hardness beyond quadratic time and (2) any superlinear bound for constant sized P or Q . In this paper, we affirmatively answer these questions under the k SUM conjecture, proving natural hardness results that increase with each degree of freedom (scaling, x translation, y translation, rotation) (1) Finding the largest copy of P that can be x translated into Q requires time n 2 o(1) under the 3SUM conjecture. (2) Finding the largest copy of P that can be arbitrarily translated into Q requires time n 2 o(1) under the 4SUM conjecture. (3) The above lower bounds are almost tight when one of the polygons is of constant size we obtain an tilde O((pq) 2.5 ) time algorithm for orthogonal polygons P,Q with p and q vertices, respectively. (4) Finding the largest copy of P that can be arbitrarily rotated and translated into Q requires time n 3 o(1) under the 5SUM conjecture. We are not aware of any other such natural ( degree of freedom 1) SUM hardness for a geometric optimization problem.


Population Protocols for Graph Class Identification Problems. In this paper, we focus on graph class identification problems in the population protocol model. A graph class identification problem aims to decide whether a given communication graph is in the desired class (e.g. whether the given communication graph is a ring graph). Angluin et al. proposed graph class identification protocols with directed graphs and designated initial states under global fairness Angluin et al., DCOSS2005 . We consider graph class identification problems for undirected graphs on various assumptions such as initial states of agents, fairness of the execution, and initial knowledge of agents. In particular, we focus on lines, rings, k regular graphs, stars, trees, and bipartite graphs. With designated initial states, we propose graph class identification protocols for k regular graphs, and trees under global fairness, and propose a graph class identification protocol for stars under weak fairness. Moreover, we show that, even if agents know the number of agents n , there is no graph class identification protocol for lines, rings, k regular graphs, trees, or bipartite graphs under weak fairness. On the other hand, with arbitrary initial states, we show that there is no graph class identification protocol for lines, rings, k regular graphs, stars, trees, or bipartite graphs.


Imitation Learning of Stabilizing Policies for Nonlinear Systems. There has been a recent interest in imitation learning methods that are guaranteed to produce a stabilizing control law with respect to a known system. Work in this area has generally considered linear systems and controllers, for which stabilizing imitation learning takes the form of a biconvex optimization problem. In this paper it is demonstrated that the same methods developed for linear systems and controllers can be readily extended to polynomial systems and controllers using sum of squares techniques. A projected gradient descent algorithm and an alternating direction method of multipliers algorithm are proposed as heuristics for solving the stabilizing imitation learning problem, and their performance is illustrated through numerical experiments.


Towards Sneaking as a Playful Input Modality for Virtual Environments. Using virtual reality setups, users can fade out of their surroundings and dive fully into a thrilling and appealing virtual environment. The success of such immersive experiences depends heavily on natural and engaging interactions with the virtual world. As developers tend to focus on intuitive hand controls, other aspects of the broad range of full body capabilities are easily left vacant. One repeatedly overlooked input modality is the user's gait. Even though users may walk physically to explore the environment, it usually does not matter how they move. However, gait based interactions, using the variety of information contained in human gait, could offer interesting benefits for immersive experiences. For instance, stealth VR games could profit from this additional range of interaction fidelity in the form of a sneaking based input modality. In our work, we explore the potential of sneaking as a playful input modality for virtual environments. Therefore, we discuss possible sneaking based gameplay mechanisms and develop three technical approaches, including precise foot tracking and two abstraction levels. Our evaluation reveals the potential of sneaking based interactions in IVEs, offering unique challenges and thrilling gameplay. For these interactions, precise tracking of individual footsteps is unnecessary, as a more abstract approach focusing on the players' intention offers the same experience while providing better comprehensible feedback. Based on these findings, we discuss the broader potential and individual strengths of our gait centered interactions.


Scheduling in the Secretary Model. This paper studies Makespan Minimization in the secretary model. Formally, jobs, specified by their processing times, are presented in a uniformly random order. An online algorithm has to assign each job permanently and irrevocably to one of m parallel and identical machines such that the expected time it takes to process them all, the makespan, is minimized. We give two deterministic algorithms. First, a straightforward adaptation of the semi online strategy LightLoad provides a very simple algorithm retaining its competitive ratio of 1.75. A new and sophisticated algorithm is 1.535 competitive. These competitive ratios are not only obtained in expectation but, in fact, for all but a very tiny fraction of job orders. Classically, online makespan minimization only considers the worst case order. Here, no competitive ratio below 1.885 for deterministic algorithms and 1.581 using randomization is possible. The best randomized algorithm so far is 1.916 competitive. Our results show that classical worst case orders are quite rare and pessimistic for many applications. They also demonstrate the power of randomization when compared to much stronger deterministic reordering models. We complement our results by providing first lower bounds. A competitive ratio obtained on nearly all possible job orders must be at least 1.257. This implies a lower bound of 1.043 for both deterministic and randomized algorithms in the general model.


Certified Patch Robustness via Smoothed Vision Transformers. Certified patch defenses can guarantee robustness of an image classifier to arbitrary changes within a bounded contiguous region. But, currently, this robustness comes at a cost of degraded standard accuracies and slower inference times. We demonstrate how using vision transformers enables significantly better certified patch robustness that is also more computationally efficient and does not incur a substantial drop in standard accuracy. These improvements stem from the inherent ability of the vision transformer to gracefully handle largely masked images. Our code is available at https github.com MadryLab smoothed vit.


A k mer Based Approach for SARS CoV 2 Variant Identification. With the rapid spread of the novel coronavirus (COVID 19) across the globe and its continuous mutation, it is of pivotal importance to design a system to identify different known (and unknown) variants of SARS CoV 2. Identifying particular variants helps to understand and model their spread patterns, design effective mitigation strategies, and prevent future outbreaks. It also plays a crucial role in studying the efficacy of known vaccines against each variant and modeling the likelihood of breakthrough infections. It is well known that the spike protein contains most of the information variation pertaining to coronavirus variants. In this paper, we use spike sequences to classify different variants of the coronavirus in humans. We show that preserving the order of the amino acids helps the underlying classifiers to achieve better performance. We also show that we can train our model to outperform the baseline algorithms using only a small number of training samples ( 1 of the data). Finally, we show the importance of the different amino acids which play a key role in identifying variants and how they coincide with those reported by the USA's Centers for Disease Control and Prevention (CDC).


End to end reconstruction meets data driven regularization for inverse problems. We propose an unsupervised approach for learning end to end reconstruction operators for ill posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to minimize a weighted combination of the expected distortion in the measurement space and the Wasserstein 1 distance between the distributions of the reconstruction and ground truth. More specifically, the regularizer in the variational setting is parametrized by a deep neural network and learned simultaneously with the unrolled reconstruction operator. The variational problem is then initialized with the reconstruction of the unrolled operator and solved iteratively till convergence. Notably, it takes significantly fewer iterations to converge, thanks to the excellent initialization obtained via the unrolled operator. The resulting approach combines the computational efficiency of end to end unrolled reconstruction with the well posedness and noise stability guarantees of the variational setting. Moreover, we demonstrate with the example of X ray computed tomography (CT) that our approach outperforms state of the art unsupervised methods, and that it outperforms or is on par with state of the art supervised learned reconstruction approaches.


Machine Learning in Congestion Control A Survey on Selected Algorithms and a New Roadmap to their Implementation. With the emergence of new technologies, computer networks are becoming more structurally complex, diverse and heterogenous. The increasing discrepancy (among the interconnected networks) in data rates, delays, packet loss, and transmission scenarios, influence significantly the dynamics of congestion control (CC) parametrization. In contrast to the traditional endto end CC algorithms that rely on strict rules, new approaches aim to involve machine learning in order to continuously adapt the CC to real time network requirements. However, due to the high computational complexity and memory consumption, the feasibility of these schemes may still be questioned. This paper surveys selected machine learning based approaches to CC and proposes a roadmap to their implementation in computer systems, by using dataflow computing and Gallium Arsenide (GaAs) chips.


Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction. Contrastive learning has been used to learn a high quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data augmentation for text data. In this work, we explore the method of employing contrastive learning to improve the text representation from the BERT model for relation extraction. The key knob of our framework is a unique contrastive pre training step tailored for the relation extraction tasks by seamlessly integrating linguistic knowledge into the data augmentation. Furthermore, we investigate how large scale data constructed from the external knowledge bases can enhance the generality of contrastive pre training of BERT. The experimental results on three relation extraction benchmark datasets demonstrate that our method can improve the BERT model representation and achieve state of the art performance. In addition, we explore the interpretability of models by showing that BERT with contrastive pre training relies more on rationales for prediction. Our code and data are publicly available at https github.com udel biotm lab BERT CLRE.


Trans4Trans Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World. Common fully glazed facades and transparent objects present architectural barriers and impede the mobility of people with low vision or blindness, for instance, a path detected behind a glass door is inaccessible unless it is correctly perceived and reacted. However, segmenting these safety critical objects is rarely covered by conventional assistive technologies. To tackle this issue, we construct a wearable system with a novel dual head Transformer for Transparency (Trans4Trans) model, which is capable of segmenting general and transparent objects and performing real time wayfinding to assist people walking alone more safely. Especially, both decoders created by our proposed Transformer Parsing Module (TPM) enable effective joint learning from different datasets. Besides, the efficient Trans4Trans model composed of symmetric transformer based encoder and decoder, requires little computational expenses and is readily deployed on portable GPUs. Our Trans4Trans model outperforms state of the art methods on the test sets of Stanford2D3D and Trans10K v2 datasets and obtains mIoU of 45.13 and 75.14 , respectively. Through various pre tests and a user study conducted in indoor and outdoor scenarios, the usability and reliability of our assistive system have been extensively verified.


Cosupport of artinian modules. Let (R, mathfrak m ) be a commutative local noetherian ring. For an artinian R module M , we show the equality mathrm cosupp RM mathrm Cosupp RM using the semi discrete linearly compactness of R module mathrm Hom R(R mathfrak p ,M) where mathfrak p is a prime ideal of R .