The M "obius function on Affine Grassmannian elements. To any saturated chain in the affine Weyl group whose translation parts are sufficiently regular, we associate a near path and a far path in the quantum Bruhat graph. Using this, working in the Bruhat order on the minimal length representatives of the cosets in the affine Weyl group with respect to the finite Weyl group, we characterize the pairs of elements for which the M "obius function is nonzero. This is applied to obtain explicit expansions in the K theory of affine Grassmannians, of the basis of ideal sheaves into the basis of structure sheaves of Schubert varieties.


Attention Models for Point Clouds in Deep Learning A Survey. Recently, the advancement of 3D point clouds in deep learning has attracted intensive research in different application domains such as computer vision and robotic tasks. However, creating feature representation of robust, discriminative from unordered and irregular point clouds is challenging. In this paper, our ultimate goal is to provide a comprehensive overview of the point clouds feature representation which uses attention models. More than 75 key contributions in the recent three years are summarized in this survey, including the 3D objective detection, 3D semantic segmentation, 3D pose estimation, point clouds completion etc. We provide a detailed characterization (1) the role of attention mechanisms, (2) the usability of attention models into different tasks, (3) the development trend of key technology.


SceML A Graphical Modeling Framework for Scenario based Testing of Autonomous Vehicles. Ensuring the functional correctness and safety of autonomous vehicles is a major challenge for the automotive industry. However, exhaustive physical test drives are not feasible, as billions of driven kilometers would be required to obtain reliable results. Scenariobased testing is an approach to tackle this problem and reduce necessary test drives by replacing driven kilometers with simulations of relevant or interesting scenarios. These scenarios can be generated or extracted from recorded data with machine learning algorithms or created by experts. In this paper, we propose a novel graphical scenario modeling language. The graphical framework allows experts to create new scenarios or review ones designed by other experts or generated by machine learning algorithms. The scenario description is modeled as a graph and based on behavior trees. It supports different abstraction levels of scenario description during software and test development. Additionally, the graphbased structure provides modularity and reusable sub scenarios, an important use case in scenario modeling. A graphical visualization of the scenario enhances comprehensibility for different users. The presented approach eases the scenario creation process and increases the usage of scenarios within development and testing processes.


Active Divergence with Generative Deep Learning A Survey and Taxonomy. Generative deep learning systems offer powerful tools for artefact generation, given their ability to model distributions of data and generate high fidelity results. In the context of computational creativity, however, a major shortcoming is that they are unable to explicitly diverge from the training data in creative ways and are limited to fitting the target data distribution. To address these limitations, there have been a growing number of approaches for optimising, hacking and rewriting these models in order to actively diverge from the training data. We present a taxonomy and comprehensive survey of the state of the art of active divergence techniques, highlighting the potential for computational creativity researchers to advance these methods and use deep generative models in truly creative systems.


Archimedean period relations and period relations for Rankin Selberg convolutions. We prove the Archimedean period relations for Rankin Selberg convolutions for mathrm GL (n) times mathrm GL (n 1) . This implies the period relations for critical values of the Rankin Selberg L functions for mathrm GL (n) times mathrm GL (n 1) .


Schwarz type lemmas and their applications in Banach spaces. The main purpose of this paper is to develop some methods to investigate the Schwarz type lemmas of holomorphic mappings and pluriharmonic mappings in Banach spaces. Initially, we extend the classical Schwarz lemmas of holomorphic mappings to Banach spaces, and then we apply these extensions to establish a sharp Bloch type theorem for pluriharmonic mappings on homogeneous unit balls of C n and to obtain some sharp boundary Schwarz type lemmas for holomorphic mappings in Banach spaces. Furthermore, we improve and generalize the classical Schwarz lemmas of planar harmonic mappings into the sharp forms of Banach spaces, and present some applications to sharp boundary Schwarz type lemmas for pluriharmonic mappings in Banach spaces. Additionally, using a relatively simple method of proof, we prove some sharp Schwarz Pick type estimates of pluriharmonic mappings in JB triples, and the obtained results provide the improvements and generalizations of the corresponding results in cite CH20 .


Optimization of FLASH Proton Beams Using a Track Repeating Algorithm. Methods A phase space file in a plane at 202 mm downstream of the beam exit window is generated through tuning parameters to match FDC results with measured or MCNPX Monte Carlo simulated integrated depth dose distribution (IDD) and lateral dose profiles. To spread out the Bragg peak, widen the beam and reduce the penumbra, a ridge filter (RF), a high Z material scatterer and a collimator with compensator are inserted in the beam path and their shapes and sizes have been optimized. The FDC calculations are validated by comparing Geant4 Monte Carlo simulations. In addition, a set of algorithms to automatically choose the optimum dimensions of the beam shaping elements is developed and tested using the same beams. At the last part, dose rates for optimized beams were estimated by scaling their dose distributions to that of their original beams. Results The optimized 86.4 MeV beam had an 8.5 mm wide spread out Bragg peak (SOBP) (proximal 90 to distal 90 of the maximum dose), 14.5 mm, 12.0 mm and 11.0 lateral widths with dose above 50 , 80 and 90 respectively and a 2.5 mm penumbra from 80 to 20 in the lateral profile for the energy. The 159.5 MeV beam had a SOBP of 39.0 mm and the lateral widths with dose above 50 , 80 and 90 of 20.5 mm, 15.0 and 12.5 mm when the source to surface distance (SSD) was 550 mm. Wider lateral widths was obtained with increased SSD. The FDC calculations had passing rates higher than 96 using 3mm 3 as the gamma index criterion comparing with Geant4 simulations for both energies. The set of automatic algorithms can choose the proper dimensions for the high density scatterer, RF, collimator and compensator efficiently. And the optimized 159.5 MeV beam with different SDDs had entrance dose rate higher than 40 Gy s if the entrance dose rate of the original beam was 150 Gy s.


Rational Verification for Probabilistic Systems. Rational verification is the problem of determining which temporal logic properties will hold in a multi agent system, under the assumption that agents in the system act rationally, by choosing strategies that collectively form a game theoretic equilibrium. Previous work in this area has largely focussed on deterministic systems. In this paper, we develop the theory and algorithms for rational verification in probabilistic systems. We focus on concurrent stochastic games (CSGs), which can be used to model uncertainty and randomness in complex multi agent environments. We study the rational verification problem for both non cooperative games and cooperative games in the qualitative probabilistic setting. In the former case, we consider LTL properties satisfied by the Nash equilibria of the game and in the latter case LTL properties satisfied by the core. In both cases, we show that the problem is 2EXPTIME complete, thus not harder than the much simpler verification problem of model checking LTL properties of systems modelled as Markov decision processes (MDPs).


Bilingual Problems Studying the Security Risks Incurred by Native Extensions in Scripting Languages. Scripting languages are continuously gaining popularity due to their ease of use and the flourishing software ecosystems that surround them. These languages offer crash and memory safety by design, hence developers do not need to understand and prevent most low level security issues plaguing languages like C. However, scripting languages often allow native extensions, which are a way for custom C C code to be invoked directly from the high level language. While this feature promises several benefits such as increased performance or the reuse of legacy code, it can also break the guarantees provided by the language, e.g., crash safety. In this work, we first provide a comparative analysis of the security risks of the existing native extension API in three popular scripting languages. Additionally, we discuss a novel methodology for studying vulnerabilities caused by misuse of the native extension API. We then perform an in depth study of npm, an ecosystem which appears to be the most exposed to threats introduced by native extensions. We show that vulnerabilities in extensions can be exploited in their embedding library by producing a hard crash in 30 npm packages, simply by invoking their API. Moreover, we identify five open source web applications in which such exploits can be deployed remotely. Finally, we provide a set of recommendations for language designers, users and for the research community.


Investigating Conversion from Mild Cognitive Impairment to Alzheimer's Disease using Latent Space Manipulation. Alzheimer's disease is the most common cause of dementia that affects millions of lives worldwide. Investigating the underlying causes and risk factors of Alzheimer's disease is essential to prevent its progression. Mild Cognitive Impairment (MCI) is considered an intermediate stage before Alzheimer's disease. Early prediction of the conversion from the MCI to Alzheimer's is crucial to take necessary precautions for decelerating the progression and developing suitable treatments. In this study, we propose a deep learning framework to discover the variables which are identifiers of the conversion from MCI to Alzheimer's disease. In particular, the latent space of a variational auto encoder network trained with the MCI and Alzheimer's patients is manipulated to obtain the significant attributes and decipher their behavior that leads to the conversion from MCI to Alzheimer's disease. By utilizing a generative decoder and the dimensions that lead to the Alzheimer's diagnosis, we generate synthetic dementia patients from MCI patients in the dataset. Experimental results show promising quantitative and qualitative results on one of the most extensive and commonly used Alzheimer's disease neuroimaging datasets in literature.


A mutual information based in vivo monitoring of adaptive response to targeted therapies in melanoma. The mechanisms of adaptive resistance to genetic based targeted therapies of solid malignancies have been the subject of intense research. These studies hold great promise for finding co targetable hub pathways which in turn would control the downstream non genetic mechanisms of adaptive resistance. Many such mechanisms have been described in the paradigmatic BRAF mutated melanoma model of adaptive response to BRAF inhibition. Currently, a major challenge for these mechanistic studies is to confirm in vivo, at the single cell proteomic level, the existence of dependencies between the co targeted hub pathways and their downstream effectors. Moreover, the drug induced in vivo modulation of these dependencies needs to be demonstrated. Here, we implement such single cell based in vivo expression dependency quantification using immunohistochemistry (IHC) based analyses of sequential biopsies in two xenograft models. These mimic phase 2 and 3 trials in our own therapeutic strategy to prevent the adaptive response to BRAF inhibition. In this mechanistic model, the dependencies between the targeted Li2CO3 inducible hub HuR and the resistance effectors are more likely time shifted and transient since the minority of HuRLow cells, which act as a reservoir of adaptive plasticity, switch to a HuRHigh state as they paradoxically proliferate under BRAF inhibition. Nevertheless, we show that a copula kernel density estimator (KDE) based quantification of mutual information (MI) efficiently captures, at the individual level, the dependencies between HuR and two relevant resistance markers pERK and EGFR, and outperforms classic expression correlation coefficients. Ultimately, the validation of MI as a predictive IHC based metric of response to our therapeutic strategy will be carried in clinical trials.


A Class Of Curvature Flows Expanded By Support Function And Curvature Function In The Euclidean Space And Hyperbolic Space. In this paper, we first consider a class of expanding flows of closed, smooth, star shaped hypersurface in Euclidean space mathbb R n 1 with speed u alpha f beta , where u is the support function of the hypersurface, f is a smooth, symmetric, homogenous of degree one, positive function of the principal curvatures of the hypersurface on a convex cone. For alpha le 0 beta le 1 alpha , we prove that the flow has a unique smooth solution for all time, and converges smoothly after normalization, to a sphere centered at the origin. In particular, the results of Gerhardt cite GC3 and Urbas cite UJ2 can be recovered by putting alpha 0 and beta 1 in our first result. If the initial hypersurface is convex, this is our previous work cite DL . If alpha le 0 beta 1 alpha and the ambient space is hyperbolic space mathbb H n 1 , we prove that the flow frac partial X partial t (u alpha f beta eta u) nu has a longtime existence and smooth convergence to a coordinate slice. The flow in mathbb H n 1 is equivalent (up to an isomorphism) to a re parametrization of the original flow in mathbb R n 1 case. Finally, we find a family of monotone quantities along the flows in mathbb R n 1 . As applications, we give a new proof of a family of inequalities involving the weighted integral of k th elementary symmetric function for k convex, star shaped hypersurfaces, which is an extension of the quermassintegral inequalities in cite GL2 .


Non vanishing of symmetric cube L functions. We prove that there are infinitely many Maass Hecke cuspforms over the field mathbb Q sqrt 3 such that the corresponding symmetric cube L series does not vanish at the center of the critical strip. This is done by using a result of Ginzburg, Jiang and Rallis which shows that the symmetric cube non vanishing happens if and only if a certain triple product integral involving the cusp form and the cubic theta function on mathbb Q sqrt 3 does not vanish. We use spectral theory and the properties of the cubic theta function to show that the non vanishing of this triple product occurs for infinitely many cusp forms. We also formulate a conjecture about the meaning of the absolute value squared of the triple product which is reminiscent of Watson's identity.


NF iSAM Incremental Smoothing and Mapping via Normalizing Flows. This paper presents a novel non Gaussian inference algorithm, Normalizing Flow iSAM (NF iSAM), for solving SLAM problems with non Gaussian factors and or non linear measurement models. NF iSAM exploits the expressive power of neural networks, and trains normalizing flows to draw samples from the joint posterior of non Gaussian factor graphs. By leveraging the Bayes tree, NF iSAM is able to exploit the sparsity structure of SLAM, thus enabling efficient incremental updates similar to iSAM2, albeit in the more challenging non Gaussian setting. We demonstrate the performance of NF iSAM and compare it against the state of the art algorithms such as iSAM2 (Gaussian) and mm iSAM (non Gaussian) in synthetic and real range only SLAM datasets.


Global solutions for H s critical nonlinear biharmonic Schr " o dinger equation. We consider the nonlinear biharmonic Schr "odinger equation i partial tu ( Delta 2 mu Delta)u f(u) 0, qquad ( text BNLS ) in the critical Sobolev space H s( R N) , where N ge1 , mu 0 or 1 , 0 s min fc N2,8 and f(u) is a nonlinear function that behaves like lambda left u right alpha u with lambda in mathbb C , alpha frac 8 N 2s . We prove the existence and uniqueness of the global solutions to (BNLS) for the small initial data.


Some approximate solutions to the spread of influenza A virus infection. We study differential equations describing the spread of influenza A virus infection based on a mathematical model. We look for surface trajectories of the dynamical system in hand and their asymptotic behaviour.


Deep UV enhanced supercontinuum generated in tapered gas filled photonic crystal fiber. We present the use of linearly down tapered gas filled hollow core photonic crystal fiber in a single stage, pumped with pulses from a compact infrared laser source, to generate a supercontinuum carrying significant spectral power in the deep ultraviolet (200 300 nm). The generated supercontinuum extends from the near infrared down to around 213 nm with up to 0.83 mW nm in the deep ultraviolet.


Weighted Davis inequalities for martingale square functions. For a Hilbert space valued martingale (f n) and an adapted sequence of positive random variables (w n) , we show the weighted Davis type inequality mathbb E Bigl( f 0 w 0 frac 1 4 sum n 1 N frac df n 2 f n w n Bigr) leq mathbb E ( f N w N). This inequality is sharp and implies several results about the martingale square function. We also obtain a variant of this inequality for martingales with values in uniformly convex Banach spaces.


MLDev Data Science Experiment Automation and Reproducibility Software. In this paper we explore the challenges of automating experiments in data science. We propose an extensible experiment model as a foundation for integration of different open source tools for running research experiments. We implement our approach in a prototype open source MLDev software package and evaluate it in a series of experiments yielding promising results. Comparison with other state of the art tools signifies novelty of our approach.


Fractional Order Modelling and Optimal Control of Cholera Transmission. A Caputo type fractional order mathematical model for "metapopulation cholera transmission" was recently proposed in Chaos Solitons Fractals 117 (2018), 37 49 . A sensitivity analysis of that model is done here to show the accuracy relevance of parameter estimation. Then, a fractional optimal control (FOC) problem is formulated and numerically solved. A cost effectiveness analysis is performed to assess the relevance of studied control measures. Moreover, such analysis allows us to assess the cost and effectiveness of the control measures during intervention. We conclude that the FOC system is more effective only in part of the time interval. For this reason, we propose a system where the derivative order varies along the time interval, being fractional or classical when more advantageous. Such variable order fractional model, that we call a 'FractInt' system, shows to be the most effective in the control of the disease.


Sample Efficient Imitation Learning via Reward Function Trained in Advance. Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms of environment interaction, which severely limits their application to simulated domains. In industrial applications, learner usually have a high interaction cost, the more interactions with environment, the more damage it causes to the environment and the learner itself. In this article, we make an effort to improve sample efficiency by introducing a novel scheme of inverse reinforcement learning. Our method, which we call textit Model Reward Function Based Imitation Learning (MRFIL), uses an ensemble dynamic model as a reward function, what is trained with expert demonstrations. The key idea is to provide the agent with an incentive to match the demonstrations over a long horizon, by providing a positive reward upon encountering states in line with the expert demonstration distribution. In addition, we demonstrate the convergence guarantee for new objective function. Experimental results show that our algorithm reaches the competitive performance and significantly reducing the environment interactions compared to IL methods.


Norton algebras of the Hamming Graphs via linear characters. The Norton product is defined on each eigenspace of a distance regular graph by the orthogonal projection of the entry wise product. The resulting algebra, known as the Norton algebra, is a commutative nonassociative algebra that is useful in group theory due to its interesting automorphism group. We provide a formula for the Norton product on each eigenspace of a Hamming graph using linear characters. We construct a large subgroup of automorphisms of the Norton algebra of a Hamming graph and completely describe the automorphism group in some cases. We also show that the Norton product on each eigenspace of a Hamming graph is as nonassociative as possible, except for some special cases in which it is either associative or equally as nonassociative as the so called double minus operation previously studied by the author, Mickey, and Xu. Our results restrict to the hypercubes and extend to the halved and or folded cubes, the bilinear forms graphs, and more generally, all Cayley graphs of finite abelian groups.


An Approach for Combining Multimodal Fusion and Neural Architecture Search Applied to Knowledge Tracing. Knowledge Tracing is the process of tracking mastery level of different skills of students for a given learning domain. It is one of the key components for building adaptive learning systems and has been investigated for decades. In parallel with the success of deep neural networks in other fields, we have seen researchers take similar approaches in the learning science community. However, most existing deep learning based knowledge tracing models either (1) only use the correct incorrect response (ignoring useful information from other modalities) or (2) design their network architectures through domain expertise via trial and error. In this paper, we propose a sequential model based optimization approach that combines multimodal fusion and neural architecture search within one framework. The commonly used neural architecture search technique could be considered as a special case of our proposed approach when there is only one modality involved. We further propose to use a new metric called time weighted Area Under the Curve (weighted AUC) to measure how a sequence model performs with time. We evaluate our methods on two public real datasets showing the discovered model is able to achieve superior performance. Unlike most existing works, we conduct McNemar's test on the model predictions and the results are statistically significant.


Tree Cotree Decomposition of Isogeometric Mortared Spaces in H(curl) on Multi Patch Domains. When applying isogeometric analysis to engineering problems, one often deals with multi patch spline spaces that have incompatible discretisations, e.g. in the case of moving objects. In such cases mortaring has been shown to be advantageous. This contribution discusses the appropriate B spline spaces needed for the solution of Maxwell's equations in the functions space H(curl) and the corresponding mortar spaces. The main contribution of this paper is to show that in formulations requiring gauging, as in the vector potential formulation of magnetostatic equations, one can remove the discrete kernel subspace from the mortared spaces by the graph theoretical concept of a tree cotree decomposition. The tree cotree decomposition is done based on the control mesh, it works for non contractible domains, and it can be straightforwardly applied independently of the degree of the B spline bases. Finally, the simulation workflow is demonstrated using a realistic model of a rotating permanent magnet synchronous machine.


Crowd against the machine A simulation based benchmark tool to evaluate and compare robot capabilities to navigate a human crowd. The evaluation of robot capabilities to navigate human crowds is essential to conceive new robots intended to operate in public spaces. This paper initiates the development of a benchmark tool to evaluate such capabilities our long term vision is to provide the community with a simulation tool that generates virtual crowded environment to test robots, to establish standard scenarios and metrics to evaluate navigation techniques in terms of safety and efficiency, and thus, to install new methods to benchmarking robots' crowd navigation capabilities. This paper presents the architecture of the simulation tools, introduces first scenarios and evaluation metrics, as well as early results to demonstrate that our solution is relevant to be used as a benchmark tool.


Proto A Neural Cocktail for Generating Appealing Conversations. In this paper, we present our Alexa Prize Grand Challenge 4 socialbot Proto. Leveraging diverse sources of world knowledge, and powered by a suite of neural and rule based natural language understanding modules, state of the art neural generators, novel state based deterministic generators, an ensemble of neural re rankers, a robust post processing algorithm, and an efficient overall conversation strategy, Proto strives to be able to converse coherently about a diverse range of topics of interest to humans, and provide a memorable experience to the user. In this paper we dissect and analyze the different components and conversation strategies implemented by our socialbot, which enables us to generate colloquial, empathetic, engaging, self rectifying, factually correct, and on topic response, which has helped us achieve consistent scores throughout the competition.


Domain Adversarial Training of Self Attention Based Networks for Land Cover Classification using Multi temporal Sentinel 2 Satellite Imagery. The increasing availability of large scale remote sensing labeled data has prompted researchers to develop increasingly precise and accurate data driven models for land cover and crop classification (LC CC). Moreover, with the introduction of self attention and introspection mechanisms, deep learning approaches have shown promising results in processing long temporal sequences in the multi spectral domain with a contained computational request. Nevertheless, most practical applications cannot rely on labeled data, and in the field, surveys are a time consuming solution that poses strict limitations to the number of collected samples. Moreover, atmospheric conditions and specific geographical region characteristics constitute a relevant domain gap that does not allow direct applicability of a trained model on the available dataset to the area of interest. In this paper, we investigate adversarial training of deep neural networks to bridge the domain discrepancy between distinct geographical zones. In particular, we perform a thorough analysis of domain adaptation applied to challenging multi spectral, multi temporal data, accurately highlighting the advantages of adapting state of the art self attention based models for LC CC to different target zones where labeled data are not available. Extensive experimentation demonstrated significant performance and generalization gain in applying domain adversarial training to source and target regions with marked dissimilarities between the distribution of extracted features.


COVID 19 vaccination certificates in the Darkweb. COVID 19 vaccines have been rolled out in many countries and with them a number of vaccination certificates. For instance, the EU is utilizing a digital certificate in the form of a QR code that is digitally signed and can be easily validated throughout all EU countries. In this paper, we investigate the current state of the COVID 19 vaccination certificate market in the darkweb with a focus on the EU Digital Green Certificate (DGC). We investigate 17 marketplaces and 10 vendor shops, that include vaccination certificates in their listings. Our results suggest that a multitude of sellers in both types of platforms are advertising selling capabilities. According to their claims, it is possible to buy fake vaccination certificates issued in most countries worldwide. We demonstrate some examples of such sellers, including how they advertise their capabilities, and the methods they claim to be using to provide their services. We highlight two particular cases of vendor shops, with one of them showing an elevated degree of professionalism, showcasing forged valid certificates, the validity of which we verify using two different national mobile COVID 19 applications.


Algorithm Agnostic Explainability for Unsupervised Clustering. Supervised machine learning explainability has developed rapidly in recent years. However, clustering explainability has lagged behind. Here, we demonstrate the first adaptation of model agnostic explainability methods to explain unsupervised clustering. We present two novel "algorithm agnostic" explainability methods global permutation percent change (G2PC) and local perturbation percent change (L2PC) that identify feature importance globally to a clustering algorithm and locally to the clustering of individual samples. The methods are (1) easy to implement and (2) broadly applicable across clustering algorithms, which could make them highly impactful. We demonstrate the utility of the methods for explaining five popular clustering methods on low dimensional synthetic datasets and on high dimensional functional network connectivity data extracted from a resting state functional magnetic resonance imaging dataset of 151 individuals with schizophrenia and 160 controls. Our results are consistent with existing literature while also shedding new light on how changes in brain connectivity may lead to schizophrenia symptoms. We further compare the explanations from our methods to an interpretable classifier and find them to be highly similar. Our proposed methods robustly explain multiple clustering algorithms and could facilitate new insights into many applications. We hope this study will greatly accelerate the development of the field of clustering explainability.


Graphene oxide films for ultra flat optics and linear and nonlinear integrated photonic circuits. With superior optical properties, high flexibility in engineering its material properties, and strong capability for large scale on chip integration, graphene oxide (GO) is an attractive solution for on chip integration of two dimensional (2D) materials to implement functional integrated photonic devices capable of new features. Over the past decade, integrated GO photonics, representing an innovative merging of integrated photonic devices and thin GO films, has experienced significant development, leading to a surge in many applications covering almost every field of optical sciences. This paper reviews the recent advances in this emerging field, providing an overview of the optical properties of GO as well as methods for the on chip integration of GO. The main achievements made in GO hybrid integrated photonic devices for diverse applications are summarized. The open challenges as well as the potential for future improvement are also discussed.


An Efficient Transformer Decoder with Compressed Sub layers. The large attention based encoder decoder network (Transformer) has become prevailing recently due to its effectiveness. But the high computation complexity of its decoder raises the inefficiency issue. By examining the mathematic formulation of the decoder, we show that under some mild conditions, the architecture could be simplified by compressing its sub layers, the basic building block of Transformer, and achieves a higher parallelism. We thereby propose Compressed Attention Network, whose decoder layer consists of only one sub layer instead of three. Extensive experiments on 14 WMT machine translation tasks show that our model is 1.42x faster with performance on par with a strong baseline. This strong baseline is already 2x faster than the widely used standard baseline without loss in performance.


Recovery from Power Sums. We study the problem of recovering a collection of n numbers from the evaluation of m power sums. This yields a system of polynomial equations, which can be underconstrained ( m n ), square ( m n ), or overconstrained ( m n ). Fibers and images of power sum maps are explored in all three regimes, and in settings that range from complex and projective to real and positive. This involves surprising deviations from the B 'ezout bound, and the recovery of vectors from length measurements by p norms.


PP OCRv2 Bag of Tricks for Ultra Lightweight OCR System. Optical Character Recognition (OCR) systems have been widely used in various of application scenarios. Designing an OCR system is still a challenging task. In previous work, we proposed a practical ultra lightweight OCR system (PP OCR) to balance the accuracy against the efficiency. In order to improve the accuracy of PP OCR and keep high efficiency, in this paper, we propose a more robust OCR system, i.e. PP OCRv2. We introduce bag of tricks to train a better text detector and a better text recognizer, which include Collaborative Mutual Learning (CML), CopyPaste, Lightweight CPUNetwork (LCNet), Unified Deep Mutual Learning (U DML) and Enhanced CTCLoss. Experiments on real data show that the precision of PP OCRv2 is 7 higher than PP OCR under the same inference cost. It is also comparable to the server models of the PP OCR which uses ResNet series as backbones. All of the above mentioned models are open sourced and the code is available in the GitHub repository PaddleOCR which is powered by PaddlePaddle.


A Logic of Expertise. In this paper we introduce a simple modal logic framework to reason about the expertise of an information source. In the framework, a source is an expert on a proposition p if they are able to correctly determine the truth value of p in any possible world. We also consider how information may be false, but true after accounting for the lack of expertise of the source. This is relevant for modelling situations in which information sources make claims beyond their domain of expertise. We use non standard semantics for the language based on an expertise set with certain closure properties. It turns out there is a close connection between our semantics and S5 epistemic logic, so that expertise can be expressed in terms of knowledge at all possible states. We use this connection to obtain a sound and complete axiomatisation.


Monochromatic Edges in Complete Multipartite Hypergraphs. Consider the following problem. In a school with three classes containing n students each, given that their genders are unknown, find the minimum possible number of triples of same gender students not all of which are from the same class. Muaengwaeng asked this question and conjectured that the minimum scenario occurs when the classes are all boy, all girl and half and half. In this paper, we solve many generalizations of the problem including when the school has more than three classes, when triples are replaced by groups of larger sizes, when the classes are of different sizes, and when gender is replaced by other non binary attributes.


Variational Embeddings for Community Detection and Node Representation. In this paper, we study how to simultaneously learn two highly correlated tasks of graph analysis, i.e., community detection and node representation learning. We propose an efficient generative model called VECoDeR for jointly learning Variational Embeddings for Community Detection and node Representation. VECoDeR assumes that every node can be a member of one or more communities. The node embeddings are learned in such a way that connected nodes are not only "closer" to each other but also share similar community assignments. A joint learning framework leverages community aware node embeddings for better community detection. We demonstrate on several graph datasets that VECoDeR effectively out performs many competitive baselines on all three tasks i.e. node classification, overlapping community detection and non overlapping community detection. We also show that VECoDeR is computationally efficient and has quite robust performance with varying hyperparameters.


Analytical travelling vortex solutions of hyperbolic equations for validating very high order schemes. Testing the order of accuracy of (very) high order methods for shallow water (and Euler) equations is a delicate operation and the test cases are the crucial starting point of this operation. We provide a short derivation of vortex like analytical solutions in 2 dimensions for the shallow water equations (and, hence, Euler equations) that can be used to test the order of accuracy of numerical methods. These solutions have different smoothness in their derivatives (up to mathcal C infty ) and can be used accordingly to the order of accuracy of the scheme to test.


Hostility Detection in Hindi leveraging Pre Trained Language Models. Hostile content on social platforms is ever increasing. This has led to the need for proper detection of hostile posts so that appropriate action can be taken to tackle them. Though a lot of work has been done recently in the English Language to solve the problem of hostile content online, similar works in Indian Languages are quite hard to find. This paper presents a transfer learning based approach to classify social media (i.e Twitter, Facebook, etc.) posts in Hindi Devanagari script as Hostile or Non Hostile. Hostile posts are further analyzed to determine if they are Hateful, Fake, Defamation, and Offensive. This paper harnesses attention based pre trained models fine tuned on Hindi data with Hostile Non hostile task as Auxiliary and fusing its features for further sub tasks classification. Through this approach, we establish a robust and consistent model without any ensembling or complex pre processing. We have presented the results from our approach in CONSTRAINT 2021 Shared Task on hostile post detection where our model performs extremely well with 3rd runner up in terms of Weighted Fine Grained F1 Score.


E2ETag An End to End Trainable Method for Generating and Detecting Fiducial Markers. Existing fiducial markers solutions are designed for efficient detection and decoding, however, their ability to stand out in natural environments is difficult to infer from relatively limited analysis. Furthermore, worsening performance in challenging image capture scenarios such as poor exposure, motion blur, and off axis viewing sheds light on their limitations. E2ETag introduces an end to end trainable method for designing fiducial markers and a complimentary detector. By introducing back propagatable marker augmentation and superimposition into training, the method learns to generate markers that can be detected and classified in challenging real world environments using a fully convolutional detector network. Results demonstrate that E2ETag outperforms existing methods in ideal conditions and performs much better in the presence of motion blur, contrast fluctuations, noise, and off axis viewing angles. Source code and trained models are available at https github.com jbpeace E2ETag.


Decentralized Unsupervised Learning of Visual Representations. Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully labeled data for training, which is inconvenient or sometimes infeasible to obtain due to the high labeling cost and the requirement of expertise. The lack of labels makes collaborative learning impractical in many realistic settings. Self supervised learning can address this challenge by learning from unlabeled data. Contrastive learning (CL), a self supervised learning approach, can effectively learn visual representations from unlabeled image data. However, the distributed data collected on clients are usually not independent and identically distributed (non IID) among clients, and each client may only have few classes of data, which degrades the performance of CL and learned representations. To tackle this problem, we propose a collaborative contrastive learning framework consisting of two approaches feature fusion and neighborhood matching, by which a unified feature space among clients is learned for better data representations. Feature fusion provides remote features as accurate contrastive information to each client for better local learning. Neighborhood matching further aligns each client's local features to the remote features such that well clustered features among clients can be learned. Extensive experiments show the effectiveness of the proposed framework. It outperforms other methods by 11 on IID data and matches the performance of centralized learning.


The Concept of Inverse Robustness. In the past, a lot of methods were developed to deal with uncertain optimization problems. In this paper, we describe an approach of how to find a solution that covers a largest uncertainty set possible depending on a given budget. Namely, we allow a deviation from an optimal nominal solution value by at most a given budget in order to cover the largest possible subset of the underlying uncertainty set. We describe a main problem definition as well as some generalizations to give a modeler the possibility to adapt the concept to a special context. Furthermore we provide a comparison to existing robustness concepts such as the stability radius, the resiliency radius and the radius of robust feasibility. We conclude with a small example which is solved both analytically and numerically.


Early Lane Change Prediction for Automated Driving Systems Using Multi Task Attention based Convolutional Neural Networks. Lane change (LC) is one of the safety critical manoeuvres in highway driving according to various road accident records. Thus, reliably predicting such manoeuvre in advance is critical for the safe and comfortable operation of automated driving systems. The majority of previous studies rely on detecting a manoeuvre that has been already started, rather than predicting the manoeuvre in advance. Furthermore, most of the previous works do not estimate the key timings of the manoeuvre (e.g., crossing time), which can actually yield more useful information for the decision making in the ego vehicle. To address these shortcomings, this paper proposes a novel multi task model to simultaneously estimate the likelihood of LC manoeuvres and the time to lane change (TTLC). In both tasks, an attention based convolutional neural network (CNN) is used as a shared feature extractor from a bird's eye view representation of the driving environment. The spatial attention used in the CNN model improves the feature extraction process by focusing on the most relevant areas of the surrounding environment. In addition, two novel curriculum learning schemes are employed to train the proposed approach. The extensive evaluation and comparative analysis of the proposed method in existing benchmark datasets show that the proposed method outperforms state of the art LC prediction models, particularly considering long term prediction performance.


DeepFace EMD Re ranking Using Patch wise Earth Mover's Distance Improves Out Of Distribution Face Identification. Face identification (FI) is ubiquitous and drives many high stake decisions made by law enforcement. State of the art FI approaches compare two images by taking the cosine similarity between their image embeddings. Yet, such an approach suffers from poor out of distribution (OOD) generalization to new types of images (e.g., when a query face is masked, cropped, or rotated) not included in the training set or the gallery. Here, we propose a re ranking approach that compares two faces using the Earth Mover's Distance on the deep, spatial features of image patches. Our extra comparison stage explicitly examines image similarity at a fine grained level (e.g., eyes to eyes) and is more robust to OOD perturbations and occlusions than traditional FI. Interestingly, without finetuning feature extractors, our method consistently improves the accuracy on all tested OOD queries masked, cropped, rotated, and adversarial while obtaining similar results on in distribution images.


Data Driven Threat Hunting Using Sysmon. Threat actors can be persistent, motivated and agile, and leverage a diversified and extensive set of tactics and techniques to attain their goals. In response to that, defenders establish threat intelligence programs to stay threat informed and lower risk. Actionable threat intelligence is integrated into security information and event management systems (SIEM) or is accessed via more dedicated tools like threat intelligence platforms. A threat intelligence platform gives access to contextual threat information by aggregating, processing, correlating, and analyzing real time data and information from multiple sources, and in many cases, it provides centralized analysis and reporting of an organization's security events. Sysmon logs is a data source that has received considerable attention for endpoint visibility. Approaches for threat detection using Sysmon have been proposed, mainly focusing on search engine technologies like NoSQL database systems. This paper demonstrates one of the many use cases of Sysmon and cyber threat intelligence. In particular, we present a threat assessment system that relies on a cyber threat intelligence ontology to automatically classify executed software into different threat levels by analyzing Sysmon log streams. The presented system and approach augments cyber defensive capabilities through situational awareness, prediction, and automated courses of action.


Nearly constant Q models of the generalized standard linear solid type and the corresponding wave equations. Time domain seismic forward and inverse modeling for a dissipative medium is a vital research topic to investigate the attenuation structure of the Earth. Constant Q, also called frequency independence of the quality factor, is a common assumption for seismic Q inversion. We propose the first and second order nearly constant Q dissipative models of the generalized standard linear solid type, using a novel Q independent weighting function approach. The two new models, which originate from the Kolsky model (a nearly constant Q model) and the Kjartansson model (an exactly constant Q model), result in the corresponding wave equations in differential form. Even for extremely strong attenuation (e.g., Q 5), the quality factor and phase velocity for the two new models are close to those for the Kolsky and Kjartansson models, in a frequency range of interest. The wave equations for the two new models involve explicitly a specified Q parameter and have compact and simple forms. We provide a novel perspective on how to build a nearly constant Q dissipative model which is beneficial for time domain large scale wavefield forward and inverse modeling. This perspective could also help obtain other dissipative models with similar advantages. We also discuss the extension beyond viscoacousticity and other related issues, for example, extending the two new models to viscoelastic anisotropy.


A multiple time renewal equation for neural assemblies with elapsed time model. We introduce and study an extension of the classical elapsed time equation in the context of neuron populations that are described by the elapsed time since the last discharge, i.e., the refractory period. In this extension we incorporate the elapsed since the penultimate discharge and we obtain a more complex system of integro differential equations. For this new system we prove convergence to stationary state by means of Doeblin's theory in the case of weak non linearities in an appropriate functional setting, inspired by the case of the classical elapsed time equation. Moreover, we present some numerical simulations to observe how different firing rates can give different types of behaviors and to contrast them with theoretical results of both classical and extended models.


Variational and numerical analysis of a mathbf Q tensor model for smectic A liquid crystals. We analyse an energy minimisation problem recently proposed for modelling smectic A liquid crystals. The optimality conditions give a coupled nonlinear system of partial differential equations, with a second order equation for the tensor valued nematic order parameter mathbf Q and a fourth order equation for the scalar valued smectic density variation u . Our two main results are a proof of the existence of solutions to the minimisation problem, and the derivation of a priori error estimates for its discretisation using the mathcal C 0 interior penalty method. More specifically, optimal rates in the H 1 and L 2 norms are obtained for mathbf Q , while optimal rates in a mesh dependent norm and L 2 norm are obtained for u . Numerical experiments confirm the rates of convergence.


Is "my favorite new movie" my favorite movie? Probing the Understanding of Recursive Noun Phrases. Recursive noun phrases (NPs) have interesting semantic properties. For example, "my favorite new movie" is not necessarily "my favorite movie", whereas "my new favorite movie" is. This is common sense to humans, yet it is unknown whether pre trained language models have such knowledge. We introduce the Recursive Noun Phrase Challenge (RNPC), a challenge set targeting the understanding of recursive NPs. When evaluated on our dataset, state of the art Transformer models only achieve around chance performance. Still, we show that such knowledge is learnable with appropriate data. We further probe the models for relevant linguistic features that can be learned from our tasks, including modifier semantic category and modifier scope. Finally, models trained on RNPC achieve strong zero shot performance on an extrinsic Harm Detection task, showing the usefulness of the understanding of recursive NPs in downstream applications. All code and data will be released at https github.com veronica320 Recursive NPs.


E k pushouts and E k 1 tensors. We prove a general result that relates certain pushouts of E k algebras to relative tensors over E k 1 algebras. Specializations include a number of established results on classifying spaces, resolutions of modules, and (co)homology theories for ring spectra. The main results apply when the category in question has centralizers. Among our applications, we show that certain quotients of the dual Steenrod algebra are realized as associative algebras over HF p wedge HF p by attaching single E 1 algebra relation, generalizing previous work at the prime 2 . We also construct a filtered E 2 algebra structure on the sphere spectrum, and the resulting spectral sequence for the stable homotopy groups of spheres has E 1 term isomorphic to a regrading of the E 1 term of the May spectral sequence.


Distributed Random Reshuffling over Networks. In this paper, we consider the distributed optimization problem where n agents, each possessing a local cost function, collaboratively minimize the average of the local cost functions over a connected network. To solve the problem, we propose a distributed random reshuffling (D RR) algorithm that combines the classical distributed gradient descent (DGD) method and Random Reshuffling (RR). We show that D RR inherits the superiority of RR for both smooth strongly convex and smooth nonconvex objective functions. In particular, for smooth strongly convex objective functions, D RR achieves mathcal O (1 T 2) rate of convergence (here, T counts the total number of iterations) in terms of the squared distance between the iterate and the unique minimizer. When the objective function is assumed to be smooth nonconvex and has Lipschitz continuous component functions, we show that D RR drives the squared norm of gradient to 0 at a rate of mathcal O (1 T 2 3 ) . These convergence results match those of centralized RR (up to constant factors).


Deep Bayesian Learning for Car Hacking Detection. With the rise of self drive cars and connected vehicles, cars are equipped with various devices to assistant the drivers or support self drive systems. Undoubtedly, cars have become more intelligent as we can deploy more and more devices and software on the cars. Accordingly, the security of assistant and self drive systems in the cars becomes a life threatening issue as smart cars can be invaded by malicious attacks that cause traffic accidents. Currently, canonical machine learning and deep learning methods are extensively employed in car hacking detection. However, machine learning and deep learning methods can easily be overconfident and defeated by carefully designed adversarial examples. Moreover, those methods cannot provide explanations for security engineers for further analysis. In this work, we investigated Deep Bayesian Learning models to detect and analyze car hacking behaviors. The Bayesian learning methods can capture the uncertainty of the data and avoid overconfident issues. Moreover, the Bayesian models can provide more information to support the prediction results that can help security engineers further identify the attacks. We have compared our model with deep learning models and the results show the advantages of our proposed model. The code of this work is publicly available


Implementation of relativistic coupled cluster theory for massively parallel GPU accelerated computing architectures. In this paper, we report a reimplementation of the core algorithms of relativistic coupled cluster theory aimed at modern heterogeneous high performance computational infrastructures. The code is designed for efficient parallel execution on many compute nodes with optional GPU coprocessing, accomplished via the new ExaTENSOR back end. The resulting ExaCorr module is primarily intended for calculations of molecules with one or more heavy elements, as relativistic effects on electronic structure are included from the outset. In the current work, we thereby focus on exact 2 component methods and demonstrate the accuracy and performance of the software. The module can be used as a stand alone program requiring a set of molecular orbital coefficients as starting point, but is also interfaced to the DIRAC program that can be used to generate these. We therefore also briefly discuss an improvement of the parallel computing aspects of the relativistic self consistent field algorithm of the DIRAC program.


Hierarchical Graph Representations in Digital Pathology. Cancer diagnosis, prognosis, and therapy response predictions from tissue specimens highly depend on the phenotype and topological distribution of constituting histological entities. Thus, adequate tissue representations for encoding histological entities is imperative for computer aided cancer patient care. To this end, several approaches have leveraged cell graphs that encode cell morphology and organization to denote the tissue information. These allow for utilizing machine learning to map tissue representations to tissue functionality to help quantify their relationship. Though cellular information is crucial, it is incomplete alone to comprehensively characterize complex tissue structure. We herein treat the tissue as a hierarchical composition of multiple types of histological entities from fine to coarse level, capturing multivariate tissue information at multiple levels. We propose a novel multi level hierarchical entity graph representation of tissue specimens to model hierarchical compositions that encode histological entities as well as their intra and inter entity level interactions. Subsequently, a graph neural network is proposed to operate on the hierarchical entity graph representation to map the tissue structure to tissue functionality. Specifically, for input histology images we utilize well defined cells and tissue regions to build HierArchical Cell to Tissue (HACT) graph representations, and devise HACT Net, a graph neural network, to classify such HACT representations. As part of this work, we introduce the BReAst Carcinoma Subtyping (BRACS) dataset, a large cohort of H E stained breast tumor images, to evaluate our proposed methodology against pathologists and state of the art approaches. Through comparative assessment and ablation studies, our method is demonstrated to yield superior classification results compared to alternative methods as well as pathologists.


CDN MEDAL Two stage Density and Difference Approximation Framework for Motion Analysis. Background modeling and subtraction is a promising research area with a variety of applications for video surveillance. Recent years have witnessed a proliferation of effective learning based deep neural networks in this area. However, the techniques have only provided limited descriptions of scenes' properties while requiring heavy computations, as their single valued mapping functions are learned to approximate the temporal conditional averages of observed target backgrounds and foregrounds. On the other hand, statistical learning in imagery domains has been a prevalent approach with high adaptation to dynamic context transformation, notably using Gaussian Mixture Models (GMM) with its generalization capabilities. By leveraging both, we propose a novel method called CDN MEDAL net for background modeling and subtraction with two convolutional neural networks. The first architecture, CDN GM, is grounded on an unsupervised GMM statistical learning strategy to describe observed scenes' salient features. The second one, MEDAL net, implements a light weighted pipeline of online video background subtraction. Our two stage architecture is small, but it is very effective with rapid convergence to representations of intricate motion patterns. Our experiments show that the proposed approach is not only capable of effectively extracting regions of moving objects in unseen cases, but it is also very efficient.


Traces for factorization homology in dimension 1. We construct a circle invariant trace from the factorization homology of the circle sf trace colon int alpha mathbb S 1 underline sf End (V) longrightarrow uno associated to a dualizable object V in boldsymbol mathfrak X in a symmetric monoidal infty category. This proves a conjecture of To "en Vezzosi on existence of circle invariant traces. Underlying our construction is a calculation of the factorization homology over the circle of the walking adjunction in terms of the paracyclic category of Getzler Jones int mathbb S 1 sf Adj simeq bDelta circlearrowleft triangleleft ! triangleright . This calculation exhibits a form of Poincar 'e duality for 1 dimensional factorization homology.


Joint Universal Syntactic and Semantic Parsing. While numerous attempts have been made to jointly parse syntax and semantics, high performance in one domain typically comes at the price of performance in the other. This trade off contradicts the large body of research focusing on the rich interactions at the syntax semantics interface. We explore multiple model architectures which allow us to exploit the rich syntactic and semantic annotations contained in the Universal Decompositional Semantics (UDS) dataset, jointly parsing Universal Dependencies and UDS to obtain state of the art results in both formalisms. We analyze the behaviour of a joint model of syntax and semantics, finding patterns supported by linguistic theory at the syntax semantics interface. We then investigate to what degree joint modeling generalizes to a multilingual setting, where we find similar trends across 8 languages.


Non blocking programmable delay line with minimal dead time and tens of picoseconds jitter. We report a non blocking high resolution digital delay line based on an asynchronous circuit design. Field programmable gate array logic primitives were used as a source of delay and optimally arranged using combinatorial optimization. This approach allows for an efficient trade off of the resolution and a delay range together with minimized dead time operation. We demonstrate the method by implementing the delay line adjustable from 23 ns up to 1635 ns with a resolution of 10 ps. We present a detailed experimental characterization of the device focusing on thermal instability, timing jitter, and pulse spreading, which represent three main issues of the asynchronous design. We found a linear dependence of the delay on the temperature with the slope of 0.2 ps K per a logic primitive. We measured the timing jitter of the delay to be in the range of 7 ps 165 ps, linearly increasing over the dynamic range of the delay. We reduced the effect of pulse spreading by introducing pulse shrinking circuits, and reached the overall dead time of 4 ns 22.5 ns within the dynamic range of the delay. The presented non blocking delay line finds usage in applications where the dead time minimization is crucial, and tens of picoseconds excess jitter is acceptable, such as in many advanced photonic networks.


UAV Assisted Communication in Remote Disaster Areas using Imitation Learning. The damage to cellular towers during natural and man made disasters can disturb the communication services for cellular users. One solution to the problem is using unmanned aerial vehicles to augment the desired communication network. The paper demonstrates the design of a UAV Assisted Imitation Learning (UnVAIL) communication system that relays the cellular users' information to a neighbor base station. Since the user equipment (UEs) are equipped with buffers with limited capacity to hold packets, UnVAIL alternates between different UEs to reduce the chance of buffer overflow, positions itself optimally close to the selected UE to reduce service time, and uncovers a network pathway by acting as a relay node. UnVAIL utilizes Imitation Learning (IL) as a data driven behavioral cloning approach to accomplish an optimal scheduling solution. Results demonstrate that UnVAIL performs similar to a human expert knowledge based planning in communication timeliness, position accuracy, and energy consumption with an accuracy of 97.52 when evaluated on a developed simulator to train the UAV.


An assessment of phase field fracture crack initiation and growth. The phase field paradigm, in combination with a suitable variational structure, has opened a path for using Griffith's energy balance to predict the fracture of solids. These so called phase field fracture methods have gained significant popularity over the past decade, and are now part of commercial finite element packages and engineering fitness for service assessments. Crack paths can be predicted, in arbitrary geometries and dimensions, based on a global energy minimisation without the need for textit ad hoc criteria. In this work, we review the fundamentals of phase field fracture methods and examine their capabilities in delivering predictions in agreement with the classical fracture mechanics theory pioneered by Griffith. The two most widely used phase field fracture models are implemented in the context of the finite element method, and several paradigmatic boundary value problems are addressed to gain insight into their predictive abilities across all cracking stages both the initiation of growth and stable crack propagation are investigated. In addition, we examine the effectiveness of phase field models with an internal material length scale in capturing size effects and the transition flaw size concept. Our results show that phase field fracture methods satisfactorily approximate classical fracture mechanics predictions and can also reconcile stress and toughness criteria for fracture. The accuracy of the approximation is however dependent on modelling and constitutive choices we provide a rationale for these differences and identify suitable approaches for delivering phase field fracture predictions that are in good agreement with well established fracture mechanics paradigms.


MUSE Multi faceted Attention for Signed Network Embedding. Signed network embedding is an approach to learn low dimensional representations of nodes in signed networks with both positive and negative links, which facilitates downstream tasks such as link prediction with general data mining frameworks. Due to the distinct properties and significant added value of negative links, existing signed network embedding methods usually design dedicated methods based on social theories such as balance theory and status theory. However, existing signed network embedding methods ignore the characteristics of multiple facets of each node and mix them up in one single representation, which limits the ability to capture the fine grained attentions between node pairs. In this paper, we propose MUSE, a MUlti faceted attention based Signed network Embedding framework to tackle this problem. Specifically, a joint intra and inter facet attention mechanism is introduced to aggregate fine grained information from neighbor nodes. Moreover, balance theory is also utilized to guide information aggregation from multi order balanced and unbalanced neighbors. Experimental results on four real world signed network datasets demonstrate the effectiveness of our proposed framework.


N 'eron models of Jacobians over bases of arbitrary dimension. We work with a smooth relative curve X U U with nodal reduction over an excellent and locally factorial scheme S . We show that blowing up a nodal model of X U in the ideal sheaf of a section yields a new nodal model, and describe how these models relate to each other. We construct a N 'eron model for the Jacobian of X U , and describe it locally on S as a quotient of the Picard space of a well chosen nodal model. We provide a combinatorial criterion for the N 'eron model to be separated.


Finding Closure Terms Directly from Coarse Data for 2D Turbulent Flow. Machine learning is used to develop closure terms for coarse grained model of two dimensional turbulent flow directly from the coarse grained data by adding a source term to the Navier Stokes equations to ensure that the coarse grained flow evolves in the correct way. The source term is related to the average flow using a Neural Network with a relatively simple structure and smoothed slightly to prevent instabilities in a posteriori test. The time dependent coarse grained flow field is generated by filtering fully resolved results and the predicted coarse field evolution agrees well with the filtered results, both for the flow used to learn the closure terms and for flows not used for the learning.


The Adams spectral sequence for the image of J spectrum. We show that if we factor the long exact sequence in cohomology of a cofiber sequence of spectra into short exact sequences, then the d 2 differential in the Adams spectral sequence of any one term is related in a precise way to Yoneda composition with the 2 extension given by the complementary terms in the long exact sequence. We use this to give a complete analysis of the Adams spectral sequence for the connective image of J spectrum, finishing a calculation that was begun by D. Davis in 1975.


Rethinking Keypoint Representations Modeling Keypoints and Poses as Objects for Multi Person Human Pose Estimation. In keypoint estimation tasks such as human pose estimation, heatmap based regression is the dominant approach despite possessing notable drawbacks heatmaps intrinsically suffer from quantization error and require excessive computation to generate and post process. Motivated to find a more efficient solution, we propose to model individual keypoints and sets of spatially related keypoints (i.e., poses) as objects within a dense single stage anchor based detection framework. Hence, we call our method KAPAO (pronounced "Ka Pow"), for Keypoints And Poses As Objects. KAPAO is applied to the problem of single stage multi person human pose estimation by simultaneously detecting human pose and keypoint objects and fusing the detections to exploit the strengths of both object representations. In experiments, we observe that KAPAO is faster and more accurate than previous methods, which suffer greatly from heatmap post processing. The accuracy speed trade off is especially favourable in the practical setting when not using test time augmentation.


MirrorWiC On Eliciting Word in Context Representations from Pretrained Language Models. Recent work indicated that pretrained language models (PLMs) such as BERT and RoBERTa can be transformed into effective sentence and word encoders even via simple self supervised techniques. Inspired by this line of work, in this paper we propose a fully unsupervised approach to improving word in context (WiC) representations in PLMs, achieved via a simple and efficient WiC targeted fine tuning procedure MirrorWiC. The proposed method leverages only raw texts sampled from Wikipedia, assuming no sense annotated data, and learns context aware word representations within a standard contrastive learning setup. We experiment with a series of standard and comprehensive WiC benchmarks across multiple languages. Our proposed fully unsupervised MirrorWiC models obtain substantial gains over off the shelf PLMs across all monolingual, multilingual and cross lingual setups. Moreover, on some standard WiC benchmarks, MirrorWiC is even on par with supervised models fine tuned with in task data and sense labels.


Parametrised topological complexity of group epimorphisms. We show that the parametrised topological complexity of Cohen, Farber and Weinberger gives an invariant of group epimorphisms. We extend various bounds for the topological complexity of groups to obtain bounds for the parametrised topological complexity of epimorphisms. Several applications are given, including an alternative computation of the parametrised topological complexity of the planar Fadell Neuwirth fibrations which avoids calculations involving cup products. We also prove a homotopy invariance result for parametrised topological complexity of fibrations over different bases.


Multi source Neural Topic Modeling in Multi view Embedding Spaces. Though word embeddings and topics are complementary representations, several past works have only used pretrained word embeddings in (neural) topic modeling to address data sparsity in short text or small collection of documents. This work presents a novel neural topic modeling framework using multi view embedding spaces (1) pretrained topic embeddings, and (2) pretrained word embeddings (context insensitive from Glove and context sensitive from BERT models) jointly from one or many sources to improve topic quality and better deal with polysemy. In doing so, we first build respective pools of pretrained topic (i.e., TopicPool) and word embeddings (i.e., WordPool). We then identify one or more relevant source domain(s) and transfer knowledge to guide meaningful learning in the sparse target domain. Within neural topic modeling, we quantify the quality of topics and document representations via generalization (perplexity), interpretability (topic coherence) and information retrieval (IR) using short text, long text, small and large document collections from news and medical domains. Introducing the multi source multi view embedding spaces, we have shown state of the art neural topic modeling using 6 source (high resource) and 5 target (low resource) corpora.


Bias Free FedGAN A Federated Approach to Generate Bias Free Datasets. Federated Generative Adversarial Network (FedGAN) is a communication efficient approach to train a GAN across distributed clients without clients having to share their sensitive training data. In this paper, we experimentally show that FedGAN generates biased data points under non independent and identically distributed (non iid) settings. Also, we propose Bias Free FedGAN, an approach to generate bias free synthetic datasets using FedGAN. Our approach generates metadata at the aggregator using the models received from clients and retrains the federated model to achieve bias free results for image synthesis. Bias Free FedGAN has the same communication cost as that of FedGAN. Experimental results on image datasets (MNIST and FashionMNIST) validate our claims.


Bi Kolmogorov type operators and weighted Rellich's inequalities. In this paper we consider the symmetric Kolmogorov operator L Delta frac nabla mu mu cdot nabla on L 2( mathbb R N,d mu) , where mu is the density of a probability measure on mathbb R N . Under general conditions on mu we prove first weighted Rellich's inequalities with optimal constants and deduce that the operators L and L 2 with domain H 2( mathbb R N,d mu) and H 4( mathbb R N,d mu) respectively, generate analytic semigroups of contractions on L 2( mathbb R N,d mu) . We observe that d mu is the unique invariant measure for the semigroup generated by L 2 and as a consequence we describe the asymptotic behaviour of such semigroup and obtain some local positivity properties. As an application we study the bi Ornstein Uhlenbeck operator and its semigroup on L 2( mathbb R N,d mu) .


physics.ao-ph cs.NA math.NA physics.flu-dyn

On Divergence and Gradient Preserving Coarse Graining for Finite Volume Primitive Equation Ocean Models. We consider the problem of coarse graining in the context of finite volume fluid models. If a variable is defined on a high resolution grid it may be coarse grained so that it is defined on a grid of lower resolution. In general this will cause some information about the variable to be lost. In particular, horizontal divergences, gradients or other operators calculated on the coarse grid after projecting may differ from those calculated on the fine grid. In some cases we are able to choose averaging weights for coarse graining such that the coarse grid operators will give a result approximating that of the corresponding fine grid operators applied on the fine grid. In this work we derive general conditions on the averaging weights that allow the divergence and gradient to be preserved. These conditions are applied to a regular triangular mesh with B grid variable placement in which the fine grid resolution is some integer multiple N of the coarse grid resolution. For this case we find particular values for the averaging weights that preserve the divergence, and a set of different averaging weights that preserve the gradient. We observe that the vertical component of the curl is also preserved by the same coarse graining that preserves divergence. These coarse grainings are applied to data from FESOM2 simulations and we demonstrate that using the particular coarse grainings derived herein gives an overall reduction in L 1 error when compared with other methods.


BiRdQA A Bilingual Dataset for Question Answering on Tricky Riddles. A riddle is a question or statement with double or veiled meanings, followed by an unexpected answer. Solving riddle is a challenging task for both machine and human, testing the capability of understanding figurative, creative natural language and reasoning with commonsense knowledge. We introduce BiRdQA, a bilingual multiple choice question answering dataset with 6614 English riddles and 8751 Chinese riddles. For each riddle answer pair, we provide four distractors with additional information from Wikipedia. The distractors are automatically generated at scale with minimal bias. Existing monolingual and multilingual QA models fail to perform well on our dataset, indicating that there is a long way to go before machine can beat human on solving tricky riddles. The dataset has been released to the community.


Medical Aegis Robust adversarial protectors for medical images. Deep neural network based medical image systems are vulnerable to adversarial examples. Many defense mechanisms have been proposed in the literature, however, the existing defenses assume a passive attacker who knows little about the defense system and does not change the attack strategy according to the defense. Recent works have shown that a strong adaptive attack, where an attacker is assumed to have full knowledge about the defense system, can easily bypass the existing defenses. In this paper, we propose a novel adversarial example defense system called Medical Aegis. To the best of our knowledge, Medical Aegis is the first defense in the literature that successfully addresses the strong adaptive adversarial example attacks to medical images. Medical Aegis boasts two tier protectors The first tier of Cushion weakens the adversarial manipulation capability of an attack by removing its high frequency components, yet posing a minimal effect on classification performance of the original image the second tier of Shield learns a set of per class DNN models to predict the logits of the protected model. Deviation from the Shield's prediction indicates adversarial examples. Shield is inspired by the observations in our stress tests that there exist robust trails in the shallow layers of a DNN model, which the adaptive attacks can hardly destruct. Experimental results show that the proposed defense accurately detects adaptive attacks, with negligible overhead for model inference.


SuperVoxHenry Tucker Enhanced and FFT Accelerated Inductance Extraction for Voxelized Superconducting Structures. This paper introduces SuperVoxHenry, an inductance extraction simulator for analyzing voxelized superconducting structures. SuperVoxHenry extends the capabilities of the inductance extractor VoxHenry for analyzing the superconducting structures by incorporating the following enhancements. 1. SuperVoxHenry utilizes a two fluid model to account for normal currents and supercurrents. 2. SuperVoxHenry introduces the Tucker decompositions to reduce the memory requirement of circulant tensors as well as the setup time of the simulator. 3. SuperVoxHenry incorporates an aggregation based algebraic multigrid technique to obtain the sparse preconditioner.


Variable Grasping Mode Gripper With Different Finger Structures For Grasping Small Sized Items. This letter presents a novel small gripper capable of grasping various types of small sized items from flat surfaces for the assembly of small devices. Using a single actuator, the proposed gripper realizes two grasping modes parallel grip and turn over modes. The gripper's mode can be switched via contact with a flat surface, such as a table. Handling thin thicknesses and light weights are the key challenges faced in attempts to grasp small sized items. Although parallel grippers are effective in handling small items, there is a limit to the thinness of objects that can be grasped by parallel grippers. Accordingly, the turn over mode was adopted to grasp items that exceeded this threshold. In the turn over mode, one finger lifts the item, while another finger holds the item from above to keep it from flicking out. The proposed gripper is capable of picking up several types of items from a table, including thin (0.05 mm) and lightweight (0.007 g) items.


Nonlinear bicolor holography using plasmonic metasurfaces. Nonlinear metasurface holography shows the great potential of metasurfaces to control the phase, amplitude, and polarization of light while simultaneously converting the frequency of the light. The possibility of tailoring the scattering properties of a coherent beam, as well as the scattering properties of nonlinear signals originating from the meta atoms facilitates a huge degree of freedom in beam shaping application. Recently, several approaches showed that virtual objects or any kind of optical information can be generated at a wavelength different from the laser input beam. Here, we demonstrate a single layer nonlinear geometric phase metasurface made of plasmonic nanostructures for a simultaneous second and third harmonic generation. Different from previous works, we demonstrate a two color hologram with dissimilar types of nanostructures that generate the color information by different nonlinear optical processes. The amplitude ratio of both harmonic signals can be adapted depending on the nanostructures' resonance as well as the power and the wavelength of the incident laser beam. The two color holographic image is reconstructed in the Fourier space at visible wavelengths with equal amplitudes using a single near infrared wavelength. Nonlinear holography using multiple nonlinear processes simultaneously provides an alternative path to holographic color display applications, enhanced optical encryption schemes, and multiplexed optical data storage.


Sensor Guided Optical Flow. This paper proposes a framework to guide an optical flow network with external cues to achieve superior accuracy either on known or unseen domains. Given the availability of sparse yet accurate optical flow hints from an external source, these are injected to modulate the correlation scores computed by a state of the art optical flow network and guide it towards more accurate predictions. Although no real sensor can provide sparse flow hints, we show how these can be obtained by combining depth measurements from active sensors with geometry and hand crafted optical flow algorithms, leading to accurate enough hints for our purpose. Experimental results with a state of the art flow network on standard benchmarks support the effectiveness of our framework, both in simulated and real conditions.


Scalings of scale by scale turbulence energy in non homogeneous turbulence. A theory of non homogeneous turbulence is developed and is applied to boundary free shear flows. The theory introduces assumptions of inner and outer similarity for the non homogeneity of two point statistics and predicts power law scalings of second order structure functions which have some similarities with but also some differences from Kolmogorov scalings. These scalings arise as a consequence of these assumptions, of the general inter scale and inter space energy balance and of an inner outer equivalence hypothesis for turbulence dissipation. They reduce to usual Kolmogorov scalings in stationary homogeneous turbulence. Comparisons with structure function data from three qualitatively different turbulent wakes provide support for the theory's predictions but also raise new questions for future research.


A Sequence to Set Network for Nested Named Entity Recognition. Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span based methods, considering the entity recognition as a span classification task, can deal with nested entities naturally. But they suffer from the huge search space and the lack of interactions between entities. To address these issues, we propose a novel sequence to set neural network for nested NER. Instead of specifying candidate spans in advance, we provide a fixed set of learnable vectors to learn the patterns of the valuable spans. We utilize a non autoregressive decoder to predict the final set of entities in one pass, in which we are able to capture dependencies between entities. Compared with the sequence to sequence method, our model is more suitable for such unordered recognition task as it is insensitive to the label order. In addition, we utilize the loss function based on bipartite matching to compute the overall training loss. Experimental results show that our proposed model achieves state of the art on three nested NER corpora ACE 2004, ACE 2005 and KBP 2017. The code is available at https github.com zqtan1024 sequence to set.


Toeplitz operators on the Fock space with quasi radial symbols. The Fock space mathcal F ( mathbb C n) is the space of holomorphic functions on mathbb C n that are square integrable with respect to the Gaussian measure on mathbb C n . This space plays an important role in several subfields of analysis and representation theory. In particular, it has for a long time been a model to study Toeplitz operators. Esmeral and Maximenko showed in 2016 that radial Toeplitz operators on mathcal F ( mathbb C ) generate a commutative C algebra which is isometrically isomorphic to the C algebra C b,u ( mathbb N 0, rho 1) . In this article, we extend the result to k quasi radial symbols acting on the Fock space mathcal F ( mathbb C n) . We calculate the spectra of the said Toeplitz operators and show that the set of all eigenvalue functions is dense in the C algebra C b,u ( mathbb N 0 k, rho k) of bounded functions on mathbb N 0 k which are uniformly continuous with respect to the square root metric. In fact, the C algebra generated by Toeplitz operators with quasi radial symbols is C b,u ( mathbb N 0 k, rho k) .


Supercontinuum Generation by Saturated chi (2) Interactions. We demonstrate a new approach to supercontinuum generation and carrier envelope offset detection in dispersion engineered nanophotonic waveguides based on saturated second harmonic generation of femtosecond pulses. In contrast with traditional approaches based on self phase modulation, this technique simultaneously broadens both harmonics by generating rapid amplitude modulations of the field envelopes. The generated supercontinuum produces coherent carrier envelope offset beatnotes in the overlap region that remain in phase across 100's of nanometers of bandwidth while requiring 10 picojoules of pulse energy.


Multimodal Entity Linking for Tweets. In many information extraction applications, entity linking (EL) has emerged as a crucial task that allows leveraging information about named entities from a knowledge base. In this paper, we address the task of multimodal entity linking (MEL), an emerging research field in which textual and visual information is used to map an ambiguous mention to an entity in a knowledge base (KB). First, we propose a method for building a fully annotated Twitter dataset for MEL, where entities are defined in a Twitter KB. Then, we propose a model for jointly learning a representation of both mentions and entities from their textual and visual contexts. We demonstrate the effectiveness of the proposed model by evaluating it on the proposed dataset and highlight the importance of leveraging visual information when it is available.


On C 2 solution of the free transport equation in a disk. The free transport operator of probability density function f(t,x,v) is one the most fundamental operator which is widely used in many areas of PDE theory including kinetic theory, in particular. When it comes to general boundary problems in kinetic theory, however, it is well known that high order regularity is very hard to obtain in general. In this paper, we study the free transport equation in a disk with the specular boundary condition. We obtain initial boundary compatibility conditions for C 1 t,x,v and C 2 t,x,v regularity of the solution. We also provide regularity estimates.


SynCoBERT Syntax Guided Multi Modal Contrastive Pre Training for Code Representation. Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep learning based models for code intelligence. Recently, many pre trained language models for source code (e.g., CuBERT and CodeBERT) have been proposed to model the context of code and serve as a basis for downstream code intelligence tasks such as code search, code clone detection, and program translation. Current approaches typically consider the source code as a plain sequence of tokens, or inject the structure information (e.g., AST and data flow) into the sequential model pre training. To further explore the properties of programming languages, this paper proposes SynCoBERT, a syntax guided multi modal contrastive pre training approach for better code representations. Specially, we design two novel pre training objectives originating from the symbolic and syntactic properties of source code, i.e., Identifier Prediction (IP) and AST Edge Prediction (TEP), which are designed to predict identifiers, and edges between two nodes of AST, respectively. Meanwhile, to exploit the complementary information in semantically equivalent modalities (i.e., code, comment, AST) of the code, we propose a multi modal contrastive learning strategy to maximize the mutual information among different modalities. Extensive experiments on four downstream tasks related to code intelligence show that SynCoBERT advances the state of the art with the same pre training corpus and model size.


Health Status Prediction with Local Global Heterogeneous Behavior Graph. Health management is getting increasing attention all over the world. However, existing health management mainly relies on hospital examination and treatment, which are complicated and untimely. The emerging of mobile devices provides the possibility to manage people's health status in a convenient and instant way. Estimation of health status can be achieved with various kinds of data streams continuously collected from wearable sensors. However, these data streams are multi source and heterogeneous, containing complex temporal structures with local contextual and global temporal aspects, which makes the feature learning and data joint utilization challenging. We propose to model the behavior related multi source data streams with a local global graph, which contains multiple local context sub graphs to learn short term local context information with heterogeneous graph neural networks and a global temporal sub graph to learn long term dependency with self attention networks. Then health status is predicted based on the structure aware representation learned from the local global behavior graph. We take experiments on StudentLife dataset, and extensive results demonstrate the effectiveness of our proposed model.


On the Security and Privacy of Hyperledger Fabric Challenges and Open Issues. In the last few years, a countless number of permissioned blockchain solutions have been proposed, with each one to claim that it revolutionizes the way of the transaction processing along with the security and privacy preserving mechanisms that it provides. Hyperledger Fabric is one of the most popular permissioned blockchain architectures that has made a significant impact on the market. However, there are only few papers of finding architectural risks regarding the security and the privacy preserving mechanisms of Hyperledger Fabric. This paper separates the attack surface of the blockchain platform into four components, namely, consensus, chaincode, network and privacy preserving mechanisms, in all of which an attacker (from inside or outside the network) can exploit the platform's design and gain access to or misuse the network. In addition, we highlight the appropriate counter measures that can be taken in each component to address the corresponding risks and provide a significantly secure and enhanced privacy preserving Fabric network. We hope that by bringing this paper into light, we can aid developers to avoid security flaws and implementations that can be exploited by attackers but also to motivate further research to harden the platform's security and the client's privacy.


User Level Label Leakage from Gradients in Federated Learning. Federated learning enables multiple users to build a joint model by sharing their model updates (gradients), while their raw data remains local on their devices. In contrast to the common belief that this provides privacy benefits, we here add to the very recent results on privacy risks when sharing gradients. Specifically, we investigate Label Leakage from Gradients (LLG), a novel attack to extract the labels of the users' training data from their shared gradients. The attack exploits the direction and magnitude of gradients to determine the presence or absence of any label. LLG is simple yet effective, capable of leaking potential sensitive information represented by labels, and scales well to arbitrary batch sizes and multiple classes. We mathematically and empirically demonstrate the validity of the attack under different settings. Moreover, empirical results show that LLG successfully extracts labels with high accuracy at the early stages of model training. We also discuss different defense mechanisms against such leakage. Our findings suggest that gradient compression is a practical technique to mitigate the attack.


Machine Biometrics Towards Identifying Machines in a Smart City Environment. This paper deals with the identification of machines in a smart city environment. The concept of machine biometrics is proposed in this work for the first time, as a way to authenticate machine identities interacting with humans in everyday life. This definition is imposed in modern years where autonomous vehicles, social robots, etc. are considered active members of contemporary societies. In this context, the case of car identification from the engine behavioral biometrics is examined. For this purpose, 22 sound features were extracted and their discrimination capabilities were tested in combination with 9 different machine learning classifiers, towards identifying 5 car manufacturers. The experimental results revealed the ability of the proposed biometrics to identify cars with high accuracy up to 98 for the case of the Multilayer Perceptron (MLP) neural network model.


ReStore Neural Data Completion for Relational Databases. Classical approaches for OLAP assume that the data of all tables is complete. However, in case of incomplete tables with missing tuples, classical approaches fail since the result of a SQL aggregate query might significantly differ from the results computed on the full dataset. Today, the only way to deal with missing data is to manually complete the dataset which causes not only high efforts but also requires good statistical skills to determine when a dataset is actually complete. In this paper, we propose an automated approach for relational data completion called ReStore using a new class of (neural) schema structured completion models that are able to synthesize data which resembles the missing tuples. As we show in our evaluation, this efficiently helps to reduce the relative error of aggregate queries by up to 390 on real world data compared to using the incomplete data directly for query answering.


Consistency Training of Multi exit Architectures for Sensor Data. Deep neural networks have become larger over the years with increasing demand of computational resources for inference incurring exacerbate costs and leaving little room for deployment on devices with limited battery and other resources for real time applications. The multi exit architectures are type of deep neural network that are interleaved with several output (or exit) layers at varying depths of the model. They provide a sound approach for improving computational time and energy utilization of running a model through producing predictions from early exits. In this work, we present a novel and architecture agnostic approach for robust training of multi exit architectures termed consistent exit training. The crux of the method lies in a consistency based objective to enforce prediction invariance over clean and perturbed inputs. We leverage weak supervision to align model output with consistency training and jointly optimize dual losses in a multi task learning fashion over the exits in a network. Our technique enables exit layers to generalize better when confronted with increasing uncertainty, hence, resulting in superior quality efficiency trade offs. We demonstrate through extensive evaluation on challenging learning tasks involving sensor data that our approach allows examples to exit earlier with better detection rate and without executing all the layers in a deep model.


Combining chest X rays and electronic health record (EHR) data using machine learning to diagnose acute respiratory failure. Objective When patients develop acute respiratory failure, accurately identifying the underlying etiology is essential for determining the best treatment. However, differentiating between common medical diagnoses can be challenging in clinical practice. Machine learning models could improve medical diagnosis by aiding in the diagnostic evaluation of these patients. Materials and Methods Machine learning models were trained to predict the common causes of acute respiratory failure (pneumonia, heart failure, and or COPD). Models were trained using chest radiographs and clinical data from the electronic health record (EHR) and applied to an internal and external cohort. Results The internal cohort of 1,618 patients included 508 (31 ) with pneumonia, 363 (22 ) with heart failure, and 137 (8 ) with COPD based on physician chart review. A model combining chest radiographs and EHR data outperformed models based on each modality alone. Models had similar or better performance compared to a randomly selected physician reviewer. For pneumonia, the combined model area under the receiver operating characteristic curve (AUROC) was 0.79 (0.77 0.79), image model AUROC was 0.74 (0.72 0.75), and EHR model AUROC was 0.74 (0.70 0.76). For heart failure, combined 0.83 (0.77 0.84), image 0.80 (0.71 0.81), and EHR 0.79 (0.75 0.82). For COPD, combined AUROC 0.88 (0.83 0.91), image 0.83 (0.77 0.89), and EHR 0.80 (0.76 0.84). In the external cohort, performance was consistent for heart failure and increased for COPD, but declined slightly for pneumonia. Conclusions Machine learning models combining chest radiographs and EHR data can accurately differentiate between common causes of acute respiratory failure. Further work is needed to determine how these models could act as a diagnostic aid to clinicians in clinical settings.


Annular Khovanov homology and meridional disks. We exhibit infinite families of annular links for which the maximum non zero annular Khovanov grading grows infinitely large but the maximum non zero annular Floer theoretic gradings are bounded. We also show this phenomenon exists at the decategorified level for some of the infinite families. Our computations provide further evidence for the wrapping conjecture of Hoste Przytycki and its categorified analogue. Additionally, we show that certain satellite operations cannot be used to construct counterexamples to the categorified wrapping conjecture. We also extend the Batson Seed link splitting spectral sequence to the setting of annular Khovanov homology.