A Hybrid Direct Iterative Method for Solving KKT Linear Systems. We propose a solution strategy for linear systems arising in interior method optimization, which is suitable for implementation on hardware accelerators such as graphical processing units (GPUs). The current gold standard for solving these systems is the LDL T factorization. However, LDL T requires pivoting during factorization, which substantially increases communication cost and degrades performance on GPUs. Our novel approach solves a large indefinite system by solving multiple smaller positive definite systems, using an iterative solve for the Schur complement and an inner direct solve (via Cholesky factorization) within each iteration. Cholesky is stable without pivoting, thereby reducing communication and allowing reuse of the symbolic factorization. We demonstrate the practicality of our approach and show that on large systems it can efficiently utilize GPUs and outperform LDL T factorization of the full system.


The principal block of a mathbb Z ell spets and Yokonuma type algebras. We formulate conjectures concerning the dimension of the principal block of a mathbb Z ell spets (as defined in our earlier paper), motivated by analogous statements for finite groups. We show that these conjectures hold in certain situations. For this we introduce and study a Yokonuma type algebra for torus normalisers in ell compact groups which may be of independent interest.


Unsupervised Compound Domain Adaptation for Face Anti Spoofing. We address the problem of face anti spoofing which aims to make the face verification systems robust in the real world settings. The context of detecting live vs. spoofed face images may differ significantly in the target domain, when compared to that of labeled source domain where the model is trained. Such difference may be caused due to new and unknown spoof types, illumination conditions, scene backgrounds, among many others. These varieties of differences make the target a compound domain, thus calling for the problem of the unsupervised compound domain adaptation. We demonstrate the effectiveness of the compound domain assumption for the task of face anti spoofing, for the first time in this work. To this end, we propose a memory augmentation method for adapting the source model to the target domain in a domain aware manner. The adaptation process is further improved by using the curriculum learning and the domain agnostic source network training approaches. The proposed method successfully adapts to the compound target domain consisting multiple new spoof types. Our experiments on multiple benchmark datasets demonstrate the superiority of the proposed method over the state of the art.


Broadening the convergence domain of Seventh order method satisfying Lipschitz and H " o lder conditions. In this paper, the local convergence analysis of the multi step seventh order method is presented for solving nonlinear equations assuming that the first order Fr 'echet derivative belongs to the Lipschitz class. The significance of our work is that it avoids the standard practice of Taylor expansion thereby, extends the applicability of the scheme by applying the technique based on the first order derivative only. Also, this study provides radii of balls of convergence, the error bounds in terms of distances in addition to the uniqueness of the solution. Furthermore, generalization of this analysis satisfying H " o lder continuity condition is provided since it is more relaxed than Lipschitz continuity condition. We have considered some numerical examples and computed the radii of the convergence balls.


2 generated axial algebras of Monster type (2 beta, beta) . In this paper we prove that 2 generated primitive axial algebras of Monster type (2 beta, beta) over a ring R in which 2 and beta are invertible can be generated as R module by 8 vectors. We then completely classify 2 generated primitive axial algebras of Monster type (2 beta, beta) over any field of characteristic other than 2 .


Squeezed State of an Electron Cloud as a "Quasi Neutral'' One Component Plasma. We present a one dimensional model which gives a novel physical interpretation to the specific state of an ensemble of electrons continuously injected into an electrostatic potential well immersed in a strong applied magnetic field preventing radial expansion. When the space charge field of the electrons accumulated in the potential well compensates the external electrostatic field, a force free steady state of the electron cloud forms. This state of equilibrium is known in another context as a squeezed state of an electron beam. It is shown that the spatial distribution of the electron number density in this steady state correlates with the shape of the potential well. Perturbations of the steady state propagate along the electron cloud in the form of Trivelpiece Gould modes.


A multi layer network model to assess school opening policies during the COVID 19 vaccination campaign. We propose a multi layer network model for the spread of COVID 19 that accounts for interactions within the family, between schoolmates, and casual contacts in the population. We utilize the proposed model calibrated on epidemiological and demographic data to investigate current questions concerning the implementation of non pharmaceutical interventions (NPIs) during the vaccination campaign. Specifically, we consider scenarios in which the most fragile population has already received the vaccine, and we focus our analysis on the role of schools as drivers of the contagions and on the implementation of targeted intervention policies oriented to children and their families. We perform our analysis by means of a campaign of Monte Carlo simulations. Our findings suggest that, in a phase with NPIs enacted but in person education, children play a key role in the spreading of COVID 19. Interestingly, we show that children's testing might be an important tool to flatten the epidemic curve, in particular when combined with enacting temporary online education for classes in which infected students are detected. Finally, we test a vaccination strategy that prioritizes the members of large families and we demonstrate its good performance. We believe that our modeling framework and our findings could be of help for public health authorities for planning their current and future interventions, as well as to increase preparedness for future epidemic outbreaks.


Spherical polar coordinate transformation for integration of singular functions on tetrahedra. A method is presented for the evaluation of integrals on tetrahedra where the integrand has an integrable singularity at one vertex. The approach uses a transformation to spherical polar coordinates which explicitly eliminates the singularity and facilitates the evaluation of integration limits. The method is also implemented in an adaptive form which gives convergence to a required tolerance. Results from the method are compared to the output from an exact analytical method for one tetrahedron and show high accuracy. In particular, when the adaptive algorithm is used, highly accurate results are found for poorly conditioned tetrahedra which normally present difficulties for numerical quadrature techniques. The approach is also demonstrated for evaluation of the Biot Savart integral on an unstructured mesh in combination with a fixed node quadrature rule and demonstrates good convergence and accuracy.


Quasi solvable lattice models for mathrm Sp 2n and mathrm SO 2n 1 Demazure atoms and characters. We construct colored lattice models whose partition functions represent symplectic and odd orthogonal Demazure characters and atoms. We show that our lattice models are not solvable, but we are able to show the existence of sufficiently many solutions of the Yang Baxter equation that allows us to compute functional equations for the corresponding partition functions. From these functional equations, we determine that the partition function of our models are the Demazure atoms and characters for the symplectic and odd orthogonal Lie groups. We coin our lattice models as quasi solvable. We use the natural bijection of admissible states in our models with Proctor patterns to give a right key algorithm for reverse King tableaux and Sundaram tableaux.


The history of V. A. Rokhlin's ergodic seminar (1960 1970). The paper tells about the main features and events of the ergodic seminar organized and headed by V. A. Rokhlin at the Leningrad State University. The seminar was active in rm1960 1970.


Blind Calibration of Air Quality Wireless Sensor Networks Using Deep Neural Networks. Temporal drift of low cost sensors is crucial for the applicability of wireless sensor networks (WSN) to measure highly local phenomenon such as air quality. The emergence of wireless sensor networks in locations without available reference data makes calibrating such networks without the aid of true values a key area of research. While deep learning (DL) has proved successful on numerous other tasks, it is under researched in the context of blind WSN calibration, particularly in scenarios with networks that mix static and mobile sensors. In this paper we investigate the use of DL architectures for such scenarios, including the effects of weather in both drifting and sensor measurement. New models are proposed and compared against a baseline, based on a previous proposed model and extended to include mobile sensors and weather data. Also, a procedure for generating simulated air quality data is presented, including the emission, dispersion and measurement of the two most common particulate matter pollutants PM 2.5 and PM 10 . Results show that our models reduce the calibration error with an order of magnitude compared to the baseline, showing that DL is a suitable method for WSN calibration and that these networks can be remotely calibrated with minimal cost for the deployer.


A Comprehensive Survey on 6G Networks Applications, Core Services, Enabling Technologies, and Future Challenges. Cellular Internet of Things (IoT) is considered as de facto paradigm to improve the communication and computation systems. Cellular IoT connects massive number of physical and virtual objects to the Internet using cellular networks. The latest generation of cellular networks, e.g. fifth generation (5G), use evolutionary and revolutionary technologies to notably improve the performance of wireless networks. However, given the envisioned new use cases, e.g., holographic communication, and the ever increasing deployment of massive smart physical end devices in IoT, the volume of network traffic has considerably raised, and therefore, the current generation of mobile networks cannot wholly meet the ever increasing demands. Hence, it is envisioned that the next generation, sixth generation (6G) networks, need to play a critical role to alleviate such challenges in IoT by providing new communication services, network capacity, and ultra low latency communications (uRLLC). In this paper, first, the need for 6G networks is discussed. Then, the potential 6G requirements and trends, as well as the latest research activities related to 6G are introduced e.g., Tactile Internet and Terahertz (THz). Furthermore, the key performance indicators, applications, new services, and the potential key enabling technologies for 6G networks are presented. Finally, several potential unresolved challenges for future 6G networks are presented.


Uniform Tur 'an density of cycles. In the early 1980s, Erd H o s and S 'os initiated the study of the classical Tur 'an problem with a uniformity condition the uniform Tur 'an density of a hypergraph H is the infimum over all d for which any sufficiently large hypergraph with the property that all its linear size subhyperghraphs have density at least d contains H . In particular, they raise the questions of determining the uniform Tur 'an densities of K 4 (3) and K 4 (3) . The former question was solved only recently in Israel J. Math. 211 (2016), 349 366 and J. Eur. Math. Soc. 20 (2018), 1139 1159 , while the latter still remains open for almost 40 years. In addition to K 4 (3) , the only 3 uniform hypergraphs whose uniform Tur 'an density is known are those with zero uniform Tur 'an density classified by Reiher, R "odl and Schacht J. London Math. Soc. 97 (2018), 77 97 and a specific family with uniform Tur 'an density equal to 1 27 . We develop new tools for embedding hypergraphs in host hypergraphs with positive uniform density and apply them to completely determine the uniform Tur 'an density of a fundamental family of 3 uniform hypergraphs, namely tight cycles C ell (3) . The uniform Tur 'an density of C ell (3) , ell ge 5 , is equal to 4 27 if ell is not divisible by three, and is equal to zero otherwise. The case ell 5 resolves a problem suggested by Reiher.


Triggerflow Trigger based Orchestration of Serverless Workflows. As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center. But existing cloud orchestration systems either focus on short running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions). None of them are open systems enabling extensible interception and optimization of custom workflows. We present Triggerflow an extensible Trigger based Orchestration architecture for serverless workflows. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive orchestrators (State Machines, Directed Acyclic Graphs, Workflow as code, Federated Learning orchestrator). We also validate that it can support high volume event processing workloads, auto scale on demand with scale down to zero when not used, and transparently guarantee fault tolerance and efficient resource usage when orchestrating long running scientific workflows.


T3AB Transparent and Trustworthy Third party Authority using Blockchain. Increasingly, information systems rely on computational, storage, and network resources deployed in third party facilities or are supported by service providers. Such an approach further exacerbates cybersecurity concerns constantly raised by numerous incidents of security and privacy attacks resulting in data leakage and identity theft, among others. These have in turn forced the creation of stricter security and privacy related regulations and have eroded the trust in cyberspace. In particular, security related services and infrastructures such as Certificate Authorities (CAs) that provide digital certificate service and Third Party Authorities (TPAs) that provide cryptographic key services, are critical components for establishing trust in Internet enabled applications and services. To address such trust issues, various transparency frameworks and approaches have been recently proposed in the literature. In this paper, we propose a Transparent and Trustworthy TPA using Blockchain (T3AB) to provide transparency and accountability to the trusted third party entities, such as honest but curious third party IaaS servers, and coordinators in various privacy preserving machine learning (PPML) approaches. T3AB employs the Ethereum blockchain as the underlying public ledger and also includes a novel smart contract to automate accountability with an incentive mechanism that motivates participants' to participate in auditing, and punishes unintentional or malicious behaviors. We implement T3AB, and show through experimental evaluation in the Ethereum official test network, Rinkeby, that the framework is efficient. We also formally show the security guarantee provided by T3AB, and analyze the privacy guarantee and trustworthiness it provides.


Asymptotic Behaviour of Linear eigenvalue statistics of Hankel matrices. We study linear eigenvalue statistics of band Hankel matrices with Brownian motion entries. We prove that, the centred, normalized linear eigenvalue statistics of band Hankel matrices obey a central limit theorem (CLT) type result. We also discuss the convergence of linear eigenvalue statistics of band Hankel matrices with independent entries for odd power monomials. Our method is based on trace formula, moment method and some results of process convergence.


Wasserstein Patch Prior for Image Superresolution. In this paper, we introduce a Wasserstein patch prior for superresolution of two and three dimensional images. Here, we assume that we have given (additionally to the low resolution observation) a reference image which has a similar patch distribution as the ground truth of the reconstruction. This assumption is e.g. fulfilled when working with texture images or material data. Then, the proposed regularizer penalizes the W 2 distance of the patch distribution of the reconstruction to the patch distribution of some reference image at different scales. We demonstrate the performance of the proposed regularizer by two and three dimensional numerical examples.


Numerically Stable Binary Coded Computations. This paper addresses the gradient coding and coded matrix multiplication problems in distributed optimization and coded computing. We present a numerically stable binary coding method which overcomes the drawbacks of the gradient coding method proposed by Tandon et al., and can also be leveraged by coded computing networks whose servers are of heterogeneous nature. The proposed binary encoding avoids operations over the real and complex numbers which are inherently numerically unstable, thereby enabling numerically stable distributed encodings of the partial gradients. We then make connections between gradient coding and coded matrix multiplication. Specifically, we show that any gradient coding scheme can be extended to coded matrix multiplication. Furthermore, we show how the proposed binary gradient coding scheme can be used to construct three different coded matrix multiplication schemes, each achieving different trade offs.


Anonymous communication system provides a secure environment without leaking metadata, which has many application scenarios in IoT. Anonymous Identity Based Encryption (AIBET) scheme allows a tracer to use the tracing key to reveal the recipient's identity from the ciphertext while keeping other data anonymous. This special feature makes AIBET a promising solution to distributed IoT data security. In this paper, we construct an efficient quantum safe Hierarchical Identity Based cryptosystem with Traceable Identities (AHIBET) with fully anonymous ciphertexts. We prove the security of the AHIBET scheme under the Learning with Errors (LWE) problem in the standard model.


Physics based Deep Learning. This digital book contains a practical and comprehensive introduction of everything related to deep learning in the context of physical simulations. As much as possible, all topics come with hands on code examples in the form of Jupyter notebooks to quickly get started. Beyond standard supervised learning from data, we'll look at physical loss constraints, more tightly coupled learning algorithms with differentiable simulations, as well as reinforcement learning and uncertainty modeling. We live in exciting times these methods have a huge potential to fundamentally change what computer simulations can achieve.


Socio Technical Grounded Theory for Software Engineering. Grounded Theory (GT), a sociological research method designed to study social phenomena, is increasingly being used to investigate the human and social aspects of software engineering (SE). However, being written by and for sociologists, GT is often challenging for a majority of SE researchers to understand and apply. Additionally, SE researchers attempting ad hoc adaptations of traditional GT guidelines for modern socio technical (ST) contexts often struggle in the absence of clear and relevant guidelines to do so, resulting in poor quality studies. To overcome these research community challenges and leverage modern research opportunities, this paper presents Socio Technical Grounded Theory (STGT) designed to ease application and achieve quality outcomes. It defines what exactly is meant by an ST research context and presents the STGT guidelines that expand GT's philosophical foundations, provide increased clarity and flexibility in its methodological steps and procedures, define possible scope and contexts of application, encourage frequent reporting of a variety of interim, preliminary, and mature outcomes, and introduce nuanced evaluation guidelines for different outcomes. It is hoped that the SE research community and related ST disciplines such as computer science, data science, artificial intelligence, information systems, human computer robot AI interaction, human centered emerging technologies (and increasingly other disciplines being transformed by rapid digitalisation and AI based augmentation), will benefit from applying STGT to conduct quality research studies and systematically produce rich findings and mature theories with confidence.


Second order expansion for the nonlocal perimeter functional. The seminal results of Bourgain, Brezis, Mironescu and D 'avila show that the classical perimeter can be approximated by a family of nonlocal perimeter functionals. We consider a corresponding second order expansion for the nonlocal perimeter functional. In a special case, the considered family of energies is also relevant for a variational model for thin ferromagnetic films. We derive the Gamma limit of these functionals. We also show existence for minimizers with prescribed volume fraction. For small volume fraction, the unique, up to translation, minimizer of the limit energy is given by the ball. The analysis is based on a systematic exploitation of the associated symmetrized autocorrelation function.


Web Mining for Estimating Regulatory Blockchain Readiness. The regulatory framework of cryptocurrencies (and, in general, blockchain tokens) is of paramount importance. This framework drives nearly all key decisions in the respective business areas. In this work, a computational model is proposed for quantitatively estimating the regulatory stance of countries with respect to cryptocurrencies. This is conducted via web mining utilizing web search engines. The proposed model is experimentally validated. In addition, unsupervised learning (clustering) is applied for better analyzing the automatically derived estimations. Overall, very good performance is achieved by the proposed algorithmic approach.


MexPub Deep Transfer Learning for Metadata Extraction from German Publications. Extracting metadata from scientific papers can be considered a solved problem in NLP due to the high accuracy of state of the art methods. However, this does not apply to German scientific publications, which have a variety of styles and layouts. In contrast to most of the English scientific publications that follow standard and simple layouts, the order, content, position and size of metadata in German publications vary greatly among publications. This variety makes traditional NLP methods fail to accurately extract metadata from these publications. In this paper, we present a method that extracts metadata from PDF documents with different layouts and styles by viewing the document as an image. We used Mask R CNN that is trained on COCO dataset and finetuned with PubLayNet dataset that consists of 200K PDF snapshots with five basic classes (e.g. text, figure, etc). We refine tuned the model on our proposed synthetic dataset consisting of 30K article snapshots to extract nine patterns (i.e. author, title, etc). Our synthetic dataset is generated using contents in both languages German and English and a finite set of challenging templates obtained from German publications. Our method achieved an average accuracy of around 90 which validates its capability to accurately extract metadata from a variety of PDF documents with challenging templates.


Effective weak and vague convergence of measures on the real line. We expand our effective framework for weak convergence of measures on the real line by showing that effective convergence in the Prokhorov metric is equivalent to effective weak convergence. In addition, we establish a framework for the study of the effective theory of vague convergence of measures. We introduce a uniform notion and a non uniform notion of vague convergence, and we show that both these notions are equivalent. However, limits under effective vague convergence may not be computable even when they are finite. We give an example of a finite incomputable effective vague limit measure, and we provide a necessary and sufficient condition so that effective vague convergence produces a computable limit. Finally, we determine a sufficient condition for which effective weak and vague convergence of measures coincide. As a corollary, we obtain an effective version of the equivalence between classical weak and vague convergence of sequences of probability measures.


Internet of things a multiprotocol gateway as solution of the interoperability problem. One of the main challenges of the Internet of Things is the interoperability of highly heterogeneous devices, mainly in terms of the communication capabilities and network protocols used. As consequence, the interconnection model of the different devices involves an intermediary device, known as gateway. This gateway is a centralized element for the management of the devices that make up an IoT application. In addition, it is essential for the transmission of information to the Internet, especially when many IoT devices are not IP based. This chapter describes a proposed model for an IoT gateway that allows the exchange of data through different wireless technologies and forwarding of such data to the Internet. The proposed gateway has important advantages such as supporting for multiprotocol interconnectivity, the remote configuration of wireless nodes for sensor and actuators management a flexible algorithm totranslate the data obtained by sensors into a uniform format for transmission to a cloud server low energy consumption due to efficient data transfer over MQTT protocol. In order to demonstrate the usefulness of the developed gateway, a proof of concept test was implemented. The implemented scenario consists of 2 wireless nodes responsible for sensing environmental variables and transmitting data to the gateway node through different communication protocols. The obtained results show the feasibility for simultaneous data transmission from the remote wireless nodes to the gateway. Metrics on energy consumption in the devices are also presented.


Time series forecasting of new cases and new deaths rate for COVID 19 using deep learning methods. The first known case of Coronavirus disease 2019 (COVID 19) was identified in December 2019. It has spread worldwide, leading to an ongoing pandemic, imposed restrictions and costs to many countries. Predicting the number of new cases and deaths during this period can be a useful step in predicting the costs and facilities required in the future. The purpose of this study is to predict new cases and deaths rate one, three and seven day ahead during the next 100 days. The motivation for predicting every n days (instead of just every day) is the investigation of the possibility of computational cost reduction and still achieving reasonable performance. Such a scenario may be encountered in real time forecasting of time series. Six different deep learning methods are examined on the data adopted from the WHO website. Three methods are LSTM, Convolutional LSTM, and GRU. The bidirectional extension is then considered for each method to forecast the rate of new cases and new deaths in Australia and Iran countries. This study is novel as it carries out a comprehensive evaluation of the aforementioned three deep learning methods and their bidirectional extensions to perform prediction on COVID 19 new cases and new death rate time series. To the best of our knowledge, this is the first time that Bi GRU and Bi Conv LSTM models are used for prediction on COVID 19 new cases and new deaths time series. The evaluation of the methods is presented in the form of graphs and Friedman statistical test. The results show that the bidirectional models have lower errors than other models. A several error evaluation metrics are presented to compare all models, and finally, the superiority of bidirectional methods is determined. This research could be useful for organisations working against COVID 19 and determining their long term plans.


A Two stage Framework for Compound Figure Separation. Scientific literature contains large volumes of complex, unstructured figures that are compound in nature (i.e. composed of multiple images, graphs, and drawings). Separation of these compound figures is critical for information retrieval from these figures. In this paper, we propose a new strategy for compound figure separation, which decomposes the compound figures into constituent subfigures while preserving the association between the subfigures and their respective caption components. We propose a two stage framework to address the proposed compound figure separation problem. In particular, the subfigure label detection module detects all subfigure labels in the first stage. Then, in the subfigure detection module, the detected subfigure labels help to detect the subfigures by optimizing the feature selection process and providing the global layout information as extra features. Extensive experiments are conducted to validate the effectiveness and superiority of the proposed framework, which improves the detection precision by 9 .


Reinforcement Learning Compensated Extended Kalman Filter for Attitude Estimation. Inertial measurement units are widely used in different fields to estimate the attitude. Many algorithms have been proposed to improve estimation performance. However, most of them still suffer from 1) inaccurate initial estimation, 2) inaccurate initial filter gain, and 3) non Gaussian process and or measurement noise. In this paper, we leverage reinforcement learning to compensate for the classical extended Kalman filter estimation, i.e., to learn the filter gain from the sensor measurements. We also analyse the convergence of the estimate error. The effectiveness of the proposed algorithm is validated on both simulated data and real data.


Retrofitting Effect Handlers onto OCaml. Effect handlers have been gathering momentum as a mechanism for modular programming with user defined effects. Effect handlers allow for non local control flow mechanisms such as generators, async await, lightweight threads and coroutines to be composably expressed. We present a design and evaluate a full fledged efficient implementation of effect handlers for OCaml, an industrial strength multi paradigm programming language. Our implementation strives to maintain the backwards compatibility and performance profile of existing OCaml code. Retrofitting effect handlers onto OCaml is challenging since OCaml does not currently have any non local control flow mechanisms other than exceptions. Our implementation of effect handlers for OCaml (i) imposes a mean 1 overhead on a comprehensive macro benchmark suite that does not use effect handlers (ii) remains compatible with program analysis tools that inspect the stack and (iii) is efficient for new code that makes use of effect handlers.


Challenges Women in Software Engineering Leadership Roles Face A Qualitative Study. Software engineering is not only about technical solutions. To a large extent, it is also concerned with organizational issues, project management, and human behavior. There are serious gender issues that can severely limit the participation of women in science and engineering careers. It is claimed that women lead differently than men and are more collaboration oriented, communicative, and less aggressive than their male counterparts. However, when talking with women in technology companies' leadership roles, a list of problems women face grows fast. We invite women in software engineering management roles to answer the questions from an empathy map canvas. We used thematic analysis for coding the answers and group the codes into themes. From the analysis, we identified seven themes that support us to list the main challenges they face in their careers.


Designing Enhanced Multi dimensional Constellations for Code Domain NOMA. This paper presents an enhanced design of multi dimensional (MD) constellations which play a pivotal role in many communication systems such as code domain non orthogonal multiple access (CD NOMA). MD constellations are attractive as their structural properties, if properly designed, lead to signal space diversity and hence improved error rate performance. Unlike the existing works which mostly focus on MD constellations with large minimum Euclidean distance (MED), we look for new MD constellations with additional feature that the minimum product distance (MPD) is also large. To this end, a non convex optimization problem is formulated and then solved by the convex concave procedure (CCCP). Our numerical simulation results show that the obtained MD constellations enjoy excellent error rate performances over both Gaussian and Rayleigh fading channels.


Rotating Binaries. This paper investigates the behaviour of rotating binaries. A rotation by r digits to the left of a binary number B exhibits in particular cases the divisibility l mid N 1(B) cdot r 1 , where l is the bit length of B and N 1(B) is the Hamming weight of B , that is the number of ones in B . The integer r is called the left rotational distance. We investigate the connection between this rotational distance, the length and the Hamming weight of binary numbers. Moreover we follow the question under which circumstances the above mentioned divisibility is true. We have found out and will demonstrate that this divisibility occurs for kn c cycles.


Conservation theorems on semi classical arithmetic. We systematically study conservation theorems on theories of semi classical arithmetic, which lie in between classical arithmetic mathsf PA and intuitionistic arithmetic mathsf HA . Using a generalized negative translation, we first provide a new structured proof of the fact that mathsf PA is Pi k 2 conservative over mathsf HA Sigma k text mathrm LEM where Sigma k text mathrm LEM is the axiom scheme of the law of excluded middle restricted to formulas in Sigma k . In addition, we show that this conservation theorem is optimal in the sense that for any semi classical arithmetic T , if mathsf PA is Pi k 2 conservative over T , then T proves Sigma k text mathrm LEM . In the same manner, we also characterize conservation theorems for other well studied classes of formulas by fragments of classical axioms or rules. This reveals the entire structure of conservation theorems with respect to the arithmetical hierarchy of classical principles.


Thermal boundary layer structure in low Prandtl number turbulent convection. We study the structure of the thermal boundary layer (BL) in Rayleigh B 'enard convection for Prandtl number ( Pr ) 0.021 by conducting direct numerical simulations in a two dimensional square box for Rayleigh numbers ( Ra ) up to 10 9 . The large scale circulation in the flow divides the horizontal plates into three distinct regions, and we observe that the local thermal BL thicknesses in the plume ejection region are larger than those in the plume impact and shear dominated regions. Moreover, the local BL width decreases as Ra beta(x) , with beta(x) depending on the position at the plate. We find that beta(x) are nearly the same in impact and shear regions and are smaller than those in the ejection region. Thus, the local BL width decreases faster in the ejection region than those in the shear and impact regions, and we estimate that the thermal BL structure would be uniform throughout the horizontal plate for Ra geq 8 times 10 12 in our low Pr convection. We compare the thermal BL profiles measured at various positions at the plate with the Prandtl Blasius Pohlhausen (PBP) profile and find deviations everywhere for all the Rayleigh numbers. However, the dynamically rescaled profiles, as suggested by Zhou Xia ( it Phys. Rev. Lett. , vol. 104, 2010, 104301), agree well with the PBP profile in the shear and impact regions for all the Rayleigh numbers, whereas they still deviate in the ejection region. We also find that, despite the growing fluctuations with increasing Ra , thermal boundary layers in our low Pr convection are transitional and not yet fully turbulent.


Experimental Extraction and Simulation of Charge Trapping during Endurance of FeFET with TiN HfZrO SiO2 Si (MFIS) Gate Structure. We investigate the charge trapping during endurance fatigue of FeFET with TiN Hf0.5Zr0.5O2 SiO2 Si (MFIS) gate structure. We propose a method of experimentally extracting the number of trapped charges during the memory operation, by measuring the charges in the metal gate and Si substrate. We verify that the amount of trapped charges increases during the endurance fatigue process. This is the first time that the trapped charges are directly experimentally extracted and verified to increase during endurance fatigue. Moreover, we model the interplay between the trapped charges and ferroelectric polarization switching during endurance fatigue. Through the consistency of experimental results and simulated data, we demonstrate that as the memory window decreases 1) The ferroelectric characteristic of Hf0.5Zr0.5O2 is not degraded. 2) The trap density in the upper bandgap of the gate stacks increases. 3) The reason for memory window decrease is increased trapped electrons after program operation but not related to hole trapping de trapping. Our work is helpful to study the charge trapping behavior of FeFET and the related endurance fatigue process.


Byzantine Agreement with Less Communication Recent Advances. In recent years, Byzantine Agreement is being considered in increasing scales due to the proliferation of blockchains and other decentralized financial technologies. Consequently, a number of works have improved its communication complexity in various network models. In this short paper we survey recent advances and outline some open research questions on the subject.


Tenodesis Grasp Emulator Kinematic Assessment of Wrist Driven Orthotic Control. Wrist driven orthotics have been designed to assist people with C6 7 spinal cord injury, however, the kinematic constraint imposed by such a control strategy can impede mobility and lead to abnormal body motion. This study characterizes body compensation using the novel Tenodesis Grasp Emulator, an adaptor orthotic that allows for the investigation of tenodesis grasping in subjects with unimpaired hand function. Subjects perform a series of grasp and release tasks in order to compare normal (test control) and constrained wrist driven modes, showing significant compensation as a result of the constraint. A motor augmented mode is also compared against traditional wrist driven operation, to explore the potential role of hybrid human robot control. We find that both the passive wrist driven and motor augmented modes fulfill different roles throughout various tasks tested. Thus, we conclude that a flexible control scheme that can alter intervention based on the task at hand holds the potential to reduce compensation in future work.


Combinatorial and harmonic analytic methods for integer tilings. A finite set of integers A tiles the integers by translations if mathbb Z can be covered by pairwise disjoint translated copies of A . Restricting attention to one tiling period, we have A oplus B mathbb Z M for some M in mathbb N and B subset mathbb Z . This can also be stated in terms of cyclotomic divisibility of the mask polynomials A(X) and B(X) associated with A and B . In this article, we introduce a new approach to a systematic study of such tilings. Our main new tools are the box product, multiscale cuboids, and saturating spaces, developed through a combination of harmonic analytic and combinatorial methods. We provide new criteria for tiling and cyclotomic divisibility in terms of these concepts. As an application, we can determine whether a set A containing certain configuration can tile a cyclic group mathbb Z M , or recover a tiling set based on partial information about it. We also develop tiling reductions where a given tiling can be replaced by one or more tilings with a simpler structure. The tools introduced here are crucial in our proof in a follow up paper that all tilings of period (pqr) 2 , where p,q,r are distinct odd primes, satisfy a tiling condition proposed by Coven and Meyerowitz.


Improving Semi Supervised Learning for Remaining Useful Lifetime Estimation Through Self Supervision. RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi Supervised Learning (SSL) can incorporate the unlabeled data produced by machines that did not yet fail. Previous work on SSL evaluated their approaches under unrealistic conditions where the data near failure was still available. Even so, only moderate improvements were made. This paper proposes a novel SSL approach based on self supervised pre training. The method can outperform two competing approaches from the literature and a supervised baseline under realistic conditions on the NASA C MAPSS dataset.


A characterization of normal 3 pseudomanifolds with at most two singularities. Characterizing face number related invariants of a given class of simplicial complexes has been a central topic in combinatorial topology. In this regard, one of the most well known invariants is g 2 . Kalai's relative lower bound 10 for g 2 says that if K is a normal d pseudomanifold with d geq 3, then g 2(K) geq g 2(lk (v)) for any vertex v of K. In 7 , two combinatorial tools vertex folding' and edge folding' were defined. Let K be a normal 3 pseudomanifold with at most two singularities (in case of two singularities, we take one singularity as mathbb RP 2 ). Let t be a vertex of K with g 2(lk (t)) geq g 2(lk (v)) for any other vertex v . We prove that if g 2 (K) leq g 2(lk (t)) 9 then K is obtained from some boundary complex of 4 simplices by a sequence of operations connected sum, bistellar 1 move, edge contraction, edge expansion, vertex folding and edge folding. Further, we prove that the upper bound is sharp for such combinatorial normal 3 pseudomanifolds.


A Marketplace for Trading AI Models based on Blockchain and Incentives for IoT Data. As Machine Learning (ML) models are becoming increasingly complex, one of the central challenges is their deployment at scale, such that companies and organizations can create value through Artificial Intelligence (AI). An emerging paradigm in ML is a federated approach where the learning model is delivered to a group of heterogeneous agents partially, allowing agents to train the model locally with their own data. However, the problem of valuation of models, as well the questions of incentives for collaborative training and trading of data models, have received limited treatment in the literature. In this paper, a new ecosystem of ML model trading over a trusted Blockchain based network is proposed. The buyer can acquire the model of interest from the ML market, and interested sellers spend local computations on their data to enhance that model's quality. In doing so, the proportional relation between the local data and the quality of trained models is considered, and the valuations of seller's data in training the models are estimated through the distributed Data Shapley Value (DSV). At the same time, the trustworthiness of the entire trading process is provided by the distributed Ledger Technology (DLT). Extensive experimental evaluation of the proposed approach shows a competitive run time performance, with a 15 drop in the cost of execution, and fairness in terms of incentives for the participants.


Anatomical Guided Attention Enhances Unsupervised PET Image Denoising Performance. Although supervised convolutional neural networks (CNNs) often outperform conventional alternatives for denoising positron emission tomography (PET) images, they require many low and high quality reference PET image pairs. Herein, we propose an unsupervised 3D PET image denoising method based on an anatomical information guided attention mechanism. The proposed magnetic resonance guided deep decoder (MR GDD) utilizes the spatial details and semantic features of MR guidance image more effectively by introducing encoder decoder and deep decoder subnetworks. Moreover, the specific shapes and patterns of the guidance image do not affect the denoised PET image, because the guidance image is input to the network through an attention gate. In a Monte Carlo simulation of 18 F fluoro 2 deoxy D glucose (FDG), the proposed method achieved the highest peak signal to noise ratio and structural similarity (27.92 pm 0.44 dB 0.886 pm 0.007), as compared with Gaussian filtering (26.68 pm 0.10 dB 0.807 pm 0.004), image guided filtering (27.40 pm 0.11 dB 0.849 pm 0.003), deep image prior (DIP) (24.22 pm 0.43 dB 0.737 pm 0.017), and MR DIP (27.65 pm 0.42 dB 0.879 pm 0.007). Furthermore, we experimentally visualized the behavior of the optimization process, which is often unknown in unsupervised CNN based restoration problems. For preclinical (using 18 F FDG and 11 C raclopride) and clinical (using 18 F florbetapir) studies, the proposed method demonstrates state of the art denoising performance while retaining spatial resolution and quantitative accuracy, despite using a common network architecture for various noisy PET images with 1 10th of the full counts. These results suggest that the proposed MR GDD can reduce PET scan times and PET tracer doses considerably without impacting patients.


BioLCNet Reward modulated Locally Connected Spiking Neural Networks. Brain inspired computation and information processing alongside compatibility with neuromorphic hardware have made spiking neural networks (SNN) a promising method for solving learning tasks in machine learning (ML). However, the mere use of spiking neurons is not sufficient for building models that mimic the learning mechanisms in the biological brain network architecture and learning rules are important factors to consider when developing such artificial agents. In this work, inspired by the human visual pathway and the role of dopamine in learning, we propose a reward modulated locally connected spiking neural network, BioLCNet, for visual learning tasks. To extract visual features from Poisson distributed spike trains, we used local filters that are more analogous to the biological visual system compared to convolutional filters with weight sharing. In the decoding layer, we applied a spike population based voting scheme to determine the decision of the network. We employed Spike timing dependent plasticity (STDP) for learning the visual features, and its reward modulated variant (R STDP) for training the decoder based on the reward or punishment feedback signal. For evaluation, we first assessed the robustness of our rewarding mechanism to varying target responses in a classical conditioning experiment. Afterwards, we evaluated the performance of our network on image classification tasks of MNIST and XOR MNIST datasets.


Upper bounds on the length function for covering codes with covering radius R and codimension tR 1 . The length function ell q(r,R) is the smallest length of a q ary linear code with codimension (redundancy) r and covering radius R . In this work, new upper bounds on ell q(tR 1,R) are obtained in the following forms begin equation begin split (a) ell q(r,R) le cq (r R) R cdot sqrt R ln q , R ge3, r tR 1, t ge1, phantom (a) q text is an arbitrary prime power , c text is independent of q. end split end equation begin equation begin split (b) ell q(r,R) 3.43Rq (r R) R cdot sqrt R ln q , R ge3, r tR 1, t ge1, phantom (b) q text is an arbitrary prime power , q text is large enough . end split end equation In the literature, for q (q') R with q' a prime power, smaller upper bounds are known however, when q is an arbitrary prime power, the bounds of this paper are better than the known ones. For t 1 , we use a one to one correspondence between n,n (R 1) qR codes and (R 1) saturating n sets in the projective space mathrm PG (R,q) . A new construction of such saturating sets providing sets of small size is proposed. Then the n,n (R 1) qR codes, obtained by geometrical methods, are taken as the starting ones in the lift constructions (so called " q m concatenating constructions") for covering codes to obtain infinite families of codes with growing codimension r tR 1 , t ge1 .


The Pyro game a slow intelligent fire. In the Firefighter problem, a fire breaks out at a vertex of a graph and at each subsequent time step, the firefighter chooses a vertex to protect and then the fire spreads from each burned vertex to every unprotected neighbour. The problem can be thought of as a simplified model for the spread of gossip or disease in a network. We introduce a new two player variation called the Pyro game, in which at each step, the fire spreads from one burned vertex to all unprotected neighbours of that vertex. The fire is no longer automated and aims to maximize the number of burned vertices. We show, that unlike the Firefighter problem, one firefighter can contain a fire on the Cartesian grid in the Pyro game. We also study both the Pyro Game and the Firefighter Problem on the infinite strong grid and the complexity of the Pyro game.


DeepNP Deep Learning Based Noise Prediction for Ultra Reliable Low Latency Communications. Closing the gap between high data rates and low delay in real time streaming applications is a major challenge in advanced communication systems. While adaptive network coding schemes have the potential of balancing rate and delay in real time, they often rely on prediction of the channel behavior. In practice, such prediction is based on delayed feedback, making it difficult to acquire causally, particularly when the underlying channel model is unknown. In this work, we propose a deep learning based noise prediction (DeepNP) algorithm, which augments the recently proposed adaptive and causal random linear network coding scheme with a dedicated deep neural network, that learns to carry out noise prediction from data. This neural augmentation is utilized to maximize the throughput while minimizing in order delivery delay of the network coding scheme, and operate in a channel model agnostic manner. We numerically show that performance can dramatically increase by the learned prediction of the channel noise rate. In particular, we demonstrate that DeepNP gains up to a factor of four in mean and maximum delay and a factor two in throughput compared with statistic based network coding approaches.


Nonlinear Filtering of Partially Observed Systems arising in Singular Stochastic Optimal Control. This paper deals with a nonlinear filtering problem in which a multi dimensional signal process is additively affected by a process nu whose components have paths of bounded variation. The presence of the process nu prevents from directly applying classical results and novel estimates need to be derived. By making use of the so called reference probability measure approach, we derive the Zakai equation satisfied by the unnormalized filtering process, and then we deduce the corresponding Kushner Stratonovich equation. Under the condition that the jump times of the process nu do not accumulate over the considered time horizon, we show that the unnormalized filtering process is the unique solution to the Zakai equation, in the class of measure valued processes having a square integrable density. Our analysis paves the way to the study of stochastic control problems where a decision maker can exert singular controls in order to adjust the dynamics of an unobservable It o process.


IFDS Taint Analysis with Access Paths. Over the years, static taint analysis emerged as the analysis of choice to detect some of the most common web application vulnerabilities, such as SQL injection (SQLi) and cross site scripting (XSS) cite OWASP . Furthermore, from an implementation perspective, the IFDS dataflow framework stood out as one of the most successful vehicles to implement static taint analysis for real world Java applications. While existing approaches scale reasonably to medium size applications (e.g. up to one hour analysis time for less than 100K lines of code), our experience suggests that no existing solution can scale to very large industrial code bases (e.g. more than 1M lines of code). In this paper, we present our novel IFDS based solution to perform fast and precise static taint analysis of very large industrial Java web applications. Similar to state of the art approaches to taint analysis, our IFDS based taint analysis uses textit access paths to abstract objects and fields in a program. However, contrary to existing approaches, our analysis is demand driven, which restricts the amount of code to be analyzed, and does not rely on a computationally expensive alias analysis, thereby significantly improving scalability.


Code to Comment Translation A Comparative Study on Model Effectiveness Errors. Automated source code summarization is a popular software engineering research topic wherein machine translation models are employed to "translate" code snippets into relevant natural language descriptions. Most evaluations of such models are conducted using automatic reference based metrics. However, given the relatively large semantic gap between programming languages and natural language, we argue that this line of research would benefit from a qualitative investigation into the various error modes of current state of the art models. Therefore, in this work, we perform both a quantitative and qualitative comparison of three recently proposed source code summarization models. In our quantitative evaluation, we compare the models based on the smoothed BLEU 4, METEOR, and ROUGE L machine translation metrics, and in our qualitative evaluation, we perform a manual open coding of the most common errors committed by the models when compared to ground truth captions. Our investigation reveals new insights into the relationship between metric based performance and model prediction errors grounded in an empirically derived error taxonomy that can be used to drive future research efforts


Data driven method for real time prediction and uncertainty quantification of fatigue failure under stochastic loading using artificial neural networks and Gaussian process regression. Various engineering systems such as naval and aerial vehicles, offshore structures, and mechanical components of motorized systems, are exposed to fatigue failures due to stochastic loadings. Methods for early failure prediction are essential for engineering, military, and civil applications. In addition to the prediction of time to failure (TtF), uncertainty quantification (UQ) is of major importance for real time decision making purposes. Usually, time domain or frequency domain methods are used for fatigue prediction, such as rainflow counting and Miner's rule or Dirlik's method. However, those methods suffer from over simplistic modeling and inaccurate failure predictions under stochastic loadings. During the last years, several data driven models were suggested for offline fatigue failure. However, most of them are not capable of both accurate real time fatigue prediction and UQ. In the current work, a probabilistic data driven model is introduced. A hybrid architecture of a fully connected artificial neural network (FC ANN) and Gaussian process regression (GPR) is proposed to ensure enhanced predictive abilities and simultaneous UQ of the predicted TtF. The real time prediction and UQ performances of the suggested model are validated using both synthetic and experimental data. This novel hybrid method is fully data driven and extends the forecasting capabilities of existing time domain and machine learning based methods for fatigue prediction. It paves the way towards the development of a preventive system that provides real time safety and operational instructions and insights for structural health monitoring (SHM) purposes, allowing prevention of environmental damage, and loss of human lives.


Rings with an elementary abelian p group of units. What are all rings R for which R (the group of invertible elements of R under multiplication) is an elementary abelian p group? We answer this question for finite dimensional commutative k algebras, finite commutative rings, modular group algebras, and path algebras. Two interesting byproducts of this work are a characterization of Mersenne primes and a connection to Dedekind's problem.


Clustering Vietnamese Conversations From Facebook Page To Build Training Dataset For Chatbot. The biggest challenge of building chatbots is training data. The required data must be realistic and large enough to train chatbots. We create a tool to get actual training data from Facebook messenger of a Facebook page. After text preprocessing steps, the newly obtained dataset generates FVnC and Sample dataset. We use the Retraining of BERT for Vietnamese (PhoBERT) to extract features of our text data. K Means and DBSCAN clustering algorithms are used for clustering tasks based on output embeddings from PhoBERT base . We apply V measure score and Silhouette score to evaluate the performance of clustering algorithms. We also demonstrate the efficiency of PhoBERT compared to other models in feature extraction on the Sample dataset and wiki dataset. A GridSearch algorithm that combines both clustering evaluations is also proposed to find optimal parameters. Thanks to clustering such a number of conversations, we save a lot of time and effort to build data and storylines for training chatbot.


Constructing uncountably many groups with the same profinite completion. We present two uncountable families of finitely generated residually finite groups all having the same profinite completion. One consists of soluble groups, the other of branch groups.


math.NA cs.NA physics.comp-ph physics.flu-dyn

An explicit and non iterative moving least squares immersed boundary method with low boundary velocity error. In this work, based on the moving least squares immersed boundary method, we proposed a new technique to improve the calculation of the volume force representing the body boundary. For boundary with simple geometry, we theoretically analyse the error between the desired volume force at boundary and the actual force given by the original method. The ratio between the two forces is very close to a constant. Numerical experiments reveal that for complex geometry, this ratio exhibits very narrow distribution around certain value. A spatially uniform coefficient is then introduced to correct the force and fixed by the least square method over all boundary markers. Such method is explicit and non iterative, and can be easily implemented into the existing scheme. Several test cases have been simulated with stationary and moving boundaries. Our new method can reduce the residual boundary velocity to the level comparable to that given by the iterative method, but requires much less computing time. Moreover, the new method can be readily combined with the iterative method and further reduces the residual boundary velocity.


Unsupervised and self adaptative techniques for cross domain person re identification. Person Re Identification (ReID) across non overlapping cameras is a challenging task and, for this reason, most works in the prior art rely on supervised feature learning from a labeled dataset to match the same person in different views. However, it demands the time consuming task of labeling the acquired data, prohibiting its fast deployment, specially in forensic scenarios. Unsupervised Domain Adaptation (UDA) emerges as a promising alternative, as it performs feature learning adaptation from a model trained on a source to a target domain without identity label annotation. However, most UDA based algorithms rely upon a complex loss function with several hyper parameters, which hinders the generalization to different scenarios. Moreover, as UDA depends on the translation between domains, it is important to select the most reliable data from the unseen domain, thus avoiding error propagation caused by noisy examples on the target data an often overlooked problem. In this sense, we propose a novel UDA based ReID method that optimizes a simple loss function with only one hyper parameter and that takes advantage of triplets of samples created by a new offline strategy based on the diversity of cameras within a cluster. This new strategy adapts the model and also regularizes it, avoiding overfitting on the target domain. We also introduce a new self ensembling strategy, in which weights from different iterations are aggregated to create a final model combining knowledge from distinct moments of the adaptation. For evaluation, we consider three well known deep learning architectures and combine them for final decision making. The proposed method does not use person re ranking nor any label on the target domain, and outperforms the state of the art, with a much simpler setup, on the Market to Duke, the challenging Market1501 to MSMT17, and Duke to MSMT17 adaptation scenarios.


Robust Pedestrian Attribute Recognition Using Group Sparsity for Occlusion Videos. Occlusion processing is a key issue in pedestrian attribute recognition (PAR). Nevertheless, several existing video based PAR methods have not yet considered occlusion handling in depth. In this paper, we formulate finding non occluded frames as sparsity based temporal attention of a crowded video. In this manner, a model is guided not to pay attention to the occluded frame. However, temporal sparsity cannot include a correlation between attributes when occlusion occurs. For example, "boots" and "shoe color" cannot be recognized when the foot is invisible. To solve the uncorrelated attention issue, we also propose a novel group sparsity based temporal attention module. Group sparsity is applied across attention weights in correlated attributes. Thus, attention weights in a group are forced to pay attention to the same frames. Experimental results showed that the proposed method achieved a higher F1 score than the state of the art methods on two video based PAR datasets.


On Roli's Cube. First described in 2014, Roli's cube mathcal R is a chiral 4 polytope, faithfully realized in Euclidean 4 space (a situation earlier thought to be impossible). Here we describe mathcal R in a new way, determine its minimal regular cover, and reveal connections to the M " o bius Kantor configuration.


Model reduction and uncertainty quantification of multiscale diffusions with parameter uncertainties using nonlinear expectations. In this paper we study model reduction of linear and bilinear quadratic stochastic control problems with parameter uncertainties. Specifically, we consider slow fast systems with unknown diffusion coefficient and study the convergence of the slow process in the limit of infinite scale separation. The aim of our work is two fold Firstly, we want to propose a general framework for averaging and homogenisation of multiscale systems with parametric uncertainties in the drift or in the diffusion coefficient. Secondly, we want to use this framework to quantify the uncertainty in the reduced system by deriving a limit equation that represents a worst case scenario for any given (possibly path dependent) quantity of interest. We do so by reformulating the slow fast system as an optimal control problem in which the unknown parameter plays the role of a control variable that can take values in a closed bounded set. For systems with unknown diffusion coefficient, the underlying stochastic control problem admits an interpretation in terms of a stochastic differential equation driven by a G Brownian motion. We prove convergence of the slow process with respect to the nonlinear expectation on the probability space induced by the G Brownian motion. The idea here is to formulate the nonlinear dynamic programming equation of the underlying control problem as a forward backward stochastic differential equation in the G Brownian motion framework (in brief G FBSDE), for which convergence can be proved by standard means. We illustrate the theoretical findings with two simple numerical examples, exploiting the connection between fully nonlinear dynamic programming equations and second order BSDE (2BSDE) a linear quadratic Gaussian regulator problem and a bilinear multiplicative triad that is a standard benchmark system in turbulence and climate modelling.


A note on the Hausdorff dimension of uniformly non flat sets with plenty of big projections. Using a recent result of Orponen (Invent. math. '21), we show that sets with plenty of big projections (PBP) admit an Analyst's Travelling Salesman Theorem. We then show that sets with PBP which are uniformly non flat (or wiggly) have large Hausdorff dimension. We also obtain a corollary on analytic Lipschitz harmonic capacities.


Cuboids Revisited Learning Robust 3D Shape Fitting to Single RGB Images. Humans perceive and construct the surrounding world as an arrangement of simple parametric models. In particular, man made environments commonly consist of volumetric primitives such as cuboids or cylinders. Inferring these primitives is an important step to attain high level, abstract scene descriptions. Previous approaches directly estimate shape parameters from a 2D or 3D input, and are only able to reproduce simple objects, yet unable to accurately parse more complex 3D scenes. In contrast, we propose a robust estimator for primitive fitting, which can meaningfully abstract real world environments using cuboids. A RANSAC estimator guided by a neural network fits these primitives to 3D features, such as a depth map. We condition the network on previously detected parts of the scene, thus parsing it one by one. To obtain 3D features from a single RGB image, we additionally optimise a feature extraction CNN in an end to end manner. However, naively minimising point to primitive distances leads to large or spurious cuboids occluding parts of the scene behind. We thus propose an occlusion aware distance metric correctly handling opaque scenes. The proposed algorithm does not require labour intensive labels, such as cuboid annotations, for training. Results on the challenging NYU Depth v2 dataset demonstrate that the proposed algorithm successfully abstracts cluttered real world 3D scene layouts.


Discovering Interpretable Machine Learning Models in Parallel Coordinates. This paper contributes to interpretable machine learning via visual knowledge discovery in parallel coordinates. The concepts of hypercubes and hyper blocks are used as easily understandable by end users in the visual form in parallel coordinates. The Hyper algorithm for classification with mixed and pure hyper blocks (HBs) is proposed to discover hyper blocks interactively and automatically in individual, multiple, overlapping, and non overlapping setting. The combination of hyper blocks with linguistic description of visual patterns is presented too. It is shown that Hyper models generalize decision trees. The Hyper algorithm was tested on the benchmark data from UCI ML repository. It allowed discovering pure and mixed HBs with all data and then with 10 fold cross validation. The links between hyper blocks, dimension reduction and visualization are established. Major benefits of hyper block technology and the Hyper algorithm are in their ability to discover and observe hyper blocks by end users including side by side visualizations making patterns visible for all classes. Another advantage of sets of HBs relative to the decision trees is the ability to avoid both data overgeneralization and overfitting.


The model companionship spectrum of set theory, generic absoluteness, and the Continuum problem. We show that for Pi 2 properties of second or third order arithmetic as formalized in appropriate natural signatures the apparently weaker notion of forcibility overlaps with the standard notion of consistency (assuming large cardinal axioms). Among such Pi 2 properties we mention the negation of the Continuum hypothesis, Souslin Hypothesis, the negation of Whitehead's conjecture on free groups, the non existence of outer automorphisms for the Calkin algebra, etc... In particular this gives an a posteriori explanation of the success forcing (and forcing axioms) met in producing models of such properties. Our main results relate generic absoluteness theorems for second order arithmetic, Woodin's axiom ( ) and forcing axioms to Robinson's notion of model companionship (as applied to set theory). We also briefly outline in which ways these results provide an argument to refute the Continuum hypothesis.


Instructive artificial intelligence (AI) for human training, assistance, and explainability. We propose a novel approach to explainable AI (XAI) based on the concept of "instruction" from neural networks. In this case study, we demonstrate how a superhuman neural network might instruct human trainees as an alternative to traditional approaches to XAI. Specifically, an AI examines human actions and calculates variations on the human strategy that lead to better performance. Experiments with a JHU APL developed AI player for the cooperative card game Hanabi suggest this technique makes unique contributions to explainability while improving human performance. One area of focus for Instructive AI is in the significant discrepancies that can arise between a human's actual strategy and the strategy they profess to use. This inaccurate self assessment presents a barrier for XAI, since explanations of an AI's strategy may not be properly understood or implemented by human recipients. We have developed and are testing a novel, Instructive AI approach that estimates human strategy by observing human actions. With neural networks, this allows a direct calculation of the changes in weights needed to improve the human strategy to better emulate a more successful AI. Subjected to constraints (e.g. sparsity) these weight changes can be interpreted as recommended changes to human strategy (e.g. "value A more, and value B less"). Instruction from AI such as this functions both to help humans perform better at tasks, but also to better understand, anticipate, and correct the actions of an AI. Results will be presented on AI instruction's ability to improve human decision making and human AI teaming in Hanabi.


What Will it Take to Fix Benchmarking in Natural Language Understanding?. Evaluation for many natural language understanding (NLU) tasks is broken Unreliable and biased systems score so highly on standard benchmarks that there is little room for researchers who develop better systems to demonstrate their improvements. The recent trend to abandon IID benchmarks in favor of adversarially constructed, out of distribution test sets ensures that current models will perform poorly, but ultimately only obscures the abilities that we want our benchmarks to measure. In this position paper, we lay out four criteria that we argue NLU benchmarks should meet. We argue most current benchmarks fail at these criteria, and that adversarial data collection does not meaningfully address the causes of these failures. Instead, restoring a healthy evaluation ecosystem will require significant progress in the design of benchmark datasets, the reliability with which they are annotated, their size, and the ways they handle social bias.


Fake or Credible? Towards Designing Services to Support Users' Credibility Assessment of News Content. Fake news has become omnipresent in digitalized areas such as social media platforms. While being disseminated online, it also poses a threat to individuals and societies offline, for example, in the context of democratic elections. Research and practice have investigated the detection of fake news with behavioral science or method related perspectives. However, to date, we lack design knowledge on presenting fake news warnings to users to support their individual news credibility assessment. We present the journey through the first design cycle on developing a fake news detection service focusing on the user interface design. The design is grounded in concepts from the field of source credibility theory and instantiated in a prototype that was qualitatively evaluated. The 13 participants communicated their interest in a lightweight application that aids in the news credibility assessment and rated the design features as useful as well as desirable.


"Connected Researches" in "Smart Lab Bubble" A Lifeline for Commercial Agriculture in "New Normal". Research in commercial agriculture is the best strategy that can be adopted by a country to keep on track of the second sustainable goal zero hunger by 2030. Analyzing the drawbacks of present research environment and find solutions through digital intervention would be ideal solution to de isolate the research out come in light of disruptions caused by the Covid pandemic. The performance of the research institutes is not expected to remain the same and would prefer to be stagnated at a lower level. The right evacuation plan that could be worked out by establishing connected research through the digital solution and followed by digitally endorsed performance monitoring and evaluation would be saviour for keeping the research in commercial agriculture live at this pandemic. This paper will discuss what are the problems in carrying out research in commercial agriculture and propose a conceptual model to connect research beyond physical presence by digital transformations in organization design of research institutes in light of Covid 19. Further, digitally endorsed performance measurements and evaluation is envisaged in a digitally empowered connected lab complex "Smart Lab Bubble" that is further facilitated through policy measures. The connected lab complex called the "Smart Lab Bubble" concept we present here could be viewed or applied in different perspectives to engineer the real need of the time for the sustainability of research in commercial agriculture. Further, it could be adopted in research in other life science areas.


Designer User Communication for XAI An epistemological approach to discuss XAI design. Artificial Intelligence is becoming part of any technology we use nowadays. If the AI informs people's decisions, the explanation about AI's outcomes, results, and behavior becomes a necessary capability. However, the discussion of XAI features with various stakeholders is not a trivial task. Most of the available frameworks and methods for XAI focus on data scientists and ML developers as users. Our research is about XAI for end users of AI systems. We argue that we need to discuss XAI early in the AI system design process and with all stakeholders. In this work, we aimed at investigating how to operationalize the discussion about XAI scenarios and opportunities among designers and developers of AI and its end users. We took the Signifying Message as our conceptual tool to structure and discuss XAI scenarios. We experiment with its use for the discussion of a healthcare AI System.


MSO Multi Feature Space Joint Optimization Network for RGB Infrared Person Re Identification. The RGB infrared cross modality person re identification (ReID) task aims to recognize the images of the same identity between the visible modality and the infrared modality. Existing methods mainly use a two stream architecture to eliminate the discrepancy between the two modalities in the final common feature space, which ignore the single space of each modality in the shallow layers. To solve it, in this paper, we present a novel multi feature space joint optimization (MSO) network, which can learn modality sharable features in both the single modality space and the common space. Firstly, based on the observation that edge information is modality invariant, we propose an edge features enhancement module to enhance the modality sharable features in each single modality space. Specifically, we design a perceptual edge features (PEF) loss after the edge fusion strategy analysis. According to our knowledge, this is the first work that proposes explicit optimization in the single modality feature space on cross modality ReID task. Moreover, to increase the difference between cross modality distance and class distance, we introduce a novel cross modality contrastive center (CMCC) loss into the modality joint constraints in the common feature space. The PEF loss and CMCC loss jointly optimize the model in an end to end manner, which markedly improves the network's performance. Extensive experiments demonstrate that the proposed model significantly outperforms state of the art methods on both the SYSU MM01 and RegDB datasets.


A relative entropy and a unique continuation result for Ricci expanders. We prove an optimal relative integral convergence rate for two expanding gradient Ricci solitons coming out of the same cone. As a consequence, we obtain a unique continuation result at infinity and we prove that a relative entropy for two such self similar solutions to the Ricci flow is well defined.


On quadratic multidimensional type I BSVIEs, infinite families of BSDEs and their applications. This paper investigates multidimensional extended type I BSVIEs and infinite families of BSDEs in the case of quadratic generators. We establish existence and uniqueness results in the case of fully quadratic as well as Lipschitz quadratic quadratic generators. We also present and discuss a type of flow property satisfied by this family of BSVIEs. As a preliminary step, we establish the well posedness of a class of infinite families of BSDEs, as introduced in Hern aa ndez and Possama "i 20 , which are of interest in their own right. Our approach relies on the strategy developed by Tevsadze 49 for quadratic BSDEs and the treatment of Lipschitz extended type I BSVIEs in 20 . We motivate their analysis of both of these objects by a series of practical applications.


Assessing the Performance of an Adaptive Multi Fidelity Gaussian Process with Noisy Training Data A Statistical Analysis. Despite the increased computational resources, the simulation based design optimization (SBDO) procedure can be very expensive from a computational viewpoint, especially if high fidelity solvers are required. Multi fidelity metamodels have been successfully applied to reduce the computational cost of the SBDO process. In this context, the paper presents the performance assessment of an adaptive multi fidelity metamodel based on a Gaussian process regression (MF GPR) for noisy data. The MF GPR is developed to (i) manage an arbitrary number of fidelity levels, (ii) deal with objective function evaluations affected by noise, and (iii) improve its fitting accuracy by adaptive sampling. Multi fidelity is achieved by bridging a low fidelity metamodel with metamodels of the error between successive fidelity levels. The MF GPR handles the numerical noise through regression. The adaptive sampling method is based on the maximum prediction uncertainty and includes rules to automatically select the fidelity to sample. The MF GPR performance are assessed on a set of five analytical benchmark problems affected by noisy objective function evaluations. Since the noise introduces randomness in the evaluation of the objective function, a statistical analysis approach is adopted to assess the performance and the robustness of the MF GPR. The paper discusses the efficiency and effectiveness of the MF GPR in globally approximating the objective function and identifying the global minimum. One, two, and three fidelity levels are used. The results of the statistical analysis show that the use of three fidelity levels achieves a more accurate global representation of the noise free objective function compared to the use of one or two fidelities.


High Power, Fiber Laser Based Source for Magic Wavelength Trapping in Neutral Atom Optical Clocks. We present a continuous wave, 810 nm laser with watt level powers. Our system is based on difference frequency generation of 532 nm and 1550 nm fiber lasers in a single pass through periodically poled lithium niobate (PPLN). We measure the broadband spectral noise and residual intensity noise to be compatible with off resonant dipole trapping of ultracold atoms. Given the large bandwidth of the fiber amplifiers, the output can be optimized for a range of wavelengths, including the strontium clock magic wavelength of 813 nm. Furthermore, with the exploration of more appropriate nonlinear crystals, we believe there is a path toward scaling this proof of principle design to many watts of power, and that this approach could provide a robust, rack mountable trapping laser for future use in strontium based optical clocks.


Perturbing eigenvalues of nonnegative centrosymmetric matrices. An n times n matrix C is said to be it centrosymmetric if it satisfies the relation JCJ C , where J is the n times n counteridentity matrix. Centrosymmetric matrices have a rich eigenstructure that has been studied extensively in the literature. Many results for centrosymmetric matrices have been generalized to wider classes of matrices that arise in a wide variety of disciplines. In this paper, we obtain interesting spectral properties for nonnegative centrosymmetric matrices. We show how to change one single eigenvalue, two or three eigenvalues of an n times n nonnegative centrosymmetric matrix without changing any of the remaining eigenvalues neither nonnegativity nor the centrosymmetric structure. Moreover, our results allow partially answer some known questions given by Guo 11 and by Guo and Guo 12 . Our proofs generate algorithmic procedures that allow to compute a solution matrix.


Privacy and Integrity Preserving Training Using Trusted Hardware. Privacy and security related concerns are growing as machine learning reaches diverse application domains. The data holders want to train with private data while exploiting accelerators, such as GPUs, that are hosted in the cloud. However, Cloud systems are vulnerable to attackers that compromise the privacy of data and integrity of computations. This work presents DarKnight, a framework for large DNN training while protecting input privacy and computation integrity. DarKnight relies on cooperative execution between trusted execution environments (TEE) and accelerators, where the TEE provides privacy and integrity verification, while accelerators perform the computation heavy linear algebraic operations.


Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level. Larger language models have higher accuracy on average, but are they better on every single instance (datapoint)? Some work suggests larger models have higher out of distribution robustness, while other work suggests they have lower accuracy on rare subgroups. To understand these differences, we investigate these models at the level of individual instances. However, one major challenge is that individual predictions are highly sensitive to noise in the randomness in training. We develop statistically rigorous methods to address this, and after accounting for pretraining and finetuning noise, we find that our BERT Large is worse than BERT Mini on at least 1 4 of instances across MNLI, SST 2, and QQP, compared to the overall accuracy improvement of 2 10 . We also find that finetuning noise increases with model size and that instance level accuracy has momentum improvement from BERT Mini to BERT Medium correlates with improvement from BERT Medium to BERT Large. Our findings suggest that instance level predictions provide a rich source of information we therefore, recommend that researchers supplement model weights with model predictions.


CSL YOLO A New Lightweight Object Detection System for Edge Computing. The development of lightweight object detectors is essential due to the limited computation resources. To reduce the computation cost, how to generate redundant features plays a significant role. This paper proposes a new lightweight Convolution method Cross Stage Lightweight (CSL) Module, to generate redundant features from cheap operations. In the intermediate expansion stage, we replaced Pointwise Convolution with Depthwise Convolution to produce candidate features. The proposed CSL Module can reduce the computation cost significantly. Experiments conducted at MS COCO show that the proposed CSL Module can approximate the fitting ability of Convolution 3x3. Finally, we use the module to construct a lightweight detector CSL YOLO, achieving better detection performance with only 43 FLOPs and 52 parameters than Tiny YOLOv4.


The Divergence Borel Cantelli Lemma revisited. Let ( Omega, mathcal A , mu) be a probability space. The classical Borel Cantelli Lemma states that for any sequence of mu measurable sets E i ( i 1,2,3, dots ), if the sum of their measures converges then the corresponding limsup set E infty is of measure zero. In general the converse statement is false. However, it is well known that the divergence counterpart is true under various additional 'independence' hypotheses. In this paper we revisit these hypotheses and establish both sufficient and necessary conditions for E infty to have either positive or full measure.


An ASP based Solution to the Chemotherapy Treatment Scheduling problem. The problem of scheduling chemotherapy treatments in oncology clinics is a complex problem, given that the solution has to satisfy (as much as possible) several requirements such as the cyclic nature of chemotherapy treatment plans, maintaining a constant number of patients, and the availability of resources, e.g., treatment time, nurses, and drugs. At the same time, realizing a satisfying schedule is of upmost importance for obtaining the best health outcomes. In this paper we first consider a specific instance of the problem which is employed in the San Martino Hospital in Genova, Italy, and present a solution to the problem based on Answer Set Programming (ASP). Then, we enrich the problem and the related ASP encoding considering further features often employed in other hospitals, desirable also in S. Martino, and or considered in related papers. Results of an experimental analysis, conducted on the real data provided by the San Martino Hospital, show that ASP is an effective solving methodology also for this important scheduling problem. Under consideration for acceptance in TPLP.


Stable Emulation of an Entire Suite of Model Physics in a State of the Art GCM using a Neural Network. There has been a lot of recent interest in developing hybrid models that couple deterministic numerical model components to statistical model components derived using machine learning techniques. One approach that we follow in this pilot study is to replace an existing computationally expensive deterministic model component with its fast machine learning based emulator, leading to the model speed up and or improvement. We developed a shallow neural network based emulator of a complete suite of atmospheric physics parameterizations in NCEP Global Forecast System (GFS) general circulation model (GCM). The suite emulated by a single NN includes radiative transfer, cloud macro and micro physics, shallow and deep convection, boundary layer processes, gravity wave drag, land model, etc. NCEP GFS with the neural network replacing the original suite of atmospheric parameterizations produces stable and realistic medium range weather forecasts for 24 initial conditions spanning all months of 2018. It also remains stable in a year long AMIP like experiment and in the run with a quadrupled horizontal resolution. We present preliminary results of parallel runs, evaluating the accuracy and speedup of the resulting hybrid GCM.


QuatDE Dynamic Quaternion Embedding for Knowledge Graph Completion. Knowledge graph embedding has been an active research topic for knowledge base completion (KGC), with progressive improvement from the initial TransE, TransH, RotatE et al to the current state of the art QuatE. However, QuatE ignores the multi faceted nature of the entity and the complexity of the relation, only using rigorous operation on quaternion space to capture the interaction between entitiy pair and relation, leaving opportunities for better knowledge representation which will finally help KGC. In this paper, we propose a novel model, QuatDE, with a dynamic mapping strategy to explicitly capture the variety of relational patterns and separate different semantic information of the entity, using transition vectors to adjust the point position of the entity embedding vectors in the quaternion space via Hamilton product, enhancing the feature interaction capability between elements of the triplet. Experiment results show QuatDE achieves state of the art performance on three well established knowledge graph completion benchmarks. In particular, the MR evaluation has relatively increased by 26 on WN18 and 15 on WN18RR, which proves the generalization of QuatDE.


Asymmetric One Dimensional Slow Electron Holes. Slow solitary positive potential peaks sustained by trapped electron deficit in a plasma with asymmetric ion velocity distributions are in principle asymmetric, involving a potential change across the hole. It is shown theoretically how to construct such asymmetric electron holes, thus providing fully consistent solutions of the one dimensional Vlasov Poisson equation for a wide variety of prescribed background ion velocity distributions. Because of ion reflection forces experienced by the hole, there is generally only one discrete slow hole velocity that is in equilibrium. Moreover the equilibrium is unstable unless there is a local minimum in the ion velocity distribution, in which the hole velocity then resides. For stable equilibria with Maxwellian electrons, the potential drop across the hole is shown to be Delta phi simeq 2 over 9 f''' T e over e ( e psi over m i ) 2 , where psi is the hole peak potential, f''' is the third derivative of the background ion velocity distribution function at the hole velocity, and T e the electron temperature. Potential asymmetry is small for holes of the amplitudes usually observed, psi lesssim 0.5T e e .


Estimating smooth and sparse neural receptive fields with a flexible spline basis. Spatio temporal receptive field (STRF) models are frequently used to approximate the computation implemented by a sensory neuron. Typically, such STRFs are assumed to be smooth and sparse. Current state of the art approaches for estimating STRFs based on empirical Bayes are often not computationally efficient in high dimensional settings, as encountered in sensory neuroscience. Here we pursued an alternative approach and encode prior knowledge for estimation of STRFs by choosing a set of basis functions with the desired properties natural cubic splines. Our method is computationally efficient and can be easily applied to a wide range of existing models. We compared the performance of spline based methods to non spline ones on simulated and experimental data, showing that spline based methods consistently outperform the non spline versions.


Least Squares ReLU Neural Network (LSNN) Method For Scalar Nonlinear Hyperbolic Conservation Law. We introduced the least squares ReLU neural network (LSNN) method for solving the linear advection reaction problem with discontinuous solution and showed that the method outperforms mesh based numerical methods in terms of the number of degrees of freedom. This paper studies the LSNN method for scalar nonlinear hyperbolic conservation law. The method is a discretization of an equivalent least squares (LS) formulation in the set of neural network functions with the ReLU activation function. Evaluation of the LS functional is done by using numerical integration and conservative finite volume scheme. Numerical results of some test problems show that the method is capable of approximating the discontinuous interface of the underlying problem automatically through the free breaking lines of the ReLU neural network. Moreover, the method does not exhibit the common Gibbs phenomena along the discontinuous interface.


The New SARS CoV 2 Strain Shows a Stronger Binding Affinity to ACE2 Due to N501Y Mutation. SARS CoV 2 is a global challenge due to its ability to spread much faster than SARS CoV, which was attributed to the mutations in the receptor binding domain (RBD). These mutations enhanced the electrostatic interactions. Recently, a new strain was reported in the UK that includes a mutation (N501Y) in the RBD, that possibly increases the infection rate. Using Molecular Dynamics simulations (MD) and Monte Carlo (MC) sampling, we showed that the N501 mutation enhances the electrostatic interactions due to the formation of a strong hydrogen bond between SARS CoV 2 T500 and ACE2 D355 near the mutation site. In addition, we observed that the electrostatic interactions between the SARS CoV 2 and ACE2 in the wild type and the mutant are dominated by salt bridges formed between SARS CoV 2 K417 and ACE2 D30, SARS CoV 2 K458, ACE2 E23, and SARS CoV 2 R403 and ACE2 E37. These interactions contributed more than 40 of the total binding energies.


A TinyML Platform for On Device Continual Learning with Quantized Latent Replays. In the last few years, research and development on Deep Learning models and techniques for ultra low power devices in a word, TinyML has mainly focused on a train then deploy assumption, with static models that cannot be adapted to newly collected data without cloud based data collection and fine tuning. Latent Replay based Continual Learning (CL) techniques 1 enable online, serverless adaptation in principle, but so farthey have still been too computation and memory hungry for ultra low power TinyML devices, which are typically based on microcontrollers. In this work, we introduce a HW SW platform for end to end CL based on a 10 core FP32 enabled parallel ultra low power (PULP) processor. We rethink the baseline Latent Replay CL algorithm, leveraging quantization of the frozen stage of the model and Latent Replays (LRs) to reduce their memory cost with minimal impact on accuracy. In particular, 8 bit compression of the LR memory proves to be almost lossless ( 0.26 with 3000LR) compared to the full precision baseline implementation, but requires 4x less memory, while 7 bit can also be used with an additional minimal accuracy degradation (up to 5 ). We also introduce optimized primitives for forward and backward propagation on the PULP processor. Our results show that by combining these techniques, continual learning can be achieved in practice using less than 64MB of memory an amount compatible with embedding in TinyML devices. On an advanced 22nm prototype of our platform, called VEGA, the proposed solution performs onaverage 65x faster than a low power STM32 L4 microcontroller, being 37x more energy efficient enough for a lifetime of 535h when learning a new mini batch of data once every minute.


Prototypical Cross domain Self supervised Learning for Few shot Unsupervised Domain Adaptation. Unsupervised Domain Adaptation (UDA) transfers predictive models from a fully labeled source domain to an unlabeled target domain. In some applications, however, it is expensive even to collect labels in the source domain, making most previous works impractical. To cope with this problem, recent work performed instance wise cross domain self supervised learning, followed by an additional fine tuning stage. However, the instance wise self supervised learning only learns and aligns low level discriminative features. In this paper, we propose an end to end Prototypical Cross domain Self Supervised Learning (PCS) framework for Few shot Unsupervised Domain Adaptation (FUDA). PCS not only performs cross domain low level feature alignment, but it also encodes and aligns semantic structures in the shared embedding space across domains. Our framework captures category wise semantic structures of the data by in domain prototypical contrastive learning and performs feature alignment through cross domain prototypical self supervision. Compared with state of the art methods, PCS improves the mean classification accuracy over different domain pairs on FUDA by 10.5 , 3.5 , 9.0 , and 13.2 on Office, Office Home, VisDA 2017, and DomainNet, respectively. Our project page is at http xyue.io pcs fuda index.html


First Order Locally Orderless Registration. First Order Locally Orderless Registration (FLOR) is a scale space framework for image density estimation used for defining image similarity, mainly for Image Registration. The Locally Orderless Registration framework was designed in principle to use zeroth order information, providing image density estimates over three scales image scale, intensity scale, and integration scale. We extend it to take first order information into account and hint at higher order information. We show how standard similarity measures extend into the framework. We study especially Sum of Squared Differences (SSD) and Normalized Cross Correlation (NCC) but present the theory of how Normalised Mutual Information (NMI) can be included.