Heterogeneous Graph Attention Networks for Learning Diverse Communication. Multi agent teaming achieves better performance when there is communication among participating agents allowing them to coordinate their actions for maximizing shared utility. However, when collaborating a team of agents with different action and observation spaces, information sharing is not straightforward and requires customized communication protocols, depending on sender and receiver types. Without properly modeling such heterogeneity in agents, communication becomes less helpful and could even deteriorate the multi agent cooperation performance. We propose heterogeneous graph attention networks, called HetNet, to learn efficient and diverse communication models for coordinating heterogeneous agents towards accomplishing tasks that are of collaborative nature. We propose a Multi Agent Heterogeneous Actor Critic (MAHAC) learning paradigm to obtain collaborative per class policies and effective communication protocols for composite robot teams. Our proposed framework is evaluated against multiple baselines in a complex environment in which agents of different types must communicate and cooperate to satisfy the objectives. Experimental results show that HetNet outperforms the baselines in learning sophisticated multi agent communication protocols by achieving sim 10 improvements in performance metrics.


Heat emitting damage in skin a thermal pathway for mechanical algesia. Mechanical pain (or mechanical algesia) can both be a vital mechanism warning us for dangers or an undesired medical symptom important to mitigate. Thus, a comprehensive understanding of the different mechanisms of this type of pain is paramount. In this work, we study the tearing of porcine skin in front of an infrared camera, and show that mechanical injuries in biological tissues can generate enough heat to stimulate the neural network. In particular, we report local temperature elevations of up to 24 degrees Celsius around fast cutaneous ruptures, which shall exceed the threshold of the neural nociceptors usually involved in thermal pain. Slower fractures exhibit lower temperature elevations, and we characterise such dependency to the damaging rate. Overall, we bring experimental evidence of a novel thermal pathway for direct mechanical algesia. In addition, the implications of this pathway are discussed for mechanical hyperalgesia as well, in which a role of the cutaneous thermal sensors has long been suspected. We also show that thermal dissipation shall actually account for a significant portion of the total skin's fracture energy, making temperature monitoring an efficient way to detect biological damages.


Pruned Collapsed Projection Aggregation Decoding of Reed Muller Codes. The paper proposes to decode Reed Muller (RM) codes by projecting onto only a few subspaces such that the number of projections is significantly reduced. It reveals that the probability that error pairs are canceled simultaneously in two different projections is determined by their intersection size. Then, correlation coefficient which indicates the intersection size of two subspaces in a collection is introduced for collecting subspaces. Simulation results show that our proposed approach with a small number of projections onto collected subspaces performs close to the original approach.


Geometric structures as variational objects, I. This note provides a variational description of the most basic differential geometric structures on a smooth manifold.


Forward Composition Propagation for Explainable Neural Reasoning. This paper proposes an algorithm called Forward Composition Propagation (FCP) to explain the predictions of feed forward neural networks operating on structured pattern recognition problems. In the proposed FCP algorithm, each neuron is described by a composition vector indicating the role of each problem feature in that neuron. Composition vectors are initialized using a given input instance and subsequently propagated through the whole network until we reach the output layer. It is worth mentioning that the algorithm is executed once the network's training network is done. The sign of each composition value indicates whether the corresponding feature excites or inhibits the neuron, while the absolute value quantifies such an impact. Aiming to validate the FCP algorithm's correctness, we develop a case study concerning bias detection in a state of the art problem in which the ground truth is known. The simulation results show that the composition values closely align with the expected behavior of protected features.


Grounding inductive biases in natural images invariance stems from variations in data. To perform well on unseen and potentially out of distribution samples, it is desirable for machine learning models to have a predictable response with respect to transformations affecting the factors of variation of the input. Here, we study the relative importance of several types of inductive biases towards such predictable behavior the choice of data, their augmentations, and model architectures. Invariance is commonly achieved through hand engineered data augmentation, but do standard data augmentations address transformations that explain variations in real data? While prior work has focused on synthetic data, we attempt here to characterize the factors of variation in a real dataset, ImageNet, and study the invariance of both standard residual networks and the recently proposed vision transformer with respect to changes in these factors. We show standard augmentation relies on a precise combination of translation and scale, with translation recapturing most of the performance improvement despite the (approximate) translation invariance built in to convolutional architectures, such as residual networks. In fact, we found that scale and translation invariance was similar across residual networks and vision transformer models despite their markedly different architectural inductive biases. We show the training data itself is the main source of invariance, and that data augmentation only further increases the learned invariances. Notably, the invariances learned during training align with the ImageNet factors of variation we found. Finally, we find that the main factors of variation in ImageNet mostly relate to appearance and are specific to each class.


We Know What You Want An Advertising Strategy Recommender System for Online Advertising. Advertising expenditures have become the major source of revenue for e commerce platforms. Providing good advertising experiences for advertisers by reducing their costs of trial and error in discovering the optimal advertising strategies is crucial for the long term prosperity of online advertising. To achieve this goal, the advertising platform needs to identify the advertiser's optimization objectives, and then recommend the corresponding strategies to fulfill the objectives. In this work, we first deploy a prototype of strategy recommender system on Taobao display advertising platform, which indeed increases the advertisers' performance and the platform's revenue, indicating the effectiveness of strategy recommendation for online advertising. We further augment this prototype system by explicitly learning the advertisers' preferences over various advertising performance indicators and then optimization objectives through their adoptions of different recommending advertising strategies. We use contextual bandit algorithms to efficiently learn the advertisers' preferences and maximize the recommendation adoption, simultaneously. Simulation experiments based on Taobao online bidding data show that the designed algorithms can effectively optimize the strategy adoption rate of advertisers.


Area minimizing hypersurfaces modulo p a geometric free boundary problem. We consider area minimizing m dimensional currents mathrm mod (p) in complete C 2 Riemannian manifolds Sigma of dimension m 1 . For odd moduli we prove that, away from a closed rectifiable set of codimension 2 , the current in question is, locally, the union of finitely many smooth minimal hypersurfaces coming together at a common C 1, alpha boundary of dimension m 1 , and the result is optimal. For even p such structure holds in a neighborhood of any point where at least one tangent cone has (m 1) dimensional spine. These structural results are indeed the byproduct of a theorem that proves (for any modulus) uniqueness and decay towards such tangent cones. The underlying strategy of the proof is inspired by the techniques developed by Leon Simon in "Cylindrical tangent cones and the singular set of minimal submanifolds" (J. Diff. Geom. 1993) in a class of multiplicity one stationary varifolds. The major difficulty in our setting is produced by the fact that the cones and surfaces under investigation have arbitrary multiplicities ranging from 1 to lfloor frac p 2 rfloor .


Hybrid attention network based on progressive embedding scale context for crowd counting. The existing crowd counting methods usually adopted attention mechanism to tackle background noise, or applied multi level features or multi scales context fusion to tackle scale variation. However, these approaches deal with these two problems separately. In this paper, we propose a Hybrid Attention Network (HAN) by employing Progressive Embedding Scale context (PES) information, which enables the network to simultaneously suppress noise and adapt head scale variation. We build the hybrid attention mechanism through paralleling spatial attention and channel attention module, which makes the network to focus more on the human head area and reduce the interference of background objects. Besides, we embed certain scale context to the hybrid attention along the spatial and channel dimensions for alleviating these counting errors caused by the variation of perspective and head scale. Finally, we propose a progressive learning strategy through cascading multiple hybrid attention modules with embedding different scale context, which can gradually integrate different scale context information into the current feature map from global to local. Ablation experiments provides that the network architecture can gradually learn multi scale features and suppress background noise. Extensive experiments demonstrate that HANet obtain state of the art counting performance on four mainstream datasets.


Temporal search in the scientific space predicts breakthrough inventions. The development of inventions is theorized as a process of searching and recombining existing knowledge components. Previous studies under this theory have examined myriad characteristics of recombined knowledge and their performance implications. One feature that has received much attention is technological knowledge age. Yet, little is known about how the age of scientific knowledge influences the impact of inventions, despite the widely known catalyzing role of science in the creation of new technologies. Here we use a large corpus of patents and derive features characterizing how patents temporally search in the scientific space. We find that patents that cite scientific papers have more citations and substantially more likely to become breakthroughs. Conditional on searching in the scientific space, referencing more recent papers increases the impact of patents and the likelihood of being breakthroughs. However, this positive effect can be offset if patents cite papers whose ages exhibit a low variance. These effects are consistent across technological fields.


Pilot Edge Distributed Resource Management Along the Edge to Cloud Continuum. Many science and industry IoT applications necessitate data processing across the edge to cloud continuum to meet performance, security, cost, and privacy requirements. However, diverse abstractions and infrastructures for managing resources and tasks across the edge to cloud scenario are required. We propose Pilot Edge as a common abstraction for resource management across the edge to cloud continuum. Pilot Edge is based on the pilot abstraction, which decouples resource and workload management, and provides a Function as a Service (FaaS) interface for application level tasks. The abstraction allows applications to encapsulate common functions in high level tasks that can then be configured and deployed across the continuum. We characterize Pilot Edge on geographically distributed infrastructures using machine learning workloads (e.g., k means and auto encoders). Our experiments demonstrate how Pilot Edge manages distributed resources and allows applications to evaluate task placement based on multiple factors (e.g., model complexities, throughput, and latency).


Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models. While vector based language representations from pretrained language models have set a new standard for many NLP tasks, there is not yet a complete accounting of their inner workings. In particular, it is not entirely clear what aspects of sentence level syntax are captured by these representations, nor how (if at all) they are built along the stacked layers of the network. In this paper, we aim to address such questions with a general class of interventional, input perturbation based analyses of representations from pretrained language models. Importing from computational and cognitive neuroscience the notion of representational invariance, we perform a series of probes designed to test the sensitivity of these representations to several kinds of structure in sentences. Each probe involves swapping words in a sentence and comparing the representations from perturbed sentences against the original. We experiment with three different perturbations (1) random permutations of n grams of varying width, to test the scale at which a representation is sensitive to word position (2) swapping of two spans which do or do not form a syntactic phrase, to test sensitivity to global phrase structure and (3) swapping of two adjacent words which do or do not break apart a syntactic phrase, to test sensitivity to local phrase structure. Results from these probes collectively suggest that Transformers build sensitivity to larger parts of the sentence along their layers, and that hierarchical phrase structure plays a role in this process. More broadly, our results also indicate that structured input perturbations widens the scope of analyses that can be performed on often opaque deep learning systems, and can serve as a complement to existing tools (such as supervised linear probes) for interpreting complex black box models.


Industrial Digital Twins at the Nexus of NextG Wireless Networks and Computational Intelligence A Survey. By amalgamating recent communication and control technologies, computing and data analytics techniques, and modular manufacturing, Industry 4.0 promotes integrating cyber physical worlds through cyber physical systems (CPS) and digital twin (DT) for monitoring, optimization, and prognostics of industrial processes. A DT is an emerging but conceptually different construct than CPS. Like CPS, DT relies on communication to create a highly consistent, synchronized digital mirror image of the objects or physical processes. DT, in addition, uses built in models on this precise image to simulate, analyze, predict, and optimize their real time operation using feedback. DT is rapidly diffusing in the industries with recent advances in the industrial Internet of things (IIoT), edge and cloud computing, machine learning, artificial intelligence, and advanced data analytics. However, the existing literature lacks in identifying and discussing the role and requirements of these technologies in DT enabled industries from the communication and computing perspective. In this article, we first present the functional aspects, appeal, and innovative use of DT in smart industries. Then, we elaborate on this perspective by systematically reviewing and reflecting on recent research in next generation (NextG) wireless technologies (e.g., 5G and beyond networks), various tools (e.g., age of information, federated learning, data analytics), and other promising trends in networked computing (e.g., edge and cloud computing). Moreover, we discuss the DT deployment strategies at different industrial communication layers to meet the monitoring and control requirements of industrial applications. We also outline several key reflections and future research challenges and directions to facilitate industrial DT's adoption.


NeuralMVS Bridging Multi View Stereo and Novel View Synthesis. Multi View Stereo (MVS) is a core task in 3D computer vision. With the surge of novel deep learning methods, learned MVS has surpassed the accuracy of classical approaches, but still relies on building a memory intensive dense cost volume. Novel View Synthesis (NVS) is a parallel line of research and has recently seen an increase in popularity with Neural Radiance Field (NeRF) models, which optimize a per scene radiance field. However, NeRF methods do not generalize to novel scenes and are slow to train and test. We propose to bridge the gap between these two methodologies with a novel network that can recover 3D scene geometry as a distance function, together with high resolution color images. Our method uses only a sparse set of images as input and can generalize well to novel scenes. Additionally, we propose a coarse to fine sphere tracing approach in order to significantly increase speed. We show on various datasets that our method reaches comparable accuracy to per scene optimized methods while being able to generalize and running significantly faster.


A Simple and Tight Greedy OCRS. In recent years, Contention Resolution Schemes (CRSs), introduced by Chekuri, Vondr ' a k, and Zenklusen, have emerged as a general framework for obtaining feasible solutions to combinatorial optimization problems with constraints. The idea is to first solve a continuous relaxation and then round the fractional solution. When one does not have any control on the order of rounding, Online Contention Resolution Schemes (OCRSs) can be used instead, and have been successfully applied in settings such as prophet inequalities and stochastic probing. Intuitively, a greedy OCRS has to decide which elements to include in the integral solution before the online process starts. In this work, we give simple 1 e selectable greedy OCRSs for rank 1 matroids, partition matroids and transversal matroids. We also show that our greedy OCRSs are optimal, even for the simple single item case.


Independence and orthogonality of algebraic eigenvectors over the max plus algebra. The max plus algebra mathbb R cup infty is a semiring with the two operations addition a oplus b max(a,b) and multiplication a otimes b a b . Roots of the characteristic polynomial of a max plus matrix are called algebraic eigenvalues. Recently, algebraic eigenvectors with respect to algebraic eigenvalues were introduced as a generalized concept of eigenvectors. In this paper, we present properties of algebraic eigenvectors analogous to those of eigenvectors in the conventional linear algebra. First, we prove that for generic matrices algebraic eigenvectors with respect to distinct algebraic eigenvalues are linearly independent. We further prove that for symmetric matrices algebraic eigenvectors with respect to distinct algebraic eigenvalues are orthogonal to each other.


Enabling Fast Exploration and Validation of Thermal Dissipation Requirements for Heterogeneous SoCs. The management of the energy consumption and thermal dissipation of multi core heterogeneous platforms is becoming increasingly important as it can have direct impact on the platform performance. This paper discusses an approach that enables fast exploration and validation of heterogeneous system on chips (SoCs) platform configurations with respect to their thermal dissipation. Such platforms can be configured to find the optimal trade off between performance and power consumption. This directly reflects in the head dissipation of the platform, which when increases over a given threshold will actually decrease the performance of the platform. Therefore, it is important to be able to quickly probe and explore different configurations and identify the most suitable one. However, this task is hindered by the large space of possible configurations of such platforms and by the time required to benchmark each configurations. As such, we propose an approach in which we construct a model of the thermal dissipation of a given platform using a system identification methods and then we use this model to explore and validate different configurations. The approach allows us to decrease the exploration time with several orders of magnitude. We exemplify the approach on an Odroid XU4 board featuring an Exynos 5422 SoC.


Spatio Temporal Resource Meshes for Serverless Computing. Serverless computing is leading the way to a simplified and general purpose programming model for the cloud. A key enabler behind serverless computing is efficient load balancing, which routes function invocations to appropriate backend VM nodes. However, current load balancing algorithms implemented in serverless platforms are static and simple to operate without advantageous performance guarantee. Although policies such as Pod or JFIQ yield asymptotically optimal average response time, the information they depend on are usually unavailable. In addition, dispatching serverless functions with strict deadlines to heterogenous VM nodes with limited input data processing speeds online is difficult because the resource contention is intensified with frequently creating and evicting of function instances. To design an online load balancing algorithm without assumptions on the arrival patterns of serverless functions and the processing capacity of VM nodes while maximizing the social welfare, i.e., the sum of utility of functions and the revenue of the serverless platform, we construct several pseudo social welfare functions and marginal cost functions, where the latter is to estimate the marginal cost for provisioning resources to every newly arrived function based on present resource surplus. The proposed algorithm, named OnSocMax, works by following the solutions of several convex optimization problems. It is proved to be alpha competitive for some alpha at least 2. We also validate the theoretical superiority of OnSocMax with simulations and the results show that it significantly outperforms two handcrafted benchmarking policies on the social welfare.


Autonomous Driving in Adverse Weather Conditions A Survey. Automated Driving Systems (ADS) open up a new domain for the automotive industry and offer new possibilities for future transportation with higher efficiency and comfortable experiences. However, autonomous driving under adverse weather conditions has been the problem that keeps autonomous vehicles (AVs) from going to level 4 or higher autonomy for a long time. This paper assesses the influences and challenges that weather brings to ADS sensors in an analytic and statistical way, and surveys the solutions against inclement weather conditions. State of the art techniques on perception enhancement with regard to each kind of weather are thoroughly reported. External auxiliary solutions like V2X technology, weather conditions coverage in currently available datasets, simulators, and experimental facilities with weather chambers are distinctly sorted out. By pointing out all kinds of major weather problems the autonomous driving field is currently facing, and reviewing both hardware and computer science solutions in recent years, this survey contributes a holistic overview on the obstacles and directions of ADS development in terms of adverse weather driving conditions.


Nonexistence of graded unital homomorphisms between Leavitt algebras and their Cuntz splices. Let n ge 2 , let mathcal R n be the graph consisting of one vertex and n loops and let mathcal R n be its Cuntz splice. Let L n L( mathcal R n) and L n L( mathcal R n ) be the Leavitt path algebras over a unital ring ell . Let C m be the cyclic group on 2 le m le infty elements. Equip L n and L n with their natural C m gradings. We show that under mild conditions on ell , which are satisfied for example when ell is a field or a PID, there are no unital C m graded ring homomorphisms L n to L n nor in the opposite direction.


SOFT Softmax free Transformer with Linear Complexity. Vision transformers (ViTs) have pushed the state of the art for various visual recognition tasks by patch wise image tokenization followed by self attention. However, the employment of self attention modules results in a quadratic complexity in both computation and memory usage. Various attempts on approximating the self attention computation with linear complexity have been made in Natural Language Processing. However, an in depth analysis in this work shows that they are either theoretically flawed or empirically ineffective for visual recognition. We further identify that their limitations are rooted in keeping the softmax self attention during approximations. Specifically, conventional self attention is computed by normalizing the scaled dot product between token feature vectors. Keeping this softmax operation challenges any subsequent linearization efforts. Based on this insight, for the first time, a softmax free transformer or SOFT is proposed. To remove softmax in self attention, Gaussian kernel function is used to replace the dot product similarity without further normalization. This enables a full self attention matrix to be approximated via a low rank matrix decomposition. The robustness of the approximation is achieved by calculating its Moore Penrose inverse using a Newton Raphson method. Extensive experiments on ImageNet show that our SOFT significantly improves the computational efficiency of existing ViT variants. Crucially, with a linear complexity, much longer token sequences are permitted in SOFT, resulting in superior trade off between accuracy and complexity.


Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations. Natural language interfaces (NLIs) for data visualization are becoming increasingly popular both in academic research and in commercial software. Yet, there is a lack of empirical understanding of how people specify visualizations through natural language. To bridge this gap, we conducted an online study with 102 participants. We showed participants a series of ten visualizations for a given dataset and asked them to provide utterances they would pose to generate the displayed charts. The curated list of utterances generated from the study is provided below. This corpus of utterances can be used to evaluate existing NLIs for data visualization as well as for creating new systems and models to generate visualizations from natural language utterances.


Learning Predictive and Interpretable Timeseries Summaries from ICU Data. Machine learning models that utilize patient data across time (rather than just the most recent measurements) have increased performance for many risk stratification tasks in the intensive care unit. However, many of these models and their learned representations are complex and therefore difficult for clinicians to interpret, creating challenges for validation. Our work proposes a new procedure to learn summaries of clinical time series that are both predictive and easily understood by humans. Specifically, our summaries consist of simple and intuitive functions of clinical data (e.g. falling mean arterial pressure). Our learned summaries outperform traditional interpretable model classes and achieve performance comparable to state of the art deep learning models on an in hospital mortality classification task.


Knowledge Enhanced Top K Recommendation in Poincar 'e Ball. Personalized recommender systems are increasingly important as more content and services become available and users struggle to identify what might interest them. Thanks to the ability for providing rich information, knowledge graphs (KGs) are being incorporated to enhance the recommendation performance and interpretability. To effectively make use of the knowledge graph, we propose a recommendation model in the hyperbolic space, which facilitates the learning of the hierarchical structure of knowledge graphs. Furthermore, a hyperbolic attention network is employed to determine the relative importances of neighboring entities of a certain item. In addition, we propose an adaptive and fine grained regularization mechanism to adaptively regularize items and their neighboring representations. Via a comparison using three real world datasets with state of the art methods, we show that the proposed model outperforms the best existing models by 2 16 in terms of NDCG K on Top K recommendation.


Visual Motion Imagery Classification with Deep Neural Network based on Functional Connectivity. Brain computer interfaces (BCIs) use brain signals such as electroencephalography to reflect user intention and enable two way communication between computers and users. BCI technology has recently received much attention in healthcare applications, such as neurorehabilitation and diagnosis. BCI applications can also control external devices using only brain activity, which can help people with physical or mental disabilities, especially those suffering from neurological and neuromuscular diseases such as stroke and amyotrophic lateral sclerosis. Motor imagery (MI) has been widely used for BCI based device control, but we adopted intuitive visual motion imagery to overcome the weakness of MI. In this study, we developed a three dimensional (3D) BCI training platform to induce users to imagine upper limb movements used in real life activities (picking up a cell phone, pouring water, opening a door, and eating food). We collected intuitive visual motion imagery data and proposed a deep learning network based on functional connectivity as a mind reading technique. As a result, the proposed network recorded a high classification performance on average (71.05 ). Furthermore, we applied the leave one subject out approach to confirm the possibility of improvements in subject independent classification performance. This study will contribute to the development of BCI based healthcare applications for rehabilitation, such as robotic arms and wheelchairs, or assist daily life.


Variationally and Intrinsically motivated reinforcement learning for decentralized traffic signal control. One of the biggest challenges in multi agent reinforcement learning is coordination, a typical application scenario of this is traffic signal control. Recently, it has attracted a rising number of researchers and has become a hot research field with great practical significance. In this paper, we propose a novel method called MetaVRS (Meta Variational RewardShaping) for traffic signal coordination control. By heuristically applying the intrinsic reward to the environmental reward, MetaVRS can wisely capture the agent to agent interplay. Besides, latent variables generated by VAE are brought into policy for automatically tradeoff between exploration and exploitation to optimize the policy. In addition, meta learning was used in decoder for faster adaptation and better approximation. Empirically, we demonstate that MetaVRS substantially outperforms existing methods and shows superior adaptability, which predictably has a far reaching significance to the multi agent traffic signal coordination control.


Software Estimations Risk in Pakistan Software Industry. Software and IT industry in Pakistan have seen a dramatic growth and success in past few years and is expected to get doubled by 2020, according to a research. Software development life cycle comprises of multiple phases, activities and techniques that can lead to successful projects, and software evaluation is one of the vital and important parts of that. Software estimation can alone be the reason of product success factor or the products failure factor. To estimate the right cost, effort and resources is an art. But it is also very important to include the risks that may arise in the in a software project which can affect your estimates. In this paper, we highlight how the risks in Pakistan Software Industry can affect the estimates and how to mitigate them.


Automatic task based parallelization of C applications by source to source transformations. Currently, multi many core CPUs are considered standard in most types of computers including, mobile phones, PCs or supercomputers. However, the parallelization of applications as well as refactoring design of applications for efficient hardware usage remains restricted to experts who have advanced technical knowledge and who can invest time tuning their software. In this context, the compilation community has proposed different methods for automatic parallelization, but their focus is traditionally on loops and nested loops with the support of polyhedral techniques. In this study, we propose a new approach to transform sequential C source code into a task based parallel one by inserting annotations. We explain the different mechanisms we used to create tasks at each function method call, and how we can limit the number of tasks. Our method can be implemented on top of the OpenMP 4.0 standard. It is compiler independent and can rely on external well optimized OpenMP libraries. Finally, we provide preliminary performance results that illustrate the potential of our method.


Hyperbolic Potentials for Continuous Non Uniformly Expanding Maps. In this work, we give a class of examples of hyperbolic potentials (including the null one) for continuous non uniformly expanding maps. It implies the existence and uniqueness of equilibrium state (in particular, of maximal entropy measure). Among the maps considered is the important class known as Viana maps.


Difference of Composition operators over Bergman spaces with exponential weights. In this paper, we obtain a complete characterization for the compact difference of two composition operators acting on Bergman spaces with weight omega e eta , Delta eta 0 using the eta derived bounded distance of two analytic self maps inducing composition operators. In addition, we provide an example that supports our main result. We also study the topological structure of the space of all bounded composition operators on A 2( omega) endowed with topologies which are induced by the operator norm and the Hilbert Schmidt norm.


Toward Sensor and Software Product Line Based Context Aware Cloud Environment Assignment. Because of the growing interest for mobile device and pervasive applications deployed on cloud computing, the providing of intelligent and ubiquitous context aware applications that take into account the user's context is one of the main challenges in future applications. In this article we consider how to augment applications aware context used by mobiles device and deployed on cloud computing. The behavior of these applications should depend not only on their internal state and user interactions but also on the context sensed during their execution. Indeed, our approach based on two essential mechanisms, context sensoring and context reasoning. We consider the information acquired by the context sensoring as a product line and we use feature models to represent this information received, the services provided by cloud provider, the available resources and constraints. At the context reasoning step, the context provisioning feature model (CSCAFM) algorithm permits to generate service context aware that fulfils the requirements of use ensures a certain level of performance of resources.


A General "Power of d" Dispatching Framework for Heterogeneous Systems. Intelligent dispatching is crucial to obtaining low response times in large scale systems. One common scalable dispatching paradigm is the power of d ,'' in which the dispatcher queries d servers at random and assigns the job to a server based only on the state of the queried servers. The bulk of power of d policies studied in the literature assume that the system is homogeneous, meaning that all servers have the same speed meanwhile real world systems often exhibit server speed heterogeneity. This paper introduces a general framework for describing and analyzing heterogeneity aware power of d policies. The key idea behind our framework is that dispatching policies can make use of server speed information at two decision points when choosing which d servers to query, and when assigning a job to one of those servers. Our framework explicitly separates the dispatching policy into a querying rule and an assignment rule we consider general families of both rule types. While the strongest assignment rules incorporate both detailed queue length information and server speed information, these rules typically are difficult to analyze. We overcome this difficulty by focusing on heterogeneity aware assignment rules that ignore queue length information beyond idleness status. In this setting, we analyze mean response time and formulate novel optimization problems for the joint optimization of querying and assignment. We build upon our optimized policies to develop heuristic queue length aware dispatching policies. Our heuristic policies perform well in simulation, relative to policies that have appeared in the literature.


Cyber Kittens, or Some First Steps Towards Categorical Cybernetics. We define a categorical notion of cybernetic system as a dynamical realisation of a generalized open game, along with a coherence condition. We show that this notion captures a wide class of cybernetic systems in computational neuroscience and statistical machine learning, exposes their compositional structure, and gives an abstract justification for the bidirectional structure empirically observed in cortical circuits. Our construction is built on the observation that Bayesian updates compose optically, a fact which we prove along the way, via a fibred category of state dependent stochastic channels.


High order Brunel harmonics and supercontinuum formed by a weak optical pump in presence of a strong terahertz field. Brunel harmonics appear in the optical response of an atom in process of laser induced ionization, when the electron leaves the atom and is accelerated in the strong optical field. In contrast to recollision based harmonics, the Brunel mechanism does not require the electron returning to the core. Here we show that in the presence of a strong ionizing terahertz (THz) field, even a weak driving field at the optical frequencies allow for generating Brunel harmonics effectively. The strong ionizing THz pump suppresses recollisions, making Brunel dominant in a wide spectral range. High order Brunel harmonics may form a coherent carrier envelope phase insensitive supercontinuum, compressible into an isolated pulse with the duration down to 100 attoseconds.


Exploring extreme magnetization phenomena in directly driven imploding cylindrical targets. This paper uses extended magnetohydrodynamics (MHD) simulations to explore an extreme magnetized plasma regime realisable by cylindrical implosions on the OMEGA laser facility. This regime is characterized by highly compressed magnetic fields (greater than 10 kT across the fuel), which contain a significant proportion of the implosion energy and induce large electrical currents in the plasma. Parameters governing the different magnetization processes such as Ohmic dissipation and suppression of instabilities by magnetic tension are presented, allowing for optimization of experiments to study specific phenomena. For instance, a dopant added to the target gas fill can enhance magnetic flux compression while enabling spectroscopic diagnosis of the imploding core. In particular, the use of Ar K shell spectroscopy is investigated by performing detailed non LTE atomic kinetics and radiative transfer calculations on the MHD data. Direct measurement of the core electron density and temperature would be possible, allowing for both the impact of magnetization on the final temperature and thermal pressure to be obtained. By assuming the magnetic field is frozen into the plasma motion, which is shown to be a good approximation for highly magnetized implosions, spectroscopic diagnosis could be used to estimate which magnetization processes are ruling the implosion dynamics for example, a relation is given for inferring whether thermally driven or current driven transport is dominating.


Designs, permutations, and transitive groups. A notion of t designs in the symmetric group on n letters was introduced by Godsil in 1988. In particular t transitive sets of permutations form a t design. We derive special lower bounds for t 1 and t 2 by a power moment method. For general n,t we give a linear programming lower bound . For n ge 4 and t 2, this bound is strong enough to show a lower bound on the size of such t designs of n(n 1) dots (n t 1), which is best possible when sharply t transitive sets of permutations exist. This shows, in particular, that tight 2 designs do not exist.


Notes on planar semimodular lattices. VIII. Congruence lattices of SPS lattices. In this note, I find a new property of the congruence lattice, Con L , of an SPS lattice L (slim, planar, semimodular, where "slim" is the absence of mathsf M 3 sublattices) with more than 2 elements emph there are at least two dual atoms in Con L . So the three element chain cannot be represented as the congruence lattice of an SPS lattice, supplementing a result of G. Cz 'edli.


Filtrations of moduli spaces of tropical weighted stable curves. We study how changing the weight datum mathcal A (a 1,...,a n) in( mathbb Q cap(0,1 ) n affects the topology of tropical moduli spaces M g, mathcal A trop , overline M g, mathcal A trop and Delta g, mathcal A and the homology of the latter one. We show that for fixed g and n , there are particular filtrations of these topological spaces which we can use to compute the reduced rational homology of Delta g, mathcal A and the top weight cohomology of the moduli space mathcal M g, mathcal A of smooth (g, mathcal A ) stable algebraic curves.


Towards Autonomous Crop Agnostic Visual Navigation in Arable Fields. Autonomous navigation of a robot in agricultural fields is essential for every task from crop monitoring to weed management and fertilizer application. Many current approaches rely on accurate GPS, however, such technology is expensive and also prone to failure (e.g. through lack of coverage). As such, autonomous navigation through sensors that can interpret their environment (such as cameras) is important to achieve the goal of autonomy in agriculture. In this paper, we introduce a purely vision based navigation scheme that is able to reliably guide the robot through row crop fields without manual intervention. Independent of any global localization or mapping, this approach is able to accurately follow the crop rows and switch between the rows, only using onboard cameras. With the help of a novel crop row detection and a novel crop row switching technique, our navigation scheme can be deployed in a wide range of fields with different canopy types in various growth stages with limited parameter tuning, creating a crop agnostic navigation approach. We have extensively evaluated our approach in three different fields under various illumination conditions using our agricultural robotic platform (BonnBot I). For navigation, our approach is evaluated on five crop types and achieves an average navigation accuracy of 3.82cm relative to manual teleoperation.


Towards Logging Noisiness Theory quality aspects to characterize unwanted log entries. Context Logging tasks track the system's functioning by keeping records of evidence that have been analyzed by monitoring and observability activities. For these activities to be effective, it is necessary to consider the quality of the consumed information. Problem However, the presence of noise unwanted information compromises the log files' quality. The noisiness of a log file can be affected among other things by (i) the wrong severity log choices, (ii) the production of duplicate entries, (iii) the incompleteness of the information, (iv) the inappropriate format of the entries, (v) the amount of information generated. Objective This work aims to broadly define the concept of noise in the context of logging, proposing the initial steps of Logging Noisiness, a theory on quality aspects to characterize unwanted log entries.


Non negative integral matrices with given spectral radius and controlled dimension. A celebrated theorem of Lind states that a positive real number is equal to the spectral radius of some integral primitive matrix, if and only if, it is a Perron algebraic integer. Given a Perron number p , we prove that there is an integral irreducible matrix with spectral radius p , and with dimension bounded above in terms of the algebraic degree, the ratio of the first two largest Galois conjugates, and arithmetic information about the ring of integers of its number field. This arithmetic information can be taken to be either the discriminant or the minimal Hermite like thickness. Equivalently, given a Perron number p , there is an irreducible shift of finite type with entropy log(p) defined as an edge shift on a graph whose number of vertices is bounded above in terms of the aforementioned data.


Meta Reinforcement Learning Based Sensor Scanning in 3D Uncertain Environments for Heterogeneous Multi Robot Systems. We study a novel problem that tackles learning based sensor scanning in 3D and uncertain environments with heterogeneous multi robot systems. Our motivation is two fold first, 3D environments are complex, the use of heterogeneous multi robot systems intuitively can facilitate sensor scanning by fully taking advantage of sensors with different capabilities. Second, in uncertain environments (e.g. rescue), time is of great significance. Since the learning process normally takes time to train and adapt to a new environment, we need to find an effective way to explore and adapt quickly. To this end, in this paper, we present a meta learning approach to improve the exploration and adaptation capabilities. The experimental results demonstrate our method can outperform other methods by approximately 15 27 on success rate and 70 75 on adaptation speed.


PIMIP An Open Source Platform for Pathology Information Management and Integration. Digital pathology plays a crucial role in the development of artificial intelligence in the medical field. The digital pathology platform can make the pathological resources digital and networked, and realize the permanent storage of visual data and the synchronous browsing processing without the limitation of time and space. It has been widely used in various fields of pathology. However, there is still a lack of an open and universal digital pathology platform to assist doctors in the management and analysis of digital pathological sections, as well as the management and structured description of relevant patient information. Most platforms cannot integrate image viewing, annotation and analysis, and text information management. To solve the above problems, we propose a comprehensive and extensible platform PIMIP. Our PIMIP has developed the image annotation functions based on the visualization of digital pathological sections. Our annotation functions support multi user collaborative annotation and multi device annotation, and realize the automation of some annotation tasks. In the annotation task, we invited a professional pathologist for guidance. We introduce a machine learning module for image analysis. The data we collected included public data from local hospitals and clinical examples. Our platform is more clinical and suitable for clinical use. In addition to image data, we also structured the management and display of text information. So our platform is comprehensive. The platform framework is built in a modular way to support users to add machine learning modules independently, which makes our platform extensible.


PESTO Switching Point based Dynamic and Relative Positional Encoding for Code Mixed Languages. NLP applications for code mixed (CM) or mix lingual text have gained a significant momentum recently, the main reason being the prevalence of language mixing in social media communications in multi lingual societies like India, Mexico, Europe, parts of USA etc. Word embeddings are basic build ing blocks of any NLP system today, yet, word embedding for CM languages is an unexplored territory. The major bottleneck for CM word embeddings is switching points, where the language switches. These locations lack in contextually and statistical systems fail to model this phenomena due to high variance in the seen examples. In this paper we present our initial observations on applying switching point based positional encoding techniques for CM language, specifically Hinglish (Hindi English). Results are only marginally better than SOTA, but it is evident that positional encoding could bean effective way to train position sensitive language models for CM text.


Digital Voodoo Dolls. An institution, be it a body of government, commercial enterprise, or a service, cannot interact directly with a person. Instead, a model is created to represent us. We argue the existence of a new high fidelity type of person model which we call a digital voodoo doll. We conceptualize it and compare its features with existing models of persons. Digital voodoo dolls are distinguished by existing completely beyond the influence and control of the person they represent. We discuss the ethical issues that such a lack of accountability creates and argue how these concerns can be mitigated.


Making Access Control Easy in IoT. Secure installation of Internet of Things (IoT) devices requires configuring access control correctly for each device. In order to enable correct configuration the Manufacturer Usage Description (MUD) has been developed by Internet Engineering Task Force (IETF) to automate the protection of IoT devices by micro segmentation using dynamic access control lists. The protocol defines a conceptually straightforward method to implement access control upon installation by providing a list of every authorized access for each device. This access control list may contain a few rules or hundreds of rules for each device. As a result, validating these rules is a challenge. In order to make the MUD standard more usable for developers, system integrators, and network operators, we report on an interactive system called MUD Visualizer that visualizes the files containing these access control rules. We show that, unlike manual analysis, the level of the knowledge and experience does not affect the accuracy of the analysis when MUD Visualizer is used, indicating that the tool is effective for all participants in our study across knowledge and experience levels.


Strong coupling between scales in a multi scalar model of urban dynamics. Urban evolution processes occur at different scales, with intricate interactions between levels and relatively distinct type of processes. To what extent actual urban dynamics include an actual strong coupling between scales, in the sense of both top down and bottom up feedbacks, remains an open issue with important practical implications for the sustainable management of territories. We introduce in this paper a multi scalar simulation model of urban growth, coupling a system of cities interaction model at the macroscopic scale with morphogenesis models for the evolution of urban form at the scale of metropolitan areas. Strong coupling between scales is achieved through an update of model parameters at each scale depending on trajectories at the other scale. The model is applied and explored on synthetic systems of cities. Simulation results show a non trivial effect of the strong coupling. As a consequence, an optimal action on policy parameters such as containing urban sprawl is shifted. We also run a multi objective optimization algorithm on the model, showing showing that compromise between scales are captured. Our approach opens new research directions towards more operational urban dynamics models including a strong feedback between scales.


Sustainability Forecasting for Apache Incubator Projects. Although OSS development is very popular, ultimately more than 80 percent of OSS projects fail. Identifying the factors associated with OSS success can help in devising interventions when a project takes a downturn. OSS success has been studied from a variety of angles, more recently in empirical studies of large numbers of diverse projects, using proxies for sustainability, e.g., internal metrics related to productivity and external ones, related to community popularity. The internal socio technical structure of projects has also been shown important, especially their dynamics. This points to another angle on evaluating software success, from the perspective of self sustaining and self governing communities. To uncover the dynamics of how a project at a nascent development stage gradually evolves into a sustainable one, here we apply a socio technical network modeling perspective to a dataset of Apache Software Foundation Incubator (ASFI), sustainability labeled projects. To identify and validate the determinants of sustainability, we undertake a mix of quantitative and qualitative studies of ASFI projects' socio technical network trajectories. We develop interpretable models which can forecast a project becoming sustainable with more than 93 percent accuracy, within 8 months of incubation start. Based on the interpretable models we describe a strategy for real time monitoring and suggesting actions, which can be used by projects to correct their sustainability trajectories.


The equivariant Hilbert series of the canonical ring of Fermat curves. We consider a Fermat curve F n x n y n z n 1 over an algebraically closed field k of characteristic p geq0 and study the action of the automorphism group G left( mathbb Z n mathbb Z times mathbb Z n mathbb Z right) rtimes S 3 on the canonical ring R bigoplus H 0(F n, Omega F n otimes m ) when p 3 , p nmid n and n 1 is not a power of p . In particular, we explicitly determine the classes H 0(F n, Omega F n otimes m ) in the Grothendieck group K 0(G,k) of finitely generated k G modules, describe the respective equivariant Hilbert series H R,G (t) as a rational function, and use our results to write a program in Sage that computes H R,G (t) for an arbitrary Fermat curve.


The Logic of Collective Action Revisited. Mancur Olson's "Logic of Collective Action" predicts that voluntary action for the common good will only happen in small groups. His theory of the structure and behaviour of organisations fails to account for the UK Labour Party's promotion of, rejection and ultimate compliance with its Political Parties Act (PPERA). I propose a revised computational theory to explain this behaviour. It negates key tenets of Olson's work that consumption of a common good by one member inevitably reduces the quantity available to another and that negotiation between members does not in general affect a decision to work for the common good. The approach has application in private and public sector service design.


Towards Unsupervised Sketch based Image Retrieval. Current supervised sketch based image retrieval (SBIR) methods achieve excellent performance. However, the cost of data collection and labeling imposes an intractable barrier to practical deployment of real applications. In this paper, we present the first attempt at unsupervised SBIR to remove the labeling cost (category annotations and sketch photo pairings) that is conventionally needed for training. Existing single domain unsupervised representation learning methods perform poorly in this application, due to the unique cross domain (sketch and photo) nature of the problem. We therefore introduce a novel framework that simultaneously performs unsupervised representation learning and sketch photo domain alignment. Technically this is underpinned by exploiting joint distribution optimal transport (JDOT) to align data from different domains during representation learning, which we extend with trainable cluster prototypes and feature memory banks to further improve scalability and efficacy. Extensive experiments show that our framework achieves excellent performance in the new unsupervised setting, and performs comparably or better than state of the art in the zero shot setting.


On the Properties of Kullback Leibler Divergence Between Gaussians. Kullback Leibler (KL) divergence is one of the most important divergence measures between probability distributions. In this paper, we investigate the properties of KL divergence between Gaussians. Firstly, for any two n dimensional Gaussians mathcal N 1 and mathcal N 2 , we find the supremum of KL( mathcal N 1 mathcal N 2) when KL( mathcal N 2 mathcal N 1) leq epsilon for epsilon 0 . This reveals the approximate symmetry of small KL divergence between Gaussians. We also find the infimum of KL( mathcal N 1 mathcal N 2) when KL( mathcal N 2 mathcal N 1) geq M for M 0 . Secondly, for any three n dimensional Gaussians mathcal N 1, mathcal N 2 and mathcal N 3 , we find a bound of KL( mathcal N 1 mathcal N 3) if KL( mathcal N 1 mathcal N 2) and KL( mathcal N 2 mathcal N 3) are bounded. This reveals that the KL divergence between Gaussians follows a relaxed triangle inequality. Importantly, all the bounds in the theorems presented in this paper are independent of the dimension n .


Mechanistic Models of COVID 19 Insights into Disease Progression, Vaccines, and Therapeutics. The COVID 19 pandemic has severely impacted health systems and economies worldwide. Significant global efforts are therefore ongoing to improve vaccine efficacies, optimize vaccine deployment, and develop new antiviral therapies to combat the pandemic. Mechanistic viral dynamics and quantitative systems pharmacology models of SARS CoV 2 infection, vaccines, immunomodulatory agents, and antiviral therapeutics have played a key role in advancing our understanding of SARS CoV 2 pathogenesis and transmission, the interplay between innate and adaptive immunity to influence the outcomes of infection, effectiveness of treatments, mechanisms and performance of COVID 19 vaccines, and the impact of emerging SARS CoV 2 variants. Here, we review some of the critical insights provided by these models and discuss the challenges ahead.


Towards AI Logic for Social Reasoning. Artificial Intelligence (AI) logic formalizes the reasoning of intelligent agents. In this paper, we discuss how an argumentation based AI logic could be used also to formalize important aspects of social reasoning. Besides reasoning about the knowledge and actions of individual agents, social AI logic can reason also about social dependencies among agents using the rights, obligations and permissions of the agents. We discuss four aspects of social AI logic. First, we discuss how rights represent relations between the obligations and permissions of intelligent agents. Second, we discuss how to argue about the right to know, a central issue in the recent discussion of privacy and ethics. Third, we discuss how a wide variety of conflicts among intelligent agents can be identified and (sometimes) resolved by comparing formal arguments. Importantly, to cover a wide range of arguments occurring in daily life, also fallacious arguments can be represented and reasoned about. Fourth, we discuss how to argue about the freedom to act for intelligent agents. Examples from social, legal and ethical reasoning highlight the challenges in developing social AI logic. The discussion of the four challenges leads to a research program for argumentation based social AI logic, contributing towards the future development of AI logic.


An Iterative Contextualization Algorithm with Second Order Attention. Combining the representations of the words that make up a sentence into a cohesive whole is difficult, since it needs to account for the order of words, and to establish how the words present relate to each other. The solution we propose consists in iteratively adjusting the context. Our algorithm starts with a presumably erroneous value of the context, and adjusts this value with respect to the tokens at hand. In order to achieve this, representations of words are built combining their symbolic embedding with a positional encoding into single vectors. The algorithm then iteratively weighs and aggregates these vectors using our novel second order attention mechanism. Our models report strong results in several well known text classification tasks.


A higher order moment preserving reduction scheme for the Stochastic Weighted Particle Method. The Stochastic Weighted Particle Method (SWPM) is a Monte Carlo technique developed by Rjasanow and Wagner that generalizes Bird's Direct Simulation Monte Carlo (DSMC) method for solving the Boltzmann equation. To reduce computational cost due to the gradual increase in the number of stochastic particles in the SWPM, Rjasanow and Wagner proposed several particle reduction schemes designed to preserve specified moments of the velocity distribution. Here, we introduce an improved particle reduction scheme that preserves all moments of the velocity distribution up to the second order, as well as the raw and central heat flux both within each group of particles to be reduced and for the entire system. Furthermore, we demonstrate that with the new reduction scheme the scalar fourth order moment can be computed more accurately at a reduced computational cost.


Exceeding the Limits of Visual Linguistic Multi Task Learning. By leveraging large amounts of product data collected across hundreds of live e commerce websites, we construct 1000 unique classification tasks that share similarly structured input data, comprised of both text and images. These classification tasks focus on learning the product hierarchy of different e commerce websites, causing many of them to be correlated. Adopting a multi modal transformer model, we solve these tasks in unison using multi task learning (MTL). Extensive experiments are presented over an initial 100 task dataset to reveal best practices for "large scale MTL" (i.e., MTL with more than 100 tasks). From these experiments, a final, unified methodology is derived, which is composed of both best practices and new proposals such as DyPa, a simple heuristic for automatically allocating task specific parameters to tasks that could benefit from extra capacity. Using our large scale MTL methodology, we successfully train a single model across all 1000 tasks in our dataset while using minimal task specific parameters, thereby showing that it is possible to extend several orders of magnitude beyond current efforts in MTL.


Context aware Attentional Pooling (CAP) for Fine grained Visual Classification. Deep convolutional neural networks (CNNs) have shown a strong ability in mining discriminative object pose and parts information for image recognition. For fine grained recognition, context aware rich feature representation of object scene plays a key role since it exhibits a significant variance in the same subcategory and subtle variance among different subcategories. Finding the subtle variance that fully characterizes the object scene is not straightforward. To address this, we propose a novel context aware attentional pooling (CAP) that effectively captures subtle changes via sub pixel gradients, and learns to attend informative integral regions and their importance in discriminating different subcategories without requiring the bounding box and or distinguishable part annotations. We also introduce a novel feature encoding by considering the intrinsic consistency between the informativeness of the integral regions and their spatial structures to capture the semantic correlation among them. Our approach is simple yet extremely effective and can be easily applied on top of a standard classification backbone network. We evaluate our approach using six state of the art (SotA) backbone networks and eight benchmark datasets. Our method significantly outperforms the SotA approaches on six datasets and is very competitive with the remaining two.


Enhancing hierarchical surrogate assisted evolutionary algorithm for high dimensional expensive optimization via random projection. By remarkably reducing real fitness evaluations, surrogate assisted evolutionary algorithms (SAEAs), especially hierarchical SAEAs, have been shown to be effective in solving computationally expensive optimization problems. The success of hierarchical SAEAs mainly profits from the potential benefit of their global surrogate models known as "blessing of uncertainty" and the high accuracy of local models. However, their performance leaves room for improvement on highdimensional problems since now it is still challenging to build accurate enough local models due to the huge solution space. Directing against this issue, this study proposes a new hierarchical SAEA by training local surrogate models with the help of the random projection technique. Instead of executing training in the original high dimensional solution space, the new algorithm first randomly projects training samples onto a set of low dimensional subspaces, then trains a surrogate model in each subspace, and finally achieves evaluations of candidate solutions by averaging the resulting models. Experimental results on six benchmark functions of 100 and 200 dimensions demonstrate that random projection can significantly improve the accuracy of local surrogate models and the new proposed hierarchical SAEA possesses an obvious edge over state of the art SAEAs


SPNet Multi Shell Kernel Convolution for Point Cloud Semantic Segmentation. Feature encoding is essential for point cloud analysis. In this paper, we propose a novel point convolution operator named Shell Point Convolution (SPConv) for shape encoding and local context learning. Specifically, SPConv splits 3D neighborhood space into shells, aggregates local features on manually designed kernel points, and performs convolution on the shells. Moreover, SPConv incorporates a simple yet effective attention module that enhances local feature aggregation. Based upon SPConv, a deep neural network named SPNet is constructed to process large scale point clouds. Poisson disk sampling and feature propagation are incorporated in SPNet for better efficiency and accuracy. We provided details of the shell design and conducted extensive experiments on challenging large scale point cloud datasets. Experimental results show that SPConv is effective in local shape encoding, and our SPNet is able to achieve top ranking performances in semantic segmentation tasks.


Cartesian Frames. We introduce a novel framework, the theory of Cartesian frames (CF), that gives powerful tools for manipulating sets of acts. The CF framework takes as its most fundamental building block that an agent can freely choose from a set of available actions. The framework uses the mathematics of Chu spaces to develop a calculus of those sets of actions, how those actions change at various levels of description, and how different agents' actions can combine when agents work in concert. We discuss how this framework might provide an illuminating perspective on issues in decision theory and formal epistemology.


Characterization of atmospheric coherent structures and their impact on a utility scale wind turbine. Atmospheric turbulent velocity fluctuations are known to increase wind turbine structural loading and accelerate wake recovery, but the impact of vortical coherent structures in the atmosphere on wind turbines has not yet been evaluated. The current study uses flow imaging with natural snowfall with a field of view spanning the inflow and near wake. Vortical coherent structures with diameters on the order of 1 m are identified and characterized in the flow approaching a 2.5 MW wind turbine in the region spanning the bottom blade tip elevation to hub height. Their impact on turbine structural loading, power generation, and wake behaviour are evaluated. Long coherent structure packets (larger than 200 m) are shown to increase fluctuating stresses on the turbine support tower. Large inflow vortices interact with the turbine blades, leading to deviations from the expected power generation. The sign of these deviations is related to the rotation direction of the vortices, with rotation in the same direction as the circulation on the blades leading to periods of power surplus, and opposite rotation causing power deficit. Periods of power deficit coincide with wake contraction events. These findings highlight the importance of considering coherent structure properties when making turbine design and siting decisions.


Large Scale News Classification using BERT Language Model Spark NLP Approach. The rise of big data analytics on top of NLP increases the computational burden for text processing at scale. The problems faced in NLP are very high dimensional text, so it takes a high computation resource. The MapReduce allows parallelization of large computations and can improve the efficiency of text processing. This research aims to study the effect of big data processing on NLP tasks based on a deep learning approach. We classify a big text of news topics with fine tuning BERT used pre trained models. Five pre trained models with a different number of parameters were used in this study. To measure the efficiency of this method, we compared the performance of the BERT with the pipelines from Spark NLP. The result shows that BERT without Spark NLP gives higher accuracy compared to BERT with Spark NLP. The accuracy average and training time of all models using BERT is 0.9187 and 35 minutes while using BERT with Spark NLP pipeline is 0.8444 and 9 minutes. The bigger model will take more computation resources and need a longer time to complete the tasks. However, the accuracy of BERT with Spark NLP only decreased by an average of 5.7 , while the training time was reduced significantly by 62.9 compared to BERT without Spark NLP.


Smoothed Analysis of Population Protocols. In this work, we initiate the study of emph smoothed analysis of population protocols. We consider a population protocol model where an adaptive adversary dictates the interactions between agents, but with probability p every such interaction may change into an interaction between two agents chosen uniformly at random. That is, p fraction of the interactions are random, while (1 p) fraction are adversarial. The aim of our model is to bridge the gap between a uniformly random scheduler (which is too idealistic) and an adversarial scheduler (which is too strict). We focus on the fundamental problem of leader election in population protocols. We show that, for a population of size n , the leader election problem can be solved in O(p 2 n log 3 n) steps with high probability, using O(( log 2 n) cdot ( log (n p))) states per agent, for emph all values of p leq 1 . Although our result does not match the best known running time of O(n log n) for the uniformly random scheduler ( p 1 ), we are able to present a emph smooth transition between a running time of O(n cdot mathrm polylog n) for p 1 and an infinite running time for the adversarial scheduler ( p 0 ), where the problem cannot be solved. The key technical contribution of our work is a novel emph phase clock algorithm for our model. This is a key primitive for much studied fundamental population protocol algorithms (leader election, majority), and we believe it is of independent interest.


Modeling of unsaturated flow through porous media using meshless methods. In this study, we focus on the modelling of infiltration process in porous media. We use the meshless techniques for efficiently solving the Richards equation which describes unsaturated water flow through soils. The design of approximate numerical methods for the Richards equation remains computationally challenging and requires the development of efficient numerical techniques. This difficulty is mainly due to the nonlinearity of the unsaturated hydraulic conductivity and the capillary pressure function. In this study, we develop a new method based on the localized radial basis function (RBF) and the Kirchhoff transformation technique in order to solve Richards equation in one and two dimensional homogeneous medium. Our approach using the multiquadric radial basis function allows us to reduce the computational time and provide accurate numerical solutions. The proposed method does not require mesh generation. Picard's iterations are used to linearize the resulting nonlinear problem obtained using the Kirchhoff transformation technique. The numerical simulations show the capability of the proposed numerical techniques in predicting the dynamics of water through unsaturated soils.


Lp estimates for the Caffarelli Silvestre extension operators. We study elliptic and parabolic problems governed by the singular elliptic operators Delta x c yD y b y 2 on the half space R N 1 .


Deciding twin width at most 4 is NP complete. We show that determining if an n vertex graph has twin width at most 4 is NP complete, and requires time 2 Omega(n log n) unless the Exponential Time Hypothesis fails. Along the way, we give an elementary proof that n vertex graphs subdivided at least 2 log n times have twin width at most 4. We also show how to encode trigraphs H (2 edge colored graphs involved in the definition of twin width) into graphs G , in the sense that every d sequence (sequence of vertex contractions witnessing that the twin width is at most d ) of G inevitably creates H as an induced subtrigraph, whereas there exists a partial d sequence that actually goes from G to H . We believe that these facts and their proofs can be of independent interest.


Robust Online Selection with Uncertain Offer Acceptance. Online advertising has motivated interest in online selection problems. Displaying ads to the right users benefits both the platform (e.g., via pay per click) and the advertisers (by increasing their reach). In practice, not all users click on displayed ads, while the platform's algorithm may miss the users most disposed to do so. This mismatch decreases the platform's revenue and the advertiser's chances to reach the right customers. With this motivation, we propose a secretary problem where a candidate may or may not accept an offer according to a known probability p . Because we do not know the top candidate willing to accept an offer, the goal is to maximize a robust objective defined as the minimum over integers k of the probability of choosing one of the top k candidates, given that one of these candidates will accept an offer. Using Markov decision process theory, we derive a linear program for this max min objective whose solution encodes an optimal policy. The derivation may be of independent interest, as it is generalizable and can be used to obtain linear programs for many online selection models. We further relax this linear program into an infinite counterpart, which we use to provide bounds for the objective and closed form policies. For p geq p approx 0.6 , an optimal policy is a simple threshold rule that observes the first p 1 (1 p) fraction of candidates and subsequently makes offers to the best candidate observed so far.


Bilinear Strichartz's type estimates in Besov spaces with application to inhomogeneous nonlinear biharmonic Schr "odinger equation. In this paper, we consider the well posedness of the inhomogeneous nonlinear biharmonic Schr "odinger equation with spatial inhomogeneity coefficient K(x) behaves like left x right b for 0 b min left frac N 2 ,4 right . We show the local well posedness in the whole H s subcritical case, with 0 s le2 . The difficulties of this problem come from the singularity of K(x) and the lack of differentiability of the nonlinear term. To resolve this, we derive the bilinear Strichartz's type estimates for the nonlinear biharmonic Schr "odinger equations in Besov spaces.


Understanding TEE Containers, Easy to Use? Hard to Trust. As an emerging technique for confidential computing, trusted execution environment (TEE) receives a lot of attention. To better develop, deploy, and run secure applications on a TEE platform such as Intel's SGX, both academic and industrial teams have devoted much effort to developing reliable and convenient TEE containers. In this paper, we studied the isolation strategies of 15 existing TEE containers to protect secure applications from potentially malicious operating systems (OS) or untrusted applications, using a semi automatic approach combining a feedback guided analyzer with manual code review. Our analysis reveals the isolation protection each of these TEE containers enforces, and their security weaknesses. We observe that none of the existing TEE containers can fulfill the goal they set, due to various pitfalls in their design and implementation. We report the lessons learnt from our study for guiding the development of more secure containers, and further discuss the trend of TEE container designs. We also release our analyzer that helps evaluate the container middleware both from the enclave and from the kernel.


A divergence free finite element method for the Stokes problem with boundary correction. This paper constructs and analyzes a boundary correction finite element method for the Stokes problem based on the Scott Vogelius pair on Clough Tocher splits. The velocity space consists of continuous piecewise quadratic polynomials, and the pressure space consists of piecewise linear polynomials without continuity constraints. A Lagrange multiplier space that consists of continuous piecewise quadratic polynomials with respect to boundary partition is introduced to enforce boundary conditions as well as to mitigate the lack of pressure robustness. We prove several inf sup conditions, leading to the well posedness of the method. In addition, we show that the method converges with optimal order and the velocity approximation is divergence free.


HP GNN Generating High Throughput GNN Training Implementation on CPU FPGA Heterogeneous Platform. Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU FPGA heterogeneous platforms have been used to accelerate many applications by exploiting customizable data path and abundant user controllable on chip memory resources of FPGAs. Yet, accelerating and deploying GNN training on such platforms requires not only expertise in hardware design but also substantial development efforts. We propose HP GNN, a novel framework that generates high throughput GNN training implementations on a given CPU FPGA platform that can benefit both application developers and machine learning researchers. HP GNN takes GNN training algorithms, GNN models as the inputs, and automatically performs hardware mapping onto the target CPU FPGA platform. HP GNN consists of (1) data layout and internal representation that reduce the memory traffic and random memory accesses (2) optimized hardware templates that support various GNN models (3) a design space exploration engine for automatic hardware mapping (4) high level application programming interfaces (APIs) that allows users to specify GNN training with only a handful of lines of code. To evaluate HP GNN, we experiment with two well known sampling based GNN training algorithms and two GNN models. For each training algorithm and model, HP GNN generates implementation on a state of the art CPU FPGA platform. Compared with CPU only and CPU GPU platforms, experimental results show that the generated implementations achieve 55.67 times and 2.17 times speedup on the average, respectively. Compared with the state of the art GNN training implementations, HP GNN achieves up to 4.45 times speedup.


Meshfree Approximation for Stochastic Optimal Control Problems. In this work, we study the gradient projection method for solving a class of stochastic control problems by using a mesh free approximation approach to implement spatial dimension approximation. Our main contribution is to extend the existing gradient projection method to moderate high dimensional space. The moving least square method and the general radial basis function interpolation method are introduced as showcase methods to demonstrate our computational framework, and rigorous numerical analysis is provided to prove the convergence of our meshfree approximation approach. We also present several numerical experiments to validate the theoretical results of our approach and demonstrate the performance meshfree approximation in solving stochastic optimal control problems.


Random multifunctions as the set minimizers of infinitely many differentiable random functions. Under mild assumptions, we prove that any random multifunction can be represented as the set of minimizers of an infinitely many differentiable normal integrand, which preserves the convexity of the random multifunction. We provide several applications of this result to the approximation of random multifunctions and integrands. The paper ends with a characterization of the set of integrable selections of a measurable multifunction as the set of minimizers of an infinitely many differentiable integral function.


From Schouten to Mackenzie notes on brackets. In this paper, dedicated to the memory of Kirill Mackenzie, I relate the origins and early development of the theory of graded Lie brackets, first in the publications on differential geometry of Schouten, Nijenhuis, and Fr "olicher Nijenhuis, then in the work of Gerstenhaber and Nijenhuis Richardson in cohomology theory.


Mortar coupling of hp discontinuous Galerkin and boundary element methods for the Helmholtz equation. We design and analyze a coupling of a discontinuous Galerkin finite element method with a boundary element method to solve the Helmholtz equation with variable coefficients in three dimensions. The coupling is realized with a mortar variable that is related to an impedance trace on a smooth interface. The method obtained has a block structure with nonsingular subblocks. We prove quasi optimality of the h and p versions of the scheme, under a threshold condition on the approximability properties of the discrete spaces. Amongst others, an essential tool in the analysis is a novel discontinuous to continuous reconstruction operator on tetrahedral meshes with curved faces.


Performance Evaluation of Adversarial Attacks Discrepancies and Solutions. Recently, adversarial attack methods have been developed to challenge the robustness of machine learning models. However, mainstream evaluation criteria experience limitations, even yielding discrepancies among results under different settings. By examining various attack algorithms, including gradient based and query based attacks, we notice the lack of a consensus on a uniform standard for unbiased performance evaluation. Accordingly, we propose a Piece wise Sampling Curving (PSC) toolkit to effectively address the aforementioned discrepancy, by generating a comprehensive comparison among adversaries in a given range. In addition, the PSC toolkit offers options for balancing the computational cost and evaluation effectiveness. Experimental results demonstrate our PSC toolkit presents comprehensive comparisons of attack algorithms, significantly reducing discrepancies in practice.


Controllable Open ended Question Generation with A New Question Type Ontology. We investigate the less explored task of generating open ended questions that are typically answered by multiple sentences. We first define a new question type ontology which differentiates the nuanced nature of questions better than widely used question words. A new dataset with 4,959 questions is labeled based on the new ontology. We then propose a novel question type aware question generation framework, augmented by a semantic graph representation, to jointly predict question focuses and produce the question. Based on this framework, we further use both exemplars and automatically generated templates to improve controllability and diversity. Experiments on two newly collected large scale datasets show that our model improves question quality over competitive comparisons based on automatic metrics. Human judges also rate our model outputs highly in answerability, coverage of scope, and overall quality. Finally, our model variants with templates can produce questions with enhanced controllability and diversity.


Attention meets Geometry Geometry Guided Spatial Temporal Attention for Consistent Self Supervised Monocular Depth Estimation. Inferring geometrically consistent dense 3D scenes across a tuple of temporally consecutive images remains challenging for self supervised monocular depth prediction pipelines. This paper explores how the increasingly popular transformer architecture, together with novel regularized loss formulations, can improve depth consistency while preserving accuracy. We propose a spatial attention module that correlates coarse depth predictions to aggregate local geometric information. A novel temporal attention mechanism further processes the local geometric information in a global context across consecutive images. Additionally, we introduce geometric constraints between frames regularized by photometric cycle consistency. By combining our proposed regularization and the novel spatial temporal attention module we fully leverage both the geometric and appearance based consistency across monocular frames. This yields geometrically meaningful attention and improves temporal depth stability and accuracy compared to previous methods.


X ray Ptychography with a Laboratory Source. X ray ptychography has revolutionised nanoscale phase contrast imaging at large scale synchrotron sources in recent years. We present here the first successful demonstration of the technique in a small scale laboratory setting. We conducted an experiment with a liquid metal jet X ray source and a single photon counting detector with a high spectral resolution. The experiment used a spot size of 5 microns to produce a ptychographic phase image of a Siemens star test pattern with a sub micron spatial resolution. The result and methodology presented show how high resolution phase contrast imaging can now be performed at small scale laboratory sources worldwide.


Automatic Y axis Rescaling in Dynamic Visualizations. Animated and interactive data visualizations dynamically change the data rendered in a visualization (e.g., bar chart). As the data changes, the y axis may need to be rescaled as the domain of the data changes. Each axis rescaling potentially improves the readability of the current chart, but may also disorient the user. In contrast to static visualizations, where there is considerable literature to help choose the appropriate y axis scale, there is a lack of guidance about how and when rescaling should be used in dynamic visualizations. Existing visualization systems and libraries adapt a fixed global y axis, or rescale every time the data changes. Yet, professional visualizations, such as in data journalism, do not adopt either strategy. They instead carefully and manually choose when to rescale based on the analysis task and data. To this end, we conduct a series of Mechanical Turk experiments to study the potential of dynamic axis rescaling and the factors that affect its effectiveness. We find that the appropriate rescaling policy is both task and data dependent, and we do not find one clear policy choice for all situations.


Simple Trust Metric in a Low Power Sensor Network. Distributed systems become more and more important to our life. Especially in areas like Smart Home and the Internet of Things (IoT) reliable low power sensor networks become increasingly important. For ensuring this there are a lot of trust metrics. In this paper we compare a model of a distributed low power sensor network including one root node and the corresponding Simple Trust Metric to the requirements from "Representation of Trust and Reputation in Self Managed Computing Systems" 1 , the Weighted Trust Metric and the Weighted Simple Exponential Smoothing


DIMY Enabling Privacy preserving Contact Tracing. The infection rate of COVID 19 and lack of an approved vaccine has forced governments and health authorities to adopt lockdowns, increased testing, and contact tracing to reduce the spread of the virus. Digital contact tracing has become a supplement to the traditional manual contact tracing process. However, although there have been a number of digital contact tracing apps proposed and deployed, these have not been widely adopted owing to apprehensions surrounding privacy and security. In this paper, we propose a blockchain based privacy preserving contact tracing protocol, "Did I Meet You" (DIMY), that provides full lifecycle data privacy protection on the devices themselves as well as on the back end servers, to address most of the privacy concerns associated with existing protocols. We have employed Bloom filters to provide efficient privacy preserving storage, and have used the Diffie Hellman key exchange for secret sharing among the participants. We show that DIMY provides resilience against many well known attacks while introducing negligible overheads. DIMY's footprint on the storage space of clients' devices and back end servers is also significantly lower than other similar state of the art apps.


Voxel selection framework based on meta heuristic search and mutual information for brain decoding. Visual stimulus decoding is an increasingly important challenge in neuroscience. The goal is to classify the activity patterns from the human brain during the sighting of visual objects. One of the crucial problems in the brain decoder is the selecting informative voxels. We propose a meta heuristic voxel selection framework for brain decoding. It is composed of four phases preprocessing of fMRI data filtering insignificant voxels postprocessing and meta heuristics selection. The main contribution is benefiting a meta heuristics search algorithm to guide a wrapper voxel selection. The main criterion to nominate a voxel is based on its mutual information with the provided stimulus label. The results show impressive accuracy rates which are 90.66 3.66 and 91.61 8.24 for DS105 and DS107, respectively. This outperforms the most of existing brain decoders in similar validation conditions. The experimental results are very encouraging which can be successfully useId in the brain computer interface.


Self Diagnosis through AI enabled Chatbot based Symptom Checkers User Experiences and Design Considerations. Recently, there has been a growing interest in developing AI enabled chatbot based symptom checker (CSC) apps in the healthcare market. CSC apps provide potential diagnoses for users and assist them with self triaging based on Artificial Intelligence (AI) techniques using human like conversations. Despite the popularity of such CSC apps, little research has been done to investigate their functionalities and user experiences. To do so, we conducted a feature review, a user review analysis, and an interview study. We found that the existing CSC apps lack the functions to support the whole diagnostic process of an offline medical visit. We also found that users perceive the current CSC apps to lack support for a comprehensive medical history, flexible symptom input, comprehensible questions, and diverse diseases and user groups. Based on these results, we derived implications for the future features and conversational design of CSC apps.


Robust 2D 3D Vehicle Parsing in CVIS. We present a novel approach to robustly detect and perceive vehicles in different camera views as part of a cooperative vehicle infrastructure system (CVIS). Our formulation is designed for arbitrary camera views and makes no assumptions about intrinsic or extrinsic parameters. First, to deal with multi view data scarcity, we propose a part assisted novel view synthesis algorithm for data augmentation. We train a part based texture inpainting network in a self supervised manner. Then we render the textured model into the background image with the target 6 DoF pose. Second, to handle various camera parameters, we present a new method that produces dense mappings between image pixels and 3D points to perform robust 2D 3D vehicle parsing. Third, we build the first CVIS dataset for benchmarking, which annotates more than 1540 images (14017 instances) from real world traffic scenarios. We combine these novel algorithms and datasets to develop a robust approach for 2D 3D vehicle parsing for CVIS. In practice, our approach outperforms SOTA methods on 2D detection, instance segmentation, and 6 DoF pose estimation, by 4.5 , 4.3 , and 2.9 , respectively. More details and results are included in the supplement. To facilitate future research, we will release the source code and the dataset on GitHub.


Broadband optical power limiter metalens. In recent years, the need for high power laser is of great interest for different applications ranging from direct laser processing, light detection, medicine, and lighting. However, high power lasers with high intensities give rise to fundamental problems for optical detectors and imaging systems with low threshold damage, which still need reliable solutions. Here, we report and numerically demonstrate a hybrid system that synergically combines a broadband optical power limiter with a transmittance difference between on state (70 o C) and off state (25 o C) about 62.5 , and a diffraction limited broadband metalens from 1534 nm to 1664 nm. Such a metalens power limiter could be used in any system requiring an intermediate focal plane in the optical path to the detector from damage by exposure to high intensity lasers.


DJXPerf Identifying Memory Inefficiencies via Object centric Profiling for Java. Java is the "go to" programming language choice for developing scalable enterprise cloud applications. In such systems, even a few percent CPU time savings can offer a significant competitive advantage and cost saving. Although performance tools abound in Java, those that focus on the data locality in the memory hierarchy are rare. In this paper, we present DJXPerf, a lightweight, object centric memory profiler for Java, which associates memory hierarchy performance metrics (e.g., cache TLB misses) with Java objects. DJXPerf uses statistical sampling of hardware performance monitoring counters to attribute metrics to not only source code locations but also Java objects. DJXPerf presents Java object allocation contexts combined with their usage contexts and presents them ordered by the poor locality behaviors. DJXPerf's performance measurement, object attribution, and presentation techniques guide optimizing object allocation, layout, and access patterns. DJXPerf incurs only 8 runtime overhead and 5 memory overhead on average, requiring no modifications to hardware, OS, Java virtual machine, or application source code, which makes it attractive to use in production. Guided by DJXPerf, we study and optimize a number of Java and Scala programs, including well known benchmarks and real world applications, and demonstrate significant speedups.


Simple Entity Centric Questions Challenge Dense Retrievers. Open domain question answering has exploded in popularity recently due to the success of dense retrieval models, which have surpassed sparse models using only a few supervised training examples. However, in this paper, we demonstrate current dense models are not yet the holy grail of retrieval. We first construct EntityQuestions, a set of simple, entity rich questions based on facts from Wikidata (e.g., "Where was Arve Furset born?"), and observe that dense retrievers drastically underperform sparse methods. We investigate this issue and uncover that dense retrievers can only generalize to common entities unless the question pattern is explicitly observed during training. We discuss two simple solutions towards addressing this critical problem. First, we demonstrate that data augmentation is unable to fix the generalization problem. Second, we argue a more robust passage encoder helps facilitate better question adaptation using specialized question encoders. We hope our work can shed light on the challenges in creating a robust, universal dense retriever that works well across different input distributions.


Deconfounded Visual Grounding. We focus on the confounding bias between language and location in the visual grounding pipeline, where we find that the bias is the major visual reasoning bottleneck. For example, the grounding process is usually a trivial language location association without visual reasoning, e.g., grounding any language query containing sheep to the nearly central regions, due to that most queries about sheep have ground truth locations at the image center. First, we frame the visual grounding pipeline into a causal graph, which shows the causalities among image, query, target location and underlying confounder. Through the causal graph, we know how to break the grounding bottleneck deconfounded visual grounding. Second, to tackle the challenge that the confounder is unobserved in general, we propose a confounder agnostic approach called Referring Expression Deconfounder (RED), to remove the confounding bias. Third, we implement RED as a simple language attention, which can be applied in any grounding method. On popular benchmarks, RED improves various state of the art grounding methods by a significant margin. Code will soon be available at https github.com JianqiangH Deconfounded VG.


Model free Reinforcement Learning for Robust Locomotion using Demonstrations from Trajectory Optimization. We present a general, two stage reinforcement learning approach to create robust policies that can be deployed on real robots without any additional training using a single demonstration generated by trajectory optimization. The demonstration is used in the first stage as a starting point to facilitate initial exploration. In the second stage, the relevant task reward is optimized directly and a policy robust to environment uncertainties is computed. We demonstrate and examine in detail the performance and robustness of our approach on highly dynamic hopping and bounding tasks on a quadruped robot.


Some Rigorous Results on the Phase Transition of Finitary Random Interlacement. In this paper, we show several rigorous results on the phase transition of Finitary Random Interlacement (FRI). For the high intensity regime, we show the existence of a critical fiber length, and give the exact asymptotic of it as intensity goes to infinity. At the same time, our result for the low intensity regime proves the global existence of a non trivial phase transition with respect to the system intensity.